fastmachinelearning/hls4ml

Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild

Infrastructure to enable deployment of ML models to low-power resource-constrained embedded targets (including microcontrollers and digital signal processors).

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Inference at the speed of light.

High-efficiency floating-point neural network inference operators for mobile, server, and Web

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

Hummingbird compiles trained ML models into tensor computation for faster inference.