airockchip/rknn-toolkit2

Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

🪙 TT-NN operator library, and TT-Metalium low level kernel programming model.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework