microsoft/onnxruntime-inference-examples

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

Fast ML inference & training for ONNX models in Rust

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

High-efficiency floating-point neural network inference operators for mobile, server, and Web

📚 Jupyter notebook tutorials for OpenVINO™

ncnn is a high-performance neural network inference framework optimized for the mobile platform

On-device AI across mobile, embedded and edge for PyTorch

ONNX-TensorRT: TensorRT backend for ONNX