inisis/OnnxSlim

ONNX Optimizer

Simplify your onnx model

Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.

Neural Network Compression Framework for enhanced OpenVINO™ inference

Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

ONNX-TensorRT: TensorRT backend for ONNX