huggingface/optimum-executorch

This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficiently on Qualcomm Cloud AIxx (AI100, AI200 and so on) accelerators.

🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

Support PyTorch model conversion with LiteRT.

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

PyTorch Neural Network eXchange

Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)

AI Edge Quantizer: flexible post training quantization for LiteRT models.