huggingface/optimum-graphcore

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficiently on Qualcomm Cloud AIxx (AI100, AI200 and so on) accelerators.

AMD related optimizations for transformer models

Training and inference on AWS Trainium and Inferentia chips.

Utils for Unsloth https://github.com/unslothai/unsloth

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.