huggingface/accelerate

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

You like pytorch? You like micrograd? You love tinygrad! ❤️

Accessible large language models via k-bit quantization for PyTorch.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Making large AI models cheaper, faster and more accessible

Go ahead and axolotl questions

The fastai deep learning library