EleutherAI/gpt-neox

Ongoing research training transformer models at scale

Making large AI models cheaper, faster and more accessible

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Train transformer language models with reinforcement learning.

Go ahead and axolotl questions

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Accessible large language models via k-bit quantization for PyTorch.

LLM training in simple, raw C/CUDA