AMD-AGI/Primus

A high-performance acceleration library dedicated to large-scale model training on AMD GPUs

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Making large AI models cheaper, faster and more accessible

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

Agentic RL Training at Scale

GigaTrain: An Efficient and Scalable Training Framework for AI Models

Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.