baidu-baige/LoongForge

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Halo is an open-source framework built by White Circle for training large language and multimodal models

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

[ICLR 2026] Official code for TraceRL: Revolutionizing post-training for Diffusion LLMs, powering the SOTA TraDo series.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

A lightweight, AI-native training framework for large language models. Designed for fast iteration, reproducible experiments, and modular configuration across SFT, RLVR, and evaluation workflows.

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries