PaddlePaddle/PaddleFormers

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Train transformer language models with reinforcement learning.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

PyTorch native post-training library

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.