flagos-ai/FlagScale

FlagGems is an operator library for large language models implemented in the Triton Language.

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

ModelScope: bring the notion of Model-as-a-Service to life.

Go ahead and axolotl questions

Universal LLM Deployment Engine with ML Compilation

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Utils for Unsloth https://github.com/unslothai/unsloth

Scale LLM Engine public repository

Find the best models and how to run them locally.