apple-aiml-research/ml-l3m

A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.

Minimalistic large language model 3D-parallelism training

A Framework of Small-scale Large Multimodal Models

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

4M: Massively Multimodal Masked Modeling

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

OpenMMLab Pre-training Toolbox and Benchmark

ModelScope: bring the notion of Model-as-a-Service to life.