TinyLLaVA/TinyLLaVA_Factory

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

4M: Massively Multimodal Masked Modeling

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

OpenMMLab Pre-training Toolbox and Benchmark

Code for the Molmo Vision-Language Model

GLM-4.6V/4.5V/4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.