OpenGVLab/LLaMA-Adapter

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Code and documentation to train Stanford's Alpaca models, and generate the data.

[COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!

PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).