eric-mitchell/direct-preference-optimization

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

AllenAI's post-training codebase

Robust recipes to align language models with human and AI preferences

Train transformer language models with reinforcement learning.

Post-training with Tinker

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

Go ahead and axolotl questions

Sky-T1: Train your own O1 preview model within $450

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).