microsoft/nanovppo

mini project for nanorllm

SkyRL: A Modular Full-stack RL Library for LLMs

Implementing a tiny RL framework from scratch with as little dependencies as possible, can run RL on real LLMS using PC/laptops with limited resources.

Reproducing and studying RL algorithms for LLM agents, including GRPO, GSPO, DAPO, OPD, Search-R1, ReTool, ALFWorld and beyond.

Democratizing Reinforcement Learning for LLMs

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

An Open-source RL System from ByteDance Seed and Tsinghua AIR

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!

RL with Experience Replay