seal-rg/recurrent-pretraining

LLM training in simple, raw C/CUDA

AllenAI's post-training codebase

Open weights language model from Google DeepMind, based on Griffin.

A repository for research on medium sized language models.

NanoGPT (124M) in 90 seconds

Mamba SSM architecture

Muon is Scalable for LLM Training

Code for the paper "Language Models are Unsupervised Multitask Learners"

The fastest way to build and start training your own LLM. CLI tool that scaffolds production-ready PyTorch training projects in seconds. Like create-next-app but for language models.