microsoft/data-efficacy

DataComp for Language Models

Data and tools for generating and inspecting OLMo pre-training data.

AllenAI's post-training codebase

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

Deliver safe & effective language models

[ICML 2025] Official implementation of paper "Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning"

Sky-T1: Train your own O1 preview model within $450

A project to improve skills of large language models

Code and documentation to train Stanford's Alpaca models, and generate the data.