mlfoundations/dclm

Data and tools for generating and inspecting OLMo pre-training data.

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

Curated list of datasets and tools for post-training.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

Create Custom LLMs

Scalable data pre processing and curation toolkit for LLMs

Code and documentation to train Stanford's Alpaca models, and generate the data.

AllenAI's post-training codebase