facebookresearch/blt

Code for the paper "Language Models are Unsupervised Multitask Learners"

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

Bringing BERT into modernity via both architecture changes and scaling

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

An autoregressive character-level language model for making more things

official repository of aiXcoder-7B Code Large Language Model

Implementation for MatMul-free LM.

AllenAI's post-training codebase

A library for mechanistic interpretability of GPT-style language models