facebookresearch/fairseq2

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

An autoregressive character-level language model for making more things

Mamba SSM architecture

Task-based datasets, preprocessing, and evaluation for sequence models.

Interpretability for sequence generation models 🐛 🔍

Code for the paper "Language Models are Unsupervised Multitask Learners"

Code for BLT research paper

Go ahead and axolotl questions