lucidrains/x-transformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Mamba SSM architecture

🚀 Efficient implementations for emerging model architectures

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.