lucidrains/perceiver-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Code for ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

Helpful tools and examples for working with flex-attention

MambaOut: Do We Really Need Mamba for Vision? (CVPR 2025)

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

ResNeSt: Split-Attention Networks