jsbaan/transformer-from-scratch

Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch

哈佛大学 Transformer 经典入门教程 annotated-transformer-Chinese 中文版 Transformer 论文 Attention is All You Need 的 pytorch 中文注释代码实现，翻译自harvardnlp/annotated-transformer

Transformer architecture explained step by step - the full architecture, every attention variant, positional embeddings, and every layer inside a Transformer.

A concise but complete full-attention transformer with a set of promising experimental features from various papers

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Build LLM from scratch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Hackable and optimized Transformers building blocks, supporting a composable construction.

Sutskever 30 implementations inspired by https://papercode.vercel.app/ | For Agents, use https://github.com/pageman/Sutskever-Agent | Polyglot / Multi-Backed version at https://github.com/pageman/sutskever-30-beyond-numpy