mcxiaoxiao/annotated-transformer-Chinese

Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.

Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch

This is the official repository for the book Transformers - The Definitive Guide

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Transformer architecture explained step by step - the full architecture, every attention variant, positional embeddings, and every layer inside a Transformer.

This repository contains demos I made with the Transformers library by HuggingFace.

Code for CRATE (Coding RAte reduction TransformEr).

Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)