kyegomez/BitNet

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

Accessible large language models via k-bit quantization for PyTorch.

Official inference framework for 1-bit LLMs

LSQ+ or LSQplus

Lightweight toolkit package to train and fine-tune 1.58bit Language models

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Making 1.58-bit models simple to build and broadly accessible through low-cost, high-accuracy post-training ternary quantization.

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"

Official implementation of LittleBit (NeurIPS 2025) and its follow-up LittleBit-2 (ICML 2026)