HuangOwen/Awesome-LLM-Compression

Awesome-LLM: a curated list of Large Language Model

Large Language Model (LLM) Systems Paper List

A curated list of 120+ LLM libraries category wise.

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

State-of-the-art LLM compression, built for production inference with vLLM

A curated list of Large Language Model (LLM) Interpretability resources.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852