October2001/Awesome-KV-Cache-Compression

[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

Unified KV Cache Compression Methods for Auto-Regressive Models

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

Awesome LLM compression research papers and tools.

LLM KV cache compression made easy

TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer