xiongsiheng/DHSA

Sparse Decoupled Attention for Efficient Long-Context LLM Inference

RIS-Kernel: A Model-Agnostic Architecture for Long-Context LLM Inference via Sparse Attention

[NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning

MoBA: Mixture of Block Attention for Long-Context LLMs

[CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

Trainable fast and memory-efficient sparse attention

A sparse-first inference engine (SparseEngine).

Official code for HiLS-Attention