woct0rdho/SageAttention

Pre-compiled Python whl for Flash-attention, SageAttention, NATTEN, xFormer etc

Provide with pre-build flash-attention 2 and 3 package wheels on Linux and Windows using GitHub Actions

Cross-platform installer for Triton and SageAttention on ComfyUI. Simplifies GPU-accelerated inference setup for Windows users with automated dependency management and RTX 5090 support.

Fast and memory-efficient exact attention

Fast and memory-efficient exact attention

Helpful tools and examples for working with flex-attention

Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

FlashMLA: Efficient Multi-head Latent Attention Kernels