Tencent released HiLS-Attention A sparse attention mechanism that learns chunk selection end-to-end under the LM loss. It matches full attention in-domain while extrapolating 64× beyond training…