Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
StartluxLabs/Massive-Activations-HLA — GitHub trending stats & insights | Trendshift
Featured
open-connector
StartluxLabs/Massive-Activations-HLA
⚡ Official code for “Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus”.
Visit GitHub
Like StartluxLabs/Massive-Activations-HLA, 0 likes
0
Python
7
2
2 contributors
MIT License
website
Social mentions
Recent discussions about this repository across the web
Massive Activations in Hybrid Linear Attention LLMs This paper uncovers how massive activations form pre-attention spikes and inter-spike plateaus in hybrid linear attention models, with code and…
@HuggingPapers · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues