Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
Tencent-Hunyuan/Simple-Attention-Sparsification — GitHub trending stats & insights | Trendshift
Omnigraph
VModal Mobile SDK
Bifrost
Tencent-Hunyuan/Simple-Attention-Sparsification
#
NLP
Code for our resarch paper "SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking"
Visit GitHub
Like Tencent-Hunyuan/Simple-Attention-Sparsification, 0 likes
0
Bookmark Tencent-Hunyuan/Simple-Attention-Sparsification, 0 bookmarks
0
Python
60
1
2 contributors
Social mentions
Recent discussions about this repository across the web
Verdict: Solid result, will likely replicate—principled misalignment fix, clean ablations on design choices, consistent gains across three task families.
@AIEnthusiast26x · x.com
📄 SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking by Zhiwei Li, Lei Zhu et al. Continuous log-space gates are injected into sparse attention, letting LM loss…
@papersdatacode · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues