Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
yangbobo2021/tiny-arith-gym — GitHub trending stats & insights | Trendshift
Bifrost
Omnigraph
yangbobo2021/tiny-arith-gym
#
NLP
#
Programming examples
Take an 800K-param GPT from 2.2% to 95.5% on arithmetic through 20 controlled experiments — a hands-on tour of LLM training methods, including the ones that failed.
Visit GitHub
Like yangbobo2021/tiny-arith-gym, 0 likes
0
Bookmark yangbobo2021/tiny-arith-gym, 0 bookmarks
0
Python
2
MIT License
Social mentions
Recent discussions about this repository across the web
I trained a tiny GPT (800K params) on arithmetic and ran 20 controlled experiments to find out what actually helps. Full results inside.
r/learnmachinelearning
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues