Submit repository
Discover trends that matter
Daily explore
Live mentions
Topics
GitHub trending
Repositories
Developers
Repository engagements
Insights
Stats
KellerJordan/modded-nanogpt — GitHub trending stats & insights | Trendshift
Featured
Openhuman
Embed Badge
Visit GitHub
KellerJordan/modded-nanogpt
NanoGPT (124M) in 90 seconds
Data last synced with GitHub 5 days ago
Python
5.3k
761
51 contributors
last commit 6 days ago
last user commit 6 days ago
MIT License
created almost 2 years ago
Social mentions
Recent discussions about this repository across the web
Of the novelty-gated ideas, the best one improved on the 3500 baseline by only 125 steps compared to PR-copying which gives 500+ step gains.
@vvvincent_c · x.com · about 1 hour ago
fun little artifact, i worked on something similar to freon last year and started writing an (unedited) post that is hidden on my blog: very naive implementation of steepest descent under various p…
@joemelko · x.com · 4 days ago
Modded-NanoGPT optimization result #14 (2026/05/04): @Sam_Acqua has achieved a new record of 3150 steps (-60), by adding SOAP preconditioning before Muon orthogonalization for the MLP weights…
@kellerjordan0 · x.com · 6 days ago
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
GitHub trending history
Shows when the repository has appeared on GitHub Trending across any language
all language ranking
python ranking