Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
john-friedman/good-enough-model-benchmarks-for-speed — GitHub trending stats & insights | Trendshift
Featured
Busbar
open-connector
john-friedman/good-enough-model-benchmarks-for-speed
Benchmark for comparing model prefill, latency, and decode.
Visit GitHub
Like john-friedman/good-enough-model-benchmarks-for-speed, 0 likes
0
Bookmark john-friedman/good-enough-model-benchmarks-for-speed, 0 bookmarks
0
Python
1 contributors
Social mentions
Recent discussions about this repository across the web
things to know: 1. these benchmark are not rigorous. I ran it off a laptop in CA, so some latency is due to that. Also, ran at one time period. 2. time before prefill: estimated using a 'on belay'…
@johngfriedman · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues