Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
LocBench/locbench — GitHub trending stats & insights | Trendshift
Busbar
Bifrost
Kane CLI
LocBench/locbench
#
LLM inference
A measurement bench for local LLM inference. One variable at a time, raw data published, limits declared. Every number comes with the command that produced it
Visit GitHub
Like LocBench/locbench, 0 likes
0
Bookmark LocBench/locbench, 0 bookmarks
0
Python
2 contributors
MIT License
Social mentions
Recent discussions about this repository across the web
The "prompt tok/s" that llama.cpp and TabbyAPI report is: uncached_tokens / time_to_first_token Time-to-first-token holds everything that doesn't scale with your prompt. At 200 tokens the same…
@GiovanniOsserv1 · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues