Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
robertlangdonn/ondevice-bench — GitHub trending stats & insights | Trendshift
Sponsor spot open
·
promote your product
robertlangdonn/ondevice-bench
#
Local LLM
Honest local-LLM benchmarks on Apple Silicon (MLX) — what actually runs well on a 16GB Mac.
Visit GitHub
Python
1 contributors
Social mentions
Recent discussions about this repository across the web
Practical upshot for 16 GB Macs: • Speed + reliability: Llama-3.1-8B (4-bit) • Best quality that fits: Gemma-3-12B QAT 3-bit — 5.9 GB, clean outputs • Skip: any 14B at naïve 3-bit — slower and less…
@sleepybroke · x.com
Three traps that almost gave me wrong numbers: • cold-start (warm up before timing) • the laptop sleeping mid-run (a "460s load" was a nap — use caffeinate) • memory accumulating across models in one…
@sleepybroke · x.com
No trending activity
This repository has not yet been featured on GitHub Trending
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
Data is not available yet
Recent activity data for stars, forks, merged PRs, issues, and closed issues will appear here once available