Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
rmacy/vllm — GitHub trending stats & insights | Trendshift
Featured
Busbar
open-connector
rmacy/vllm
#
AI infrastructure
A high-throughput and memory-efficient inference and serving engine for LLMs
Visit GitHub
Like rmacy/vllm, 0 likes
0
Bookmark rmacy/vllm, 0 bookmarks
0
Python
Apache License 2.0
website
Social mentions
Recent discussions about this repository across the web
I got Qwen3.8-27B FP8 to 72–79 tok/s on 2× Intel Arc Pro B70. It runs 2.3× faster than no speculation, and ahead of native MTP2 (54.7 tok/s). The recipe: I trained a 1.36B DSpark speculative drafter…
@bitr0t_ · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues