Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
weicj/vllm-2080ti-definitive — GitHub trending stats & insights | Trendshift
Sponsor spot open
·
promote your product
weicj/vllm-2080ti-definitive
#
Local LLM
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering 27B/31B local inference with 100+ tok/s single-request decode and native 262K context.
Visit GitHub
Python
68
11
1 contributors
Apache License 2.0
Social mentions
Recent discussions about this repository across the web
#vLLM_2080Ti_Definitive_Edition ready to go, enjoy single request 100+ tok/s of 27B/31B dense at 1/8 cost of RTX 5090. Qwen3.6 27B full feature support (Gemma4 31B as experiemental path). Check to…
@maxweicj · x.com
No trending activity
This repository has not yet been featured on GitHub Trending
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues