Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
gtrak/tinyllb — GitHub trending stats & insights | Trendshift
Featured
open-connector
gtrak/tinyllb
#
AI infrastructure
#
Proxy
Agent-aware LLM inference scheduling proxy — flow-aware admission control, fairness (DRR/WFQ), and KV-cache-aware backpressure for vLLM
Visit GitHub
Rust
1 contributors
Social mentions
Recent discussions about this repository across the web
Vibing up a vllm proxy/load-balancer for myself for gpu-poor single-node problems. Small win: it caught an early EOS token during thinking issue and successfully retried:
@gtrakGT · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues