Featured
gtrak/tinyllb
Agent-aware LLM inference scheduling proxy — flow-aware admission control, fairness (DRR/WFQ), and KV-cache-aware backpressure for vLLM
Rust
1 contributors
Social mentions
Recent discussions about this repository across the web
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues