gtrak/tinyllb — GitHub trending stats & insights | Trendshift

Footer

Your go-to destination for discovering trending open-source projects and uncovering the insights that matter

Legal

Terms and conditions
Privacy policy

More

Pricing
Advertise
onedump
gosnakego
Contact us

Social

X (Twitter)
GitHub

What they build speaks louder than words

© 2026 Trendshift, created by Julian Li with ❤️

Signal Advertise

Signal Advertise

Discover trends that matter

Daily Weekly Monthly Yearly

Live mentions Topics

Repositories Developers

gtrak/tinyllb — GitHub trending stats & insights | Trendshift

Featured

gtrak/tinyllb

#AI infrastructure #Proxy

Agent-aware LLM inference scheduling proxy — flow-aware admission control, fairness (DRR/WFQ), and KV-cache-aware backpressure for vLLM

Rust

1 contributors

Social mentions

Recent discussions about this repository across the web

My little local LLM load balancer supports llama.cpp now. Associating flows with llama.cpp slots to make prompt caching less janky hopefully. Local qwen built this feature end to end from a vague…

@gtrakGT · x.com

Vibing up a vllm proxy/load-balancer for myself for gpu-poor single-node problems. Small win: it caught an early EOS token during thinking issue and successfully retried:

@gtrakGT · x.com

Repository activities

repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues

Featured

Control what AI can do before it acts

open-source connector gateway for AI agents

150K+ monthly visitors

Want to advertise your product to high-intent tech audiences at a simple, flat rate?

Advertise on Trendshift