Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
HanzCEO/batcher-party — GitHub trending stats & insights | Trendshift
Featured
Busbar
open-connector
HanzCEO/batcher-party
#
Proxy
OpenAI-compatible batching proxy for endpoints that doesn't support Batching REST API. Natively handles file hosting too.
Visit GitHub
Like HanzCEO/batcher-party, 0 likes
0
Bookmark HanzCEO/batcher-party, 0 bookmarks
0
Rust
1 contributors
Apache License 2.0
Social mentions
Recent discussions about this repository across the web
If you liked the idea of local AI, you should max your utilization at night by batching! I developed a 100% local AI proxy that abstracts away all OpenAI Batch REST API so that your vLLM or llama.cpp…
@hanzceo · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues