Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Dev-Art-Solutions/InferHub — GitHub trending stats & insights | Trendshift
Sponsor spot open
·
promote your product
Dev-Art-Solutions/InferHub
#
AI infrastructure
#
Local LLM
#
Self-hosted
Self-hosted LLM inference mesh in .NET. One Ollama-compatible API in front, a pool of GPU worker nodes behind it — run the hub where you have no GPU, run nodes where you do. Pluggable backends (Ollama first).
Visit GitHub
C#
1 contributors
MIT License
Social mentions
Recent discussions about this repository across the web
InferHub runs prompts now. /api/generate and /api/chat route to a node with the requested model, execute via OllamaClient, and return Ollama-shaped responses. Two nodes with the same model?…
@DevArtSolutions · x.com
InferHub v0.2.0 is out: nodes now connect to the coordinator over SignalR, outbound only, so they sit happily behind NAT. Registration, heartbeats, auto-reconnect, and a live fleet view are done.…
@DevArtSolutions · x.com
No trending activity
This repository has not yet been featured on GitHub Trending
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
Data is not available yet
Recent activity data for stars, forks, merged PRs, issues, and closed issues will appear here once available