jhammant/AIonDemandCluster — GitHub trending stats & insights

Reach 125K+ monthly visitors

jhammant/AIonDemandCluster

Spin up any open LLM on rented GPUs (vast.ai/RunPod), serve it with vLLM or llama.cpp, and drive it from Claude Code via Claude Code Router. Pay by the hour.

Visit GitHub

Python

2 contributors

MIT License

Social mentions

Recent discussions about this repository across the web

Claude Opus 4.8 is $25/1M output — so a 789B open model, self-hosted, came out cheaper per token. Opus is the better model; the point is running a giant open model yourself is now a $34 decision.…

@JonHammant · x.com

Repository activities

repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues