Michael-A-Kuykendall/shimmy
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
Rust
5.2k
483
5 contributors
Apache License 2.0
Social mentions
Recent discussions about this repository across the web
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues