Featured
antonellof/ferrox
Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.
Rust
9
2 contributors
Custom license
Social mentions
Recent discussions about this repository across the web
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues