SouthpawIN/turbofit

Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

High-speed Large Language Model Serving for Local Deployment

Which local LLMs can your computer run? Hardware-aware CLI, TUI and GUI: yes/slow/no verdicts and tok/s from your GPU VRAM and RAM, then verified installs via Ollama, llama.cpp, MLX and LM Studio. Native Rust.

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

Find the best models and how to run them locally.

Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve.

Local AI API Platform

Hundreds of models & providers. One command to find what runs on your hardware.

Agentic Runtime