SRSWTI/bodega-inference-engine

Fastest LLM inference runtime for Apple Silicon

🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.

works well with rocks; native Apple Silicon inference engine for capable and tiny models (ternary, Qwen) via MLX Swift. Hadamard-rotated KV cache, vision, tool calling, OpenAI + Anthropic APIs

Our lightning-fast inference engine.

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

High-performance MLX-based LLM inference engine for macOS with native Swift implementation

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Blazing fast Apple Silicon optimized inference engine built for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai