madroidmaq/mlx-omni-server

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

High-performance MLX-based LLM inference engine for macOS with native Swift implementation

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server and Mac app for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Release-gated with Claude Code, Codex CLI, Aider, Hermes and DeepSeek Harness.

Local AI, native to your Mac. Chat, serve, monitor, and connect MLX models from one macOS app.

MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint