panbanda/higgs

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just your Mac running models at full speed.

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

Big models. Small Macs. Zero excuses.

🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Fastest LLM inference runtime for Apple Silicon

lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.