perplexityai/pplx-garden

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

Run LLMs with MLX

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

A local inference engine for Apple silicon, built around the model.

vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

The official API server for Exllama. OAI compatible, lightweight, and fast.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Run PyTorch LLMs locally on servers, desktop and mobile