Metal-first MoE inference for Apple Silicon with bounded SSD expert streaming and local OpenAI Chat, Responses, and Anthropic Messages endpoints.
Tiny llms optimised for edge deployment
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
An all-in-one LLMs Chat UI for Apple Silicon Mac using MLX Framework.
Blazing fast Apple Silicon optimized inference engine built for Qwen and Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
Perplexity open source garden for inference technology
Fastest LLM inference runtime for Apple Silicon
OpenAI-compatible API server for Apple on-device models
