enescingoz/mac-llm-bench

Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

Fastest LLM inference runtime for Apple Silicon

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

An all-in-one LLMs Chat UI for Apple Silicon Mac using MLX Framework.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

Run GreenBitAI's Quantized LLMs on Apple Devices with MLX

Run LLMs with MLX

🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.