igurss/mlx-chronos

Community benchmark database for running LLMs on Apple Silicon Macs

Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Fastest LLM inference runtime for Apple Silicon

Local LLM Testing & Benchmarking for Apple Silicon

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

🔥 The fastest local AI engine for Apple Silicon. Optimised for agentic use.

ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)

Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.