mechramc/Orion

High-performance MLX-based LLM inference engine for macOS with native Swift implementation

Fine-tune and run LLMs locally on your M-series Mac. A powerful desktop interface built on Apple's MLX framework for zero-setup AI.

Python runtime for the Apple Neural Engine

macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just your Mac running models at full speed.

Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU

Fastest LLM inference runtime for Apple Silicon

lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.