okuvshynov/slowllama

Train Large Language Models on MLX.

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

Run LLMs with MLX

Runs 405B LLMs on 8GB VRAM

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

Fine-tune Gemma 4 and 3n with audio, images and text on Apple Silicon, using PyTorch and Metal Performance Shaders.

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

Running a big model on a small laptop