micytao/vllm-playground

Control panel for VLLM, Sglang, llama.cpp, exllamav3

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

A Web Interface for chatting with your local LLMs via the ollama API

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

Ollama client for iOS, Android, macOS, Linux and Windows that simplifies experimenting with LLMs.