eastriverlee/LLM.swift

Emerging and experimental patterns for building with the Foundation Models framework

LLMs and VLMs with MLX Swift

High-performance MLX-based LLM inference engine for macOS with native Swift implementation

An API-compatible, drop-in replacement for Apple's Foundation Models framework with support for custom language model providers.

Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

A cosy home for your LLMs.

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

llama and other large language models on iOS and MacOS offline using GGML library.