Telosnex/fllama

Cross-platform on-device LLM inference for Dart & Flutter: GGUF via llama.cpp and LiteRT-LM on Android, iOS, macOS, Windows, Linux and web.

On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Swift package to run local LLMs on iOS, macOS, Linux

llama and other large language models on iOS and MacOS offline using GGML library.

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

InferrLM - On-device AI for iOS & Android

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Large Language Model (LLM) module for the Spezi Ecosystem