leehack/llamadart

llama.cpp for Flutter

On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Build LLM-powered Dart/Flutter applications.

AI inference library for mobile devices

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

Open-source Llm for Apple silicon devices.