nobodywho-ooo/nobodywho

Production ready toolkit to run AI locally

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

A high-performance inference engine for AI models

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Unified, efficient, and easy-to-use inference infrastructure for edge AI || 面向端侧 AI 的统一、高效、易用的推理基础设施

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

llama and other large language models on iOS and MacOS offline using GGML library.