guilt/TinyToT

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

Ollama Client – Chat with Local LLMs Inside Your Browser A lightweight, privacy‑first extension to chat with local LLMs via Ollama, LM Studio, and llama.cpp. Supports streaming, stop/regenerate, RAG, and easy model switching — all without cloud APIs or data leaks.

NPU Ollama - An Ollama/OpenAI compatible API for Intel OpenVINO compatible computers

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Setup and run a local LLM and Chatbot using consumer grade hardware.

🕯️ A lightweight but powerful LLM chat application

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)