omnimind-ai/OmniInfer

Production ready toolkit to run AI locally

A high-performance inference engine for AI models

Fast Multimodal LLM on Mobile Devices

Local AI API Platform

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

High-speed Large Language Model Serving for Local Deployment