li-plus/chatglm.cpp

Run PyTorch LLMs locally on servers, desktop and mobile

lightweight, standalone C++ inference engine for Google's Gemma models.

Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

High-speed Large Language Model Serving for Local Deployment

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Run LLMs with MLX

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V