mitsuhiko/pi-llamacpp

Pi coding agent extension: llama.cpp provider with dynamic model + context window discovery

Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.

Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

Perplexity open source garden for inference technology

Strata minus the bullshit. clone, rsync to prod, compile and go

Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

High-speed Large Language Model Serving for Local Deployment

HF CLI extension to run local coding agent powered by llmfit and llama.cpp