onicai/llama_cpp_canister

decentralized llm sharing

Private Inference Network on Idle Macs

Enable interaction with distributed, decentralized LLMs on the Morpheus network through a desktop chat experience

Pi coding agent extension: llama.cpp provider with dynamic model + context window discovery

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Distributed LLM: People host AI models on their PC's. All together. In a public Network.

NPU Ollama - An Ollama/OpenAI compatible API for Intel OpenVINO compatible computers

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V