tairov/llama2.mojo

Inference code for Llama models

Inference Llama 2 in one file of pure C

Utilities intended for use with Llama models.

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Pi coding agent extension: llama.cpp provider with dynamic model + context window discovery

A simple TUI for serving local LLM models. Pick a model, pick a backend, serve it

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Python bindings for llama.cpp

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.