utilityai/llama-cpp-rs

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust

⚙️🦀 Build modular and scalable LLM Applications in Rust

Efficient Python bindings for the llama.cpp library

Python bindings for llama.cpp

An transformer based LLM. Written completely in Rust

Inference Llama 2 in one file of pure C

Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, ZAI, OpenRouter, FireworksAI, xAI/Grok, Groq,, ...)

llama.cpp fork with additional SOTA quants and improved performance