lemonade-sdk/llamacpp-rocm

Experimental llama.cpp fork for inference research and development

RDNA-native LLM inference engine in Rust.

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

llama.cpp fork with additional SOTA quants and improved performance

LLM inference in C/C++

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Kernels, of the mega variety :)