stew675/llama-cpp-rdna-boosts

Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration

LLM inference in C/C++

Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.

Experimental llama.cpp fork for inference research and development

RDNA-native LLM inference engine in Rust.

ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants

The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyper

llama.cpp fork with additional SOTA quants and improved performance

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx