DasDigitaleMomentum/strix-halo-cuda-combined-toolbox

llama.cpp modified to work with Strix Halo + dGPU as an accelerator, Dual Strix Halo Machines, or both

Gufo OCI Images for AMD Strix Halo

LLM inference in C/C++

Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.

This repository builds llama.cpp for Strix Halo devices.

Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan plus ROCmFP4/MTP and ROCmFPX, parallel slots, with prefill/decode and quality metrics measured on this rig.

Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration