magiccodingman/vllm-radiance

The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyper

A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

RDNA-native LLM inference engine in Rust.

ML software (llama.cpp, ComfyUI, vLLM) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60

Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration

AiTer Optimized Model

LLM inference in C/C++