ai-infos/vllm-gfx906-mobydick

The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyper

Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's

RDNA-native LLM inference engine in Rust.

AiTer Optimized Model

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx

Pure Rust Inference Engine

vllm based inference engine for looped transformer

~1300 line, minimal, extensible LLM inference engine built from scratch.