warpfront/hipfire

Pure Rust Inference Engine

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration

Fast, flexible LLM inference

Experimental llama.cpp fork for inference research and development

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

~1300 line, minimal, extensible LLM inference engine built from scratch.