Hanzo-Huang/rkllm-docker

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Fully open-source, high-performance LLM inference engine for the RK3588 NPU

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU

Run LLMs on AMD Ryzen AI NPU (Linux)

Ryzen AI Dockerfiles for ML, Robotics and Development Environments

Ollama with intel (i)GPU acceleration in docker and benchmark