phhusson/rknpu-reverse-engineering

Hardware reference and research notes for the RK3588 NPU and its regcmd interface

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU

Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver

Fully open-source, high-performance LLM inference engine for the RK3588 NPU

This is a repo with templated contains RK-chips, uboot, kernel, rootfs patches to make fast apply

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )