gregordinary/rocket-userspace

Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU

Because RKNPU only knows 4D

Hardware reference and research notes for the RK3588 NPU and its regcmd interface

Llama.cpp with the Rockchip NPU integration as a GGML backend.

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

DeepGEMM-Ascend: clean and efficient matrix multiplication kernel library for Huawei Ascend NPUs

Write and run custom C kernels for Intel Core Ultra NPUs