swdee/go-rknnlite

Go binding for TensorFlow Lite

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

Llama.cpp with the Rockchip NPU integration as a GGML backend.

A Go (golang) library wrapping microsoft/onnxruntime.

An open source light-weight and high performance inference framework for Hailo devices

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )