knights-analytics/hugot

A Go (golang) library wrapping microsoft/onnxruntime.

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

llama.cpp in pure Go

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime

Generative AI with ONNX Runtime

OpenAI, GPT 6.1, GPT-Image-2, Whisper API clients for Go. Zero-dependency.