tenstorrent/tt-inference-server

Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

The Tenstorrent Studio (TT-Studio) is an easy to use web interface for running AI models on Tenstorrent hardware. It handles all the technical setup automatically and gives you a simple GUI to deploy models, chat with models, and more.

Reference implementations of MLPerf® inference benchmarks

🪙 TT-NN operator library, and TT-Metalium low level kernel programming model.

Deep Learning Server and CLI for Torch and TensorRT

A scalable inference server for models optimized with OpenVINO™

Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.

This repository contains tutorials and examples for Triton Inference Server