NVIDIA/TensorRT-RTX

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

From PyTorch model to end-to-end TensorRT inference experience in two commands—AI-native, cross-platform, and built for the best possible user experience.

Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.

Implementation of popular deep learning networks with TensorRT network definition API

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

An open source light-weight and high performance inference framework for Hailo devices

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high throughput and low latency across Computer Vision, Object Detection, Natural Language Processing and Generative AI models.