xlite-dev/lite.ai.toolkit

A C++ standalone library for machine learning

lightweight, standalone C++ inference engine for Google's Gemma models.

A toolkit for making real world machine learning and data analysis applications in C++

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Cross-platform, customizable ML solutions for live and streaming media.

Implementation of popular deep learning networks with TensorRT network definition API

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.