kserve/kserve

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

The Cloud Native AI Platform

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Achieve state of the art inference performance with modern accelerators on Kubernetes

Cost-efficient and pluggable Infrastructure components for GenAI inference

A Datacenter Scale Distributed Inference Serving Framework

A flexible, high-performance serving system for machine learning models

Cloud Native Agentic AI | Discord: https://bit.ly/kagentdiscord

Rainbond is an open-source container platform that requires no Kubernetes expertise. Its core capabilities are 100% open source. It abstracts away infrastructure complexity and provides a unified way to deploy and manage business applications, AI-generated projects, open-source AI software, and large language model services. AI helps teams deploy