ome-projects/ome

Kubernetes AI Toolchain Operator

Achieve state of the art inference performance with modern accelerators on Kubernetes

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Lightweight, Modular, Kubernetes-native AI serving platform for scalable model serving.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Scale LLM Engine public repository

Helm chart for Ollama on Kubernetes

vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization