docker/model-runner

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Run any agent on any model, models stored as OCI images

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Containers for machine learning

A scalable inference server for models optimized with OpenVINO™

The simplest way to serve AI/ML models in production

Local AI API Platform

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

A high-performance inference engine for AI models