bentoml/BentoML

☁️ Build multimodal AI applications with cloud-native stack

Build, Manage and Deploy AI/ML Systems

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Universal LLM Deployment Engine with ML Compilation

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Containers for machine learning

Low-code framework for building custom LLMs, neural networks, and other AI models

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.