skypilot-org/skypilot

The Cloud Native AI Platform

Build, Manage and Deploy AI/ML Systems

A Datacenter Scale Distributed Inference Serving Framework

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

The open-source app everyone uses to manage agents at work

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Deploy real projects from GitHub or your AI coding agent, then keep them running with AI-powered operations.