gpustack/gpustack

A Datacenter Scale Distributed Inference Serving Framework

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

Achieve state of the art inference performance with modern accelerators on Kubernetes

Cost-efficient and pluggable Infrastructure components for GenAI inference

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters