awslabs/awsome-distributed-ai

A Datacenter Scale Distributed Inference Serving Framework

Making large AI models cheaper, faster and more accessible

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

One stop shop for running AI/ML on AWS.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Gonka AI Compute

Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.