ml-energy/zeus

Track and predict the energy consumption and carbon footprint of training deep learning models.

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrastructure for AI development at scale.

Track emissions from Compute and recommend ways to reduce their impact on the environment.

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.

A library to analyze PyTorch traces.

Kernel Tuner