mila-iqia/milabench

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks.

Reference implementations of MLPerf® training benchmarks

A suite to benchmark CPU/GPU Python performance in training ML models and running local LLMs

CloudAI Benchmark Framework

Exemplar Performance provides recipes in ready-to-use templates for evaluating performance of specific AI use cases across hardware and software combinations.

PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for evaluation of training and inference platforms.

Reference implementations of MLPerf® inference benchmarks

A benchmark of real-world DL kernel problems