facebook/FAI-PEP

Reference implementations of MLPerf® inference benchmarks

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

GenAI inference performance benchmarking tool

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

A validation and profiling tool for AI infrastructure

Building the Virtuous Cycle for AI-driven LLM Systems

AISBench Benchmark is a model evaluation tool built on OpenCompass, compatible with OpenCompass’s configuration system, dataset structure, and model backend implementation, while extending support for service-based models.