catid/dgx_station_benchmarks

A suite to benchmark CPU/GPU Python performance in training ML models and running local LLMs

📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.

Exemplar Performance provides recipes in ready-to-use templates for evaluating performance of specific AI use cases across hardware and software combinations.

Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.

Repository of machine learning benchmarks

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

Evaluating frontier models on real-world ai-infra engineering tasks