NVlabs/SOLAR

Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)

Find why PyTorch training is slow, compare runs, and catch performance regressions in CI.

A library to analyze PyTorch traces.

Capture every activation and gradient of any PyTorch model — forward and backward — with automatic graph visualization, rich metadata, and live interventions. Works on any architecture, including dynamic and recurrent ones.

Automating analysis from trace files

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

A profiling and performance analysis tool for machine learning

PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.

NVIDIA AITune is an inference toolkit designed for tuning and deploying Deep Learning models with a focus on NVIDIA GPUs.