mlcommons/mobile_app_open

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

Community-driven benchmark suite for MLX inference engines on Apple Silicon

Code sample showing how to run and benchmark models on Qualcomm's Window PCs

Reference implementations of MLPerf® inference benchmarks

MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.

Mobile vision models and code

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

The agent that grows with you

Mobile acquisition and inferencing client