llm-d/llm-d-inference-sim

Accurate, large-scale, and extensible simulator for LLM inference Systems

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Local LLM Inference Speed Test Tool

LLMServingSim 2.0: A Unified Simulator for Heterogeneous and Disaggregated LLM Serving Infrastructure

Inference server benchmarking tool

Mock everything your AI app talks to — LLM APIs, MCP, A2A, AG-UI, vector DBs, search. One package, one port, zero dependencies.

LLM Benchmark for Throughput via Ollama (Local LLMs)

A framework for generating realistic LLM serving workloads

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.