SeraphimSerapis/tool-eval-bench — GitHub trending stats & insights

Reach 125K+ monthly visitors

SeraphimSerapis/tool-eval-bench

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.

Visit GitHub

Python

161

1 contributors

MIT License

Social mentions

Recent discussions about this repository across the web

3-way tool-calling shootout on Qwen3.6-27B quants same benchmark: 🟢 mlx-optiq 4-bit - 89/100 · 20 GB 🟢 NVIDIA NVFP4 - 89/100 · 22 GB 🟠 Unsloth Q8_K_XL - 83/100 · 35 GB OptiQ ties NVIDIA's FP4 and…

@latent_node · x.com

Repository activities

repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues