Provider-agnostic, open-source evaluation infrastructure for language models
Like groq/openbench, 0 likes 0 Bookmark groq/openbench, 0 bookmarks 0 Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.
Like Aleph-Alpha-Research/eval-framework, 0 likes 0 Bookmark Aleph-Alpha-Research/eval-framework, 0 bookmarks 0 Simple LLM Evaluation Using LLM As a Judge 👩⚖️
Like cyberark/simple-llm-eval, 0 likes 0 Bookmark cyberark/simple-llm-eval, 0 bookmarks 0 Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
Like huggingface/lighteval, 0 likes 0 Bookmark huggingface/lighteval, 0 bookmarks 0 Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Like openai/evals, 0 likes 0 Bookmark openai/evals, 0 bookmarks 0 The Universe of Evaluation. All about the evaluation for LLMs.
Like UpstageAI/evalverse, 0 likes 0 Bookmark UpstageAI/evalverse, 0 bookmarks 0 High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.
Like ai-twinkle/Eval, 0 likes 0 Bookmark ai-twinkle/Eval, 0 bookmarks 0 Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.
Like DogukanUrker/BenchKit, 0 likes 0 Bookmark DogukanUrker/BenchKit, 0 bookmarks 0 Automated system for LLM evaluation via agents. Doc as below:
Like OpenDCAI/One-Eval, 0 likes 0 Bookmark OpenDCAI/One-Eval, 0 bookmarks 0