Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Like openai/evals, 0 likes 0 Bookmark openai/evals, 0 bookmarks 0 Simple LLM Evaluation Using LLM As a Judge 👩⚖️
Like cyberark/simple-llm-eval, 0 likes 0 Bookmark cyberark/simple-llm-eval, 0 bookmarks 0 Evaluate your LLM's response with Prometheus and GPT4 💯
Like prometheus-eval/prometheus-eval, 0 likes 0 Bookmark prometheus-eval/prometheus-eval, 0 bookmarks 0 Inspect: A framework for large language model evaluations
Like UKGovernmentBEIS/inspect_ai, 0 likes 0 Bookmark UKGovernmentBEIS/inspect_ai, 0 bookmarks 0 Comprehensive LLM evaluation at scale: A production-ready framework for evaluating large language models across multiple benchmarks.
Like Aleph-Alpha-Research/eval-framework, 0 likes 0 Bookmark Aleph-Alpha-Research/eval-framework, 0 bookmarks 0 OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
Like open-compass/opencompass, 0 likes 0 Bookmark open-compass/opencompass, 0 bookmarks 0 Automated system for LLM evaluation via agents. Doc as below:
Like OpenDCAI/One-Eval, 0 likes 0 Bookmark OpenDCAI/One-Eval, 0 bookmarks 0