Bazaarlinkorg/LLMprobe-engine

Untuk cek model apakah maskingan atau bukan

Who is really behind that API? Fingerprint any OpenAI-compatible endpoint in the browser: 9 infrastructure probes, side-by-side comparison, community-extensible.

Model authenticity / dilution detection CLI: one command, one report. Detect fake or watered-down LLM endpoints via identity, context, tokenizer, capability and latency checks.

llama-benchy - llama-bench style benchmarking tool for all backends

The LLM API Benchmark Tool is a flexible Go-based utility designed to measure and analyze the performance of OpenAI-compatible API endpoints across different concurrency levels.

LLM evals to test open-source inference providers

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Provider-agnostic, open-source evaluation infrastructure for language models