langfuse/langfuse-python

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

LangSmith Client SDK Implementations

AI observability platform for production LLM and agent systems.

Evaluation and Tracking for LLM Experiments and AI Agents

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

AI Observability & Evaluation