Best Open-source LLM Evaluation & Observability tools

Agenta

Accelerate production LLM apps with integrated prompt, evaluation, observability

Langfuse

Collaborative platform for building, monitoring, and debugging LLM applications.

Phoenix

AI observability platform for tracing, evaluation, and prompt management

Laminar

Trace, evaluate, and scale AI applications with minimal code.

OpenLIT

Unified observability and management platform for LLM applications

Opik

Open-source platform for tracing, evaluating, and optimizing LLM applications

TruLens

Systematically evaluate, track, and improve your LLM applications

Coze Loop

Full‑life‑cycle platform for building, testing, and monitoring AI agents

OpenLLMetry

Full‑stack observability for LLM applications via OpenTelemetry

Evidently

Evaluate, test, and monitor ML & LLM systems effortlessly

Helicone

Open-source LLM observability and developer platform for AI applications

Langtrace

Observability platform for LLM applications with real‑time tracing