Best Open-source LLM Evaluation & Observability tools

Laminar

Trace, evaluate, and scale AI applications with minimal code.

Opik

Open-source platform for tracing, evaluating, and optimizing LLM applications

Agenta

Accelerate production LLM apps with integrated prompt, evaluation, observability

Langfuse

Collaborative platform for building, monitoring, and debugging LLM applications.

Coze Loop

Full‑life‑cycle platform for building, testing, and monitoring AI agents

OpenLLMetry

Full‑stack observability for LLM applications via OpenTelemetry

Evidently

Evaluate, test, and monitor ML & LLM systems effortlessly

Helicone

Open-source LLM observability and developer platform for AI applications

Phoenix

AI observability platform for tracing, evaluation, and prompt management

OpenLIT

Unified observability and management platform for LLM applications

TruLens

Systematically evaluate, track, and improve your LLM applications

Langtrace

Observability platform for LLM applications with real‑time tracing