Best Open-source LLM Evaluation & Observability tools

Opik

Open-source platform for tracing, evaluating, and optimizing LLM applications

Helicone

Open-source LLM observability and developer platform for AI applications

Coze Loop

Full‑life‑cycle platform for building, testing, and monitoring AI agents

Phoenix

AI observability platform for tracing, evaluation, and prompt management

OpenLLMetry

Full‑stack observability for LLM applications via OpenTelemetry

Laminar

Trace, evaluate, and scale AI applications with minimal code.

Langfuse

Collaborative platform for building, monitoring, and debugging LLM applications.

Agenta

Accelerate production LLM apps with integrated prompt, evaluation, observability

TruLens

Systematically evaluate, track, and improve your LLM applications

OpenLIT

Unified observability and management platform for LLM applications

Evidently

Evaluate, test, and monitor ML & LLM systems effortlessly

Langtrace

Observability platform for LLM applications with real‑time tracing