Best Open-source LLM Evaluation & Observability tools

Langfuse

Collaborative platform for building, monitoring, and debugging LLM applications.

Coze Loop

Full‑life‑cycle platform for building, testing, and monitoring AI agents

Opik

Open-source platform for tracing, evaluating, and optimizing LLM applications

Phoenix

AI observability platform for tracing, evaluation, and prompt management

Agenta

Accelerate production LLM apps with integrated prompt, evaluation, observability

TruLens

Systematically evaluate, track, and improve your LLM applications

Laminar

Trace, evaluate, and scale AI applications with minimal code.

Evidently

Evaluate, test, and monitor ML & LLM systems effortlessly

OpenLLMetry

Full‑stack observability for LLM applications via OpenTelemetry

OpenLIT

Unified observability and management platform for LLM applications

Helicone

Open-source LLM observability and developer platform for AI applications

Langtrace

Observability platform for LLM applications with real‑time tracing