Langfuse
Collaborative platform for building, monitoring, and debugging LLM applications.
- Stars
- 18,876
- License
- Unknown
- Last commit
- 3 days ago
TypeScriptActive
Best LLM Evaluation & Observability Tools
Explore leading tools in the LLM Evaluation & Observability category, including open-source options and SaaS products. Compare features, use cases, and find the best fit for your workflow.
10+ open-source projects · 3 SaaS products
Top open-source LLM Evaluation & Observability
These projects are active, self-hostable choices for knowledge management teams evaluating alternatives to SaaS tools.
Opik
Open-source platform for tracing, evaluating, and optimizing LLM applications
- Stars
- 16,274
- License
- Apache-2.0
- Last commit
- 3 days ago
PythonActive
Phoenix
AI observability platform for tracing, evaluation, and prompt management
- Stars
- 7,830
- License
- Unknown
- Last commit
- 4 days ago
Jupyter NotebookActive
- Stars
- 6,876
- License
- Apache-2.0
- Last commit
- 3 days ago
Jupyter NotebookActive
OpenLLMetry
Full‑stack observability for LLM applications via OpenTelemetry
- Stars
- 6,643
- License
- Apache-2.0
- Last commit
- 3 days ago
PythonActive
Coze Loop
Full‑life‑cycle platform for building, testing, and monitoring AI agents
- Stars
- 5,129
- License
- Apache-2.0
- Last commit
- 3 days ago
GoActive
Most starred project
18,876★
Collaborative platform for building, monitoring, and debugging LLM applications.
Recently updated
3 days ago
Laminar provides automatic OpenTelemetry tracing, cost and token metrics, parallel evaluation, and dataset export for LLM apps, all via a Rust backend and SDKs for Python and TypeScript.
Popular SaaS Platforms to Replace
Understand the commercial incumbents teams migrate from and how many open-source alternatives exist for each product.
Confident AI
DeepEval-powered LLM evaluation platform to test, benchmark, and safeguard apps
LLM Evaluation & Observability
Alternatives tracked
12 alternatives
InsightFinder
AIOps platform for streaming anomaly detection, root cause analysis, and incident prediction
LLM Evaluation & Observability
Alternatives tracked
12 alternatives
LangSmith Observability
LLM/agent observability with tracing, monitoring, and alerts
LLM Evaluation & Observability
Alternatives tracked
12 alternatives
Most compared product
10+ open-source alternatives
Confident AI (from the creators of DeepEval) provides metrics, regression testing, tracing, and guardrails to compare prompts/models, catch regressions, and monitor LLM applications.
Leading hosted platforms
Frequently replaced when teams want private deployments and lower TCO.
Explore related categories
Browse neighbouring categories in ML & AI to widen your evaluation.
- AI Agent FrameworksFrameworks for building and orchestrating agentic LLM applications: tool use, multi-agent workflows, memory, planning, and evaluation.
- AI App BuildersPlatforms that generate production web apps from natural-language prompts, producing runnable code (repo/PR/deploy) with iterative editing.
- AI Application Frameworks & OrchestrationBuild AI apps/agents with tools, retrieval, prompts and routing graphs.
- AutoML ToolsAutomated modeling and pipeline tooling for selection and tuning.
- Conversational AI PlatformsPlatforms to design, build, and deploy chat/voice assistants with NLU/dialogue, channels, policies, analytics, and hosting.
- Data Labeling & AnnotationAnnotate images, text and audio with workflows, QA and datasets.