Langfuse
Collaborative platform for building, monitoring, and debugging LLM applications.
- Stars
- 20,896
- License
- —
- Last commit
- 1 hour ago
TypeScriptActive
Best LLM Evaluation & Observability Tools
Explore leading tools in the LLM Evaluation & Observability category, including open-source options and SaaS products. Compare features, use cases, and find the best fit for your workflow.
10+ open-source projects · 3 SaaS products
Top open-source LLM Evaluation & Observability
These projects are active, self-hostable choices for knowledge management teams evaluating alternatives to SaaS tools.
Opik
Open-source platform for tracing, evaluating, and optimizing LLM applications
- Stars
- 17,386
- License
- Apache-2.0
- Last commit
- 48 minutes ago
PythonActive
Phoenix
AI observability platform for tracing, evaluation, and prompt management
- Stars
- 8,322
- License
- —
- Last commit
- 1 hour ago
Jupyter NotebookActive
- Stars
- 7,029
- License
- Apache-2.0
- Last commit
- 8 days ago
Jupyter NotebookActive
OpenLLMetry
Full‑stack observability for LLM applications via OpenTelemetry
- Stars
- 6,776
- License
- Apache-2.0
- Last commit
- 2 hours ago
PythonActive
Coze Loop
Full‑life‑cycle platform for building, testing, and monitoring AI agents
- Stars
- 5,267
- License
- Apache-2.0
- Last commit
- 55 minutes ago
GoActive
Most starred project
20,896★
Collaborative platform for building, monitoring, and debugging LLM applications.
Recently updated
48 minutes ago
Agenta enables engineering and product teams to build reliable LLM applications faster through collaborative prompt management, systematic evaluation, and real‑time observability, supporting 50+ models and custom integrations.
Dominant language
TypeScript • 5 projectsExpect a strong TypeScript presence among maintained projects.
Popular SaaS Platforms to Replace
Understand the commercial incumbents teams migrate from and how many open-source alternatives exist for each product.
Confident AI
DeepEval-powered LLM evaluation platform to test, benchmark, and safeguard apps
LLM Evaluation & Observability
Alternatives tracked
12 alternatives
InsightFinder
AIOps platform for streaming anomaly detection, root cause analysis, and incident prediction
LLM Evaluation & Observability
Alternatives tracked
12 alternatives
LangSmith Observability
LLM/agent observability with tracing, monitoring, and alerts
LLM Evaluation & Observability
Alternatives tracked
12 alternatives
Most compared product
10+ open-source alternatives
Confident AI (from the creators of DeepEval) provides metrics, regression testing, tracing, and guardrails to compare prompts/models, catch regressions, and monitor LLM applications.
Leading hosted platforms
Frequently replaced when teams want private deployments and lower TCO.
Explore related categories
Browse neighbouring categories in ML & AI to widen your evaluation.
- AI Agent FrameworksFrameworks for building and orchestrating agentic LLM applications: tool use, multi-agent workflows, memory, planning, and evaluation.
- AI App BuildersPlatforms that generate production web apps from natural-language prompts, producing runnable code (repo/PR/deploy) with iterative editing.
- AI Application Frameworks & OrchestrationBuild AI apps/agents with tools, retrieval, prompts and routing graphs.
- AutoML ToolsAutomated modeling and pipeline tooling for selection and tuning.
- Conversational AI PlatformsPlatforms to design, build, and deploy chat/voice assistants with NLU/dialogue, channels, policies, analytics, and hosting.
- Data Labeling & AnnotationAnnotate images, text and audio with workflows, QA and datasets.