- Stars
- 31,904
- License
- Unknown
- Last commit
- 3 days ago
Best LLM Gateways & Aggregators Tools
Explore leading tools in the LLM Gateways & Aggregators category, including open-source options and SaaS products. Compare features, use cases, and find the best fit for your workflow.
5 open-source projects · 3 SaaS products
Top open-source LLM Gateways & Aggregators
These projects are active, self-hostable choices for knowledge management teams evaluating alternatives to SaaS tools.
- Stars
- 10,023
- License
- MIT
- Last commit
- 3 days ago
- Stars
- 6,972
- License
- Apache-2.0
- Last commit
- 7 days ago

Envoy AI Gateway
Unified gateway for secure, scalable generative AI traffic
- Stars
- 1,239
- License
- Apache-2.0
- Last commit
- 4 days ago
- Stars
- 1,203
- License
- Apache-2.0
- Last commit
- 3 days ago
A lightweight gateway that routes requests to over 1,600 language, vision, audio, and image models with sub‑millisecond latency, built‑in retries, guardrails, and enterprise‑grade security.
Popular SaaS Platforms to Replace
Understand the commercial incumbents teams migrate from and how many open-source alternatives exist for each product.
Eden AI
Unified API aggregator for AI services across providers
OpenRouter
One API for 400+ AI models with smart routing and unified billing/BYOK
Vercel AI Gateway
Unified AI gateway for multi-provider routing, caching, rate limits, and observability
Eden AI offers a single API to multiple AI engines (vision, speech, NLP), selecting the best provider per task and price.
Frequently replaced when teams want private deployments and lower TCO.
Explore related categories
Browse neighbouring categories in ML & AI to widen your evaluation.
- AI Agent FrameworksFrameworks for building and orchestrating agentic LLM applications: tool use, multi-agent workflows, memory, planning, and evaluation.
- AI App BuildersPlatforms that generate production web apps from natural-language prompts, producing runnable code (repo/PR/deploy) with iterative editing.
- AI Application Frameworks & OrchestrationBuild AI apps/agents with tools, retrieval, prompts and routing graphs.
- AutoML ToolsAutomated modeling and pipeline tooling for selection and tuning.
- Conversational AI PlatformsPlatforms to design, build, and deploy chat/voice assistants with NLU/dialogue, channels, policies, analytics, and hosting.
- Data Labeling & AnnotationAnnotate images, text and audio with workflows, QA and datasets.



