Best LLM Gateways & Aggregators Tools

Explore leading tools in the LLM Gateways & Aggregators category, including open-source options and SaaS products. Compare features, use cases, and find the best fit for your workflow.

5 open-source projects · 3 SaaS products

Top open-source LLM Gateways & Aggregators

These projects are active, self-hostable choices for knowledge management teams evaluating alternatives to SaaS tools.

LiteLLM logo

LiteLLM

Unified gateway for all LLM APIs with OpenAI compatibility

Stars
31,904
License
Unknown
Last commit
3 days ago
PythonActive
Portkey AI Gateway logo

Portkey AI Gateway

Fast, secure routing hub for 1600+ AI models

Stars
10,023
License
MIT
Last commit
3 days ago
TypeScriptActive
Higress logo

Higress

Cloud-native API gateway with AI and Wasm extensibility

Stars
6,972
License
Apache-2.0
Last commit
7 days ago
GoActive
Envoy AI Gateway logo

Envoy AI Gateway

Unified gateway for secure, scalable generative AI traffic

Stars
1,239
License
Apache-2.0
Last commit
4 days ago
GoActive
Bifrost logo

Bifrost

Unified AI gateway with instant failover and zero-config startup

Stars
1,203
License
Apache-2.0
Last commit
3 days ago
GoActive
Most starred project
31,904★

Unified gateway for all LLM APIs with OpenAI compatibility

Recently updated
3 days ago

A lightweight gateway that routes requests to over 1,600 language, vision, audio, and image models with sub‑millisecond latency, built‑in retries, guardrails, and enterprise‑grade security.

Dominant language
Go • 3 projects

Expect a strong Go presence among maintained projects.

Popular SaaS Platforms to Replace

Understand the commercial incumbents teams migrate from and how many open-source alternatives exist for each product.

Eden AI logo

Eden AI

Unified API aggregator for AI services across providers

LLM Gateways & Aggregators
Alternatives tracked
5 alternatives
OpenRouter logo

OpenRouter

One API for 400+ AI models with smart routing and unified billing/BYOK

LLM Gateways & Aggregators
Alternatives tracked
5 alternatives
Vercel AI Gateway logo

Vercel AI Gateway

Unified AI gateway for multi-provider routing, caching, rate limits, and observability

LLM Gateways & Aggregators
Alternatives tracked
5 alternatives
Most compared product
5 open-source alternatives

Eden AI offers a single API to multiple AI engines (vision, speech, NLP), selecting the best provider per task and price.

Leading hosted platforms

Frequently replaced when teams want private deployments and lower TCO.

Explore related categories

Browse neighbouring categories in ML & AI to widen your evaluation.