Eden AI
Unified API aggregator for AI services across providers
Open-Source Projects
Discover top open-source software, updated regularly with real-world adoption signals.
Discover top open-source software, updated regularly with real-world adoption signals.
Fast, secure routing hub for 1600+ AI models
A lightweight gateway that routes requests to over 1,600 language, vision, audio, and image models with sub‑millisecond latency, built‑in retries, guardrails, and enterprise‑grade security.
The AI Gateway provides developers and AI product teams a single, OpenAI‑compatible endpoint to access over 1,600 language, vision, audio, and image models. With a tiny 122 KB binary and sub‑millisecond latency, it can be spun up locally in minutes or deployed privately on any major cloud platform, making it suitable from prototype to enterprise scale.
Routing logic lets you balance traffic, set conditional routes, and define automatic retries or fallbacks to keep applications resilient. Built‑in guardrails and compliance certifications (SOC 2, HIPAA, GDPR, CCPA) protect data and enforce content policies. Cost‑saving features such as smart caching and provider optimization reduce spend, while usage analytics give visibility into latency, error rates, and token consumption. The gateway also integrates with popular agent frameworks—LangChain, CrewAI, Autogen, LlamaIndex—and supports multi‑modal calls, enabling text, image, speech, and realtime APIs through the same interface.
When teams consider Portkey AI Gateway, these hosted platforms usually appear on the same shortlist.
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
Unified multi‑modal API for a SaaS product
Developers call text, image, and speech models through one endpoint, reducing code complexity and latency.
Failover strategy for mission‑critical chatbots
Automatic retries and provider fallbacks keep the bot responsive even when a primary LLM experiences downtime.
Cost‑optimized model selection
Smart caching and provider optimization lower API spend while maintaining response quality.
Enterprise governance of AI usage
RBAC, guardrails, and audit logs enforce policy compliance across all internal AI applications.
Any provider that offers an OpenAI‑compatible endpoint, including OpenAI, Anthropic, Bedrock, Groq, Nvidia NIM, and many vision/audio services.
Yes, the guardrail system lets you define input/output checks from 40+ pre‑built rules or custom policies.
It processes over 10 B tokens daily, offers load balancing, retries, and enterprise‑grade security, making it production‑ready.
Private deployments on AWS, Azure, GCP, OpenShift, or Kubernetes, with full org management and compliance features.
Project at a glance
ActiveLast synced 4 days ago
