Eden AI
Unified API aggregator for AI services across providers
Open-Source Projects
Discover top open-source software, updated regularly with real-world adoption signals.
Discover top open-source software, updated regularly with real-world adoption signals.
Cloud-native API gateway with AI and Wasm extensibility
Higress is a cloud-native API gateway built on Istio and Envoy, offering AI model routing, MCP server hosting, and extensible Wasm plugins for traffic, security, and observability.
Higress delivers a production‑grade API gateway that combines the robustness of Istio/Envoy with AI‑focused capabilities. It unifies access to major LLM providers, supports the Model Context Protocol (MCP) for tool integration, and provides a rich UI console for management and observability.
Developers can launch a full instance with a single Docker command or deploy via Helm in Kubernetes. The gateway’s plugin architecture relies on WebAssembly, allowing safe, hot‑updatable extensions written in Go, Rust, or JavaScript. Built‑in plugins cover traffic management, security (WAF, auth), and AI‑specific functions, meeting most enterprise scenarios out of the box.
Ideal for teams building AI agents, microservice platforms, or secure ingress points that need high‑throughput, low‑latency streaming and fine‑grained rate limiting. Enterprises benefit from Alibaba’s production validation and optional enterprise support.
When teams consider Higress, these hosted platforms usually appear on the same shortlist.
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
MCP Server Hosting
Host remote MCP servers via Wasm plugins, enabling AI agents to invoke tools with unified auth, rate limiting, and audit logging.
AI Model Routing
Connect to multiple LLM providers through a single gateway, applying token rate limits, caching, and multi‑model load balancing.
Kubernetes Ingress Controller
Replace Nginx ingress with Higress, leveraging familiar annotations while gaining AI‑aware traffic management.
Security Gateway
Enforce WAF, JWT, OIDC, and other authentication strategies with built‑in plugins and automatic TLS management.
Run the provided Docker command; it pulls the all‑in‑one image, writes config to the current directory, and exposes UI (8001) and gateway ports (8080/8443).
Higress supports all mainstream model providers, both domestic and international, via a unified protocol.
Yes, you can develop Wasm plugins in Go, Rust, or JavaScript and load them through the plugin mechanism.
Enterprise‑level support is offered by contacting the project maintainer via the listed email or social media accounts.
Kubernetes is optional; Higress can run as a standalone Docker container, though Helm charts are provided for K8s deployments.
Project at a glance
ActiveLast synced 4 days ago
