
Amazon API Gateway
Fully managed service to create, publish, and secure APIs at any scale for backend access
Discover top open-source software, updated regularly with real-world adoption signals.

Dynamic, high-performance API gateway for modern cloud and AI workloads
Apache APISIX delivers real-time traffic management, load balancing, security, and observability across HTTP, gRPC, TCP/UDP, and AI services, with hot-reload plugins and cloud-native deployment options.

Apache APISIX is a real-time, high‑performance API gateway that handles north‑south and east‑west traffic for microservices, AI models, and traditional web APIs. It supports a wide range of protocols—including HTTP/HTTPS, gRPC, WebSocket, TCP/UDP, MQTT, Dubbo, and HTTP/3 with QUIC—allowing heterogeneous services to be exposed through a single entry point.
The gateway offers dynamic routing, canary releases, A/B testing, circuit breaking, and token‑based rate limiting, all configurable via hot‑reload without service interruption. Security is reinforced with JWT, OAuth, RBAC, IP/Referer whitelists, and CSRF protection. Observability integrates natively with Prometheus, Zipkin, SkyWalking, and multiple external loggers. APISIX runs statelessly, scaling horizontally across bare metal or Kubernetes clusters, and relies on etcd or compatible service‑discovery backends for configuration storage.
Through its plugin system, APISIX can act as an AI gateway, providing LLM load balancing, retries, fallbacks, and token‑rate controls, ensuring reliable and efficient AI agent interactions.
When teams consider Apache APISIX, these hosted platforms usually appear on the same shortlist.

Fully managed service to create, publish, and secure APIs at any scale for backend access

Fully managed multicloud API management service for publishing, securing, and monitoring APIs across environments

API management platform to publish, secure, and analyze APIs
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
AI model serving gateway
Balances LLM requests, applies token-based throttling, and retries failed calls, ensuring consistent latency for AI applications.
Multi-protocol microservice ingress
Routes HTTP, gRPC, and MQTT traffic to appropriate services with dynamic load balancing and health checks.
Canary deployment for new API version
Gradually shifts a percentage of traffic to the new version while monitoring error rates, enabling safe rollouts.
Zero-downtime configuration updates
Updates routing rules and plugins on the fly without restarting services, maintaining uninterrupted API availability.
Configuration and plugins are stored in etcd; APISIX watches for changes and applies them in-process, so updates take effect instantly without restarting the gateway.
HTTP/HTTPS, gRPC, gRPC-Web, WebSocket, TCP, UDP, MQTT (3.1.*, 5.0), Dubbo, and HTTP/3 with QUIC.
Yes, it provides a native ingress controller and Helm charts for deployment on Kubernetes clusters.
Prometheus for metrics, Zipkin and SkyWalking for tracing, and various external loggers such as Elasticsearch, ClickHouse, and Datadog.
Key-auth, JWT, basic-auth, OAuth via external IdPs (Keycloak, Auth0, Okta), RBAC plugins like casbin, and IP/Referer whitelists.
Project at a glance
ActiveLast synced 4 days ago