Envoy AI Gateway
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to GenAI services.
What it is
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to GenAI services. Envoy AI Gateway is the result of the community coming together to address GenAI traffic handling needs using Envoy. Join our community on Slack, join the conversation on GitHub, and attend our Monday community meetings. See links in footer. Stay up to date with the latest news, features, and insights from the Envoy AI Gateway team. How many AIGatewayRoute resources can Envoy AI Gateway handle? We benchmarked the control plane scaling to 2,000 routes and measured latency, CPU, and memory usage. In this article explore how Envoy AI Gateway handles stateful MCP sessions, keeps performance competitive, and stays aligned with the broader Envoy ecosystem. Envoy AI Gateway now supports Model Context Protocol (MCP), bringing enterprise-grade security, routing, and observability to AI agent tool integrations with full spec compliance, OAuth authentication, and zero-friction deployment. See who's using Envoy AI Gateway. Using Envoy AI Gateway? We'd love to feature your logo!
What to verify before adopting
- Confirm current pricing, usage limits, supported regions, and contract terms on the official website.
- Test integrations, export paths, access controls, and failure recovery with low-risk data first.
- Review privacy, data retention, security, and compliance requirements for your market.
- Keep a migration or rollback plan before making the product part of a critical workflow.