Envoy AI Gateway
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
Technical Profile & Specs
verified 2026-11-07
- Cost
- $0 / forever (Open Source)
- License
- Open Source
- Hosting Model
- Local (on your machine)
- Platforms
- desktopcross-platformone-click install
- Installation
- Clone https://github.com/envoyproxy/ai-gateway or deploy with Docker Compose
- Operational Setup
- Download the native package or installer for your operating system.
- Where Your Data Lives
- All application data lives locally on your own machine.
- The Catch / Trade-off
- Community-driven open source project without dedicated enterprise SLAs.
Replaces 6 paid apps
up to $150/mo ($1,800/yr) in subscriptions
Envoy AI Gateway FAQ
Common questions
Is Envoy AI Gateway free and open source?+
Envoy AI Gateway is an open-source tool licensed under Open Source that runs on local. Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
What paid software does Envoy AI Gateway replace?+
Envoy AI Gateway serves as a free replacement for 6 paid SaaS applications: Cloudflare AI Gateway, Eden AI, Kong AI Gateway, Msty Nexus, Requesty, Vercel AI Gateway, saving up to $150/month ($1,800/year) in subscription bills.
How do you install and set up Envoy AI Gateway?+
Installation: Clone https://github.com/envoyproxy/ai-gateway or deploy with Docker Compose. Setup notes: Download the native package or installer for your operating system.
What is the catch or trade-off with Envoy AI Gateway?+
Community-driven open source project without dedicated enterprise SLAs.