Envoy AI Gateway

Visit official site ↗

Overview

Product details compiled from public sources, each with a citation.

Vendor
Envoy AI Gateway community1agent
Description
Open-source gateway on CNCF Envoy that routes traffic to many LLM providers behind one OpenAI-compatible API, with token quotas, provider failover, and an MCP gateway.4agent
Deployment
Self-hosted2agent
Status
Active4agent

Matrix Coverage

Where this product defends, by asset class and NIST CSF function. The Coverage column shows whether each asset is Primary, Secondary, or Adjacent to what the product does. The table omits empty rows and columns.

Asset class IdentifyProtect Coverage Source
AI Orchestration Tools Secondary 2
AI Gateways and Routers Primary 3

Framework Relevance

These frameworks include controls relevant to the asset classes Envoy AI Gateway defends. This is an editorial inference from the AI Defense Matrix asset-level crossmap, not a statement that Envoy AI Gateway community implements these controls or is certified against them.

Expand Collapse
Framework Asset class Relevant controls
NIST IR 8596 AI Orchestration Tools Agents as deployed artifacts (orchestration view; see AI Agent Identities row for the principal view); system prompts and templates
AI Gateways and Routers AI data flows; APIs; inference endpoints (traffic side); model registries and dataset sources
CSA AI Controls Matrix AI Orchestration Tools Application and Interface Security; Supply Chain Management
AI Gateways and Routers Infrastructure Security; Interoperability and Portability
ISO 42001 AI Orchestration Tools A.6 AI system life cycle; A.5 Assessing impacts of AI systems
AI Gateways and Routers A.8 Information for interested parties; A.9 Use of AI systems; A.10 Third-party and customer relationships
Google SAIF AI Orchestration Tools Secure the AI supply chain; application and pipeline security; agent orchestration controls
AI Gateways and Routers Harden and monitor infrastructure; network-level access and egress controls
SANS Critical AI Security Guidelines AI Orchestration Tools Secure Agentic Systems and AI Autonomy Controls (defined function scope; execution isolation; API and function-call gating); Limit Model Behavior (focused functionality; access controls outside the model)
AI Gateways and Routers Conventional Security Controls (authenticate and control access to inference APIs; API key management); Model I/O Handling (rate limiting; egress output filtering); Monitoring (interaction and API-usage logging)
MITRE ATLAS AI Orchestration Tools AML.T0051 LLM Prompt Injection; AML.T0054 LLM Jailbreak; AML.T0016 Obtain Capabilities (malicious plugins)
AI Gateways and Routers AML.T0057 LLM Data Leakage; AML.T0024 Exfiltration via AI Inference API (network-side observation)
OWASP AI Exchange AI Orchestration Tools Development-time threats: agent framework supply chain; runtime threats: plugin abuse, prompt injection via tools
AI Gateways and Routers Runtime threats: data leakage via AI egress; network-level access control gaps
OWASP LLM Top 10 AI Orchestration Tools LLM01 Prompt Injection; LLM05 Improper Output Handling; LLM07 System Prompt Leakage; LLM10 Unbounded Consumption
AI Gateways and Routers LLM10 Unbounded Consumption (cost and rate control); shadow AI egress and output handling
OWASP Agentic Security Top 10 AI Orchestration Tools ASI01 Agent Goal Hijack; ASI02 Tool Misuse and Exploitation; ASI05 Unexpected Code Execution (RCE); ASI07 Insecure Inter-Agent Communication; ASI08 Cascading Failures; ASI10 Rogue Agents
AI Gateways and Routers ASI07 Insecure Inter-Agent Communication; ASI02 Tool Misuse and Exploitation (egress and tool-invocation scope); ASI04 Agentic Supply Chain Vulnerabilities (MCP and tool-registry trust)

Provenance

Last sourced 2026-07-05.

Expand Collapse

Sources

  1. Envoy AI Gateway
    Vendor source accessed 2026-07-05
    • “Envoy AI Gateway is the result of the community coming together to address GenAI traffic handling needs using Envoy.”
  2. Envoy AI Gateway capabilities
    Vendor source accessed 2026-07-05
    • “Configure multiple controller replicas and horizontal pod autoscaling for production deployments”
    • “Server multiplexing, tool routing, OAuth authentication, and observability for MCP workloads”
  3. envoyproxy/ai-gateway
    Vendor source accessed 2026-07-05
    • “Manages Unified Access to Generative AI Services built on Envoy Gateway”
  4. Envoy AI Gateway reaches 1.0
    Vendor source accessed 2026-07-05
    • “the first stable, production-ready release of the open source AI gateway built on CNCF's Envoy Gateway”
    • “Today, Envoy AI Gateway 1.0 is generally available”

Changelog

  1. Added to the catalog from the Envoy AI Gateway documentation and release notes.

Found an error? Corrections are welcome. Suggest an edit.