AI Defense Matrix Catalog

LiteLLM

Visit official site ↗

Overview

Product details compiled from public sources, each with a citation.

Vendor
BerriAI2
Description
Open-source AI gateway and proxy for 100+ LLM providers, adding virtual-key RBAC, budgets, rate limits, guardrails (PII masking, prompt-injection), and enterprise SSO and audit logs.2
Deployment
Self-hosted, SaaS2
Status
Active2

Matrix Coverage

Where this product defends, by asset class and NIST CSF function. The Coverage column shows whether each asset is Primary, Secondary, or Adjacent to what the product does. The table omits empty rows and columns.

Asset class IdentifyProtectDetect Coverage
AI Gateways and Routers Primary 3
Runtime AI Data Secondary 1

Framework Relevance

These frameworks include controls relevant to the asset classes LiteLLM defends. This is an editorial inference from the AI Defense Matrix asset-level crossmap, not a statement that BerriAI implements these controls or is certified against them.

Expand Collapse
Framework Asset class Relevant controls
NIST IR 8596 AI Gateways and Routers AI data flows; APIs; inference endpoints (traffic side); model registries and dataset sources
Runtime AI Data Prompts (runtime); inference data
CSA AI Controls Matrix AI Gateways and Routers Infrastructure Security; Interoperability and Portability
Runtime AI Data Data Security and Privacy Lifecycle Management; Application and Interface Security
ISO 42001 AI Gateways and Routers A.8 Information for interested parties; A.9 Use of AI systems; A.10 Third-party and customer relationships
Runtime AI Data A.7 Data for AI systems; A.8 Information for interested parties
Google SAIF AI Gateways and Routers Harden and monitor infrastructure; network-level access and egress controls
Runtime AI Data Expand AI red-teaming; runtime input and output safety; prompt defense
SANS Critical AI Security Guidelines AI Gateways and Routers Conventional Security Controls (authenticate and control access to inference APIs; API key management); Model I/O Handling (rate limiting; egress output filtering); Monitoring (interaction and API-usage logging)
Runtime AI Data Model I/O Handling (sanitize, validate, and filter inputs and outputs; segregate user and system prompts; multilayered prompt-injection defense); Conventional Security Controls (protect augmentation and RAG data with vector-store access controls and validation); Data Minimization and Obfuscation (limit sensitive prompt content; context-window management); Limit Model Behavior (AI guardrails)
MITRE ATLAS AI Gateways and Routers AML.T0057 LLM Data Leakage; AML.T0024 Exfiltration via AI Inference API (network-side observation)
Runtime AI Data AML.T0051 LLM Prompt Injection; AML.T0054 LLM Jailbreak; AML.T0056 Extract LLM System Prompt
OWASP AI Exchange AI Gateways and Routers Runtime threats: data leakage via AI egress; network-level access control gaps
Runtime AI Data Input threats: prompt injection, adversarial inputs, evasion; runtime threats: RAG poisoning, memory tampering
OWASP LLM Top 10 AI Gateways and Routers LLM10 Unbounded Consumption (cost and rate control); shadow AI egress and output handling
Runtime AI Data LLM01 Prompt Injection; LLM02 Sensitive Information Disclosure; LLM08 Vector and Embedding Weaknesses; LLM05 Improper Output Handling
OWASP Agentic Security Top 10 AI Gateways and Routers ASI07 Insecure Inter-Agent Communication; ASI02 Tool Misuse and Exploitation (egress and tool-invocation scope); ASI04 Agentic Supply Chain Vulnerabilities (MCP and tool-registry trust)
Runtime AI Data ASI06 Memory & Context Poisoning; ASI01 Agent Goal Hijack (via prompt injection in runtime inputs)

Provenance

Last sourced 2026-06-09.

Expand Collapse

Sources

  1. LiteLLM Guardrails Quick Start
    Vendor source accessed 2026-07-04
    • “Setup Prompt Injection Detection, PII Masking on LiteLLM Proxy (AI Gateway)”
  2. LiteLLM
    Vendor source accessed 2026-06-09
  3. LiteLLM Enterprise
    Vendor source accessed 2026-07-04
    • “LiteLLM Enterprise adds: SSO, SCIM 24/7 Support OIDC/JWT-Auth Live upgrade assistance Team/Org Admins Key/Team-based Guardrails Secret Managers Key Rotations”

Changelog

  1. Added verbatim source quotes to coverage and compliance citations.

  2. Refined matrix coverage.

  3. Added to the catalog from the LiteLLM documentation.

Found an error? Corrections are welcome. Suggest an edit.