AI Defense Matrix Catalog

Promptfoo

Visit official site ↗

Overview

Product details compiled from public sources, each with a citation.

Vendor
Promptfoo2
Description
Open-source CLI and library for evaluating and red-teaming LLM applications, generating application-specific attacks such as prompt injections, jailbreaks, and data and PII leaks.2
Deployment
Self-hosted1
Status
Acquired3
Acquisition
Acquired by OpenAI, announced 2026-03-09. It now operates as a standalone product.3

Matrix Coverage

Where this product defends, by asset class and NIST CSF function. The Coverage column shows whether each asset is Primary, Secondary, or Adjacent to what the product does. The table omits empty rows and columns.

Asset class Detect Coverage
AI Orchestration Tools Secondary 2
AI Model Primary 2

Framework Relevance

These frameworks include controls relevant to the asset classes Promptfoo defends. This is an editorial inference from the AI Defense Matrix asset-level crossmap, not a statement that Promptfoo implements these controls or is certified against them.

Expand Collapse
Framework Asset class Relevant controls
NIST IR 8596 AI Orchestration Tools Agents as deployed artifacts (orchestration view; see AI Agent Identities row for the principal view); system prompts and templates
AI Model Models; Algorithms (model configuration)
CSA AI Controls Matrix AI Orchestration Tools Application and Interface Security; Supply Chain Management
AI Model Model Security; Governance, Risk and Compliance
ISO 42001 AI Orchestration Tools A.6 AI system life cycle; A.5 Assessing impacts of AI systems
AI Model A.6 AI system life cycle; A.10 Third-party and customer relationships; A.5 Assessing impacts of AI systems
Google SAIF AI Orchestration Tools Secure the AI supply chain; application and pipeline security; agent orchestration controls
AI Model Protect the AI model; ensure model integrity, provenance, and weight security
SANS Critical AI Security Guidelines AI Orchestration Tools Secure Agentic Systems and AI Autonomy Controls (defined function scope; execution isolation; API and function-call gating); Limit Model Behavior (focused functionality; access controls outside the model)
AI Model Conventional Security Controls (protect model parameters with least privilege, encryption at rest, runtime obfuscation, and trusted execution environments); Data/Model Engineering Controls (adversarial training; alignment and fine-tuning); AI Supply Chain Management (public-model caution; transfer-attack exposure)
MITRE ATLAS AI Orchestration Tools AML.T0051 LLM Prompt Injection; AML.T0054 LLM Jailbreak; AML.T0016 Obtain Capabilities (malicious plugins)
AI Model AML.T0043 Craft Adversarial Data; AML.T0024 Exfiltration via AI Inference API (subtechniques: AML.T0024.001 Invert AI Model and AML.T0024.002 Extract AI Model); AML.T0018 Manipulate AI Model (integrity and backdoor)
OWASP AI Exchange AI Orchestration Tools Development-time threats: agent framework supply chain; runtime threats: plugin abuse, prompt injection via tools
AI Model Development-time and runtime model threats: model inversion, extraction, evasion, poisoning
OWASP LLM Top 10 AI Orchestration Tools LLM01 Prompt Injection; LLM05 Improper Output Handling; LLM07 System Prompt Leakage; LLM10 Unbounded Consumption
AI Model LLM03 Supply Chain; LLM04 Data and Model Poisoning; LLM09 Misinformation
OWASP Agentic Security Top 10 AI Orchestration Tools ASI01 Agent Goal Hijack; ASI02 Tool Misuse and Exploitation; ASI05 Unexpected Code Execution (RCE); ASI07 Insecure Inter-Agent Communication; ASI08 Cascading Failures; ASI10 Rogue Agents
AI Model ASI04 Agentic Supply Chain Vulnerabilities (model provenance, weights, and dynamic loading)

Provenance

Last sourced 2026-07-17.

Expand Collapse

Sources

  1. Promptfoo repository
    Vendor source accessed 2026-06-09
  2. Promptfoo
    Vendor source accessed 2026-06-09
    • “Promptfoo simulates real users to uncover application-specific vulnerabilities”
    • “Automated red teaming for agents & RAGs”
  3. Promptfoo is joining OpenAI
    Vendor source accessed 2026-06-09

Changelog

  1. Added to the catalog from the Promptfoo documentation. Recorded the OpenAI acquisition announced in March 2026 and since completed, with the product staying open source.

Found an error? Corrections are welcome. Suggest an edit.