Category

LLM firewalls & guardrails: 26 tools compared

Guardrails are checks in the request path that screen what goes into and comes out of a model: libraries, open-weight safety models, cloud APIs and gateways. They exist because an injected instruction or a leaked secret in live traffic is stopped only if something inspects it. No detector catches every attack.

  • 26 tools
  • Last reviewed

Part of layer 6 in our AI security layers: Runtime guardrails. 11 tools from other categories also cover this layer.

Executive summary

What it is
Checks in the request path that screen prompts, retrieved content and model responses for prompt injection, jailbreaks, sensitive data and unsafe output, sold as libraries, safety models, cloud APIs or gateways.
The risk
A model that reads untrusted text can be steered into ignoring its instructions, leaking data or producing output that a browser, database or tool then acts on. OWASP says fool-proof prevention of prompt injection may not exist.
What to buy or do
Put one screening point, owned by a named team, in front of every production LLM endpoint. Pick the deployment shape first, then evaluate shortlisted tools on your own traffic for misses, false alarms and latency.

Quick picks

The highest Coverage Scores in this category. The score measures what each vendor documents publicly; it is not an endorsement and it does not measure detection quality.

Open sourceApache-2.0
  • Library
  • Self-hosted
  • API

Adds programmable input, dialog, retrieval, execution and output rails to LLM applications.

Best for: Teams that want to script rules for one LLM application in Python and run them in their own infrastructure

Coverage Score 76 out of 100
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM06 Excessive Agency

Reviewed

Portkey AI Gateway

Palo Alto Networks (Portkey)

Open sourceMIT Freemium Now Prisma AIRS AI Gateway
  • SaaS
  • Self-hosted
  • API

Routes LLM traffic through one gateway API and runs input and output guardrail checks on each request.

Best for: Teams that want a single gateway for several LLM providers with guardrail checks, available as open source or as a hosted service

Coverage Score 69 out of 100
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM09 Misinformation

Reviewed

Open sourceApache-2.0
  • Self-hosted
  • SaaS
  • API

Routes LLM traffic through Kong with prompt guards, PII sanitization, spend limits and observability.

Best for: Teams that already run Kong as an API gateway and want LLM routing and prompt controls on the same data plane

Coverage Score 65 out of 100
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM10 Unbounded Consumption

Reviewed

All 26 guardrails tools

Sorted by Coverage Score within the category. Tools cross-listed from another category carry an "Also covers" label.

Also covers layer
Type
Deployment
OWASP risk
Pricing model

Showing 26 of 26 tools

LLM firewalls & guardrails: 26 tools compared
Tool Type Deployment Pricing model OWASP risks Coverage Score Last reviewed
NeMo GuardrailsNVIDIA Open sourceApache-2.0
  • Library
  • Self-hosted
  • API
Free
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM06 Excessive Agency
76 out of 100
PortkeyPalo Alto Networks (Portkey) Now Prisma AIRS AI Gateway Open sourceMIT
  • SaaS
  • Self-hosted
  • API
Freemium
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM09 Misinformation
69 out of 100
Kong AI GatewayKong Open sourceApache-2.0
  • Self-hosted
  • SaaS
  • API
Usage-based
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM10 Unbounded Consumption
65 out of 100
Bedrock GuardrailsAmazon Web Services Commercial
  • API
  • Cloud-native
  • Managed service
Usage-based
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM09 Misinformation
60 out of 100
Granite GuardianIBM Open sourceApache-2.0
  • Self-hosted
  • Library
Free
  • LLM01 Prompt Injection
  • LLM06 Excessive Agency
  • LLM09 Misinformation
57 out of 100
Lakera GuardCheck Point (Lakera) Now Check Point AI Guardrails Commercial
  • SaaS
  • Self-hosted
  • API
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM06 Excessive Agency
  • LLM07 System Prompt Leakage
57 out of 100
Llama ProtectionsMeta Open, custom license
  • Library
  • Self-hosted
Free
  • LLM01 Prompt Injection
  • LLM05 Improper Output Handling
  • LLM06 Excessive Agency
56 out of 100
Azure AI Content SafetyMicrosoft Renamed Commercial
  • API
  • Cloud-native
  • Managed service
Freemium
  • LLM01 Prompt Injection
  • LLM06 Excessive Agency
  • LLM09 Misinformation
55 out of 100
Guardrails AIGuardrails AI Open sourceApache-2.0
  • Library
  • Self-hosted
  • API
Free
  • LLM05 Improper Output Handling
  • LLM09 Misinformation
52 out of 100
Qwen3GuardAlibaba Cloud Open sourceApache-2.0
  • Self-hosted
  • Library
Free
  • LLM01 Prompt Injection
50 out of 100
Cloudflare AI GatewayCloudflare Commercial
  • Cloud-native
  • Managed service
  • API
Freemium
  • LLM02 Sensitive Information Disclosure
  • LLM10 Unbounded Consumption
48 out of 100
Pangea AI GuardCrowdStrike (Pangea) Commercial
  • SaaS
  • Self-hosted
  • API
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM06 Excessive Agency
  • LLM08 Vector and Embedding Weaknesses
48 out of 100
Vigildeadbits Open sourceApache-2.0
  • Library
  • Self-hosted
  • API
Free
  • LLM01 Prompt Injection
  • LLM07 System Prompt Leakage
48 out of 100
Cisco AI DefenseCisco Commercial
  • API
  • Self-hosted
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM06 Excessive Agency
47 out of 100
Model ArmorGoogle Cloud Commercial
  • API
  • Cloud-native
  • Managed service
Usage-based
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
44 out of 100
gpt-oss-safeguardOpenAI Open sourceApache-2.0
  • Self-hosted
  • Library
Free None mapped 44 out of 100
AliceAlice Commercial
  • API
  • Library
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
42 out of 100
Radware LLM FirewallRadware Commercial
  • SaaS
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM10 Unbounded Consumption
41 out of 100
Lasso SecurityLasso Security Commercial
  • API
  • Self-hosted
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
39 out of 100
HiddenLayer AIDRHiddenLayer Commercial
  • SaaS
  • On-prem
  • Self-hosted
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM06 Excessive Agency
37 out of 100
CalypsoAIF5 (CalypsoAI) Now F5 AI Guardrails Commercial
  • Self-hosted
  • On-prem
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM06 Excessive Agency
32 out of 100
Firewall for AICloudflare Now AI Security for Apps Commercial
  • Cloud-native
  • Managed service
Contact sales
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
29 out of 100
Prompt SecuritySentinelOne (Prompt Security) Commercial
  • Browser extension
  • API
Not published
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM06 Excessive Agency
29 out of 100
Invariant GuardrailsSnyk (Invariant Labs) Also covers Open sourceApache-2.0
  • Library
Free
  • LLM01 Prompt Injection
  • LLM06 Excessive Agency
54 out of 100
LLM GuardPalo Alto Networks (Protect AI) Archived Open sourceMIT
  • Library
  • Self-hosted
  • API
Free
  • LLM01 Prompt Injection
  • LLM02 Sensitive Information Disclosure
  • LLM05 Improper Output Handling
  • LLM10 Unbounded Consumption
66 out of 100
RebuffPalo Alto Networks (Protect AI) Archived Open sourceApache-2.0
  • Library
  • Self-hosted
  • API
Free
  • LLM01 Prompt Injection
  • LLM07 System Prompt Leakage
42 out of 100

OWASP LLM risks we weigh in this category

Risk coverage is 25 of 100 Coverage Score points. A tool earns them only for risks mapped to a capability the sources document.

How to choose

Decide the deployment shape first: it sets who runs the check, where your prompts go and how much you can tune. Then match tools to the risks your application faces.

Setup

  • Pick a shape. Libraries run inside your code, open-weight safety models run on your hardware, cloud APIs and hosted platforms run on the vendor's side, and gateways sit in the request path. The table above lists each tool's deployment, license and pricing model.
  • Decide what to screen. Input checks catch injected instructions before the model sees them. Output checks are needed wherever model text reaches a browser, a database or a tool call (LLM05 improper output handling).
  • Choose the risks. We weigh LLM01 prompt injection, LLM02, LLM05, LLM07, LLM09 and LLM10 in this category. Rank them by your application's exposure and shortlist tools that document checks for your top two or three.

Integration

  • Check the integrations listed on each tool page for your model provider, gateway and agent framework.
  • A hosted service processes your prompts and responses. Read the vendor's data handling pages before you route production traffic through it.
  • Guardrails screen content. Limits on what an agent may do belong to the agent and tool access layer, and probing before release to the testing and red teaming layer.

Limits

Detection is probabilistic. OWASP says it is unclear whether fool-proof prevention of prompt injection exists, and its mitigations put least privilege, validated output formats and human approval for high-risk actions next to input and output filtering. The Coverage Score measures how much a vendor documents, not detection accuracy, false positives or latency, so evaluate shortlisted tools on your own traffic before you commit. See how the score works.

Guardrails FAQ

What is the difference between an LLM guardrail and an LLM firewall?

Both screen traffic to and from a model. Some products use the firewall label when the check sits in the request path, as a gateway or a web application firewall rule, but the checks can be the same. Compare what each product documents, not the label.

Do guardrails stop prompt injection?

They reduce it, but they cannot be the only control. OWASP says it is unclear whether fool-proof prevention of prompt injection exists. Pair detection with least privilege, validated output formats and human approval for high-risk actions.

Should I use an open-source library or a managed service?

Choose by who will run and tune the checks. A library or model you host keeps traffic in your environment, and your team operates it. A managed service leaves less to run but processes your traffic. The table on this page lists license, deployment and pricing model for each option.

Where do guardrails sit in the request path?

Input checks run before the prompt reaches the model. Output checks run before the response reaches the user or a downstream system. A gateway can apply both in one place, while a library runs inside your application code.

Can guardrails stop sensitive data from leaking?

They can screen prompts and responses for personal data and secrets, which helps with LLM02. They do not replace access control: OWASP's mitigations for that risk also include least-privilege access to data and keeping user data out of training.

Does the Coverage Score show which guardrail detects attacks best?

No. The Coverage Score measures how much a vendor documents publicly, such as capabilities, deployment options and documentation. We do not run these products, so it says nothing about detection accuracy, false positives or latency.

Sources & last reviewed

Last reviewed . We compile from the vendors' own public pages and repositories and we do not run the products. Source links open in a new tab. Found a mistake? Report a correction.

NVIDIA NeMo Guardrails (5 sources)
Portkey AI Gateway (4 sources)
Kong AI Gateway (4 sources)
Amazon Bedrock Guardrails (3 sources)
IBM Granite Guardian (4 sources)
Lakera Guard (4 sources)
Meta Llama Protections (5 sources)
Azure AI Content Safety (5 sources)
Guardrails AI (3 sources)
Qwen3Guard (3 sources)
Cloudflare AI Gateway (4 sources)
Pangea AI Guard (3 sources)
Vigil (2 sources)
Cisco AI Defense (3 sources)
Google Cloud Model Armor (2 sources)
OpenAI gpt-oss-safeguard (3 sources)
Alice WonderSuite (3 sources)
Radware LLM Firewall (3 sources)
Lasso Security (3 sources)
HiddenLayer AI Runtime Security (AIDR) (3 sources)
CalypsoAI (F5 AI Guardrails) (2 sources)
Cloudflare Firewall for AI (AI Security for Apps) (1 sources)
Prompt Security (3 sources)
Invariant Guardrails (4 sources)
LLM Guard (3 sources)
Rebuff (2 sources)