Category

Model & ML supply-chain security: 10 tools compared

Supply-chain tools scan model files, sign and verify artifacts, offer safer formats and record what went into a model before it runs in your environment. They matter because a pickle-based model file can run code the moment it is loaded, so a downloaded model is untrusted code.

  • 10 tools
  • Last reviewed

Part of layer 3 in our AI security layers: Model and supply chain. 8 tools from other categories also cover this layer.

Executive summary

What it is
Scanners, signing tools, safe file formats and AI bill of materials tools that check model files, datasets and ML dependencies before they are loaded, published or promoted to a registry.
The risk
Python's documentation warns that malicious pickle data can execute arbitrary code during unpickling, and OWASP names malicious pickling as a way a model runs harmful code when loaded. One unchecked download can compromise a build or serving host.
What to buy or do
Scan every model file in CI before it enters your registry, prefer formats that store only tensors, such as safetensors, and verify signatures or hashes from publishers you trust.

Quick picks

The highest Coverage Scores in this category. The score measures what each vendor documents publicly; it is not an endorsement and it does not measure detection quality.

ModelAudit (Promptfoo)

OpenAI (Promptfoo)

Open sourceMIT
  • CLI
  • Library
  • Self-hosted

Scans model files for malicious code, backdoor indicators and unsafe operations without loading them.

Best for: Teams that want a free scanner covering many model and archive formats, with SARIF output for code scanning in CI

Coverage Score 86 out of 100
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning

Reviewed

ModelScan

Palo Alto Networks (Protect AI)

Open sourceApache-2.0
  • CLI
  • Library

Scans saved ML model files for unsafe serialized code before you load them, from a CLI or Python.

Best for: ML and platform teams that want a free scanner to check downloaded or internally produced model files before loading or deploying them

Coverage Score 84 out of 100
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning

Reviewed

Open sourceApache-2.0
  • CLI
  • Library

Signs machine learning model files and verifies them later so tampering can be detected.

Best for: Teams that publish or consume models and want a free way to sign model files and check signatures before loading them

Coverage Score 78 out of 100
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning

Reviewed

All 10 supply chain tools

Sorted by Coverage Score within the category. Tools cross-listed from another category carry an "Also covers" label.

Also covers layer
Type
Deployment
OWASP risk
Pricing model

Showing 10 of 10 tools

Model & ML supply-chain security: 10 tools compared
Tool Type Deployment Pricing model OWASP risks Coverage Score Last reviewed
ModelAuditOpenAI (Promptfoo) Open sourceMIT
  • CLI
  • Library
  • Self-hosted
Free
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning
86 out of 100
ModelScanPalo Alto Networks (Protect AI) Open sourceApache-2.0
  • CLI
  • Library
Free
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning
84 out of 100
model-transparencySigstore Open sourceApache-2.0
  • CLI
  • Library
Free
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning
78 out of 100
picklescanMatthieu Maitre Open sourceMIT
  • CLI
  • Library
Free
  • LLM03 Supply Chain
73 out of 100
FicklingTrail of Bits Open sourceLGPL-3.0
  • CLI
  • Library
Free
  • LLM03 Supply Chain
68 out of 100
HiddenLayer ScannerHiddenLayer Commercial
  • SaaS
  • Self-hosted
Not published
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning
58 out of 100
safetensorsPyTorch Foundation (Linux Foundation) Open sourceApache-2.0
  • Library
Free
  • LLM03 Supply Chain
58 out of 100
JFrog ML SecurityJFrog Commercial
  • SaaS
  • Self-hosted
Paid
  • LLM03 Supply Chain
53 out of 100
Hub scanningHugging Face Commercial
  • SaaS
Included with platform
  • LLM03 Supply Chain
42 out of 100
Prisma AIRSPalo Alto Networks Also covers Commercial
  • SaaS
  • Cloud-native
  • API
Not published
  • LLM02 Sensitive Information Disclosure
  • LLM03 Supply Chain
  • LLM04 Data and Model Poisoning
44 out of 100

OWASP LLM risks we weigh in this category

Risk coverage is 25 of 100 Coverage Score points. A tool earns them only for risks mapped to a capability the sources document.

How to choose

Decide what you are protecting: the files you download, the files you publish or the pipeline in between. Tools here do four jobs: scan model files, sign and verify artifacts, provide safer formats and record an AI bill of materials.

Setup

  • List the formats you load. Python's pickle module can run code while it loads data, and the Python documentation says to unpickle only data you trust. Pickle-based files need a scanner that reads them without running them, or a switch to a format such as safetensors that stores tensors only.
  • Choose where the check runs: in CI before a model enters a registry, at download time or inside the registry.
  • Choose the risks. We weigh LLM03 supply chain and LLM04 data and model poisoning here, so a tool can score well while covering only one of them.

Integration

  • For provenance, OWASP's supply chain guidance recommends model integrity checks with signing and file hashes, and a signed, up-to-date inventory of components.
  • For an AI or ML bill of materials, OWASP suggests starting with CycloneDX, whose ML-BOM records models, datasets and their dependencies.
  • MCP servers and tool descriptions are outside components too. Scanning them is covered in the agent and tool access layer.

Limits

A scanner looks for known patterns. Hugging Face's pickle scanning page says its scans are not 100% foolproof and that users remain responsible for judging whether a file is safe. Combine scanning with trusted sources, signing and sandboxed loading. A model can also behave badly without any malicious file content, which is a job for the testing and red teaming layer.

Supply chain FAQ

Can a model file contain malware?

Yes, some formats can. Python's pickle module can execute arbitrary code while data is loaded, and OWASP's data and model poisoning page names malicious pickling as a way a model can run harmful code when it is loaded. Formats that store only tensors, such as safetensors, avoid that route.

Is safetensors safe?

Safetensors stores tensors without running code, unlike pickle. That protects the file format only. It does not tell you whether the model's behavior can be trusted, so you still need provenance checks and evaluation.

What is the difference between model scanning and model signing?

Scanning inspects a file for known risky content. Signing shows where a file came from and that it has not changed since it was signed. Use both: a clean scan says nothing about origin, and a valid signature says nothing about content.

What is an AI bill of materials?

It is a list of the datasets, models and settings that went into an AI system, with their dependencies. CycloneDX describes its ML-BOM as a way to capture this information for transparency and risk review.

Do scanners guarantee a model is safe?

No. A scanner finds known patterns, and Hugging Face says its own scans are not 100% foolproof. Treat a clean scan as one signal next to trusted sources, signing and sandboxed loading.

Which OWASP risks does this category cover?

We weigh LLM03 Supply Chain and LLM04 Data and Model Poisoning. Each tool page shows which of them a tool maps to and the documented capability behind it. The mapping is our analysis.

Sources & last reviewed

Last reviewed . We compile from the vendors' own public pages and repositories and we do not run the products. Source links open in a new tab. Found a mistake? Report a correction.

ModelAudit (Promptfoo) (3 sources)
ModelScan (3 sources)
Sigstore model-transparency (model-signing) (3 sources)
picklescan (3 sources)
Fickling (3 sources)
HiddenLayer Model Scanner (AI Supply Chain Security) (4 sources)
safetensors (4 sources)
JFrog ML Model Security (Xray and AI Catalog) (3 sources)
Hugging Face Hub malware and pickle scanning (2 sources)
Palo Alto Networks Prisma AIRS (3 sources)