AI red teaming & LLM evaluation
Augustus is an open-source Go LLM vulnerability scanner from Praetorian. It is released under the Apache-2.0 license and is offered as: CLI, Self-hosted.
Best for
Security teams that want a free single-binary scanner to probe models and LLM endpoints with jailbreaks, prompt injection and multi-turn attacks
Augustus is an open-source LLM vulnerability scanner from Praetorian, written in Go and built as a single binary. It runs a library of probes against a target model, covering jailbreaks, prompt injection, data extraction and other attack types, and scores the replies with detectors. The README lists connectors for 28 providers, including OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Google Vertex AI, Hugging Face and LiteLLM. Buffs transform probes into new variants, and multi-turn strategies include Crescendo, GOAT, Hydra and Mischievous User. Results come as a table, JSON, JSONL or HTML. It is licensed Apache-2.0. It is a scanner you point at a model, not an inline filter for live traffic.
This summary is our own wording of the sourced facts on this page.
Each value links to the page that states it, with the date we checked it.
As documented by the vendor or project. The tag is our label from a controlled vocabulary.
Our editorial model, not a standard. The primary layer follows the category, except for tools whose main documented job is detection and response; other layers rest on a capability the sources document. How the model works.
| Layer | Role | How it applies | Based on |
|---|---|---|---|
| L4 Testing Testing and red teaming | Primary | Attack and evaluate models, apps and agents on purpose, before release and after every change, to find what the other layers miss. | Follows its category, AI red teaming & LLM evaluation |
The risk list is OWASP's (Top 10 for LLM Applications, 2025). The mapping is our analysis, and each row rests on a capability the sources document.
| Risk | How it applies | Based on |
|---|---|---|
| LLM01 Prompt Injection | Ships prompt injection and jailbreak probes, plus multi-turn strategies. | Includes prompt injection probes among its attack categories; Includes jailbreak probes among its attack categories |
| LLM02 Sensitive Information Disclosure | Lists data extraction as one of its attack categories. | Includes data extraction probes among its attack categories |
More in AI red teaming & LLM evaluation, ranked within the category by Coverage Score.
NVIDIA
Probes language models and LLM apps for prompt injection, jailbreaks, data leakage and more.
Best for: Teams that want a free command-line scanner they can point at any model or LLM endpoint before release
Reviewed
Giskard AI
Generates adversarial test suites for LLM agents and RAG apps, runs them and reports failures by threat type.
Best for: Python teams that want a free library to scan an LLM agent or RAG app for prompt injection and harmful output, and to write pass or fail checks for it
Reviewed
OpenAI (Promptfoo)
Runs evals and red team scans against LLM apps from a CLI or CI pipeline and writes a vulnerability report.
Best for: Developer teams that want one open-source CLI for both prompt evals and red teaming, run locally and in CI
Reviewed
Yes. It is licensed Apache-2.0 and the code is on GitHub at praetorian-inc/augustus.
The README lists connectors for 28 providers, including OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Google Vertex AI, Hugging Face and LiteLLM.
Yes. The README names four multi-turn strategies: Crescendo, GOAT, Hydra and Mischievous User, which keep a persistent conversation with the target.
Augustus is released under the Apache-2.0 license.
Source Source, checked October 21, 2026: github.com (opens in a new tab) Checked
Augustus is offered as: CLI, Self-hosted.
Source Source, checked October 21, 2026: github.com (opens in a new tab) Checked
Pricing model for Augustus: Free.
Source Source, checked October 21, 2026: github.com (opens in a new tab) Checked
Latest release of Augustus: October 3, 2026.
Source Source, checked October 21, 2026: api.github.com (opens in a new tab) Checked
We have no commercial relationship with Praetorian.