aicoolies logo

Agentic Security

LLM vulnerability scanner and red teaming kit

open-sourceopen sourceupdated Apr 29, 2026
Visit Website →
Share

Agentic Security is an open-source vulnerability scanner for LLM agent workflows that tests AI systems against jailbreaks, fuzzing, and multimodal attacks. It probes weaknesses across text, image, and audio inputs through multi-step jailbreak simulations, randomized stress testing, and reinforcement learning-powered adaptive attacks. The toolkit connects directly to LLM APIs for high-volume real-world attack scenarios, helping developers identify and patch safety gaps before deployment.

Agentic Security provides a comprehensive red-teaming toolkit specifically designed for LLM-powered agent workflows. As AI agents gain access to tools, APIs, and sensitive data, the attack surface expands well beyond simple prompt injection. This scanner tests the full range of vulnerabilities including multi-step jailbreak chains, multimodal attacks across text, image, and audio inputs, and randomized fuzzing that uncovers unexpected edge-case behaviors in production models.

The toolkit connects directly to any LLM API endpoint and runs high-volume attack scenarios drawn from a growing dataset of adversarial prompts. Its reinforcement learning module crafts adaptive probes that evolve based on the model's responses, simulating sophisticated attackers who adjust their strategy in real time. Each scan generates detailed reports identifying which attack vectors succeeded, the severity of each vulnerability, and recommended mitigations.

For security teams and ML engineers shipping agent-based products, Agentic Security fills a critical gap in the testing pipeline. Traditional software security tools cannot evaluate the probabilistic and context-dependent nature of LLM outputs. By integrating this scanner into CI/CD workflows or running it as a standalone audit, teams can systematically validate that safety guardrails hold up against the latest attack techniques before exposing their agents to real users.

Pricing

Free and open source

Platforms

Python library, pip installable

Categories

Tags

Use Cases

Alternatives

Related Tools

MCP for Unity logo

MCP for Unity

Open-source MCP bridge between AI assistants and the Unity Editor

MCP for Unity is CoplayDev’s MIT-licensed bridge between MCP-compatible AI assistants and the Unity Editor. It exposes tools for assets, scenes, GameObjects, scripts, tests, profiling, and build-oriented workflows. The community project supports Unity 2021.3 LTS through 6.x and is explicitly not affiliated with Unity Technologies.

open-sourceOpen Source
XcodeBuildMCP logo

XcodeBuildMCP

Sentry-maintained MCP server and CLI for Xcode builds, simulators, and tests

XcodeBuildMCP is a Sentry-maintained, MIT-licensed MCP server and CLI for agent-assisted iOS and macOS development. It lets MCP-compatible coding agents run Xcode build and test workflows, manage simulators, inspect failures, and work through Homebrew, npm, or on-demand client configuration, with documented Sentry telemetry controls for teams that need an opt-out.

open-sourceOpen SourceTelemetry

MEDUSA

AI-first security scanner for LLM, agent, MCP, and RAG codebases

MEDUSA is an AGPL-3.0 AI-first security scanner from Pantheon Security that checks AI and machine-learning applications, LLM agents, MCP workflows, RAG pipelines, repository-poisoning risks, secrets, and agent-specific compromise patterns.

open-sourceOpen Source
iFixAi logo

iFixAi

Open-source diagnostic for AI operational misalignment

iFixAi is an Apache-2.0 diagnostic tool for scoring AI agents and models against operational-misalignment risks such as hallucination, manipulation, sabotage, sandbagging, and oversight evasion.

open-sourceOpen Source

Inspect AI

UK AI Security Institute framework for LLM safety evaluations

Inspect AI is an MIT-licensed framework from the UK AI Security Institute for running large language model evaluations, including tool use, multi-turn dialogue, model-graded scoring, and reusable evaluation tasks.

open-sourceOpen Source

Presidio

Open-source PII detection and anonymization for AI data flows

Presidio is an MIT-licensed privacy framework for identifying and anonymizing personally identifiable information in text, images, and structured data. It can act as a de-identification layer around LLM prompts, logs, RAG corpora, and customer-data workflows.

open-sourceOpen Source