aicoolies logo

FuzzyAI

CyberArk's open-source LLM fuzzing framework for AI security testing

Share
open-sourceOpen Source
Visit Website →

FuzzyAI is CyberArk's Apache-2.0 framework for fuzzing LLM APIs to identify jailbreaks and related security vulnerabilities. Current README examples cover Ollama/local models, OpenAI, Anthropic, custom REST endpoints, and attacks such as ManyShot, Taxonomy, and ArtPrompt. Use it as a repeatable security-testing starting point, not a complete AI risk-management system.

We have a review for this tool

A detailed review by the aicoolies team — click to read

FuzzyAI applies fuzz-testing ideas to large language model APIs by running documented attack examples against configured model targets. Developed by CyberArk's security research team, the Apache-2.0 project currently documents jailbreak-oriented fuzzing plus examples for ManyShot, Taxonomy, and ArtPrompt-style attacks across OpenAI, Anthropic, Ollama/local models, and custom REST APIs.

The framework operates against documented provider examples rather than a guaranteed universal model matrix: OpenAI, Anthropic, Ollama/local models, and custom REST API targets are visible in the current README. Teams that need governance-grade evidence should wrap the CLI output with their own severity taxonomy, storage, and remediation workflow. This evidence-based approach helps security teams quantify LLM risk rather than relying on qualitative assessments of model safety.

With 1.4K+ GitHub stars and CyberArk stewardship, FuzzyAI fills a useful gap for teams that want a repeatable starting point for LLM security testing without building every fuzzing prompt from scratch. The repository was active in the source check, but the latest push observed in this pass was 2026-02-06, so production users should review current issue activity and code paths before standardizing on it.

Pricing

Free and open-source under Apache-2.0

Platforms

Python, any OS, tests any LLM via API

Categories

Tags

Use Cases

Alternatives

Related Tools

Agent Governance Toolkit logo

Agent Governance Toolkit

Microsoft’s public-preview runtime governance toolkit for policy, identity, sandboxing, audit, and MCP security around AI agents.

Agent Governance Toolkit is Microsoft’s MIT-licensed public-preview toolkit for governing AI agent runtimes. It adds policy enforcement, zero-trust identity, execution sandboxing, audit, reliability, and MCP security-gateway patterns around tool calls and autonomous actions, helping platform teams move beyond prompt-only guardrails while preserving architecture review requirements.

open-sourceOpen SourceTelemetry
Baz logo

Baz

Telemetry-aware AI code reviewer that checks how pull requests may affect real services.

Baz is an AI code-review platform focused on production-aware pull requests. Instead of only reading the diff, Baz connects code changes to application telemetry so reviewers can understand what endpoints, services, and runtime behavior may be affected. That makes it a useful complement to existing AI PR bots when the question is not just whether a change looks correct, but whether it could break a live system.

freemiumTelemetry
rampart

Rampart

Microsoft’s pytest-native red teaming framework for turning AI agent safety findings into CI tests.

RAMPART is an open-source Microsoft framework for safety and security testing of agentic AI applications. It brings red-team findings into a pytest-native workflow so teams can turn prompt injection, unsafe tool use, and behavioral boundary failures into repeatable regression tests. The strongest aicoolies angle is developer workflow: RAMPART makes agent safety part of CI/CD instead of a one-off security review.

open-sourceOpen Source
Statewright logo

Statewright

State-machine guardrails for controlling which tools AI coding agents can use at each phase.

Statewright is a guardrail layer for AI coding agents that uses explicit state machines to control what an agent can do at each stage of a workflow. Instead of relying only on prompt instructions, teams can model phases such as plan, implement, test, and review, then constrain tool access for clients like Claude Code, Codex, Cursor, opencode, and related MCP workflows.

open-sourceOpen Source
Magika logo

Magika

AI-powered file-type detection at Google scale

Open-source AI-powered file-type detection tool from Google that uses a custom deep-learning model under a few megabytes to identify more than 200 binary and textual content types in milliseconds, even on a single CPU. Magika ships as a CLI, Python package, JavaScript/TypeScript library, and an ONNX model, achieves around 99% accuracy on its test set, and is already used at Google scale across Gmail, Drive, and Safe Browsing as well as by VirusTotal and abuse.ch.

freeOpen Source
Trent AI logo

Trent AI

Agentic AI security posture management

Trent AI is a specialized security platform for agentic AI applications providing AI Security Posture Management that compounds with every development cycle. Scans, judges, mitigates, and evaluates AI agent security detecting threats traditional tools miss including prompt injection attacks, tool misuse, unintended autonomous actions, data exfiltration through agent chains, and privilege escalation. Offers continuous assessment with remediation plan execution through Claude Code.

paid

Used in Stacks