Best Giskard Alternatives

PyRIT (Python Risk Identification Toolkit) is Microsoft's open-source framework for automated red teaming of generative AI systems. It enables security researchers to probe LLMs for jailbreaks, prompt injection, content safety bypasses, and harmful output generation using multi-turn attack strategies, scoring engines, and orchestrated adversarial workflows. Supports multiple target models and integrates with Azure AI services.

Promptfoo is an OpenAI-owned open-source toolkit for evaluating, red-teaming and securing LLM applications. It supports config-driven prompt/model tests, CI regression gates, red-team scans, guardrails, model security workflows, MCP Proxy, code scanning and evaluations across prompts, agents and RAG pipelines.

garak is NVIDIA's open-source LLM vulnerability scanner for red-teaming AI models and applications. Probes for prompt injection, data leakage, hallucination, toxicity, encoding-based attacks, and dozens of other vulnerability categories. Runs automated attack sequences against any LLM endpoint and generates detailed vulnerability reports. Features a modular probe/detector architecture that is extensible with custom attack patterns. Named after the Star Trek character known for deception.