aicoolies logo

iFixAi

Open-source diagnostic for AI operational misalignment

open-sourceopen sourceupdated Jul 10, 2026
Visit Website →
Share

iFixAi is an Apache-2.0 diagnostic tool for scoring AI agents and models against operational-misalignment risks such as hallucination, manipulation, sabotage, sandbagging, and oversight evasion.

iFixAi is an open-source diagnostic project for examining operational-misalignment risks in AI models and agents. Its workflow runs structured inspections and produces scorecards intended to help teams surface behaviors such as hallucination, manipulation, sabotage, sandbagging, and oversight evasion.

The project is designed for provider- and model-spanning evaluation rather than a single hosted product. Security and safety teams can use its inspection workflow as one input when comparing model or agent behavior, building repeatable risk checks, and documenting issues that deserve deeper investigation.

iFixAi is a young, fast-moving project, so buyers should validate current provider support, inspection definitions, judge configuration, reproducibility, and release stability before adopting it in a critical gate. Its diagnostic output is not a compliance certification or proof that a deployed system is safe.

Pricing

Free and open-source under the Apache-2.0 license; users may incur model, judge, API, and infrastructure costs when running diagnostics.

Platforms

Python package and CLI for diagnostic evaluation of AI models and agents across supported providers and local workflows.

Categories

Tags

Use Cases

Related Tools

MCP for Unity

Open-source MCP bridge between AI assistants and the Unity Editor

MCP for Unity is CoplayDev’s MIT-licensed bridge between MCP-compatible AI assistants and the Unity Editor. It exposes tools for assets, scenes, GameObjects, scripts, tests, profiling, and build-oriented workflows. The community project supports Unity 2021.3 LTS through 6.x and is explicitly not affiliated with Unity Technologies.

open-sourceOpen Source

XcodeBuildMCP

Sentry-maintained MCP server and CLI for Xcode builds, simulators, and tests

XcodeBuildMCP is a Sentry-maintained, MIT-licensed MCP server and CLI for agent-assisted iOS and macOS development. It lets MCP-compatible coding agents run Xcode build and test workflows, manage simulators, inspect failures, and work through Homebrew, npm, or on-demand client configuration, with documented Sentry telemetry controls for teams that need an opt-out.

open-sourceOpen SourceTelemetry

MEDUSA

AI-first security scanner for LLM, agent, MCP, and RAG codebases

MEDUSA is an AGPL-3.0 AI-first security scanner from Pantheon Security that checks AI and machine-learning applications, LLM agents, MCP workflows, RAG pipelines, repository-poisoning risks, secrets, and agent-specific compromise patterns.

open-sourceOpen Source

Inspect AI

UK AI Security Institute framework for LLM safety evaluations

Inspect AI is an MIT-licensed framework from the UK AI Security Institute for running large language model evaluations, including tool use, multi-turn dialogue, model-graded scoring, and reusable evaluation tasks.

open-sourceOpen Source

Presidio

Open-source PII detection and anonymization for AI data flows

Presidio is an MIT-licensed privacy framework for identifying and anonymizing personally identifiable information in text, images, and structured data. It can act as a de-identification layer around LLM prompts, logs, RAG corpora, and customer-data workflows.

open-sourceOpen Source

Safari MCP Server

Apple's Safari-native MCP server for web debugging agents

Safari MCP Server is Apple's safaridriver-based MCP server in Safari Technology Preview, giving compatible coding agents local access to Safari page content, console logs, network requests, screenshots, JavaScript evaluation, interactions, viewport controls, and accessibility/performance checks.

freeTelemetry