Testing & QA

Mutation testing framework to validate test quality

Stryker Mutator is an open-source mutation testing framework for JavaScript, TypeScript, C#, and Scala that measures the real effectiveness of your test suite. It introduces small code mutations and checks whether tests catch them, revealing gaps that line coverage metrics miss. Supports incremental mode for CI/CD integration.

AI-powered flaky test detection for Playwright and CI

TestDino is an AI-powered platform for detecting and managing flaky tests, with deep Playwright integration. It uses ML to analyze CI test results, classify failure root causes like network timeouts and race conditions, and provides an MCP server for conversational CI debugging. Auto-groups failures by cause and tracks flakiness trends across test suites.

AI-powered CI reliability and flaky test management

Trunk is a developer tools platform that tackles CI reliability through AI-powered flaky test detection, automatic quarantine, and merge queue management. It uses ML-based statistical analysis to identify flaky tests, isolates them to prevent pipeline blocks, and creates GitHub issues for resolution. Used by Zillow, Brex, and Faire, with $28.5M in funding and support for all major test frameworks.

Next-gen browser and mobile testing

WebdriverIO is a progressive Node.js test automation framework built on the WebDriver and Chrome DevTools protocols. Provides an elegant, extensible API for web and mobile testing across every major browser and real devices. Supports Mocha, Jasmine, and Cucumber, ships with built-in service plugins (Selenium Standalone, Appium, visual regression), and scales from local smoke tests to distributed CI suites.

Sentry-maintained MCP server and CLI for Xcode builds, simulators, and tests

XcodeBuildMCP is a Sentry-maintained, MIT-licensed MCP server and CLI for agent-assisted iOS and macOS development. It lets MCP-compatible coding agents run Xcode build and test workflows, manage simulators, inspect failures, and work through Homebrew, npm, or on-demand client configuration, with documented Sentry telemetry controls for teams that need an opt-out.

Open-source diagnostic for AI operational misalignment

iFixAi is an Apache-2.0 diagnostic tool for scoring AI agents and models against operational-misalignment risks such as hallucination, manipulation, sabotage, sandbagging, and oversight evasion.

Modern load testing for developers

k6 is an open-source load testing and performance testing tool developed by Grafana Labs. Developers write performance tests in JavaScript and execute them on a high-performance Go runtime capable of generating thousands of virtual users per machine. Features a CLI-first workflow, cloud-based test execution, and integrations with Grafana dashboards — making performance testing as accessible as writing unit tests.

Google's vulnerability scanner using the OSV database

OSV-Scanner is Google's official open-source vulnerability scanner that checks your project's dependencies against the OSV.dev database — the largest open vulnerability database covering all major ecosystems. Written in Go, it supports lockfiles from npm, pip, Maven, Cargo, Go modules, and more, providing actionable remediation guidance and CI/CD integration for automated security scanning.

Static linter that catches production bugs in AI-generated code

prodlint is a zero-config static analysis tool with 52 rules targeting production bugs that AI coding tools consistently produce. It catches hallucinated npm imports, missing authentication checks, Prisma writes outside transactions, exposed secrets via NEXT_PUBLIC prefixes, and other patterns specific to code generated by Cursor, Claude Code, Bolt, and v0. Runs in one second via npx with no configuration needed.

AI-powered test generation agent for automated code coverage improvement

qodo-cover (formerly Cover Agent) is an open-source AI agent that automatically generates meaningful unit tests to improve code coverage. It analyzes existing code and test patterns to produce tests that follow project conventions and target uncovered branches. Uses an iterative approach where generated tests are verified by running them, discarding those that fail. MIT licensed with over 5,300 GitHub stars.

AI-powered E2E testing with plain English test authoring

testRigor enables end-to-end test creation in plain English without coding or element selectors. Tests describe user actions in natural language like 'click on the Submit button' and testRigor's AI interprets and executes them across web, mobile, and API. Self-healing tests automatically adapt to UI changes. Supports cross-browser testing, visual validation, and integration with CI/CD pipelines.

Extremely fast Python type checker written in Rust

ty is an extremely fast Python type checker built in Rust by Astral, the team behind Ruff and uv. It performs full type inference, supports PEP 695 type parameter syntax, and checks Python code orders of magnitude faster than mypy or pyright. ty completes the Astral Python toolchain alongside Ruff for linting and uv for package management, giving developers a unified Rust-powered development experience.