aicoolies logo
Testsigma logo

Testsigma

Open-source codeless test automation with NLP-based test creation

Share
open-sourceOpen Source
Visit Website →

Testsigma is an open-source codeless test automation platform where tests are written in plain English using NLP-based interpretation. It supports web, mobile, and API testing with self-healing test maintenance that adapts to UI changes automatically. Apache 2.0 licensed Community Edition is free with full functionality. Cloud edition adds parallel execution, integrations, and team management. Active development with regular releases through 2026.

We have a review for this tool

A detailed review by the aicoolies team — click to read

Testsigma removes the coding barrier from test automation by interpreting test steps written in natural language. Instead of writing Selenium selectors or Cypress commands, testers describe actions like 'Navigate to login page', 'Enter username as admin', 'Click submit button' — and Testsigma translates these into executable automation. The NLP engine understands variations in phrasing, so teams can write tests in their natural style.

Self-healing capabilities automatically adapt tests when UI elements change. If a button's ID or class name changes but its visual position and text remain the same, Testsigma updates the locator strategy without manual intervention. The platform supports web browsers (Chrome, Firefox, Safari, Edge), mobile devices (iOS and Android via real devices and emulators), and REST/GraphQL APIs — all from the same test authoring interface.

The Community Edition is Apache 2.0 licensed and includes the full test authoring, execution, and reporting capabilities. The Cloud edition adds parallel cross-browser execution, CI/CD integrations, screenshot comparison, and team collaboration features. Compared to Playwright or Cypress (which require coding), Testsigma targets QA teams that need comprehensive test coverage without dedicating developers to write and maintain test code.

Pricing

Free Community Edition (Apache 2.0); Cloud plans paid

Platforms

Web platform, Docker self-hosted, Cloud managed

Categories

Tags

Use Cases

Alternatives

Playwright logo

Playwright

Reliable end-to-end testing

Cross-browser E2E testing framework by Microsoft supporting Chromium, Firefox, and WebKit with one API. Features auto-waiting, tracing with timeline/screenshots/DOM snapshots, codegen for recording tests, and parallel execution. Component testing for React, Vue, Svelte. Built-in API testing, network mocking, and mobile emulation. Known for reliability and speed vs Selenium/Cypress. 70K+ GitHub stars, rapidly becoming the E2E standard.

open-sourceOpen Source
Cypress logo

Cypress

Test anything that runs in a browser

JavaScript end-to-end testing framework that runs tests directly in the browser with real-time reloading and an interactive test runner UI. Features automatic waiting, time-travel debugging with DOM snapshots at each step, network request stubbing/interception, screenshot and video recording, and a dashboard service for CI analytics. Supports component testing for React, Vue, Angular, and Svelte. Known for developer experience and reliable test execution. 49K+ GitHub stars.

open-sourceOpen Source
Keploy logo

Keploy

AI-powered API testing with traffic recording

Keploy is an open-source AI-powered testing platform that generates API, integration, and unit tests by recording real network traffic via eBPF. It captures API calls, database queries, and streaming events, then replays them as deterministic tests with auto-generated mocks — no code changes needed. Works across any language or framework with CI/CD pipeline integration and popular testing framework support including JUnit, PyTest, Jest, and Go-Test.

open-sourceOpen Source

Related Tools

Safari MCP Server

Apple's Safari-native MCP server for web debugging agents

Safari MCP Server is Apple's safaridriver-based MCP server in Safari Technology Preview, giving compatible coding agents local access to Safari page content, console logs, network requests, screenshots, JavaScript evaluation, interactions, viewport controls, and accessibility/performance checks.

freeTelemetry
rampart

Rampart

Microsoft’s pytest-native red teaming framework for turning AI agent safety findings into CI tests.

RAMPART is an open-source Microsoft framework for safety and security testing of agentic AI applications. It brings red-team findings into a pytest-native workflow so teams can turn prompt injection, unsafe tool use, and behavioral boundary failures into repeatable regression tests. The strongest aicoolies angle is developer workflow: RAMPART makes agent safety part of CI/CD instead of a one-off security review.

open-sourceOpen Source
Requestly logo

Requestly

One tool for intercepting, mocking, and replaying HTTP — acquired by BrowserStack

Requestly is a BrowserStack-backed API client, HTTP interceptor, mock server, and session replay tool for frontend and QA teams. Its current product is commercial/API-client led, while the legacy interceptor/open-source code is AGPLv3. The free plan covers individual workflows, and Pro lists at $12/user/month monthly or $9/user/month annually for collaborative QA and frontend debugging teams.

freemium
Browserbase logo

Browserbase

Headless browser cloud built for AI agents

Browserbase is cloud infrastructure that runs headless Chromium browsers on demand for AI agents and automation workflows, exposing Playwright, Puppeteer, and Selenium endpoints with built-in session replay, residential proxies, CAPTCHA solving, and stealth fingerprints. It also hosts Stagehand and a Model Gateway, letting teams build browser-using agents without maintaining their own fleet of Kubernetes-managed Chromium instances.

freemium
Anchor Browser logo

Anchor Browser

Cloud browser infrastructure for AI agents

Anchor Browser provides secure cloud-managed browser infrastructure for computer-use agents. Deploy humanized Chromium instances that access any website while maintaining bot-detection evasion and authentication support. Features OmniConnect for authentication lifecycle management, Web Action Cache for deterministic workflows, and built-in VPN infrastructure. Includes free tier and paid plans supporting millions of concurrent browser sessions for scalable agent automation.

freemium
RagaAI Catalyst logo

RagaAI Catalyst

AI testing and evaluation for agents and LLM apps

RagaAI Catalyst is a comprehensive Python SDK for observability, monitoring, and evaluation of LLM and agentic applications. Provides agent tracing with execution graph visualization, self-hosted dashboard with analytics, synthetic data generation, multi-metric evaluation framework, and guardrail management. Built for teams running production RAG systems and AI agents who need systematic testing, debugging, and performance optimization workflows.

open-sourceOpen Source

Used in Stacks