Tools

Better Stack is a hosted observability and incident-management platform that combines uptime monitoring, on-call workflows, status pages, logs, traces, metrics, error tracking, session replay, and an AI SRE interface. It is aimed at teams that want one SaaS control plane for telemetry and incident response.

Automated code quality

Codacy is a managed code quality, security and AI-guardrails platform for GitHub, GitLab and Bitbucket teams. It scans pull requests and repositories for quality, coverage and security issues while adding AI Inventory, AI Guardrails, AI Risk Hub, AI Reviewer and Verity beta surfaces for AI-assisted engineering.

All-in-one AI code review, security, and quality

CodeAnt AI combines AI code review, SAST, secret detection, IaC security, policy enforcement, compliance dashboards, and agentic pentesting in one platform for engineering teams that want code quality and security checks before production.

Tool infrastructure for AI agents

Composio connects AI agents to 1,000+ app toolkits with managed auth, delegated user connections, sessions, tool search, MCP gateway support, CLI workflows, and sandboxed workbench execution. It targets developers building Claude, Codex, Cursor, LangChain, CrewAI, OpenAI Agents SDK, and custom agent workflows that need authenticated business actions without hand-rolling every API integration.

Evaluation-first LLM and agent observability

Confident AI is an evaluation-first observability platform that scores every trace and span with 50+ metrics, alerting on quality drops in LLM and agent applications. It goes beyond traditional APM by treating evaluation as core observability, providing actionable insights that help teams understand not just whether their AI applications are running but whether they are producing correct and useful outputs.

High-performance open-source web crawler optimized for AI pipelines

Crawl4AI is an open-source Python web crawler built for AI and data-pipeline use cases. It produces LLM-ready Markdown, supports structured extraction, Playwright/browser automation, deep/adaptive crawling, proxy/security controls, anti-bot fallback patterns, and multiple output formats. With 68K+ GitHub stars and Apache-2.0 licensing, it is a strong local/self-hosted option for RAG datasets and agent data collection.

Open-source vulnerability management aggregator

DefectDojo is an open-source vulnerability management platform with 4.7K+ GitHub stars that aggregates findings from 200+ security tools into a single view for ranking, triaging, and tracking remediation. It serves as the operating system for security teams by normalizing data from SAST, DAST, container scanners, and dependency checkers into a unified workflow with deduplication and metrics.

Autonomous Java unit test generation in CI

Diffblue Testing Agent orchestrates verified regression unit test generation for Java and Python projects through existing AI coding platforms such as GitHub Copilot CLI and Claude Code. It measures baseline coverage, generates tests, verifies that they compile and pass, and charges for net new coverage lines added rather than per seat or API call.

Open-source agentic development environment for parallel AI agents

Emdash is an open-source agentic development environment for orchestrating many coding agents in parallel. It runs each agent in an isolated Git worktree, presents tasks in a dashboard, auto-detects installed CLIs, works with 25+ agents including Claude Code, Codex, Cursor, Amp and Gemini, and supports MCP server connections for tool access.

Open-source ML and LLM monitoring with 100+ metrics

Evidently AI is an open-source platform with 100+ pre-built metrics for monitoring data quality, model performance, and data drift in AI/ML pipelines. Available under Apache 2.0 with a cloud version, it helps teams detect when production data shifts away from training distributions, LLM output quality degrades, or feature pipelines introduce anomalies that silently degrade model accuracy.

Enterprise-grade AI coding agent system by Factory

System of specialized AI Droids — Code, Knowledge, Reliability, and Product — each optimized for specific development tasks. Ranked #1 on Terminal-Bench with 58.75% score. BYOK model with support for Anthropic and OpenAI models. Enterprise-focused approach that treats AI coding as a team of specialized agents rather than a single general-purpose assistant.

Official remote MCP server for design-to-code and write-to-canvas Figma workflows.

Figma MCP Server is Figma’s official remote Model Context Protocol surface for design-to-code agents. It gives supported clients structured design context, variables, components, selected-frame code context, Code Connect mappings, and beta write-to-canvas tools for creating or updating native Figma frames from an MCP client while keeping the workflow tied to Figma files.

CyberArk's open-source LLM fuzzing framework for AI security testing

FuzzyAI is CyberArk's Apache-2.0 framework for fuzzing LLM APIs to identify jailbreaks and related security vulnerabilities. Current README examples cover Ollama/local models, OpenAI, Anthropic, custom REST endpoints, and attacks such as ManyShot, Taxonomy, and ArtPrompt. Use it as a repeatable security-testing starting point, not a complete AI risk-management system.

AI-native Git client with virtual branches and smart commits

GitButler is a source-available Git client for virtual/stacked branches, AI-assisted workflows, and intelligent conflict resolution. Co-founded by Scott Chacon, it helps developers organize commits and work on multiple changes simultaneously. 21K+ GitHub stars; FSL-1.1-MIT license model.

Cloud development environments

Gitpod is an open-source cloud development environment platform that launches ephemeral, pre-configured workspaces in seconds from any Git repository on GitHub, GitLab, or Bitbucket. Configured via .gitpod.yml, it ships a full VS Code / JetBrains IDE, cached prebuilds, and workspace snapshots — eliminating 'works on my machine' for distributed teams and open-source contributors.

Rust-native multi-agent orchestration for production

GraphBit is a Rust-native, multi-agent orchestration framework built for production. It targets the gap between Python-first frameworks like LangGraph and the operational expectations of enterprise systems — predictable memory, low latency, deterministic concurrency, and the ability to embed an agent runtime in services that already run Rust without dragging in a Python interpreter.

Community Grok terminal agent for xAI-powered coding and command-line workflows

Grok CLI is a community command-line interface for using xAI/Grok models from a terminal workflow. It fits developers who want a lightweight, scriptable Grok surface for coding help, command-line experiments, and local agent-style interactions without waiting for a heavier IDE integration. For aicoolies, it belongs in the fast-growing AI CLI agents lane beside Grok Build, Claude Code, Codex, Gemini CLI, and Qwen Code.

Production-grade browser automation with AI self-healing and Playwright code ownership

Intuned is a code-first browser automation platform that turns natural language prompts into production-ready Playwright code, deploys it, and self-heals it when target sites change. Supports TypeScript and Python with Anthropic Computer Use, OpenAI CUA, Stagehand, Browser-Use, and Gemini Computer Use integrations. Built-in stealth, captcha solving, auth session management, and scheduled runs with concurrency control. No vendor lock-in—you own the code.

Open-source agentic engineering platform

Open-source agentic AI coding platform for VS Code, JetBrains IDEs, CLI, Slack, and Cloud that combines inline autocomplete, browser automation, automated refactoring, and custom planning/coding/debugging modes. Operates on a plan-act-observe-fix loop with 500+ model support (Gemini, Claude, GPT via OpenRouter). Memory Bank feature maintains repo-resident context across sessions, and codebase indexing keeps the agent grounded in your project.

Framework for LLM applications

The most widely-used framework for building LLM-powered applications, available in Python and JavaScript. Provides abstractions for chains, agents, RAG, memory, tool usage, and structured output. Integrates with 100+ LLM providers, vector stores, document loaders, and tools. LangSmith offers tracing and evaluation. LangGraph enables stateful, multi-agent workflows with cycles. 100K+ GitHub stars. The de facto standard for LLM application development despite growing alternatives like LlamaIndex.

Unified API proxy for 100+ LLMs

Drop-in OpenAI-compatible proxy supporting 100+ LLM providers with load balancing, spend tracking, rate limiting, and fallback routing. Acts as a unified gateway for all your AI model calls, letting teams switch between providers, enforce budgets, and add reliability layers without changing application code. Essential infrastructure for multi-model AI architectures.

AI full-stack app builder

Build production-ready applications from text and image prompts. Full-stack with Supabase backend, authentication, and one-click deployment. Formerly GPT Engineer, backed by top investors. Targets non-technical founders and product teams who want to go from idea to deployed app in minutes, with AI handling both frontend UI and backend infrastructure setup.

Full-stack observability platform with OpenTelemetry-friendly telemetry, LLM observability, and AI SRE workflows.

Middleware is a full-stack observability platform for infrastructure, APM, logs, metrics, traces, RUM, synthetics, browser testing, LLM observability, and AI SRE workflows. It targets teams that want OpenTelemetry-friendly telemetry, faster incident correlation, and a 14-day free trial before Pay As You Go or Enterprise observability commitments and rollout planning.

Beautiful documentation that converts

AI-powered documentation platform that transforms markdown into beautiful, searchable docs sites with minimal config. Features AI writing suggestions, auto API reference generation from OpenAPI specs, built-in analytics, versioning, custom domains, and a web editor for non-technical contributors. Supports MDX for interactive components. GitHub integration for CI/CD updates. Used by Anthropic, Cursor, Turso, and hundreds of developer-focused companies.

Open-source personal AI agent for messaging apps

OpenClaw is a free, open-source AI agent framework that turns any LLM into an autonomous personal assistant accessible through messaging apps like WhatsApp, Telegram, Discord, and Signal. Running entirely on your local machine via a Node.js gateway, it connects AI models to system tools, browsers, files, and APIs for multi-step task execution with persistent memory across sessions.

Open-source search engine with vector and hybrid retrieval

OpenSearch is an Apache-2.0 distributed search engine with native vector-search support for teams that want BM25, filters, aggregations, and k-NN retrieval in the same search stack. It is distinct from Elasticsearch in the aicoolies catalog: OpenSearch is the AWS-backed open fork with its own docs, plugin path, and serverless deployment options.

MySQL-compatible serverless database

Relational database platform for MySQL and Postgres with Vitess-backed MySQL scale, PlanetScale Postgres, query insights, deploy-request workflows, and Database Traffic Control. It fits production teams that need managed relational performance, safe schema changes, replicas, and database expertise rather than a simple hobby database.

API development and testing platform

The most popular API platform used by 30M+ developers worldwide. Build, test, and document APIs with collections, environments, automated testing, and team collaboration. Features mock servers, monitoring, API design tools, and a vast public API network. The industry standard for API development workflows from prototyping through production testing and documentation.

100% private document Q&A powered by local LLMs

PrivateGPT enables fully private document interaction using GPT-powered RAG without any data leaving your machine. Ingest documents (PDF, DOCX, TXT, and more) and chat with them using local LLMs via Ollama or remote providers. Built on LlamaIndex with Qdrant vector storage. 57,200+ GitHub stars, Apache 2.0 licensed. The go-to solution for air-gapped environments, regulated industries, and anyone who needs document Q&A without cloud data exposure.

Alibaba's agent framework built for the Qwen model family

Qwen-Agent is Alibaba's Apache-2.0 framework for building AI agents around the Qwen model family. It supports tool use, planning, memory, RAG, Code Interpreter, Browser Assistant, MCP extras, custom tools, and Qwen Chat backend patterns with Qwen3/Qwen3.5 examples. Best fit for teams standardizing on Qwen rather than a generic multi-agent router, with 16.5K+ GitHub stars.

Microsoft’s pytest-native red teaming framework for turning AI agent safety findings into CI tests.

RAMPART is an open-source Microsoft framework for safety and security testing of agentic AI applications. It brings red-team findings into a pytest-native workflow so teams can turn prompt injection, unsafe tool use, and behavioral boundary failures into repeatable regression tests. The strongest aicoolies angle is developer workflow: RAMPART makes agent safety part of CI/CD instead of a one-off security review.

No-code platform for building AI agent workforces

Relevance AI is a no-code platform from Sydney, Australia for building and deploying AI agent workforces that execute business workflows autonomously. Backed by a $24M Series B led by Bessemer Venture Partners, it offers 9,000+ integrations, a visual agent builder, a marketplace of pre-built agents, and multi-model support across OpenAI, Anthropic, and AWS Bedrock. Agents handle sales development, lead research, meeting prep, onboarding, and support workflows.

CNCF Sandbox Kubernetes alert enrichment and automation platform

Robusta is a CNCF Sandbox project that enriches Kubernetes alerts with diagnostic context and automates remediation workflows. It intercepts Prometheus alerts, attaches relevant logs, pod status, resource metrics, and troubleshooting suggestions before delivering them to Slack, Teams, or PagerDuty. Supports custom playbooks for automated incident response and AI-powered root cause analysis.

AI-powered incident management in Slack and Teams

Rootly is an AI-native incident management platform that runs entirely within Slack and Microsoft Teams, automating incident workflows from detection through postmortem. It reduces manual incident overhead with AI-generated summaries, automated role assignments, escalation paths, and postmortem drafts, holding SOC 2 Type II, GDPR, and HIPAA compliance certifications for enterprise use.

Autonomous Kubernetes management and predictive scaling

Sedai provides an autonomous control layer for Kubernetes that right-sizes workloads, remediates anomalies, and performs predictive autoscaling ahead of traffic demand. Sedai says it manages large enterprise cloud environments for customers including Palo Alto Networks and builds behavioral models to scale pods before demand arrives rather than reacting after performance degrades.

Kubernetes-native testing for coding agents

Signadot is a Kubernetes-native validation platform that lets developers test agent-generated code in isolated preview environments mimicking production. It creates lightweight sandboxes within existing clusters where code changes can be validated against real microservice dependencies, ensuring that AI-generated modifications do not break cross-service interactions before merging to main.

Autonomous AI agent for end-to-end software testing

TestSprite is an AI testing agent that autonomously generates test plans, writes test code, executes tests, and reports results without human intervention. Ranked #1 on Product Hunt for Developer Tools in 2025, it handles test creation from natural language requirements through execution and regression tracking. Credit-based SaaS model with 121K+ monthly visits.

Hybrid search and ML ranking engine at scale

Vespa is an open-source serving engine with 6K+ GitHub stars for hybrid search combining vector similarity, BM25 text ranking, and structured filtering in a single query. Built by Yahoo for web-scale, it handles billions of documents with millisecond latency. Features real-time indexing, ML model serving, tensor computation, and ACID-compliant writes. Supports custom ranking models, query federation, and geographic search. Used for recommendation systems, personalization, and RAG.

LLM observability and evaluation by Weights & Biases

W&B Weave is the LLM observability and evaluation toolkit from Weights & Biases. It provides automatic tracing of LLM calls with full input/output logging, cost and latency tracking, evaluation pipelines with custom scorers, and a trace explorer for debugging multi-step agent workflows. Integrates with OpenAI, Anthropic, LangChain, and CrewAI via simple Python/TypeScript decorators.

MCP server for controlling Windows desktops through UIAutomation

Windows-MCP is an open-source MCP server for giving AI agents structured access to Windows desktop automation. It focuses on UIAutomation, snapshots, input control, and Windows-specific app workflows, making it different from general filesystem or shell MCP servers.

Run frontier AI models across a cluster of everyday devices

exo turns multiple local machines into a unified AI compute cluster for models that exceed a single device's memory. It automatically discovers devices, uses topology-aware auto parallelism to split work across available resources, and supports RDMA over Thunderbolt 5 for co-located clusters or standard networking for looser setups. The project exposes OpenAI Chat Completions, Claude Messages, OpenAI Responses, and Ollama-compatible APIs plus a dashboard for cluster management.

Open-source LLMOps platform for prompt management and evaluation

Agenta is an open-source LLMOps platform that combines prompt engineering playgrounds, prompt version management, LLM evaluation, and observability in a unified interface. It supports 50+ LLM models with side-by-side prompt comparison, A/B testing, human evaluation workflows, and OpenTelemetry-native tracing. Self-hostable with 4,000+ GitHub stars.

Multi-agent AI framework

Python framework for orchestrating autonomous AI agents that collaborate to accomplish complex tasks. Define agents with specific roles, goals, and backstories, then organize them into crews with sequential or parallel task execution. Supports tool usage (web search, file I/O, API calls), memory, delegation between agents, and human-in-the-loop input. Works with OpenAI, Anthropic, local models, and more. 25K+ GitHub stars. Leading multi-agent framework alongside LangGraph and AutoGen.

AI-driven log analysis with zero false positives

Dash0 is an AI-driven observability platform focused on log analysis that auto-structures unstructured logs, provides instant alerting with zero false positives, and delivers full-stack tracing capabilities. It uses AI to transform raw log data into structured, searchable events without requiring manual parsing configuration, making log-based debugging significantly faster for engineering teams.

Library for efficient similarity search and clustering of dense vectors at billion-scale.

FAISS is Meta AI Research's open-source library for efficient similarity search and clustering of dense vectors. It implements approximate nearest-neighbor algorithms designed to scale to billions of vectors, with optimized indexes that fit in RAM and GPU acceleration for the largest workloads. Engineering teams use FAISS as the retrieval primitive underneath custom RAG pipelines, recommendation systems, and large-scale embedding search infrastructure.

Open-source Kubernetes security platform for risk analysis and compliance

Kubescape is a CNCF-backed open-source Kubernetes security platform that scans clusters, manifests, and container images for vulnerabilities, misconfigurations, and compliance violations. It checks against NSA-CISA, MITRE ATT&CK, and CIS benchmarks, integrates into CI/CD pipelines, and provides runtime threat detection via eBPF. Supports SBOM generation and vulnerability scanning. Used by ARMO with growing enterprise adoption in cloud-native security.

Open-source observability for AI agents

Laminar is an open-source observability platform for AI agents providing tracing, evaluation, and analytics for LLM applications. It integrates with Vercel AI SDK, LangChain, OpenAI, and Anthropic with a single line of code. Features include OpenTelemetry-native SDKs, an extensible evaluation framework with CI/CD support, SQL access to traces and metrics, and a visual debugging timeline for agent reasoning and actions.

The LLM anti-framework for typed AI apps

Mirascope is an open-source Python and TypeScript toolkit for building LLM applications that prioritizes type safety, composability, and 100% test coverage. Positioned as the 'anti-framework,' it provides fine-grained control over LLM interactions using familiar language constructs rather than rigid abstractions, supporting all major providers through a unified interface.