917 Developer Tools (2026)

Open-source observability for AI agents

Laminar is an open-source observability platform for AI agents providing tracing, evaluation, and analytics for LLM applications. It integrates with Vercel AI SDK, LangChain, OpenAI, and Anthropic with a single line of code. Features include OpenTelemetry-native SDKs, an extensible evaluation framework with CI/CD support, SQL access to traces and metrics, and a visual debugging timeline for agent reasoning and actions.

The LLM anti-framework for typed AI apps

Mirascope is an open-source Python and TypeScript toolkit for building LLM applications that prioritizes type safety, composability, and 100% test coverage. Positioned as the 'anti-framework,' it provides fine-grained control over LLM interactions using familiar language constructs rather than rigid abstractions, supporting all major providers through a unified interface.

LLM evaluation and tracing by Comet

Opik is an open-source LLM evaluation and tracing platform by Comet ML for debugging, testing, and monitoring AI applications. Provides detailed traces of LLM calls with latency, token usage, and cost tracking. Features automated evaluation with built-in and custom metrics, dataset management for regression testing, and production monitoring dashboards. Integrates with the broader Comet ML experiment tracking ecosystem. Available as both self-hosted open-source and managed cloud service.

Meta's open-source LLM security suite with Llama Guard and CodeShield

PurpleLlama is Meta's open-source suite of tools for evaluating and improving LLM safety. It includes Llama Guard models for input/output content safety classification, LlamaFirewall for multi-layer defense, CodeShield for insecure code detection, and CyberSecEval benchmarks for measuring LLM security. Llama Guard 4 supports multimodal safety across text and images. 4,100+ GitHub stars, backed by Meta AI with 44+ contributors.

Observability platform purpose-built for Python and Pydantic AI apps

Pydantic Logfire is an observability platform built by the Pydantic team specifically for Python AI applications. It provides structured logging, distributed tracing, and metrics with native understanding of Pydantic models, FastAPI, and AI framework data types. Auto-instruments OpenAI, Anthropic, LangChain, and other LLM providers. Built on OpenTelemetry for vendor-neutral data export. Offers a managed cloud dashboard with a generous free tier for development and small-scale production use.

Read/write MCP bridge between AI coding agents and Figma

Talk to Figma MCP is an MIT-licensed bridge from Grab that connects Cursor, Claude Code, and other MCP-capable agents to Figma through a local MCP server, WebSocket bridge, and Figma plugin. Unlike read-only context servers, it can inspect selections, create or modify nodes, update text in bulk, and automate design operations, so teams should review permissions before enabling write access.

ByteDance's open-source LLM coding agent with multi-provider support

Trae Agent is ByteDance's open-source software engineering agent that autonomously resolves GitHub issues, fixes bugs, and implements features using any LLM provider. It supports OpenAI, Anthropic, Doubao, Azure, Ollama, and Gemini backends, making it one of the most provider-flexible coding agents available. With over 11,000 GitHub stars and a modular research-friendly architecture, it offers a strong alternative to Western-centric coding agents.

Zero Trust runtime security for Kubernetes and AI

AccuKnox provides Zero Trust runtime threat prevention for Kubernetes and cloud workloads with an AI-powered prompt firewall to prevent LLM injection attacks. Built on the open-source KubeArmor project, it manages Kubernetes identities via policy-as-code, enforces runtime security policies, and provides real-time workload protection for AI-native infrastructure environments.

Observability and lifecycle management for AI agents

AgentOps is an observability platform for monitoring, debugging, and managing AI agents. It provides session replay, event timelines, tool-call and LLM tracing, cost tracking, and dashboards for multi-agent workflows. Integrations span OpenAI, CrewAI, AutoGen, LangChain, LangGraph, LlamaIndex, Google ADK, OpenAI Agents, xAI, and 400+ LLMs/frameworks.

Microsoft's conversational multi-agent framework

AutoGen is an open-source programming framework from Microsoft Research for building AI agents and facilitating cooperation among multiple agents to solve complex tasks through multi-turn conversations. Pioneered conversable agents that interact, use tools, and involve humans in the loop for multi-agent workflows. v0.4 features a redesigned async event-driven architecture with stronger observability, flexible collaboration patterns, and reusable components.

Test anything that runs in a browser

JavaScript end-to-end testing framework that runs tests directly in the browser with real-time reloading and an interactive test runner UI. Features automatic waiting, time-travel debugging with DOM snapshots at each step, network request stubbing/interception, screenshot and video recording, and a dashboard service for CI analytics. Supports component testing for React, Vue, Angular, and Svelte. Known for developer experience and reliable test execution. 49K+ GitHub stars.

Self-evolution engine for AI agents with auditable updates

Evolver is an open-source self-evolution engine for AI agents that turns run logs into auditable, reviewable updates via its Genome Evolution Protocol. Instead of ad hoc prompt tweaking, teams collect traces and Evolver proposes versioned diffs to prompts, tools and workflows that engineers can approve, reject or roll back like code.

DeepSeek's optimized attention kernel for Multi-Head Latent Attention

FlashMLA is DeepSeek's MIT-licensed CUDA kernel library for optimized attention in DeepSeek-V3 and DeepSeek-V3.2-Exp style inference. It includes dense MLA decoding plus sparse attention kernels for DeepSeek Sparse Attention, with README-reported H800/CUDA metrics up to 3000 GB/s, 660 TFLOPS, and sparse 640/410 TFlops paths. It has 12.7K+ GitHub stars.

AI quality testing for bias, drift, and vulnerabilities

Giskard is an open-source testing framework for evaluating AI model quality, detecting bias, data drift, and security vulnerabilities. It provides automated test generation for LLMs and tabular models, scanning for issues like hallucination, prompt injection susceptibility, stereotypical outputs, and data leakage. Integrates with CI/CD pipelines for continuous model validation before deployment.

Modern task queue and workflow orchestration built on PostgreSQL

Hatchet is an open-source task queue and workflow orchestration platform designed as a modern alternative to Celery and BullMQ. Built on PostgreSQL for durability, it handles background jobs, AI agent workflows, RAG pipelines, and GPU task scheduling with TypeScript and Python SDKs. YC W24 batch with 7,400+ GitHub stars, MIT licensed. Supports fan-out, rate limiting, retries, and real-time observability through a web dashboard.

Unified API, performance, and contract testing DSL

Karate is an open-source testing framework that unifies API testing, performance testing, UI automation, and contract testing in a single BDD-style DSL. Write tests in plain Gherkin-like syntax without any Java knowledge. Built-in assertions, data-driven testing, parallel execution, and HTML reports. 8,900+ GitHub stars, MIT licensed. Mature, actively maintained project with commercial support options for comprehensive API quality assurance.

Visual IDE for React that designers can use

Onlook is an open-source visual editor for React and Next.js with 25.9K+ GitHub stars that lets designers edit real code-backed interfaces on an infinite canvas. It connects visual changes, AI chat, component and layer inspection, and versioned code workflows so teams can prototype and refine product UI without treating design files as the source of truth.

OpenTelemetry-native LLM observability instrumentation

OpenLLMetry by Traceloop is an open-source instrumentation library with 7,000+ GitHub stars that adds OpenTelemetry-native tracing to LLM and AI agent applications. It captures detailed traces of model calls including latency, token usage, costs, and error rates, exporting data to any OpenTelemetry-compatible backend like Grafana, Datadog, or Jaeger for vendor-neutral AI observability.

Open-source AI-powered PR review with slash commands

PR-Agent by Qodo is the most widely adopted open-source AI code review tool with 11,500+ GitHub stars and 207 contributors. It provides automated PR description generation, intelligent line-by-line code review, and actionable improvement suggestions through intuitive slash commands like /describe, /review, and /improve, integrating natively with GitHub Actions, GitLab CI, Bitbucket, and Azure DevOps.

Open-source AI coding agent with self-hosted deployment option

Refact.ai is an open-source/on-premise oriented AI coding agent for VS Code and JetBrains that supports BYOK model routing, codebase understanding, developer-tool integrations and self-hosted deployment. Its public site now warns that Refact Cloud is shutting down soon, so teams should treat hosted availability as a migration risk and validate the current enterprise support path.

Browser automation with AI vision — no XPath or DOM parsing needed

Skyvern automates browser-based workflows using LLMs and computer vision instead of brittle XPath or CSS selectors. It understands web pages visually, navigating forms, clicking buttons, and extracting data like a human would. Achieved 85.85% success rate on WebVoyager benchmark and SOTA on WRITE tasks for RPA. 21,000+ GitHub stars, AGPL-3.0 licensed. Skyvern Cloud offers managed usage-based hosting for teams that prefer not to self-host the infrastructure.

Official Slack MCP server for approved workspace search, messaging, canvas, and user-context actions.

Slack MCP Server is Slack’s official remote MCP layer for giving approved AI clients workspace context and controlled actions. It lets agents search messages, files, users, and channels, draft or send messages, read threads, manage canvases, and authenticate through Slack OAuth while workspace admins approve integrations and normal Slack rate limits still apply.

AI-powered data quality for ML datasets

Cleanlab is a data-centric AI library that automatically detects and fixes label errors, outliers, and data quality issues in machine learning datasets. It works with any ML model and any data type including text, images, tabular, and audio by analyzing model predictions to identify mislabeled examples, near-duplicates, and ambiguous data points. Cleanlab helps teams improve model accuracy by cleaning training data rather than tuning model architecture.

Open-source dev environment management with AI integration

Daytona is secure, elastic infrastructure for running AI-generated code in isolated sandboxes. It gives agents and developer workflows programmable environments with dedicated kernel, filesystem, network, vCPU, memory, and disk, backed by OCI/Docker compatibility, SDK/API access, and under-90ms sandbox startup. The project has 72,000+ GitHub stars and is AGPL-3.0 licensed.

Run LLMs as a single portable executable file

Llamafile by Mozilla packages a complete LLM — model weights, inference engine, and OpenAI-compatible API server — into a single executable file that runs on Mac, Windows, Linux, FreeBSD, and OpenBSD with no installation. Built on llama.cpp and Cosmopolitan Libc for cross-platform portability, it delivers GPU-accelerated inference when available and falls back to optimized CPU execution. Supports GGUF models with a built-in web chat UI and REST API for integration.

Evaluation framework for RAG pipelines

RAGAS is an Apache-2.0 open-source evaluation framework with 14K+ GitHub stars that provides standardized metrics for assessing RAG pipeline quality. It measures faithfulness, answer relevancy, context precision, and context recall to identify whether retrieval, generation, or both are failing. It is framework-agnostic, supports LLM-as-judge evaluation, and its README discloses minimal anonymized Open Analytics with a RAGAS_DO_NOT_TRACK opt-out.

MIT-licensed autonomous coding-agent reference, now superseded for many new uses by mini-swe-agent.

SWE-agent is an MIT-licensed autonomous coding-agent reference from Princeton and Stanford researchers that takes GitHub issues and attempts fixes with a bring-your-own language model. Its agent-computer interface remains foundational for repository navigation, editing, and test execution. The README now says development has shifted to mini-swe-agent, which supersedes SWE-agent and is generally recommended going forward.

Open-source, local-first Notion alternative with built-in AI

AppFlowy is an open-source workspace platform offering documents, wikis, databases, and project management as a privacy-first alternative to Notion. Built with Rust and Flutter for native performance, it runs fully offline with local data storage by default. AI features include writing assistance, summarization, and translation powered by configurable LLM providers. 72.5K+ GitHub stars, backed by a growing contributor community with self-hosted and cloud deployment options.

Git-friendly offline API client

Open-source API client for testing REST, GraphQL, and gRPC APIs as a lightweight, privacy-focused alternative to Postman. Stores API collections as plain files in your Git repository for easy version control and team collaboration. Features environment variables, scripting, collection runner, and a declarative syntax called Bru. Offline-first with no cloud account required. Available on macOS, Windows, and Linux. 44K+ GitHub stars and growing rapidly among developers leaving Postman.

AI-native data application framework with SQL generation and agents

DB-GPT is an open-source AI-native data app framework combining SQL generation, database chat, RAG, and multi-agent orchestration for data-centric workflows. It supports natural language to SQL conversion, automated data analysis, and custom data app development. Integrates with MySQL, PostgreSQL, SQLite, and more. 19,000+ GitHub stars, MIT licensed. Positioned as an alternative to MindsDB for teams building AI-powered data applications and internal database tools.

Drag-and-drop LLM flow builder

Flowise is an open-source, low-code UI and API platform for building customized LLM orchestration flows, multi-agent systems, and autonomous AI applications using drag-and-drop node graphs.

Multi-agent CLI pair programmer with FORGE, MUSE, and SAGE agents

Model-agnostic terminal coding tool with 3 specialized agents: FORGE for code editing, MUSE for planning and review, and SAGE for research. Connects to hundreds of LLM providers and models with local-first privacy and conversational Git integration. Apache 2.0 licensed. A thoughtfully designed multi-agent approach that separates concerns between coding, thinking, and information gathering for more reliable results.

Self-evolving local computer agent with a reusable skill tree

GenericAgent is a minimal, self-evolving autonomous agent from a 3.3K-line seed and ~3K core loop that gives LLMs system-level control of a local computer. It writes files, runs shell commands, browses the web, and uses keyboard/mouse/screen/mobile tools, while skill crystallization saves successful runs into a reusable skill tree that cuts token cost on repeats.

Delightful JavaScript testing

Jest is Meta's open-source JavaScript and TypeScript testing framework with batteries-included support for unit, integration, and snapshot tests. Zero-config for most projects, it bundles its own test runner, assertion library, mocking utilities, code coverage, and parallel execution. The de facto standard for React, Node.js, Next.js, and modern JS apps, and a common target for AI-generated test suites.

AI agent testing and LLM evaluation platform

LangWatch is an AI agent testing, LLM evaluation, and observability platform for production AI teams. It combines traces, evaluations, scenario simulations, guardrails, prompt management, and Optimization Studio/DSPy workflows, with cloud and self-managed options for teams that need release-quality feedback loops.

Framework for evaluating LLM and agent performance

OpenAI Evals is an open-source framework and benchmark registry for evaluating LLM performance on custom tasks. It provides infrastructure for writing evaluation prompts, running them against models, and recording results in a structured format for comparison. The hosted Evals API on the OpenAI platform adds managed run tracking, dataset management, and programmatic access to evaluation pipelines. With 17,700+ GitHub stars, it serves as a foundation for systematic LLM quality measurement.

All-in-one open-source observability — logs, metrics, traces, RUM

OpenObserve is an open-source observability platform that unifies logs, metrics, traces, and real user monitoring in a single binary. It claims 140x lower storage costs than Elasticsearch through columnar storage and compression, with native OpenTelemetry support, a built-in query UI, dashboards, and alerts. Designed for AI and cloud-native workloads at petabyte scale. Over 15,000 GitHub stars.

MCP server registry and hosting

Registry and management platform for Model Context Protocol (MCP) servers that helps teams securely discover, install, deploy, and connect MCP servers for AI assistants. Smithery combines a searchable catalog, CLI setup, hosted deployments, namespaces, connection APIs, and scoped service-token flows for clients such as Claude, Cursor, Windsurf, and Codex.

Kubernetes-native framework for DevOps AI agents

kagent is a Kubernetes-native AI agent framework developed at Solo.io and accepted into the CNCF sandbox. It provides a structured environment for running DevOps-focused agents directly within Kubernetes clusters, with a dedicated kmcp toolkit for cloud-native operations. Unlike general-purpose agent frameworks, kagent targets platform engineers and SREs who need AI assistance with cluster management, troubleshooting, and infrastructure automation workflows.

Open-source no-code automation platform, self-hosted Zapier alternative

Activepieces is an open-source business automation platform and self-hostable Zapier/Make alternative. It offers a visual flow builder, TypeScript code steps, AI-native blocks, and MCP-oriented pieces for services such as Gmail, Slack, Notion, and OpenAI. With 23,000+ GitHub stars, Docker deployment, and core/open MIT Expat licensing plus separately licensed enterprise directories, it suits teams seeking data sovereignty and familiar no-code workflow automation.

Self-hosted proxy API for routing AI CLI accounts into OpenAI-compatible endpoints

CLIProxyAPI is an open-source Go proxy server that wraps Gemini CLI, Claude Code, OpenAI Codex, Grok Build, and related CLI account flows behind OpenAI/Gemini/Claude-compatible API endpoints. Use it carefully: it can touch OAuth sessions, auth files, logs, and provider account policies, so production use needs credential and ToS review.

Open-source toolkit for building AI SRE incident response agents

OpenSRE is Tracer Cloud’s open-source public-alpha Python toolkit for building AI SRE agents that investigate and respond to production incidents. It ships 60+ tools across observability, databases, incident management, communications, deployment and protocol integrations, plus simulation/evaluation workflows for benchmarking agent accuracy before live pager use.

Prompt-to-React UI with HeroUI components

HeroUI Chat turns prompts or screenshots into production-ready React code using the HeroUI open-source component library, now 29K+ GitHub stars. It generates responsive React/Tailwind interfaces on top of maintained HeroUI components rather than one-off markup, making it useful for rapid prototyping and UI scaffolding when your stack already standardizes on HeroUI.

Open-source API client

Hoppscotch is a free, open-source API development ecosystem for building, testing, documenting, and collaborating on APIs through a lightweight, fast web-based interface. It supports REST, GraphQL, WebSocket, MQTT, SSE, and Socket.IO protocols across web, desktop, and CLI clients. With 79K+ GitHub stars, 2.5M+ users, and 5M+ monthly API requests, Hoppscotch has become a leading open-source alternative to Postman for developers who prioritize speed, simplicity, and self-hostable workflows.

Open-source AI code review with hybrid AST-LLM

Kodus is an open-source AI code review platform that combines AST analysis with LLM reasoning to reduce noisy comments. Kody learns team standards, supports GitHub, GitLab, Bitbucket, and Azure DevOps, is model-agnostic across Claude, GPT, Gemini, Llama and OpenAI-compatible endpoints, and offers free/community, $10/dev monthly or $8/dev annual Teams, and Enterprise options.

Local microVM sandboxes for AI agent code execution

Microsandbox provides hardware-level isolated sandboxes for AI agents to execute code safely on local machines. Using libkrun microVMs and a 320ms bare-metal Linux/KVM homepage benchmark, it offers stronger isolation than Docker containers while staying lightweight enough for dev workstations. OCI-compatible with Python and Node.js runtimes. Apache-2.0 licensed with 6.6K+ GitHub stars.

Open-source codeless test automation with NLP-based test creation

Testsigma is an open-source codeless test automation platform where tests are written in plain English using NLP-based interpretation. It supports web, mobile, and API testing with self-healing test maintenance that adapts to UI changes automatically. Apache 2.0 licensed Community Edition is free with full functionality. Cloud edition adds parallel execution, integrations, and team management. Active development with regular releases through 2026.

OpenTelemetry-based observability SDK for LLM applications

Traceloop is an LLM reliability platform built around OpenLLMetry, an Apache-2.0 OpenTelemetry instrumentation layer for GenAI applications. It traces calls across OpenAI, Anthropic, vector databases, LangChain, LlamaIndex, and other frameworks, then sends data to OTel-compatible backends or Traceloop Cloud. Current positioning adds monitoring, evaluation dashboards, CI/CD integration, prompt management, and enterprise/on-prem options.