Open Source Tools

Run LLMs as a single portable executable file

Llamafile by Mozilla packages a complete LLM — model weights, inference engine, and OpenAI-compatible API server — into a single executable file that runs on Mac, Windows, Linux, FreeBSD, and OpenBSD with no installation. Built on llama.cpp and Cosmopolitan Libc for cross-platform portability, it delivers GPU-accelerated inference when available and falls back to optimized CPU execution. Supports GGUF models with a built-in web chat UI and REST API for integration.

Evaluation framework for RAG pipelines

RAGAS is an Apache-2.0 open-source evaluation framework with 14K+ GitHub stars that provides standardized metrics for assessing RAG pipeline quality. It measures faithfulness, answer relevancy, context precision, and context recall to identify whether retrieval, generation, or both are failing. It is framework-agnostic, supports LLM-as-judge evaluation, and its README discloses minimal anonymized Open Analytics with a RAGAS_DO_NOT_TRACK opt-out.

MIT-licensed autonomous coding-agent reference, now superseded for many new uses by mini-swe-agent.

SWE-agent is an MIT-licensed autonomous coding-agent reference from Princeton and Stanford researchers that takes GitHub issues and attempts fixes with a bring-your-own language model. Its agent-computer interface remains foundational for repository navigation, editing, and test execution. The README now says development has shifted to mini-swe-agent, which supersedes SWE-agent and is generally recommended going forward.

Open-source, local-first Notion alternative with built-in AI

AppFlowy is an open-source workspace platform offering documents, wikis, databases, and project management as a privacy-first alternative to Notion. Built with Rust and Flutter for native performance, it runs fully offline with local data storage by default. AI features include writing assistance, summarization, and translation powered by configurable LLM providers. 72.5K+ GitHub stars, backed by a growing contributor community with self-hosted and cloud deployment options.

Git-friendly offline API client

Open-source API client for testing REST, GraphQL, and gRPC APIs as a lightweight, privacy-focused alternative to Postman. Stores API collections as plain files in your Git repository for easy version control and team collaboration. Features environment variables, scripting, collection runner, and a declarative syntax called Bru. Offline-first with no cloud account required. Available on macOS, Windows, and Linux. 44K+ GitHub stars and growing rapidly among developers leaving Postman.

AI-native data application framework with SQL generation and agents

DB-GPT is an open-source AI-native data app framework combining SQL generation, database chat, RAG, and multi-agent orchestration for data-centric workflows. It supports natural language to SQL conversion, automated data analysis, and custom data app development. Integrates with MySQL, PostgreSQL, SQLite, and more. 19,000+ GitHub stars, MIT licensed. Positioned as an alternative to MindsDB for teams building AI-powered data applications and internal database tools.

Drag-and-drop LLM flow builder

Open-source protocol for connecting AI models to external tools and data sources, created by Anthropic. Provides a standardized way for LLMs to interact with APIs, databases, and local files through a universal client-server architecture. Rapidly adopted across the AI ecosystem as the standard interface between AI assistants and the tools they need to be useful.

Multi-agent CLI pair programmer with FORGE, MUSE, and SAGE agents

Model-agnostic terminal coding tool with 3 specialized agents: FORGE for code editing, MUSE for planning and review, and SAGE for research. Connects to hundreds of LLM providers and models with local-first privacy and conversational Git integration. Apache 2.0 licensed. A thoughtfully designed multi-agent approach that separates concerns between coding, thinking, and information gathering for more reliable results.

Self-evolving local computer agent with a reusable skill tree

GenericAgent is a minimal, self-evolving autonomous agent from a 3.3K-line seed and ~3K core loop that gives LLMs system-level control of a local computer. It writes files, runs shell commands, browses the web, and uses keyboard/mouse/screen/mobile tools, while skill crystallization saves successful runs into a reusable skill tree that cuts token cost on repeats.

Delightful JavaScript testing

Jest is Meta's open-source JavaScript and TypeScript testing framework with batteries-included support for unit, integration, and snapshot tests. Zero-config for most projects, it bundles its own test runner, assertion library, mocking utilities, code coverage, and parallel execution. The de facto standard for React, Node.js, Next.js, and modern JS apps, and a common target for AI-generated test suites.

AI coding agent by Moonshot AI

Terminal-based AI coding agent from Moonshot AI, powered by Kimi K2.5 with a 256K context window that achieves 76.8% on SWE-Bench Verified. Reads and edits code, executes shell commands, fetches web pages, and autonomously plans multi-step development workflows through natural language. Moonshot's entry into the AI coding agent market, leveraging their strength in large-context language models.

AI agent testing and LLM evaluation platform

LangWatch is an AI agent testing, LLM evaluation, and observability platform for production AI teams. It combines traces, evaluations, scenario simulations, guardrails, prompt management, and Optimization Studio/DSPy workflows, with cloud and self-managed options for teams that need release-quality feedback loops.

Framework for evaluating LLM and agent performance

OpenAI Evals is an open-source framework and benchmark registry for evaluating LLM performance on custom tasks. It provides infrastructure for writing evaluation prompts, running them against models, and recording results in a structured format for comparison. The hosted Evals API on the OpenAI platform adds managed run tracking, dataset management, and programmatic access to evaluation pipelines. With 17,700+ GitHub stars, it serves as a foundation for systematic LLM quality measurement.

All-in-one open-source observability — logs, metrics, traces, RUM

OpenObserve is an open-source observability platform that unifies logs, metrics, traces, and real user monitoring in a single binary. It claims 140x lower storage costs than Elasticsearch through columnar storage and compression, with native OpenTelemetry support, a built-in query UI, dashboards, and alerts. Designed for AI and cloud-native workloads at petabyte scale. Over 15,000 GitHub stars.

Kubernetes-native framework for DevOps AI agents

kagent is a Kubernetes-native AI agent framework developed at Solo.io and accepted into the CNCF sandbox. It provides a structured environment for running DevOps-focused agents directly within Kubernetes clusters, with a dedicated kmcp toolkit for cloud-native operations. Unlike general-purpose agent frameworks, kagent targets platform engineers and SREs who need AI assistance with cluster management, troubleshooting, and infrastructure automation workflows.

Open-source no-code automation platform, self-hosted Zapier alternative

Activepieces is an open-source business automation platform and self-hostable Zapier/Make alternative. It offers a visual flow builder, TypeScript code steps, AI-native blocks, and MCP-oriented pieces for services such as Gmail, Slack, Notion, and OpenAI. With 23,000+ GitHub stars, Docker deployment, and core/open MIT Expat licensing plus separately licensed enterprise directories, it suits teams seeking data sovereignty and familiar no-code workflow automation.

Self-hosted proxy API for routing AI CLI accounts into OpenAI-compatible endpoints

CLIProxyAPI is an open-source Go proxy server that wraps Gemini CLI, Claude Code, OpenAI Codex, Grok Build, and related CLI account flows behind OpenAI/Gemini/Claude-compatible API endpoints. Use it carefully: it can touch OAuth sessions, auth files, logs, and provider account policies, so production use needs credential and ToS review.

Open-source toolkit for building AI SRE incident response agents

OpenSRE is Tracer Cloud’s open-source public-alpha Python toolkit for building AI SRE agents that investigate and respond to production incidents. It ships 60+ tools across observability, databases, incident management, communications, deployment and protocol integrations, plus simulation/evaluation workflows for benchmarking agent accuracy before live pager use.

AI-powered code review and refactoring assistant

Automated code reviewer that integrates with GitHub PRs. Detects code quality issues, suggests refactoring, and auto-generates reviews. Python specialist with growing JS/TS support and 1.8k+ GitHub stars. Enforces team coding standards consistently and helps developers learn best practices through inline suggestions on every pull request.

Prompt-to-React UI with HeroUI components

HeroUI Chat turns prompts or screenshots into production-ready React code using the HeroUI open-source component library, now 29K+ GitHub stars. It generates responsive React/Tailwind interfaces on top of maintained HeroUI components rather than one-off markup, making it useful for rapid prototyping and UI scaffolding when your stack already standardizes on HeroUI.

Open-source API client

Hoppscotch is a free, open-source API development ecosystem for building, testing, documenting, and collaborating on APIs through a lightweight, fast web-based interface. It supports REST, GraphQL, WebSocket, MQTT, SSE, and Socket.IO protocols across web, desktop, and CLI clients. With 79K+ GitHub stars, 2.5M+ users, and 5M+ monthly API requests, Hoppscotch has become a leading open-source alternative to Postman for developers who prioritize speed, simplicity, and self-hostable workflows.

Open-source AI code review with hybrid AST-LLM

Kodus is an open-source AI code review platform that combines AST analysis with LLM reasoning to reduce noisy comments. Kody learns team standards, supports GitHub, GitLab, Bitbucket, and Azure DevOps, is model-agnostic across Claude, GPT, Gemini, Llama and OpenAI-compatible endpoints, and offers free/community, $10/dev monthly or $8/dev annual Teams, and Enterprise options.

Local microVM sandboxes for AI agent code execution

Microsandbox provides hardware-level isolated sandboxes for AI agents to execute code safely on local machines. Using libkrun microVMs and a 320ms bare-metal Linux/KVM homepage benchmark, it offers stronger isolation than Docker containers while staying lightweight enough for dev workstations. OCI-compatible with Python and Node.js runtimes. Apache-2.0 licensed with 6.6K+ GitHub stars.

Open-source codeless test automation with NLP-based test creation

Testsigma is an open-source codeless test automation platform where tests are written in plain English using NLP-based interpretation. It supports web, mobile, and API testing with self-healing test maintenance that adapts to UI changes automatically. Apache 2.0 licensed Community Edition is free with full functionality. Cloud edition adds parallel execution, integrations, and team management. Active development with regular releases through 2026.

OpenTelemetry-based observability SDK for LLM applications

Traceloop is an LLM reliability platform built around OpenLLMetry, an Apache-2.0 OpenTelemetry instrumentation layer for GenAI applications. It traces calls across OpenAI, Anthropic, vector databases, LangChain, LlamaIndex, and other frameworks, then sends data to OTel-compatible backends or Traceloop Cloud. Current positioning adds monitoring, evaluation dashboards, CI/CD integration, prompt management, and enterprise/on-prem options.

AI test generation from production traffic

Tusk is a Y Combinator W24-backed AI testing platform that converts real production traffic into unit and API tests, catching regressions in 43% of PRs. Its Drift SDK records live API traces with just 10 lines of code, then AI generates executable test cases covering thousands of edge cases from actual user behavior, auto-maintaining suites as application logic evolves without manual script writing.

Open-source RAG-based text-to-SQL engine

Vanna AI is an MIT-licensed text-to-SQL and SQL-agent framework with 23.6K+ GitHub stars. Its current Vanna 2.0 story adds user-aware agents, access control, audit logs, streaming UI components, and optional hosted admin features for teams that need natural-language database access without locking into one LLM or database. The original repo is now archived, so verify the current Vanna 2.0 path before adoption.

Security scanner for AI model files

ModelScan by Protect AI is an open-source tool that scans machine learning model files for malicious or unsafe code before they are loaded into production. Supporting formats like Pickle, HDF5, and SavedModel, it detects hidden code execution, deserialization attacks, and supply chain threats in the AI/ML model artifact pipeline, integrating into CI/CD as a critical security gate.

AI-native security for coding agents

Corridor is an AI-native security platform that intercepts vulnerabilities at the code generation layer, providing real-time guardrails and automated PR security reviews for teams using AI coding agents like Cursor, Claude Code, and GitHub Copilot. Founded by former CISA Secure by Design lead Jack Cable and backed by $25M Series A from Felicis at a $200M valuation, Corridor embeds proactive security context into developer workflows via MCP server integration.

Natural language interface for running code on your computer

Open Interpreter is an open-source natural-language interface for computers. It runs Python, JavaScript, shell commands, and other code locally through a ChatGPT-like terminal workflow, with user approval before execution. It can use hosted providers or local models, but its main tradeoff is safety: approved commands can access local files, apps, and system resources.

MCP server for connecting AI assistants to Supabase projects

Supabase MCP is Supabase's Apache-2.0 server for connecting AI assistants to Supabase projects. It can expose database, configuration, and project-management workflows to MCP clients such as Cursor, Claude, and Windsurf, while the official docs emphasize permission and security review before production use, SQL changes, or high-privilege database access.

JetBrains-first AI coding assistant with next-edit autocomplete and an open-weight 1.5B model

Sweep is a JetBrains-first AI coding assistant that pairs a next-edit autocomplete engine with an in-IDE coding agent. Autocomplete watches recent edits to predict where you'll change code next; tab jumps between proposed locations to compress multi-file refactors. The agent stages multi-file diffs inside the IDE. A 1.5B open-weight next-edit model shipped in February 2026. VS Code and Zed users currently get autocomplete only.

Browser automation framework

The original browser automation framework with multi-language support for Java, Python, JavaScript, and C#. Drives end-to-end testing across all major browsers via the WebDriver protocol. Despite newer alternatives, Selenium remains the industry standard for large-scale automated browser testing, with the largest community and most extensive tooling ecosystem.

Prompt fuzzing tool for LLM security testing

ps-fuzz by Prompt Security is a security testing tool with 680+ GitHub stars that fuzzes system prompts against dynamic LLM-based attack scenarios including jailbreaks, prompt injection, and data extraction attempts. It helps developers harden their GenAI applications by simulating adversarial attacks in a controlled environment, turning LLM security into a testable and reproducible quality gate.

The open-source automation server

Open-source automation server for building, testing, and deploying software. Jenkins is the de facto self-hosted CI/CD platform with thousands of plugins for source control, build tools, cloud providers, and notifications. Pipelines are defined as Groovy code (Jenkinsfile) and run on distributed agents. Battle-tested in enterprise environments since 2011 — the reference implementation for self-managed CI before SaaS alternatives existed.

Desktop orchestrator for parallel AI coding agents

1Code is an open-source desktop application for running multiple AI coding agents in parallel with isolated git worktrees and browser previews. It orchestrates agents like Claude Code and Codex in separate sandboxed environments, preventing conflicts while enabling concurrent development on different features. Built by the 21st.dev team with 5,300+ GitHub stars.

Modern open-source server management panel

1Panel is a modern open-source Linux server management panel built with Go that provides a clean web interface for managing websites, databases, containers, and system resources. It features a marketplace with 165+ one-click app installs including Nextcloud and Bitwarden, automatic SSL provisioning with Let's Encrypt, visual Docker container management, and built-in firewall configuration. 1Panel also supports native AI agent deployment through Ollama integration.

npm for design engineers — shadcn/ui component marketplace

21st.dev is the largest open-source marketplace of shadcn/ui-based React Tailwind components, blocks, and hooks. Used by 1.4M developers with 200K monthly active users. Functions as an MCP server enabling AI coding agents to discover and compose UI components via API. Features a Magic AI feature that generates components from natural language prompts. All components installable with npx shadcn.

Next-gen multi-agent framework (AutoGen fork)

AG2 (formerly AutoGen) is an open-source multi-agent AI framework that emerged as a community-driven fork of Microsoft AutoGen, founded by original creators Chi Wang and Qingyun Wu after leaving Microsoft. Licensed Apache 2.0 under open governance, it provides an AgentOS for multi-agent conversations, tool use with any LLM, human-in-the-loop workflows, group chat orchestration, and teachable agents. AG2 Beta adds streaming, event-driven production architecture.

Open standard for guiding AI coding agents at the repository level

AGENTS.md is an open standard format adopted by 60,000+ open-source projects for providing AI coding agents with repository-level instructions. With 20,000+ GitHub stars, it has been adopted by GitHub Copilot, OpenAI Codex, Google Gemini CLI, and multiple IDEs as the de facto way to communicate project context and coding conventions to AI agents.

AI red teaming and infrastructure security scanner by Tencent

AI-Infra-Guard is Tencent's open-source AI security platform providing one-click evaluation of AI infrastructure risks across five modules. It covers insecure config detection, multi-agent workflow evaluation, MCP server scanning across 14 risk categories, vulnerability scanning for 55+ AI frameworks with 1,000+ CVE mappings, and jailbreak evaluation for prompt robustness. Deployable via Docker with academic backing from Peking and Fudan Universities.

Cloud-native control plane for scalable GenAI inference

Open-source Kubernetes-native building blocks for deploying, routing and scaling GenAI inference, including an LLM gateway, autoscaling, LoRA management and KV-cache offloading.

All-in-one LLM CLI tool with shell assistant, RAG, and function calling

All-in-one LLM CLI written in Rust that gives unified access to 20+ AI providers (OpenAI, Claude, Gemini, Ollama, Groq, Mistral, DeepSeek, and more) through one terminal interface. Includes a shell assistant, interactive REPL with session management, RAG over local files and URLs, custom roles, function calling, and a built-in HTTP server exposing Chat Completions, Embeddings, and Rerank APIs plus an LLM Playground and Arena for model comparison.

MCP servers for AWS cloud services and workflows

AWS MCP Servers is a collection of open-source MCP server implementations from AWS Labs that connect AI coding agents to AWS services. It includes servers for AWS documentation, knowledge bases, and managed cloud workflows, enabling agents to provision resources, query docs, and manage infrastructure through the Model Context Protocol.

Open-source desktop AI coworker for browsing and code execution.

Accomplish Coworker is an MIT-licensed open-source AI coworker that runs on the desktop, combining computer-use style browsing with code execution so agents can research, implement, run, and debug workflows in one local environment.

Multi-agent coordination framework

A framework for coordinating multiple AI agents working together on complex development tasks. Defines agent roles, communication patterns, task delegation strategies, and inter-agent workflows to break down large projects into manageable, parallel workstreams handled by specialized agents. Ideal for teams experimenting with multi-agent architectures where different AI models handle distinct aspects of software development.

Browser automation CLI built for AI agents by Vercel Labs

Agent Browser is a Rust-based browser automation CLI designed specifically for AI agent workflows rather than traditional testing. Developed by Vercel Labs, it provides semantic element selection through a refs system, accessibility tree snapshots, session persistence, and authentication vaults. Unlike Playwright or Puppeteer which target test automation, Agent Browser optimizes for token efficiency and deterministic element selection that gives LLMs reliable browser interaction capabilities.

Terminal session manager and command center for AI coding agents

Productivity dashboard for managing AI agents, tasks, and workflows through a unified web and mobile interface. Centralizes monitoring, organization, and coordination of multiple AI-powered workflows so developers and teams can keep track of agent activity, task assignments, and project status in one place. Cross-platform access, categorization and prioritization tools, and progress tracking reduce the cognitive overhead of juggling multiple agent tools.