# Open Source

eBPF-based networking, security, and observability for Kubernetes

Cilium is a CNCF Graduated, Apache-2.0 project for Kubernetes networking, security, and observability using eBPF. It can replace kube-proxy, enforce identity-aware L3-L7 network policies, and add Hubble flow observability plus Tetragon runtime-security signals. Current source checks support GKE Dataplane V2 using Cilium/eBPF and Azure CNI Powered by Cilium for AKS.

Official debugger for MCP server development

MCP Inspector is the official interactive developer tool from the Model Context Protocol team for testing, debugging, and validating MCP servers. It provides a visual interface to inspect available tools, test transport configurations, export configs for different clients, and verify protocol compliance during MCP server development.

Distributed AI compute engine for scaling Python and ML workloads

Ray is an open-source distributed computing framework built for scaling AI and Python applications from a laptop to thousands of GPUs. It provides libraries for distributed training, hyperparameter tuning, model serving, reinforcement learning, and data processing under a single unified API. Ray's public site highlights OpenAI and other enterprise users. Maintained by Anyscale with Apache-2.0 open-source licensing.

Unified framework for fine-tuning 100+ large language models

LLaMA-Factory is an open-source toolkit providing a unified interface for fine-tuning over 100 LLMs and vision-language models. It supports SFT, RLHF with PPO and DPO, LoRA and QLoRA for memory-efficient training, and continuous pre-training. The LLaMA Board web UI enables no-code configuration, while CLI and YAML workflows serve advanced users. Integrates with Hugging Face, ModelScope, vLLM, and SGLang for model deployment.

Reliable end-to-end testing

Cross-browser E2E testing framework by Microsoft supporting Chromium, Firefox, and WebKit with one API. Features auto-waiting, tracing with timeline/screenshots/DOM snapshots, codegen for recording tests, and parallel execution. Component testing for React, Vue, Svelte. Built-in API testing, network mocking, and mobile emulation. Known for reliability and speed vs Selenium/Cypress. 70K+ GitHub stars, rapidly becoming the E2E standard.

Ultra-fast SIMD-accelerated embedded vector database with TurboQuant compression

High-performance Rust and Python vector search index utilizing TurboQuant 2-to-4-bit data-oblivious quantization for ultra-compact memory footprint and zero-training ANN retrieval.

High-throughput LLM serving engine

vLLM is an Apache-2.0 LLM inference and serving engine focused on high-throughput self-hosted model APIs. It combines PagedAttention, continuous batching, prefix caching, quantization options, OpenAI-compatible serving, structured outputs, metrics, Docker/Kubernetes deployment guidance and integrations with agent and LLM frameworks.

Run GitHub Actions locally for fast feedback

Act is an open-source tool that runs GitHub Actions workflows locally using Docker containers that match GitHub's execution environment. It provides instant feedback on workflow changes without pushing to a repository, supports matrix builds, secret management, and artifact handling. Act can also replace Makefiles by using workflow files as task definitions, making it useful for both CI/CD development and local task automation across development teams.

Build and share ML web apps in Python with a few lines of code

Gradio is a 42K+ star Apache-2.0 Python library for building interactive web interfaces around machine-learning functions and apps. It supports 40+ components for text, images, audio, video, 3D, chat, plots, JSON, and dataframes. Apps can be hosted free on Hugging Face Spaces, shared through public links, or extended with server-side rendering, streaming, API clients, and MCP server support.

Open-source observability platform for metrics, logs, and traces visualization.

Grafana is the leading open-source platform for monitoring and observability visualization. It connects to virtually any data source — Prometheus, Elasticsearch, InfluxDB, PostgreSQL, CloudWatch, Datadog, and 150+ others — to create beautiful, interactive dashboards. Used by millions of users at companies like Bloomberg, JPMorgan, eBay, and PayPal. Grafana Cloud offers a fully managed experience with generous free tier. The CNCF ecosystem standard for metrics visualization.

Sentry-style observability for AI agent conversations

Latitude is an agent observability platform for teams that need to inspect LLM traces, conversations, issues, and evaluation feedback in one workflow. Its public repo and docs position it as a Sentry-style monitor for AI agents, with semantic search, issue detection, annotations, MCP-assisted fixes, and cloud or self-hosted deployment paths for production debugging.

Security scanner for MCP servers against tool poisoning attacks

MCP-Scan is a security tool that scans MCP servers for vulnerabilities including tool poisoning, prompt injection, cross-origin escalation, and rug pull attacks. Acquired by Snyk in 2026, it is the first dedicated security scanner for the MCP ecosystem. It analyzes tool descriptions, permissions, and behavior patterns to detect malicious or compromised MCP servers before they can exploit AI agents.

Serverless Postgres

Serverless Postgres platform separating storage and compute for branching, autoscaling, read replicas, instant restore, and scale-to-zero workloads. Neon works with standard PostgreSQL clients and ORMs, supports extensions such as pgvector, and sits inside a broader Neon backend platform with Auth, Data API, Functions, Object Storage, and AI Gateway features.

Microsoft's distributed approximate nearest neighbor search library and billion-scale vector engine

Microsoft's distributed approximate nearest neighbor search library and online vector serving engine, utilizing space-partition trees and relative neighborhood graphs for billion-scale semantic retrieval.

The open-source Firebase alternative

Open-source Firebase alternative providing a full backend-as-a-service on PostgreSQL. Auto-generated REST and GraphQL APIs from your schema, real-time subscriptions, built-in auth with 20+ social providers and Row Level Security, S3-compatible file storage with CDN, and Deno-powered Edge Functions. Visual dashboard with SQL editor and table editor. Supports pgvector for AI apps. Self-hostable or managed with a generous free tier. 75K+ GitHub stars.

Declarative GitOps continuous delivery tool for Kubernetes.

Argo CD is the most popular GitOps continuous delivery tool for Kubernetes. It continuously monitors Git repositories and automatically syncs application state to match the desired configuration. A CNCF graduated project used by thousands of organizations for deploying to Kubernetes clusters.

Turn GitHub repositories into interactive architecture maps

Visual architecture generator that transforms any GitHub repository into an interactive system design map within seconds. Analyzes repository structures and README documentation to produce validated component flowcharts, dependency graphs, and Mermaid diagrams. Supports direct URL routing by replacing hub with diagram, provides instant export to SVG and PNG formats, and handles private repositories through user-supplied personal access tokens.

Official MCP server for GitHub repo operations

GitHub MCP Server is the official Model Context Protocol server from GitHub that connects AI assistants to repositories, issues, pull requests, workflows, and code search. It exposes 100+ operations with toolset filtering, permission scoping, and audit logging, available in both remote-hosted and self-hosted Docker deployment modes.

Open-source post-building layer for agents — tracing, evals, and online monitoring

Judgeval is the open-source post-building layer for AI agents from Judgment Labs, providing OpenTelemetry-based tracing, hosted and custom evaluation scorers, and online behavior monitoring for LLM-powered applications. Instrument any function with a single decorator, score live production traffic against faithfulness and instruction-adherence checks, and feed real-world failures back into reinforcement learning or supervised fine-tuning loops.

Official open catalog of Model Context Protocol servers

The official, community-run registry for discovering and publishing Model Context Protocol (MCP) servers — an open index that MCP clients read to find available servers.

Modern API documentation platform and OpenAPI reference generator

Scalar is an API documentation platform that generates beautiful, interactive API references from OpenAPI specifications. It provides a modern OpenAPI reference interface with dark mode, request examples in multiple languages, and a built-in API client. Available as open-source packages for any framework or as a hosted platform.

Up-to-date docs for AI code editors via MCP

Context7 is an MCP server developed by Upstash that injects up-to-date, version-specific documentation directly into AI code editors and coding assistants. By typing 'use context7' in prompts, developers get accurate library documentation instead of hallucinated or outdated API references. It pulls from official source documentation and serves it through the Model Context Protocol, solving the common problem of LLMs generating code with incorrect or nonexistent API calls.

Apache-2.0 Python framework for repeatable LLM, RAG, agent, MCP, and safety evaluation workflows.

DeepEval is an Apache-2.0 Python framework for evaluating LLM apps, RAG systems, agents, MCP workflows, and safety behavior with repeatable test cases. It works locally and in CI/CD, then connects to Confident AI for hosted reports, observability, red teaming, and governance when teams need shared evidence instead of ad-hoc prompt reviews and manual QA.

TypeScript ORM that feels like SQL

Lightweight, serverless-ready TypeScript ORM with zero dependencies bringing SQL-like syntax into TypeScript for maximum type-safety. Maps queries closely to raw SQL with full auto-completion and type inference. Features Drizzle Kit for migrations, Drizzle Studio for visual browsing, supports PostgreSQL, MySQL, SQLite, and Turso. Runs on Node.js, Bun, Deno, Cloudflare Workers, and Vercel Edge. 26K+ GitHub stars, growing fast as a Prisma alternative.

Turn websites into LLM-ready structured data

Firecrawl is a Y Combinator-backed API that crawls websites and converts them into clean, LLM-ready Markdown or structured JSON. Handles JavaScript rendering, pagination, sitemaps, and anti-bot measures automatically. Designed for RAG pipelines, AI agents, and data extraction workflows. Features batch crawling, scheduled scraping, webhook notifications, and custom extraction schemas. Processes content for direct ingestion into vector databases and LLM context windows.

Open-source identity and access management

Keycloak is an open-source IAM solution with 25K+ GitHub stars by Red Hat. Provides SSO, social login, LDAP/Active Directory federation, standard protocol support (OIDC, OAuth 2.0, SAML), fine-grained authorization, user federation, and admin console. Features identity brokering, multi-tenancy via realms, and client adapters for Java, JavaScript, and Node.js. Self-hosted with no per-user licensing, making it ideal for organizations needing full control over identity infrastructure.

Kubernetes cost monitoring and optimization platform

Kubecost is an IBM Apptio / Cloudability product for Kubernetes cost visibility, allocation, and optimization, built around the Kubecost/OpenCost ecosystem. It helps map infrastructure spend to Kubernetes namespaces, deployments, pods, labels, and teams. OpenCost remains the vendor-neutral Apache-2.0 open-source project for cloud-native cost allocation with AWS, Azure, GCP, and Prometheus integrations.

Intelligent memory layer for AI agents and assistants

Mem0 is an open-source intelligent memory layer for AI agents with 51K+ GitHub stars providing persistent, adaptive memory across sessions. It manages working, short-term, and long-term memory types, enabling personalized AI experiences that improve over time. Features automatic memory extraction from conversations, semantic search over stored memories, multi-format support, and integration with 100+ frameworks. Simple API for adding memory to any LLM-powered application or agent.

Multi-agent orchestration plugin for Claude Code

Oh My ClaudeCode (OMC) is a plugin for Claude Code that adds multi-agent orchestration with 19 specialized agents, smart model routing between Haiku and Opus, and execution modes such as Autopilot, Team, Ralph, Ultrawork, and Deep Interview. It provides lifecycle hooks, a real-time HUD statusline, and source-backed Claude Code workflows that turn one session into a coordinated AI development team.

Run LLMs locally with one command

Tool for running large language models locally on your machine with a simple CLI interface. Download and run Llama 3, Mistral, Gemma, Phi, Code Llama, and dozens of other open-source models with a single command. Features model management, GPU acceleration (NVIDIA/AMD/Apple Silicon), OpenAI-compatible API server, Modelfile for customization, and multi-model switching. Ideal for offline AI development, privacy-sensitive use cases, and local testing. 120K+ GitHub stars.

Open-source product analytics, session replay, and feature flags

PostHog is an open-source product and data tools platform for analytics, session replay, feature flags, experiments, surveys, error tracking, web analytics, data warehouse, CDP and LLM observability workflows. It suits developer-led teams that want one integrated product OS instead of many separate tools.

High-performance vector database written in Rust for similarity search at scale.

Qdrant is a high-performance vector similarity search engine and database written in Rust. Designed for production-grade AI applications with advanced filtering, payload indexing, and distributed deployment. Supports billion-scale vector collections with sub-second query times. Popular choice for RAG, recommendation systems, and anomaly detection.

Official Chrome DevTools MCP server for coding agents

chrome-devtools-mcp is the Chrome DevTools team's official MCP server that lets coding agents control and inspect a live Chrome browser with first-party Chrome DevTools Protocol fidelity. It exposes Network inspection, Performance traces, Lighthouse audits, console output, and structured DOM snapshots as typed MCP tools, so agents can debug real pages and ship reliable web performance investigations without resorting to brittle DOM scraping.

Automated code review for any linter on CI

reviewdog is an open-source automated code review tool that integrates any linter or static analysis tool with GitHub, GitLab, Bitbucket, and Gitea pull requests. Parses output in errorformat, Checkstyle XML, SARIF, and JSON formats to post inline review comments on changed lines only. Works with GitHub Actions, Travis CI, CircleCI, GitLab CI, and Jenkins. Supports 40+ languages through universal linter adapter architecture.

Open-source low-code platform for building internal tools and business applications.

Appsmith is an open-source low-code platform for building internal tools, admin panels, and dashboards. Drag-and-drop UI builder with 45+ widgets, connects to any database or API. Supports JavaScript for custom logic. Self-hostable alternative to Retool with 35K+ GitHub stars.

Open-source LLM observability and evaluation

Phoenix by Arize is an open-source AI observability platform for tracing, evaluating, and debugging LLM applications. It captures prompt-response pairs, retrieval context, agent tool calls, and latency data through OpenTelemetry-based instrumentation. Provides experiment tracking, dataset management, and evaluation frameworks for systematically improving AI application quality. 10K+ GitHub stars.

Open-source identity provider for self-hosted SSO and access management

Authentik is an open-source Identity Provider supporting SAML, OAuth2/OIDC, LDAP, RADIUS, and SCIM for self-hosted single sign-on. It provides customizable authentication flows, multi-factor authentication, user management, and proxy-based SSO for applications without native support. Positioned as a modern Keycloak alternative with 22K+ GitHub stars, free Open Source use, and paid Enterprise/Enterprise Plus plans.

Open-source Docker gateway for containerized MCP server orchestration

Docker MCP Gateway is Docker's open-source orchestration layer for Model Context Protocol servers. It gives MCP clients one gateway, launches catalog servers in isolated containers on demand, injects credentials, applies runtime restrictions, and routes tool requests. Catalogs and profiles let teams reuse approved server collections across clients, while Docker Desktop can run the gateway automatically with MCP Toolkit enabled.

Secure cloud sandboxes for AI agents

E2B provides secure cloud sandboxes that let AI agents execute code, run terminal commands, and interact with filesystems in isolated environments. Each sandbox spins up in ~150ms with its own OS, giving agents a safe space to run untrusted code. Supports Python, JavaScript, and any language via custom Dockerfiles. Used by AI coding assistants, data analysis agents, and code interpreters. SDK available for Python and JavaScript with a simple API for programmatic sandbox control.

Apache-2.0 Python framework for building MCP servers, clients, apps, and deployable agent tool surfaces.

FastMCP is an Apache-2.0 Python framework for building MCP servers, clients, and apps with decorators, type hints, transports, auth patterns, deployment docs, and telemetry hooks. The project now resolves to PrefectHQ/fastmcp, with Prefect Horizon available as a separate enterprise MCP gateway for identity, RBAC, audit, monitoring, and server governance.

Open-source feature flags and A/B testing platform

GrowthBook is an open-source platform for feature flags, A/B testing, and product experimentation. It includes Bayesian and frequentist statistics engines, warehouse-native analytics connecting to BigQuery, Snowflake, and Databricks, and SDKs for 15+ languages. GrowthBook supports targeting rules, gradual rollouts, and an MCP server for AI agent integration. Self-hostable via Docker.

Open-source AI agent framework with persistent memory, reusable skills, tools, and messaging gateways

Hermes Agent is an open-source AI agent framework with persistent memory, reusable skills, 40+ tools, cron jobs, and messaging gateways.

Open-source LLM engineering platform for observability

Langfuse is an open-source LLM engineering platform with 29K+ GitHub stars for tracing, evaluating, and monitoring AI applications. Acquired by ClickHouse, it provides detailed traces of LLM calls, prompt management with versioning, dataset-based evaluation, user feedback collection, and cost tracking. Framework-agnostic with native integrations for LangChain, LlamaIndex, OpenAI SDK, and Vercel AI SDK. Offers both self-hosted deployment and a managed cloud service.

Self-hosted multi-model AI chat platform

LibreChat is an open-source ChatGPT-like interface with 35K+ GitHub stars supporting multiple AI providers in a single self-hosted platform. Connect OpenAI, Anthropic, Google, Mistral, local models via Ollama, and custom endpoints simultaneously. Features conversation branching, file uploads, code interpreter, plugins, presets, multi-user support with RBAC, and LDAP/SSO authentication. Privacy-focused alternative to commercial AI chat services with full data ownership.

Data framework for LLM applications

Leading Python framework for building LLM-powered applications with focus on data-aware and agentic workflows. Provides tools for RAG (Retrieval-Augmented Generation), document indexing, vector store integrations, query engines, and multi-agent orchestration. 150+ data connectors for various sources. Works with OpenAI, Anthropic, local models, and more. Includes LlamaHub for community tools and LlamaCloud for managed RAG pipelines. 50K+ GitHub stars.

LangChain CLI for maintaining agent-friendly codebase documentation

OpenWiki is LangChain’s open-source CLI for generating and maintaining an agent-focused wiki inside a codebase. It can create an openwiki/ documentation folder, update it from repository changes, add guidance to AGENTS.md or CLAUDE.md, and run via an interactive CLI or daily GitHub Action so coding agents have durable context without stuffing every detail into prompts.

Fast open-source SAST with custom rules

Semgrep is an AppSec platform with a widely used open-source engine for readable code rules plus commercial SAST, supply-chain and secrets workflows. Current product positioning emphasizes AI-assisted detection, triage and remediation, CI/pull-request integration and managed governance for security teams.

Code quality and security analysis platform

SonarQube is an open-source code quality and security platform with 10K+ GitHub stars that inspects code for bugs, vulnerabilities, code smells, and security hotspots. It enforces quality gates in CI/CD pipelines, supports 30+ languages in Team plans and 40+ in Enterprise, and remains the industry standard for static code quality management.