Best tools for DevOps Automation

Open-source microVMs for secure serverless and AI agent sandboxing

Firecracker is an open-source virtual machine monitor that creates lightweight microVMs with sub-150ms cold starts, originally built by AWS for Lambda and Fargate. With 28,000+ GitHub stars, it provides kernel-level isolation for running untrusted code safely and powers the sandboxing infrastructure behind AI coding agents like Devin and E2B.

Open-source feature flags and remote configuration

Flagsmith is an open-source feature flag and remote config platform with 15+ SDKs, a clean REST API, and simple Docker deployment. It supports boolean, multivariate, and string flags with segment-based targeting, A/B testing via flag variations, and environment-based workflows. Flagsmith provides a straightforward self-hosted alternative to LaunchDarkly with full API-first design under a BSD-3-Clause license.

Free open-source local AWS emulator as a drop-in LocalStack replacement

Floci is a free open-source AWS emulator designed as a lightweight drop-in replacement for LocalStack Community Edition. It runs on port 4566 with the same endpoint conventions, supporting S3, SQS, DynamoDB, RDS, ElastiCache, API Gateway, Cognito, IAM, and twenty-plus other services. The Docker image is ninety megabytes versus LocalStack's one gigabyte and starts in twenty-four milliseconds.

GitOps toolkit for Kubernetes — continuous delivery the cloud-native way.

Flux is a CNCF graduated GitOps tool for keeping Kubernetes clusters in sync with configuration sources like Git repositories, Helm charts, and OCI artifacts. Lightweight, composable, and designed to work with existing tools. The primary alternative to ArgoCD in the GitOps space.

Run your app close to users

Global application hosting platform that runs full-stack apps, databases, and services close to users in 30+ regions using lightweight Firecracker micro-VMs. Deploy Docker containers or use built-in builders for Rails, Laravel, Django, Node.js, and Go. Features persistent volumes, private networking, auto-scaling, PostgreSQL/Redis managed databases, and a powerful CLI. Ideal for latency-sensitive apps needing multi-region presence. Generous free allowance with pay-as-you-go pricing.

Free and open-source Kubernetes IDE for managing clusters visually

Freelens is a free open-source Kubernetes IDE that provides a visual desktop interface for managing clusters, workloads, and configurations. Forked from the original Lens project after its licensing change, Freelens offers the same powerful cluster management experience with real-time monitoring, log viewing, and resource editing under the MIT license.

Open-source GPU control plane for scalable AI model serving

Open-source GPU cluster manager that configures vLLM, SGLang, TensorRT-LLM or custom engines, serves models through compatible APIs, and provisions SSH-accessible GPU instances across on-premises, Kubernetes and cloud environments.

Built-in CI/CD for GitLab

GitLab's built-in CI/CD pipeline system defined via .gitlab-ci.yml files in your repository. Features multi-stage pipelines, parallel jobs, matrix builds, environments with deployment tracking, merge train for serialized merges, auto DevOps for zero-config CI/CD, container registry, and security scanning (SAST/DAST). Supports self-hosted runners and Kubernetes executors. Tightly integrated with GitLab's merge requests and issue tracking. A leading alternative to GitHub Actions for GitLab users.

Modular AI agent framework with off-prompt data

Griptape is an open-source Python framework for building AI agents and workflows with a focus on modularity and enterprise-grade off-prompt data handling. It separates predictable pipeline logic from unpredictable LLM interactions, providing structures for sequential and parallel task execution with built-in memory management and tool integration.

Production-grade Terraform modules and infrastructure library

Gruntwork provides a library of battle-tested, production-grade Terraform modules covering AWS, GCP, and Azure infrastructure patterns. Modules handle networking, compute, databases, security, monitoring, and compliance with best practices built in. Terragrunt, their open-source Terraform wrapper with 15k+ stars, adds DRY configuration, remote state management, and multi-account orchestration.

AI-powered CI/CD and DevOps platform

Enterprise DevOps platform with AI-driven deployment verification, auto-rollback, and pipeline optimization. AIDA AI assistant helps debug failed deployments. Open-source tier (Gitness) available. Covers CI/CD, feature flags, cloud cost management, and security testing in a single unified platform for engineering teams.

Cloud platform for app deployment

Heroku is one of the original platform-as-a-service providers, letting developers deploy and scale web apps with a simple `git push heroku main`. Pioneered buildpacks, dyno-based scaling, and the add-on marketplace for managed Postgres, Redis, workers, and observability. Now a Salesforce product supporting Node.js, Ruby, Python, Java, Go, PHP, and custom Docker containers.

AI-native API gateway by Alibaba with MCP server hosting and LLM routing

Higress is an open-source AI-native API gateway developed by Alibaba that combines traditional API management with LLM-specific capabilities like token-based rate limiting, model routing, prompt caching, and MCP server hosting. Built on Envoy and Istio, it provides enterprise-grade traffic management while natively understanding AI workload patterns including streaming responses, long-lived connections, and multi-model fallback chains.

FOCUS-native multi-cloud cost management and FinOps platform

Holori is a multi-cloud cost management platform built on the FOCUS billing data standard. It provides unified cost visibility across AWS, Azure, GCP, and other cloud providers with automated tagging, budget alerts, and optimization recommendations. Features interactive infrastructure diagrams that link architecture visualization directly to cost data for contextual spending analysis.

Durable workflow orchestration for serverless and edge

Inngest is a workflow orchestration platform that replaces queues, state management, and scheduling with durable step functions. Write functions in TypeScript, Python, or Go that survive failures, sleep for days between steps, and retry only failed steps. SDKs integrate natively with Next.js, Vercel, and serverless platforms. Free tier includes 50,000 runs/month. Used by Resend, Mintlify, and Ocoya for background jobs, AI orchestration, and event-driven workflows.

Leading open-source service mesh for Kubernetes microservices

Istio is the most widely adopted open-source service mesh for Kubernetes, providing traffic management, security, and observability for microservice architectures. It uses Envoy proxy sidecars to intercept and manage service-to-service communication with mutual TLS, fine-grained traffic routing, circuit breaking, and distributed tracing. CNCF Graduated project used in production by Google, IBM, and Salesforce.

Open-source post-building layer for agents — tracing, evals, and online monitoring

Judgeval is the open-source post-building layer for AI agents from Judgment Labs, providing OpenTelemetry-based tracing, hosted and custom evaluation scorers, and online behavior monitoring for LLM-powered applications. Instrument any function with a single decorator, score live production traffic against faithfulness and instruction-adherence checks, and feed real-world failures back into reinforcement learning or supervised fine-tuning loops.

Cloud-native POSIX filesystem on object storage

JuiceFS is a high-performance distributed POSIX filesystem built on object storage like S3 and metadata engines like Redis or MySQL. It enables seamless data sharing across thousands of clients with low latency and elastic throughput. JuiceFS ships with a Kubernetes CSI driver, Hadoop SDK compatibility, and FUSE mount support for AI training, big data analytics, and shared storage workloads. Apache 2.0 licensed with 13K+ GitHub stars.

Terminal dashboard for Kubernetes

K9s is an open-source terminal UI with 28K+ GitHub stars for managing Kubernetes clusters interactively. Provides a real-time dashboard with resource navigation, log tailing, shell access to pods, port forwarding, and RBAC visualization — all from the terminal without kubectl commands. Features Vim-style navigation, custom resource views, plugin system, cluster metrics, and multi-cluster support. Dramatically reduces the complexity of daily Kubernetes operations for developers and SREs.

Kubernetes-native model inference platform

KServe is an open-source Kubernetes-native platform for deploying and managing ML model inference at scale. It provides standardized inference protocols, autoscaling including scale-to-zero, canary rollouts, A/B testing, and multi-model serving. KServe supports all major ML frameworks including TensorFlow, PyTorch, scikit-learn, XGBoost, and LLM runtimes like vLLM and Triton through pluggable serving runtimes.

JavaScript framework for building and visualizing multi-agent workflows on a Kanban board

KaibanJS is an MIT-licensed JavaScript framework for defining AI agents, tasks, tools, and teams, then orchestrating their work through a Kanban-inspired runtime and visual board. It can run inside Node.js, React, or Next.js projects, supports custom UIs and headless workflows, and provides real-time task-state visibility for multi-agent applications.

Open-source AIOps alert management platform

Keep is an open-source AIOps platform that provides a single pane of glass for all alerts from monitoring tools like Datadog, PagerDuty, Grafana, and 50+ integrations. It uses AI to correlate, deduplicate, and enrich alerts, reducing noise and helping on-call teams focus on real incidents. Keep includes workflow automation, bidirectional sync with ticketing systems, and a modern web dashboard.

Declarative orchestration for data, AI, and infra

Kestra is an open-source orchestration platform that uses declarative YAML to define event-driven and scheduled workflows for data pipelines, infrastructure automation, and AI workloads. With over 1,200 plugins, it connects to databases, cloud services, APIs, and SaaS tools without custom glue code. Kestra reached version 1.0 LTS with agentic AI capabilities, SDKs for Python, TypeScript, Java, and Go, and SOC 2 compliance. Clients include Leroy Merlin, Huawei, Tencent, and Decathlon.

CNCF Sandbox chaos engineering framework for Kubernetes resilience

Krkn is a CNCF Sandbox chaos engineering tool that tests Kubernetes cluster resilience by injecting controlled failures. It simulates pod kills, node failures, network partitions, CPU/memory pressure, and zone outages. Krkn-AI adds AI-powered scenario generation that suggests chaos experiments based on cluster topology. Supports CI/CD integration for automated resilience testing in deployment pipelines.

Kubernetes operator for serving AI inference workloads

KubeAI is an Apache-2.0 Kubernetes operator for deploying and scaling AI inference workloads, including LLMs, embeddings, reranking, and speech-to-text. It gives platform teams OpenAI-compatible endpoints, model proxy/controller primitives, model caching, scale-from-zero behavior, and cluster-native resource management for self-hosted inference on Kubernetes.

Modern application delivery platform for Kubernetes

KubeVela is a CNCF incubating project that provides a modern application delivery platform built on Kubernetes and the Open Application Model. It abstracts away infrastructure complexity by letting developers define applications declaratively with components, traits, and policies, while platform teams manage delivery workflows. KubeVela supports multi-cluster deployment, canary rollouts, GitOps integration, and extensible addon system.

Open-source MLOps platform for Kubernetes

Kubeflow is a CNCF open-source MLOps platform with 14,000+ GitHub stars for deploying and managing machine learning workflows on Kubernetes. It provides notebooks for experimentation, scalable training pipelines with distributed computing support, model serving with autoscaling, and comprehensive pipeline orchestration for teams running AI/ML workloads in cloud-native environments.

Open-source toolkit for quantizing, deploying, and serving LLMs and vision-language models

LMDeploy is an Apache-2.0 toolkit for self-hosting LLM and vision-language model inference with TurboMind and PyTorch engines. It combines continuous batching, blocked KV cache, tensor parallelism, AWQ and KV-cache quantization with OpenAI-compatible APIs, multi-GPU distribution, offline pipelines, and production metrics.

AI copilot for the Lens Kubernetes IDE

Lens Prism is an AI copilot integrated into the Lens Kubernetes IDE (the world's most popular K8s desktop client) that troubleshoots clusters, explains errors in plain English, and helps manage multi-cluster environments visually. It simplifies Kubernetes complexity for developers who prefer visual tools over CLI, providing AI-powered debugging and cluster management within a familiar desktop interface.

Engineering intelligence for DORA metrics and workflow automation

LinearB is a software engineering intelligence platform trusted by over 3,000 engineering leaders to track DORA metrics, cycle time broken into four phases (coding, pickup, review, deploy), and developer workflow patterns. It connects to Git repos and project management tools, benchmarks team performance against 8.1M+ pull requests from 4,800 organizations, and automates workflow improvements via gitStream — a policy-as-code engine for PR routing, labeling, and review automation.

Open-source AI-powered log analysis by Salesforce

LogAI is an open-source log analysis platform by Salesforce Research that uses deep learning to detect anomalies in large-scale system logs. It provides research-backed autonomous log troubleshooting capabilities, applying ML models to identify patterns, cluster log events, and surface anomalies that would be invisible in manual log review across high-volume production environments.

macOS and Linux VM runtime for AI agents on Apple Silicon

Lume is an open-source CLI for creating and managing macOS and Linux virtual machines on Apple Silicon, built specifically for AI agent sandboxing, CI/CD pipelines, and desktop automation. Using Apple's native Virtualization.Framework for near-native performance, it provides the missing isolation layer for running coding agents safely — so an accidental destructive command doesn't affect your host machine.

Community self-hosted MCP server for Jira and Confluence (Python)

MCP Atlassian is a community-built, self-hosted Python MCP server (sooperset/mcp-atlassian) that connects AI coding agents to Jira and Confluence using API tokens or personal access tokens. It runs on your own infrastructure and supports both Cloud and Server/Data Center deployments — a flexible alternative to Atlassian's official remote MCP server when you need on-prem control, custom auth, or self-managed configuration.

IBM-backed ContextForge gateway for federating MCP, A2A, REST, and gRPC APIs

MCP Context Forge is IBM’s Apache-2.0 ContextForge project for operating a gateway, registry, and proxy across MCP servers, A2A agents, REST APIs, and gRPC services. It centralizes discovery, authentication, policy controls, federation, and observability, with deployment paths through PyPI, Docker, and Kubernetes.

Self-hosted MCP gateway for managing multiple servers behind a single endpoint

MCPJungle is a self-hosted gateway that aggregates multiple MCP servers behind a single endpoint. It provides server discovery, health checking, access control, and request routing so AI clients connect to one gateway rather than managing individual server connections. Supports server grouping, authentication, and monitoring dashboards for production MCP deployments.

CLI package manager for MCP servers with profile-based configuration

MCPM is a command-line package manager for MCP servers that handles installation, configuration, and profile management. It supports profile-based server grouping where different AI workflows use different sets of MCP servers. Features a server registry, automatic dependency resolution, and configuration file management for Claude Desktop and other MCP clients.

MCP server manager for installing and running Model Context Protocol servers

MCPorter is a management tool for discovering, installing, and running MCP servers. It provides a registry of available servers, handles dependency installation, manages configuration, and starts servers with proper environment setup. Simplifies the process of connecting AI agents to external tools through MCP by abstracting server lifecycle management. Over 5,700 GitHub stars.

Modern data pipeline orchestration with built-in AI

Mage AI is an open-source data pipeline orchestration tool positioned as a modern alternative to Apache Airflow. It provides a visual pipeline editor, native AI integrations for generating pipeline code, real-time streaming support, and built-in data quality checks. Mage handles batch and streaming workloads with a developer-friendly notebook-style interface and deploys to any cloud provider.

AI-powered file-type detection at Google scale

Open-source AI-powered file-type detection tool from Google that uses a custom deep-learning model under a few megabytes to identify more than 200 binary and textual content types in milliseconds, even on a single CPU. Magika ships as a CLI, Python package, JavaScript/TypeScript library, and an ONNX model, achieves around 99% accuracy on its test set, and is already used at Google scale across Gmail, Drive, and Safe Browsing as well as by VirusTotal and abuse.ch.

Connect AI agents to hundreds of integrations via one interface

Metorial is an open-source integration hub that connects AI agents to hundreds of third-party services through a single interface with built-in OAuth handling, scaling, and monitoring. It simplifies the complexity of managing multiple MCP connections by providing a unified connector layer for agentic workflows.

Free MIT-licensed drop-in replacement for LocalStack

MiniStack is a free, MIT-licensed drop-in replacement for LocalStack that emulates 33 AWS services using real infrastructure — actual Postgres for RDS, real Redis for ElastiCache, real Docker for ECS — rather than faking API responses. Born from LocalStack's surprise paywall in March 2026, it starts in 2 seconds, idles at 30MB RAM versus LocalStack's ~500MB, and runs real services for accurate local AWS development.

Disaggregated KV cache storage and transfer for LLM serving

Open-source infrastructure for disaggregated LLM serving that pools KV caches across prefill and decode workers, with high-performance transfer, distributed storage and integrations for vLLM and SGLang.

Distributed inference orchestration above vLLM, SGLang and TensorRT-LLM

Open-source, datacenter-scale orchestration layer that coordinates vLLM, SGLang and TensorRT-LLM across nodes with disaggregated serving, KV-aware routing, multi-tier cache management and automatic scaling.

Open-source zero-trust networking with WireGuard

NetBird is an open-source zero-trust networking platform that creates encrypted WireGuard overlay networks between devices without opening ports or configuring firewalls. It provides peer-to-peer connectivity with NAT traversal, access control policies, DNS management, and a web dashboard for team management. NetBird replaces traditional VPNs with a simpler, more secure mesh networking approach for self-hosted infrastructure and remote teams.

Observability data accessible to AI agents via MCP

Netdata's MCP integration exposes infrastructure monitoring, discovery, and root-cause analysis capabilities to AI agents. Built into the 78K+ star Netdata monitoring platform, it lets agents query real-time metrics, explore system health, investigate incidents, and generate observability reports through the Model Context Protocol.

Low-code visual programming for event-driven apps

Node-RED is a flow-based, low-code development tool originally created by IBM in 2013 for wiring together hardware devices, APIs, and online services. Now an OpenJS Foundation project with nearly 23,000 GitHub stars, it provides a browser-based visual editor where flows are built by dragging and connecting nodes, then deployed to the Node.js runtime in a single click. Over 5,000 community-contributed nodes cover protocols like MQTT, Modbus, and OPC-UA alongside cloud APIs and databases.

Unified CI/CD and deployment platform with GPU support

Northflank is a unified platform for CI/CD, deployment, and infrastructure management that supports both traditional web applications and GPU-native AI workloads. It provides preview environments with full-stack database and AI model inclusion, BYOC deployment on any cloud, built-in observability, and automated scaling. Handles the complete deployment lifecycle from Git push to production with support for containers, databases, and GPU instances.

Open-source Kubernetes cost monitoring (CNCF)

OpenCost is a CNCF-certified open-source tool for real-time Kubernetes cost monitoring that maps cloud spend directly to namespaces, deployments, pods, and labels. It provides granular cost allocation across teams and projects without vendor lock-in, supporting AWS, GCP, Azure, and on-premises clusters as the industry standard for open-source FinOps visibility in cloud-native environments.