Best tools for DevOps Automation

AI-powered API testing with traffic recording

Keploy is an open-source AI-powered testing platform that generates API, integration, and unit tests by recording real network traffic via eBPF. It captures API calls, database queries, and streaming events, then replays them as deterministic tests with auto-generated mocks — no code changes needed. Works across any language or framework with CI/CD pipeline integration and popular testing framework support including JUnit, PyTest, Jest, and Go-Test.

AMD's open-source local LLM server with GPU and NPU acceleration

Lemonade is AMD's open-source local AI serving platform for LLMs, image generation, speech recognition, and text-to-speech on your own hardware. Built in lightweight C++, it can detect CPU, GPU, and NPU backends and is extra optimized for Ryzen AI, Radeon, and Strix Halo PCs. Lemonade exposes OpenAI, Anthropic, and Ollama-compatible APIs, ships with a desktop model manager, and supports source-confirmed GGUF, FLM, and ONNX models across Windows, Linux, macOS, and Docker.

Infrastructure, instantly

Modern cloud platform for deploying full-stack apps, databases, and workers with instant provisioning and usage-based pricing. Deploy from GitHub or CLI with zero config for Node.js, Python, Go, Rust, and Docker. Built-in PostgreSQL, MySQL, Redis, and MongoDB with auto backups. Features private networking, environment management, cron jobs, TCP proxying, and real-time logs. Popular with indie hackers and startups for fast MVPs with a generous free trial including $5 monthly credits.

OpenTelemetry-native observability with AI tracing, logs, traces, metrics, and session replay — self-hosted in 90 seconds.

Traceway is an open-source, OpenTelemetry-native observability platform that combines logs, traces, metrics, exceptions, session replay, and AI tracing in a single self-hosted system. MIT licensed with no open-core restrictions, it deploys in 90 seconds via Docker Compose and accepts OTLP/HTTP from any OTel SDK without a Collector or per-language vendor SDK.

Turn scripts into workflows, UIs, and APIs at scale

Windmill is an open-source workflow engine and developer platform built in Rust that turns scripts in Python, TypeScript, Go, Bash, SQL, and other languages into auto-generated UIs, API endpoints, workflows, data pipelines, AI agents, and scheduled jobs. The project publishes performance benchmarks against Airflow/Prefect/Temporal, supports Docker/Kubernetes self-hosting, and offers paid enterprise features.

HyperDX is the ClickStack UI for ClickHouse-backed observability. It provides a frontend for exploring logs, traces, metrics, session replay, dashboards, and alerts, with an OpenTelemetry-centered deployment path for teams that want a self-hosted or ClickHouse-aligned observability stack.

Web platform for modern development

Jamstack-focused cloud platform specializing in deploying static sites, serverless functions, and modern web applications with Git-based CI/CD. Features instant rollbacks, deploy previews for every PR, split testing, edge functions, form handling, identity/auth, and a global CDN with automatic HTTPS. Native support for Next.js, Nuxt, Gatsby, Hugo, Astro, and all major static site generators. Free $0 forever plan plus Personal and Pro credit-based tiers for growing traffic and team workflows.

Full-stack observability with AI-powered monitoring

New Relic is a full-stack observability platform combining APM, infrastructure monitoring, logs, traces, browser/mobile monitoring, synthetics, and AIOps. Current public copy highlights 50+ capabilities, 100 GB/month free data ingest, one free full platform user, unlimited basic users, and 800+ pre-built integrations.

Open-source Terraform fork — community-driven Infrastructure as Code.

OpenTofu is an open-source fork of Terraform created by the Linux Foundation after HashiCorp switched Terraform to the BSL license. Designed to preserve existing Terraform workflows and configurations, it offers state encryption, early variable evaluation, and a community-driven development model. Backed by major cloud providers and companies.

LLM evaluation and tracking with RAG triad metrics

TruLens is an open-source framework for evaluating and tracking LLM experiments with feedback functions, RAG triad metrics (answer relevance, context relevance, groundedness), and Honest/Harmless/Helpful evaluations. Features a unified Metric API for systematic evaluation of RAG pipelines and AI agents. 3,200+ GitHub stars, MIT licensed. Snowflake partnership adds enterprise integration. Supports LangChain, LlamaIndex, and custom LLM applications.

Google’s open-source Kubernetes assistant that translates natural-language intent into precise cluster operations.

kubectl-ai is an AI-powered Kubernetes assistant from Google Cloud Platform. It acts as an intelligent interface for cluster work, translating operator intent into Kubernetes commands and workflows. The key distinction from reactive diagnosis tools is that kubectl-ai is designed as an interactive natural-language interface for planning and executing Kubernetes operations, with provider configuration and MCP-oriented workflows around the CLI.

Terraform pull request automation via GitHub/GitLab comments

Atlantis is a self-hosted Terraform pull request automation tool that runs plan and apply operations triggered by GitHub, GitLab, Bitbucket, or Azure DevOps comments. Type 'atlantis plan' on a PR to see infrastructure changes, then 'atlantis apply' to deploy. 9,100+ GitHub stars, Apache 2.0 licensed. Widely adopted as the standard for GitOps-style Terraform workflows, with locking to prevent concurrent modifications to the same resources.

Better Stack is a hosted observability and incident-management platform that combines uptime monitoring, on-call workflows, status pages, logs, traces, metrics, error tracking, session replay, and an AI SRE interface. It is aimed at teams that want one SaaS control plane for telemetry and incident response.

Evaluation-first LLM and agent observability

Confident AI is an evaluation-first observability platform that scores every trace and span with 50+ metrics, alerting on quality drops in LLM and agent applications. It goes beyond traditional APM by treating evaluation as core observability, providing actionable insights that help teams understand not just whether their AI applications are running but whether they are producing correct and useful outputs.

Open-source ML and LLM monitoring with 100+ metrics

Evidently AI is an open-source platform with 100+ pre-built metrics for monitoring data quality, model performance, and data drift in AI/ML pipelines. Available under Apache 2.0 with a cloud version, it helps teams detect when production data shifts away from training distributions, LLM output quality degrades, or feature pipelines introduce anomalies that silently degrade model accuracy.

Rust-native multi-agent orchestration for production

GraphBit is a Rust-native, multi-agent orchestration framework built for production. It targets the gap between Python-first frameworks like LangGraph and the operational expectations of enterprise systems — predictable memory, low latency, deterministic concurrency, and the ability to embed an agent runtime in services that already run Rust without dragging in a Python interpreter.

Full-stack observability platform with OpenTelemetry-friendly telemetry, LLM observability, and AI SRE workflows.

Middleware is a full-stack observability platform for infrastructure, APM, logs, metrics, traces, RUM, synthetics, browser testing, LLM observability, and AI SRE workflows. It targets teams that want OpenTelemetry-friendly telemetry, faster incident correlation, and a 14-day free trial before Pay As You Go or Enterprise observability commitments and rollout planning.

CNCF Sandbox Kubernetes alert enrichment and automation platform

Robusta is a CNCF Sandbox project that enriches Kubernetes alerts with diagnostic context and automates remediation workflows. It intercepts Prometheus alerts, attaches relevant logs, pod status, resource metrics, and troubleshooting suggestions before delivering them to Slack, Teams, or PagerDuty. Supports custom playbooks for automated incident response and AI-powered root cause analysis.

AI-powered incident management in Slack and Teams

Rootly is an AI-native incident management platform that runs entirely within Slack and Microsoft Teams, automating incident workflows from detection through postmortem. It reduces manual incident overhead with AI-generated summaries, automated role assignments, escalation paths, and postmortem drafts, holding SOC 2 Type II, GDPR, and HIPAA compliance certifications for enterprise use.

Autonomous Kubernetes management and predictive scaling

Sedai provides an autonomous control layer for Kubernetes that right-sizes workloads, remediates anomalies, and performs predictive autoscaling ahead of traffic demand. Sedai says it manages large enterprise cloud environments for customers including Palo Alto Networks and builds behavioral models to scale pods before demand arrives rather than reacting after performance degrades.

Kubernetes-native testing for coding agents

Signadot is a Kubernetes-native validation platform that lets developers test agent-generated code in isolated preview environments mimicking production. It creates lightweight sandboxes within existing clusters where code changes can be validated against real microservice dependencies, ensuring that AI-generated modifications do not break cross-service interactions before merging to main.

LLM observability and evaluation by Weights & Biases

W&B Weave is the LLM observability and evaluation toolkit from Weights & Biases. It provides automatic tracing of LLM calls with full input/output logging, cost and latency tracking, evaluation pipelines with custom scorers, and a trace explorer for debugging multi-step agent workflows. Integrates with OpenAI, Anthropic, LangChain, and CrewAI via simple Python/TypeScript decorators.

MCP server for controlling Windows desktops through UIAutomation

Windows-MCP is an open-source MCP server for giving AI agents structured access to Windows desktop automation. It focuses on UIAutomation, snapshots, input control, and Windows-specific app workflows, making it different from general filesystem or shell MCP servers.

AI-driven log analysis with zero false positives

Dash0 is an AI-driven observability platform focused on log analysis that auto-structures unstructured logs, provides instant alerting with zero false positives, and delivers full-stack tracing capabilities. It uses AI to transform raw log data into structured, searchable events without requiring manual parsing configuration, making log-based debugging significantly faster for engineering teams.

Open-source Kubernetes security platform for risk analysis and compliance

Kubescape is a CNCF-backed open-source Kubernetes security platform that scans clusters, manifests, and container images for vulnerabilities, misconfigurations, and compliance violations. It checks against NSA-CISA, MITRE ATT&CK, and CIS benchmarks, integrates into CI/CD pipelines, and provides runtime threat detection via eBPF. Supports SBOM generation and vulnerability scanning. Used by ARMO with growing enterprise adoption in cloud-native security.

LLM evaluation and tracing by Comet

Opik is an open-source LLM evaluation and tracing platform by Comet ML for debugging, testing, and monitoring AI applications. Provides detailed traces of LLM calls with latency, token usage, and cost tracking. Features automated evaluation with built-in and custom metrics, dataset management for regression testing, and production monitoring dashboards. Integrates with the broader Comet ML experiment tracking ecosystem. Available as both self-hosted open-source and managed cloud service.

Observability platform purpose-built for Python and Pydantic AI apps

Pydantic Logfire is an observability platform built by the Pydantic team specifically for Python AI applications. It provides structured logging, distributed tracing, and metrics with native understanding of Pydantic models, FastAPI, and AI framework data types. Auto-instruments OpenAI, Anthropic, LangChain, and other LLM providers. Built on OpenTelemetry for vendor-neutral data export. Offers a managed cloud dashboard with a generous free tier for development and small-scale production use.

Zero Trust runtime security for Kubernetes and AI

AccuKnox provides Zero Trust runtime threat prevention for Kubernetes and cloud workloads with an AI-powered prompt firewall to prevent LLM injection attacks. Built on the open-source KubeArmor project, it manages Kubernetes identities via policy-as-code, enforces runtime security policies, and provides real-time workload protection for AI-native infrastructure environments.

Observability and lifecycle management for AI agents

AgentOps is an observability platform for monitoring, debugging, and managing AI agents. It provides session replay, event timelines, tool-call and LLM tracing, cost tracking, and dashboards for multi-agent workflows. Integrations span OpenAI, CrewAI, AutoGen, LangChain, LangGraph, LlamaIndex, Google ADK, OpenAI Agents, xAI, and 400+ LLMs/frameworks.

AI observability with security posture management

Coralogix uses AI to provide actionable insights across logs and traces with a dedicated AI-SPM dashboard for tracking prompt injections and data leaks in AI applications. Its pay-per-use model with no upfront fees integrates security posture management directly into the observability stack, making it uniquely positioned for teams running both traditional and AI-powered production workloads.

Modern task queue and workflow orchestration built on PostgreSQL

Hatchet is an open-source task queue and workflow orchestration platform designed as a modern alternative to Celery and BullMQ. Built on PostgreSQL for durability, it handles background jobs, AI agent workflows, RAG pipelines, and GPU task scheduling with TypeScript and Python SDKs. YC W24 batch with 7,400+ GitHub stars, MIT licensed. Supports fan-out, rate limiting, retries, and real-time observability through a web dashboard.

Multi-agent simulation and LLM evaluation platform

Maxim AI is an evaluation and monitoring platform for LLM applications with multi-agent simulation capabilities. Features automated test generation from production traces, custom evaluation metrics, regression detection, and real-time monitoring dashboards. Supports simulating multi-turn conversations for testing chatbots and agents at scale. Provides prompt versioning, A/B testing, and integration with CI/CD pipelines for continuous quality assurance of AI outputs across deployment cycles.

Data and AI observability for enterprise teams

Monte Carlo is the leading data and AI observability platform using ML to monitor pipelines, warehouses, and lakes for quality issues. It detects freshness delays, volume anomalies, schema changes, and distribution shifts before they impact analytics. With 500+ deployments at Nasdaq, Honeywell, and Roche, it provides automated root cause analysis, field-level lineage, and incident management. Available on AWS and Azure Marketplace.

OpenTelemetry-native LLM observability instrumentation

OpenLLMetry by Traceloop is an open-source instrumentation library with 7,000+ GitHub stars that adds OpenTelemetry-native tracing to LLM and AI agent applications. It captures detailed traces of model calls including latency, token usage, costs, and error rates, exporting data to any OpenTelemetry-compatible backend like Grafana, Datadog, or Jaeger for vendor-neutral AI observability.

Official Slack MCP server for approved workspace search, messaging, canvas, and user-context actions.

Slack MCP Server is Slack’s official remote MCP layer for giving approved AI clients workspace context and controlled actions. It lets agents search messages, files, users, and channels, draft or send messages, read threads, manage canvases, and authenticate through Slack OAuth while workspace admins approve integrations and normal Slack rate limits still apply.

Open-source dev environment management with AI integration

Daytona is secure, elastic infrastructure for running AI-generated code in isolated sandboxes. It gives agents and developer workflows programmable environments with dedicated kernel, filesystem, network, vCPU, memory, and disk, backed by OCI/Docker compatibility, SDK/API access, and under-90ms sandbox startup. The project has 72,000+ GitHub stars and is AGPL-3.0 licensed.

Self-evolving local computer agent with a reusable skill tree

GenericAgent is a minimal, self-evolving autonomous agent from a 3.3K-line seed and ~3K core loop that gives LLMs system-level control of a local computer. It writes files, runs shell commands, browses the web, and uses keyboard/mouse/screen/mobile tools, while skill crystallization saves successful runs into a reusable skill tree that cuts token cost on repeats.

AI agent testing and LLM evaluation platform

LangWatch is an AI agent testing, LLM evaluation, and observability platform for production AI teams. It combines traces, evaluations, scenario simulations, guardrails, prompt management, and Optimization Studio/DSPy workflows, with cloud and self-managed options for teams that need release-quality feedback loops.

AI-powered SRE agent for Kubernetes troubleshooting

Metoro is an AI SRE platform for Kubernetes that combines observability with autonomous troubleshooting. Its Guardian agent monitors cluster health, correlates metrics, logs, and traces to identify root causes, and suggests remediation actions. Features an MCP server for integration with AI coding agents and natural language querying of infrastructure state.

All-in-one open-source observability — logs, metrics, traces, RUM

OpenObserve is an open-source observability platform that unifies logs, metrics, traces, and real user monitoring in a single binary. It claims 140x lower storage costs than Elasticsearch through columnar storage and compression, with native OpenTelemetry support, a built-in query UI, dashboards, and alerts. Designed for AI and cloud-native workloads at petabyte scale. Over 15,000 GitHub stars.

Industry-standard incident management and on-call alerting platform

PagerDuty is an enterprise incident management platform for on-call scheduling, alert routing, escalation policies, and incident response orchestration. It integrates with 750+ monitoring, ticketing, cloud, and collaboration tools, including Datadog, Slack, Jira, AWS, and Microsoft Teams. Current pricing lists a Free tier for up to 5 users, Professional from $21/user/mo annually ($25 monthly), Business from $41/user/mo annually ($49 monthly), and Enterprise custom.

Kubernetes-native framework for DevOps AI agents

kagent is a Kubernetes-native AI agent framework developed at Solo.io and accepted into the CNCF sandbox. It provides a structured environment for running DevOps-focused agents directly within Kubernetes clusters, with a dedicated kmcp toolkit for cloud-native operations. Unlike general-purpose agent frameworks, kagent targets platform engineers and SREs who need AI assistance with cluster management, troubleshooting, and infrastructure automation workflows.

Open-source no-code automation platform, self-hosted Zapier alternative

Activepieces is an open-source business automation platform and self-hostable Zapier/Make alternative. It offers a visual flow builder, TypeScript code steps, AI-native blocks, and MCP-oriented pieces for services such as Gmail, Slack, Notion, and OpenAI. With 23,000+ GitHub stars, Docker deployment, and core/open MIT Expat licensing plus separately licensed enterprise directories, it suits teams seeking data sovereignty and familiar no-code workflow automation.

Open-source toolkit for building AI SRE incident response agents

OpenSRE is Tracer Cloud’s open-source public-alpha Python toolkit for building AI SRE agents that investigate and respond to production incidents. It ships 60+ tools across observability, databases, incident management, communications, deployment and protocol integrations, plus simulation/evaluation workflows for benchmarking agent accuracy before live pager use.

AWS AI assistant for terminal and code

Amazon Q Developer CLI is an agentic AI assistant from AWS that enhances the terminal experience with deep AWS integration, code generation, and natural-language command translation. Completes multi-step development tasks, troubleshoots AWS services, writes infrastructure code, and handles documentation lookups directly from the shell. Included with AWS accounts and integrates with existing AWS credentials.

Agentic DevOps automation via ChatOps

Kubiya is an agentic automation platform for DevOps and platform teams that uses specialized agents with connectors for Kubernetes, AWS, GitHub, Jira, and Terraform to automate operational tasks through Slack or web portals. It provides Terraform module support for infrastructure-as-code configuration and manages agent behaviors with policy-based controls for enterprise-grade governance.

OpenTelemetry-based observability SDK for LLM applications

Traceloop is an LLM reliability platform built around OpenLLMetry, an Apache-2.0 OpenTelemetry instrumentation layer for GenAI applications. It traces calls across OpenAI, Anthropic, vector databases, LangChain, LlamaIndex, and other frameworks, then sends data to OTel-compatible backends or Traceloop Cloud. Current positioning adds monitoring, evaluation dashboards, CI/CD integration, prompt management, and enterprise/on-prem options.

Continuous integration and delivery

Cloud CI/CD platform known for speed and Docker-first workflows. Offers parallelism, intelligent caching, and orbs (reusable configuration packages) for common tasks. Used by Spotify, Samsung, and Ford. Strong at complex build pipelines with conditional logic, matrix builds, and granular resource allocation that help large teams optimize their build times.