Best tools for DevOps Automation

OpenTelemetry-native observability for LLM applications with evals and GPU monitoring

OpenLIT is an open-source AI engineering platform that provides OpenTelemetry-native observability for LLM applications. It combines distributed tracing, evaluation, prompt management, a secrets vault, and GPU telemetry in a single self-hostable stack. With 50+ integrations across LLM providers and frameworks, it lets teams monitor AI applications using their existing observability backends like Grafana, Datadog, or Jaeger.

Open-source general AI agent framework from the MetaGPT team

OpenManus is an open-source framework for building general-purpose AI agents, developed by core contributors from the MetaGPT community. It provides a modular architecture with planning agents, reactive agents, and tool-calling agents that can execute code, browse the web, search for information, and handle files. Built as the open alternative to Manus AI, it gained over 55,000 GitHub stars and supports multi-agent collaboration with real-time execution feedback.

Enterprise-grade sandbox for AI agent code execution

OpenSandbox is an open-source sandbox platform from Alibaba providing secure, isolated execution environments for AI coding agents. It supports Python, Java, JavaScript, and C# SDKs with a unified Sandbox Protocol for custom runtimes. Integrates with Docker and Kubernetes, offering isolation through gVisor, Kata Containers, and Firecracker microVMs with per-sandbox network controls.

Connect 2,800+ APIs for workflows and AI agents

Pipedream is a developer-focused workflow automation platform that connects over 2,800 APIs with managed OAuth and credential handling, letting teams build integrations using Node.js, Python, Go, or Bash alongside a visual no-code builder. Its MCP server exposes 10,000+ pre-built tools to AI agents for direct API access through LangChain, CrewAI, and other frameworks. Pipedream is SOC 2 Type II and HIPAA compliant with credit-based pricing starting at a free tier of 100 credits per month.

Daemonless container engine — a drop-in Docker alternative that runs rootless.

Podman is a daemonless, open-source container engine developed by Red Hat as a secure alternative to Docker. It can run, build, and manage OCI containers and pods without requiring a daemon process or root privileges. CLI-compatible with Docker commands, making migration seamless.

Task runner for Python with Poetry and uv

Poethepoet (poe) is a batteries-included task runner for Python projects that integrates with Poetry and uv package managers. Define tasks in pyproject.toml, compose them in sequential, parallel, or DAG workflows, and execute with full virtual environment context. Supports shell commands, Python scripts, environment variables, .env file loading, and auto-generated shell completion across bash, zsh, and fish for streamlined development workflows.

Internal developer portal for self-service engineering

Port is an internal developer portal platform that provides self-service interfaces for engineering teams. It offers a software catalog for tracking services, environments, and dependencies, along with self-service actions for common workflows like spinning up environments, deploying services, and managing resources. Features scorecards for engineering standards compliance and integrates with GitHub, GitLab, K8s, and cloud providers.

Container management GUI for Docker and Kubernetes

Portainer is an open-source container management platform with 32K+ GitHub stars providing a web-based GUI for Docker, Docker Swarm, and Kubernetes. Simplifies container operations with visual management of containers, images, volumes, networks, and stacks without CLI expertise. Features user management with RBAC, environment templates, GitOps deployments, and edge computing support. Community Edition is free for up to 5 environments. Business Edition adds governance and support.

Modern workflow orchestration for data pipelines

Prefect is an open-source workflow orchestration framework with 18K+ GitHub stars providing a Python-native approach to building, scheduling, and monitoring data pipelines. Turns any Python function into a schedulable, observable workflow with decorators. Features automatic retries, caching, concurrency controls, event-driven triggers, and a modern dashboard. Easier to adopt than Airflow with less boilerplate. Prefect Cloud provides managed orchestration with team collaboration features.

Opinionated code formatter for web projects

Prettier is an opinionated code formatter with 50K+ GitHub stars that enforces a consistent style by parsing and reprinting code with its own rules. Supports JavaScript, TypeScript, CSS, HTML, JSON, Markdown, YAML, GraphQL, and more. Eliminates style debates in code reviews by making formatting automatic and deterministic. Features minimal configuration by design, editor integration for format-on-save, and pre-commit hooks via husky. The de facto formatting standard for web development.

Enterprise middleware for securing AI applications against prompt attacks

Prompt Security provides enterprise security middleware that protects AI applications from prompt injection, data leakage, jailbreaks, and toxic content generation. It sits between users and LLM APIs to inspect, filter, and sanitize inputs and outputs in real-time. Supports deployment as a proxy, SDK integration, or browser extension with customizable security policies and compliance reporting.

Autonomous cloud discount management with ML

ProsperOps uses machine learning to continuously optimize cloud commitment coverage including Savings Plans and Reserved Instances, achieving Effective Savings Rates of 40% or more on AWS, GCP, and Azure. It provides autonomous discount management with a performance-based pricing model where ProsperOps shares a percentage of the savings generated, aligning costs with actual value delivered.

AI group-buying for AWS cost reduction

Pump is a YC-backed platform that uses AI and group-buying power to automate AWS cost reduction, claiming up to 60% savings on compute through collective purchasing of Reserved Instances and Savings Plans. By pooling demand across multiple customers, Pump negotiates volume discounts that individual organizations cannot access, providing enterprise-level pricing to startups and mid-market companies.

Kafka-compatible streaming platform, no JVM required

Redpanda is a Kafka-compatible streaming data platform written in C++ using the Seastar framework. It eliminates the need for ZooKeeper and the JVM, delivering up to 10x lower tail latencies and significantly reduced operational complexity. Redpanda ships as a single binary with a built-in schema registry, HTTP proxy, and message broker. It supports the Kafka wire protocol, so existing producers, consumers, and tools work without code changes. Backed by $165M+ in funding with 12.0K GitHub stars.

Cloud for the new default

Unified cloud platform for deploying web services, static sites, background workers, cron jobs, and managed databases with automatic scaling and zero DevOps. Auto-deploy from Git with preview environments, built-in DDoS protection, free TLS, and global CDN. Native runtimes for Node.js, Python, Go, Rust, Ruby, Elixir plus Docker. Managed PostgreSQL and Redis with daily backups, private networking, and infrastructure-as-code via Blueprints. Modern Heroku alternative with a free tier.

AI-powered production incident resolution

Resolve AI automates production incident investigation, diagnosis, and remediation acting as an AI SRE that participates in every on-call rotation. Autonomously investigates incidents pursuing multiple hypotheses in parallel, validates against real evidence, creates code snippets and drafts PRs, generates post-mortems, and onboards new teammates with instant answers about code and infrastructure. Drives 5x faster MTTR and 87% faster incident investigations.

Durable execution engine for workflows and AI agents

Restate is a durable execution engine that provides reliable workflow orchestration for AI agents and backend services. It runs as a single binary with no external dependencies, delivering sub-50ms latency and 94K+ actions per second. Supports TypeScript, Python, Go, Java, and Kotlin SDKs with built-in retries, sagas, and virtual object state. MIT licensed with 3,700+ GitHub stars.

Rust-powered JavaScript bundler for Vite

Rolldown is a high-performance JavaScript and TypeScript bundler written in Rust, built as the next-generation bundler for Vite. Created by Evan You and VoidZero, it offers a Rollup-compatible plugin API with 10-30x faster builds. It combines esbuild-level speed with full Rollup ecosystem compatibility, supporting tree-shaking, code splitting, and advanced optimizations natively. With 13K+ stars and MIT license, it is set to become the default bundler for Vite 8.

GPU cloud platform for AI training and inference

RunPod is a GPU cloud platform providing on-demand and serverless GPU compute for AI training and inference workloads. It offers NVIDIA A100, H100, and RTX GPUs with per-second billing, serverless inference endpoints with auto-scaling, persistent storage, and Docker-based deployment. Popular with AI developers for its competitive pricing, fast provisioning, and developer-friendly API for deploying ML models at scale.

Fast serving framework for LLMs and vision models

SGLang is an open-source serving framework for large language and vision-language models, designed for low latency and high throughput. It features RadixAttention for automatic KV cache reuse, compressed finite state machines for fast structured output generation, continuous batching, and tensor parallelism. With over 25,000 GitHub stars, it supports models like LLaMA, Mistral, Qwen, and Gemma on NVIDIA and AMD GPUs.

Build full-stack apps on your own infra

Open-source framework for building and deploying full-stack applications on AWS with infrastructure-as-code. Supports Next.js, Remix, Astro, and more with zero-config deployments. Manages Lambda, DynamoDB, S3, and other AWS services through a clean TypeScript API, giving developers the power of AWS without the complexity of CloudFormation or CDK.

AI-native observability for multi-agent systems

Sazabi is an AI-native observability platform designed for fast-moving engineering teams building with LLMs and multi-agent systems. Backed by leaders from Vercel and LangChain, it provides multi-agent tracing, tool-call visualization, and latency analysis for complex agentic workflows. Focuses on helping developers debug the complete path of requests through interconnected agents and tool calls.

Autonomous Kubernetes and GPU infrastructure optimization

ScaleOps provides autonomous real-time management of Kubernetes and GPU infrastructure, reducing cloud costs by up to 80 percent without manual configuration. Backed by 130 million in Series C funding at an 800 million dollar valuation, it serves enterprises including Adobe, Wiz, DocuSign, and Salesforce. The platform continuously rightsizes pods, optimizes replicas, manages nodes, and allocates GPUs based on live workload demand rather than static configurations.

Self-hosted UI and API for Ansible, Terraform, and scripts

Semaphore UI provides a web interface and REST API for running Ansible playbooks, Terraform and OpenTofu configurations, Bash scripts, and PowerShell commands from a centralized self-hosted platform. With over 13,000 GitHub stars and 2 million Docker pulls, it replaces AWX and manual terminal execution with a polished dashboard for scheduling, access control, notifications, and execution history across mixed infrastructure automation environments.

Production monitoring platform for AI agent reliability

Sentrial is a YC W26-backed monitoring platform for AI agent reliability in production. It semantically detects loops, hallucinations, tool misuse, and user frustration in real-time, then diagnoses root causes and recommends fixes. The platform claims 70% MTTR reduction via automated remediation including rollback, model retraining triggers, and webhooks. Sentrial positions itself as the Datadog for teams deploying autonomous AI agents at scale.

Rust-powered coding agent and pair programmer by OVH

ShAI (Shell AI) is a CLI that brings natural language to the command line, turning plain English descriptions into executable shell commands tailored to your OS and shell. Offers command generation plus command explanation (paste an unfamiliar command, get a breakdown). Adapts syntax for macOS, Linux, and Windows across bash, zsh, fish, and PowerShell. The OVH shai variant extends further into a full pair-programming coding agent with support for multiple LLM providers.

AI-powered command-line productivity tool

ShellGPT (sgpt) is a command-line productivity tool powered by OpenAI models that generates shell commands, code snippets, and documentation directly in the terminal. Integrates with Bash, Zsh, PowerShell, and CMD; places AI-suggested commands into the terminal input via hotkeys. Supports persistent chat sessions, a REPL mode, and custom Python functions for extending capabilities. Accepts stdin and arguments for pipe-based workflows where command output can be piped to the AI.

Hunt down social media accounts by username across 400+ platforms

Sherlock is a Python CLI tool that searches for a given username across 400+ social networks and websites simultaneously. It is widely used in OSINT investigations, security audits, red teaming exercises, and digital footprint analysis. Sherlock is included in Kali Linux and Parrot Security distributions and has over 76,000 GitHub stars, making it one of the most popular open-source security tools.

Run AI workloads on any cloud with automatic cost optimization

SkyPilot is an open-source framework for running LLMs, AI, and batch jobs on any cloud with automatic cost optimization. It supports AWS, GCP, Azure, Lambda Cloud, and more, automatically selecting the cheapest available GPUs and managing spot instance preemption. Features include multi-cloud job scheduling, managed spot jobs with automatic recovery, and cluster autoscaling with 6,000+ GitHub stars.

Package manager for MCP servers and agent skills

Smithery is a CLI tool and registry for discovering, installing, and managing MCP servers and agent skills. It lets developers search thousands of available servers, install them with one command, inspect available tools, and connect their AI coding agents to external capabilities through the Model Context Protocol standard.

Supply chain security for npm and Python packages

Socket.dev detects and prevents supply chain attacks in open-source dependencies before they compromise your applications. Unlike traditional SCA tools that match known CVEs, Socket analyzes package behavior — detecting install scripts, network access, filesystem operations, and obfuscated code that indicate malicious intent. Monitors npm, Python (PyPI), and Go packages in real-time. Provides GitHub PR comments with risk assessments for new dependencies added to your projects.

AI production engineer that auto-triages and fixes alerts

Sonarly is a YC W26-backed AI production engineer that autonomously triages production alerts, deduplicates them by root cause, and sends ready-to-merge pull request fixes. It connects to monitoring tools like Sentry and Datadog, analyzes alert patterns to identify the underlying issue, and generates code fixes or optimization recommendations. Built on Claude APIs, Sonarly reduces mean time to resolution for production incidents while minimizing alert fatigue for engineering teams.

Enterprise software composition analysis for supply chain security

Sonatype Lifecycle is an enterprise software composition analysis platform that identifies vulnerabilities, license risks, and quality issues in open-source dependencies throughout the development lifecycle. It integrates with IDEs, CI/CD pipelines, and artifact repositories to block risky components before they enter the codebase. Backed by the largest vulnerability database with proprietary research beyond public CVE data.

AI-powered Infrastructure as Code management platform

IaC orchestration platform with AI-powered policy suggestions, drift detection, and automated remediation. Supports Terraform, OpenTofu, Pulumi, CloudFormation, Ansible, and Kubernetes. Centralizes infrastructure management with approval workflows, cost estimation, and compliance guardrails for teams running multi-cloud environments at scale.

AWS open-source SDK for building model-driven AI agents

Strands Agents is an open-source SDK from AWS that takes a model-driven approach to building AI agents. Developers define a prompt, model, and tools, and the LLM handles planning and orchestration autonomously. Supports Amazon Bedrock, Anthropic, OpenAI, Gemini, Ollama, and more. Powers Amazon Q Developer and AWS Glue in production. Available in Python and TypeScript with native MCP support.

Open-source Firecracker sandboxes for long-running AI agents

Superserve is an open-source sandbox infrastructure layer for AI agents that need durable computers instead of short-lived shells. It runs isolated Firecracker microVMs, supports pause, resume, snapshot, fork, preview URLs, MCP connectivity, SDK/API control, Docker workloads, and self-hosting, while the hosted service adds pay-as-you-go agent sandboxes for teams.

Cloud-native CI/CD framework for Kubernetes-native pipelines.

Tekton is a cloud-native CI/CD framework that provides Kubernetes-native pipeline resources. A Linux Foundation / CD Foundation project, it offers reusable, composable building blocks for creating CI/CD systems. Used by Google Cloud Build, Red Hat OpenShift Pipelines, and other platforms as their underlying pipeline engine.

Trusted runtime environments for AI agents in production infrastructure

Teleport Beams provides cryptographically verified, policy-gated access for AI agents to interact with production infrastructure including servers, Kubernetes clusters, and databases. Launched at KubeCon EU 2026, Beams extends Teleport's zero-trust access platform with agent-specific runtime controls, audit trails, and policy enforcement to ensure AI agents operate within defined boundaries when deployed in production environments.

Durable execution for fault-tolerant workflows

Temporal is an open-source durable execution platform that ensures application code runs to completion regardless of failures or outages. It captures workflow state at every step, enabling seamless recovery without custom retry logic. With SDKs for Go, Java, Python, TypeScript, and .NET, Temporal powers mission-critical orchestration at Netflix, Nvidia, and other enterprises. Valued at $5B, it replaces fragile cron jobs, state machines, and saga patterns with resilient workflow-as-code.

NVIDIA's LLM inference optimization and acceleration library

TensorRT-LLM is NVIDIA's open-source library for optimizing LLM inference on NVIDIA GPUs. It provides kernel fusion, quantization (FP8, INT4, INT8), KV cache optimization, and in-flight batching to maximize throughput. Supports multi-GPU and multi-node setups with tensor and pipeline parallelism, and integrates with Triton Inference Server for production deployment of models like LLaMA, GPT, Mistral, and Qwen.

Self-hosted SSH and server management platform

Termix is a self-hosted SSH and server management platform that provides a modern web-based terminal, connection management, SFTP file transfer, and multi-device sync without subscription fees. It serves as an open-source alternative to Termius, offering team collaboration features, connection sharing, and a clean interface for managing SSH connections across servers, all deployable via Docker.

IaC orchestration layer for scaling Terraform and OpenTofu

Terragrunt is an infrastructure-as-code orchestration tool that wraps Terraform and OpenTofu to keep configurations DRY, manage remote state, and coordinate multi-module deployments. The 1.0 release introduced stacks, filters, run reports, and backward compatibility guarantees after 900+ releases and tens of millions of infrastructure deployments. It provides a thin orchestration layer that eliminates duplication across environments without replacing the underlying IaC tools.

Open-source GitOps automation for Terraform and OpenTofu pull requests

Terrateam is open-source GitOps infrastructure orchestration for Terraform and OpenTofu pull requests. It automates plans and applies in GitHub workflows, supports monorepos and many workspaces, and adds apply-only locks, OPA/Rego policy checks, cost and drift signals, and approval controls without forcing teams into a separate IaC platform.

Hugging Face's production LLM serving framework

Text Generation Inference (TGI) is Hugging Face's production-ready serving framework for large language models. It features flash attention, continuous batching, tensor parallelism, quantization via GPTQ/AWQ/EETQ, and Safetensors support. Powers Hugging Face's Inference API and Inference Endpoints, with an OpenAI-compatible API and Docker deployment. Supports LLaMA, Mistral, Falcon, and other popular model architectures.

Run and govern MCP servers across desktop, CLI and Kubernetes

Open-source MCP runtime and governance platform that runs servers in isolated containers, curates registries, enforces access policies, and operates gateways across desktop, CLI, and Kubernetes.

Open-source observability and self-healing layer for AI agents

TraceRoot is a YC S25-backed open-source observability platform purpose-built for AI agents and LLM apps. It combines OpenTelemetry-compatible tracing with an agentic debugging runtime that reads your source code, correlates failures with recent commits, and proposes fix PRs automatically. BYOK support spans seven LLM providers; the entire stack runs self-hosted via Docker Compose, with TraceRoot Cloud available for managed deployments.

AI-powered CI reliability and flaky test management

Trunk is a developer tools platform that tackles CI reliability through AI-powered flaky test detection, automatic quarantine, and merge queue management. It uses ML-based statistical analysis to identify flaky tests, isolates them to prevent pipeline blocks, and creates GitHub issues for resolution. Used by Zillow, Brex, and Faire, with $28.5M in funding and support for all major test frameworks.

High-performance build system for JavaScript and TypeScript

High-performance build system from Vercel for JavaScript and TypeScript monorepos. Turborepo intelligently caches task outputs based on content hashing, parallelizes builds across CPU cores, and shares cached results between team members via remote caching. A single turbo.json orchestrates tasks across packages with topological ordering, pruning, and composable configuration for reusable task snippets.