DevOps & Deployment

RAG-based document QA with multi-user support and agent reasoning

Kotaemon is an open-source RAG-powered document question-answering interface backed by Cinnamon AI. It supports multi-user workspaces with access controls, advanced retrieval pipelines including hybrid search and knowledge graph extraction, and agentic reasoning for complex multi-step queries. The web UI handles PDFs, Office documents, and images with citations pointing to exact source passages, making it suitable for both individual research and team knowledge management.

CNCF Sandbox chaos engineering framework for Kubernetes resilience

Krkn is a CNCF Sandbox chaos engineering tool that tests Kubernetes cluster resilience by injecting controlled failures. It simulates pod kills, node failures, network partitions, CPU/memory pressure, and zone outages. Krkn-AI adds AI-powered scenario generation that suggests chaos experiments based on cluster topology. Supports CI/CD integration for automated resilience testing in deployment pipelines.

Kubernetes operator for serving AI inference workloads

KubeAI is an Apache-2.0 Kubernetes operator for deploying and scaling AI inference workloads, including LLMs, embeddings, reranking, and speech-to-text. It gives platform teams OpenAI-compatible endpoints, model proxy/controller primitives, model caching, scale-from-zero behavior, and cluster-native resource management for self-hosted inference on Kubernetes.

Modern application delivery platform for Kubernetes

KubeVela is a CNCF incubating project that provides a modern application delivery platform built on Kubernetes and the Open Application Model. It abstracts away infrastructure complexity by letting developers define applications declaratively with components, traits, and policies, while platform teams manage delivery workflows. KubeVela supports multi-cluster deployment, canary rollouts, GitOps integration, and extensible addon system.

Open-source MLOps platform for Kubernetes

Kubeflow is a CNCF open-source MLOps platform with 14,000+ GitHub stars for deploying and managing machine learning workflows on Kubernetes. It provides notebooks for experimentation, scalable training pipelines with distributed computing support, model serving with autoscaling, and comprehensive pipeline orchestration for teams running AI/ML workloads in cloud-native environments.

Quantize and compress LLMs for optimized vLLM deployment

Open-source, Hugging Face-compatible library for quantizing and compressing LLMs (W8A8, W4A16, NVFP4/MXFP4, KV-cache and attention quantization, expert pruning) into vLLM-ready `compressed-tensors` checkpoints.

Reusable KV cache infrastructure for scalable LLM inference

Open-source KV cache management layer that persists, offloads and reuses model key-value caches across requests and serving engines to reduce repeated prefill work and improve inference throughput.

Open-source toolkit for quantizing, deploying, and serving LLMs and vision-language models

LMDeploy is an Apache-2.0 toolkit for self-hosting LLM and vision-language model inference with TurboMind and PyTorch engines. It combines continuous batching, blocked KV cache, tensor parallelism, AWQ and KV-cache quantization with OpenAI-compatible APIs, multi-GPU distribution, offline pipelines, and production metrics.

AI copilot for the Lens Kubernetes IDE

Lens Prism is an AI copilot integrated into the Lens Kubernetes IDE (the world's most popular K8s desktop client) that troubleshoots clusters, explains errors in plain English, and helps manage multi-cluster environments visually. It simplifies Kubernetes complexity for developers who prefer visual tools over CLI, providing AI-powered debugging and cluster management within a familiar desktop interface.

Engineering intelligence for DORA metrics and workflow automation

LinearB is a software engineering intelligence platform trusted by over 3,000 engineering leaders to track DORA metrics, cycle time broken into four phases (coding, pickup, review, deploy), and developer workflow patterns. It connects to Git repos and project management tools, benchmarks team performance against 8.1M+ pull requests from 4,800 organizations, and automates workflow improvements via gitStream — a policy-as-code engine for PR routing, labeling, and review automation.

Build custom AI inference servers in pure Python

Open-source, FastAPI-based serving engine from Lightning AI for building custom inference APIs — models, agents, RAG, and pipelines — with built-in batching, streaming, and multi-GPU autoscaling.

Google's production on-device LLM inference framework

LiteRT-LM is Google's official open-source framework for running large language models on-device across Android, iOS, Web, Desktop, and Raspberry Pi. Already deployed in Chrome and Pixel hardware, it provides production-grade on-device LLM inference with 1.4K+ GitHub stars. Apache 2.0 licensed.

Multi-LoRA inference server for serving hundreds of fine-tuned models

LoRAX is an inference server that serves hundreds of fine-tuned LoRA models from a single base model deployment. It dynamically loads and unloads LoRA adapters on demand, sharing the base model's GPU memory across all adapters. Built on text-generation-inference with OpenAI-compatible API. Enables multi-tenant model serving without per-model GPU allocation. Over 3,700 GitHub stars.

Open-source auth infrastructure for modern apps

Logto is an open-source authentication and authorization platform built on OIDC and OAuth 2.1, serving as an alternative to Auth0, Cognito, and Firebase Auth. It provides pre-built sign-in flows with customizable UI, social login, Google One Tap, MFA, enterprise SSO via SAML, and role-based access control. SDKs cover 30+ frameworks including React, Next.js, Vue, Flutter, Go, and Python, with multi-tenancy support for SaaS applications.

Open-source visual regression testing tool

Lost Pixel is an open-source visual regression testing tool that serves as an alternative to Percy and Chromatic. It captures and compares screenshots of UI components and application pages across Storybook, Ladle, Histoire, and custom screenshot sources like Cypress or Playwright. Integrated directly into GitHub Actions pipelines, it detects unintended visual changes before they reach production, with a free SaaS tier available for open-source projects.

Lightweight session management for TypeScript

Lucia is a lightweight open-source auth library for TypeScript providing session management primitives without abstracting the database layer. Gives developers core building blocks — session creation, validation, invalidation — while they own the schema and auth logic. Supports any database through a simple adapter. Works with Next.js, SvelteKit, Astro, Express, and Hono. For developers wanting full control over auth implementation with minimal overhead and zero vendor lock-in.

macOS and Linux VM runtime for AI agents on Apple Silicon

Lume is an open-source CLI for creating and managing macOS and Linux virtual machines on Apple Silicon, built specifically for AI agent sandboxing, CI/CD pipelines, and desktop automation. Using Apple's native Virtualization.Framework for near-native performance, it provides the missing isolation layer for running coding agents safely — so an accidental destructive command doesn't affect your host machine.

IBM-backed ContextForge gateway for federating MCP, A2A, REST, and gRPC APIs

MCP Context Forge is IBM’s Apache-2.0 ContextForge project for operating a gateway, registry, and proxy across MCP servers, A2A agents, REST APIs, and gRPC services. It centralizes discovery, authentication, policy controls, federation, and observability, with deployment paths through PyPI, Docker, and Kubernetes.

AI-first security scanner for LLM, agent, MCP, and RAG codebases

MEDUSA is an AGPL-3.0 AI-first security scanner from Pantheon Security that checks AI and machine-learning applications, LLM agents, MCP workflows, RAG pipelines, repository-poisoning risks, secrets, and agent-specific compromise patterns.

Run and fine-tune Vision Language Models locally on Mac

Open-source Python package for running and fine-tuning Vision Language Models locally on Mac using Apple's MLX framework. Supports multimodal inference with images, audio, and video across Qwen, DeepSeek, Phi, and Gemma architectures. Features OpenAI-compatible API server, Gradio chat UI, and KV cache optimization. 3.8K+ GitHub stars.

Lightweight mobile and edge AI inference engine

MNN is a lightweight, high-performance deep learning inference engine developed by Alibaba and battle-tested across 30+ Alibaba apps including Taobao, DingTalk, and Youku. It supports TensorFlow, ONNX, PyTorch, and Caffe models with optimized backends for CPU, GPU, and NPU on mobile and edge devices. MNN includes on-device LLM inference, an OpenCV-like image processing library, and Python bindings for rapid prototyping. Apache 2.0 licensed with 15K+ stars.

Modern data pipeline orchestration with built-in AI

Mage AI is an open-source data pipeline orchestration tool positioned as a modern alternative to Apache Airflow. It provides a visual pipeline editor, native AI integrations for generating pipeline code, real-time streaming support, and built-in data quality checks. Mage handles batch and streaming workloads with a developer-friendly notebook-style interface and deploys to any cloud provider.

Enterprise-grade RAG and MCP knowledge base with one-click deployment

MaxKB is an enterprise-grade RAG platform with 21,000+ GitHub stars from the 1Panel team. It provides one-click deployment of knowledge bases with built-in LLM integration, MCP support, and a streamlined approach to document ingestion and retrieval that prioritizes operational simplicity over configuration complexity.

Declarative code-first ELT data integration

Meltano is a declarative, code-first data integration engine with 500+ Singer connectors for building ELT pipelines. It replaces custom API integration code with configuration-driven pipeline definitions that live in version control alongside application code. Integrates with dbt for transformation, supports scheduling and monitoring through a unified CLI, and powers production pipelines at scale.

High-performance S3-compatible object storage

MinIO is a high-performance, S3-compatible object storage server designed for AI, machine learning, and data-intensive workloads. Written in Go, it delivers industry-leading throughput for both read and write operations while maintaining full compatibility with the Amazon S3 API. MinIO includes an embedded web console for bucket management, a command-line client, and supports erasure coding, bitrot protection, and encryption at rest for enterprise-grade data durability.

Free MIT-licensed drop-in replacement for LocalStack

MiniStack is a free, MIT-licensed drop-in replacement for LocalStack that emulates 33 AWS services using real infrastructure — actual Postgres for RDS, real Redis for ElastiCache, real Docker for ECS — rather than faking API responses. Born from LocalStack's surprise paywall in March 2026, it starts in 2 seconds, idles at 30MB RAM versus LocalStack's ~500MB, and runs real services for accurate local AWS development.

Disaggregated KV cache storage and transfer for LLM serving

Open-source infrastructure for disaggregated LLM serving that pools KV caches across prefill and decode workers, with high-performance transfer, distributed storage and integrations for vLLM and SGLang.

High-performance mobile neural network inference

NCNN is Tencent's high-performance neural network inference framework optimized for mobile and embedded platforms. It features pure C++ with zero dependencies, ARM NEON assembly optimization, Vulkan GPU acceleration, and sophisticated memory management for minimal footprint. Supports importing models from PyTorch, ONNX, Caffe, TensorFlow, and Keras with 8-bit quantization and half-precision storage for efficient on-device deployment across Android, iOS, and Linux.

Distributed inference orchestration above vLLM, SGLang and TensorRT-LLM

Open-source, datacenter-scale orchestration layer that coordinates vLLM, SGLang and TensorRT-LLM across nodes with disaggregated serving, KV-aware routing, multi-tier cache management and automatic scaling.

Secure sandboxed runtime for AI agent execution

NVIDIA OpenShell provides kernel-level isolation for AI agent workloads with Landlock, seccomp, and network namespace sandboxing. Announced at GTC 2026 with 17 enterprise partners including Adobe, Atlassian, SAP, and Salesforce, it offers declarative YAML policy enforcement, L7 HTTP inspection, and GPU passthrough — purpose-built to contain the blast radius when autonomous coding agents interact with filesystems and networks.

Open-source zero-trust networking with WireGuard

NetBird is an open-source zero-trust networking platform that creates encrypted WireGuard overlay networks between devices without opening ports or configuring firewalls. It provides peer-to-peer connectivity with NAT traversal, access control policies, DNS management, and a web dashboard for team management. NetBird replaces traditional VPNs with a simpler, more secure mesh networking approach for self-hosted infrastructure and remote teams.

Cross-platform on-device AI model runtime

Nexa SDK enables running frontier LLMs and multimodal models locally across PC, mobile, IoT, and wearables with automatic hardware acceleration for GPU, NPU, and CPU. It supports Qwen, Gemma, Llama, DeepSeek models with Python/C++ desktop SDKs, Android/iOS mobile SDKs, and Docker for edge deployment. Includes an OpenAI-compatible API server with chat and function calling support.

Extensibility-first open-source no-code/low-code platform for business apps

NocoBase is an open-source, self-hosted no-code and low-code platform built around a data-model-driven architecture and plugin-based microkernel. Unlike form-centric no-code tools, it separates data structure from UI, enabling unlimited block types and views per data collection. All functionality is delivered through plugins similar to WordPress. Features include AI Employees for in-app automation, visual workflow builder, RBAC permissions, and automatic REST/GraphQL API generation.

Low-code visual programming for event-driven apps

Node-RED is a flow-based, low-code development tool originally created by IBM in 2013 for wiring together hardware devices, APIs, and online services. Now an OpenJS Foundation project with nearly 23,000 GitHub stars, it provides a browser-based visual editor where flows are built by dragging and connecting nodes, then deployed to the Node.js runtime in a single click. Over 5,000 community-contributed nodes cover protocols like MQTT, Modbus, and OPC-UA alongside cloud APIs and databases.

Unified CI/CD and deployment platform with GPU support

Northflank is a unified platform for CI/CD, deployment, and infrastructure management that supports both traditional web applications and GPU-native AI workloads. It provides preview environments with full-stack database and AI model inclusion, BYOC deployment on any cloud, built-in observability, and automated scaling. Handles the complete deployment lifecycle from Git push to production with support for containers, databases, and GPU instances.

Smart monorepo build system and dev tools

Nx is an open-source build system with 24K+ GitHub stars optimized for monorepo development. Features intelligent task scheduling that only rebuilds what changed, distributed caching for sharing build artifacts across teams, and remote execution for parallelizing CI across machines. Supports JavaScript, TypeScript, React, Angular, Node.js, Go, Rust, and more. Provides code generators, dependency graph visualization, and project boundaries enforcement. A Turborepo alternative with broader scope.

OpenAI API management gateway for 100+ LLM providers

One API is a self-hosted LLM API gateway that provides a unified OpenAI-compatible interface for managing multiple model providers including OpenAI, Azure, Anthropic, Google, and dozens of Chinese providers. It handles load balancing, quota management, rate limiting, token tracking, and channel-based routing through a web dashboard. Widely adopted in the Chinese developer ecosystem with over 18,000 GitHub stars.

Private, self-hosted research notebooks with flexible AI models, source chat, and podcasts

Open Notebook is an MIT-licensed, self-hosted alternative to NotebookLM for collecting sources, chatting over research, generating reusable transformations, and producing multi-speaker podcasts. Its Docker stack keeps notebook data under the user's control while supporting 18-plus model providers, including local Ollama and LM Studio workflows.

OpenAI's official GitHub Action that runs Codex in CI

OpenAI's official GitHub Action for running Codex CLI in GitHub Actions workflows with filesystem/network permission profiles and runner-level privilege controls. This is the CI/CD Action, not the terminal Codex agent; current Codex exec enables analytics by default, so telemetry policy needs review.

Open-source Kubernetes cost monitoring (CNCF)

OpenCost is a CNCF-certified open-source tool for real-time Kubernetes cost monitoring that maps cloud spend directly to namespaces, deployments, pods, and labels. It provides granular cost allocation across teams and projects without vendor lock-in, supporting AWS, GCP, Azure, and on-premises clusters as the industry standard for open-source FinOps visibility in cloud-native environments.

Fine-grained authorization engine by Okta

OpenFGA is an open-source authorization engine inspired by Google Zanzibar, built and maintained by Okta (Auth0). It provides relationship-based access control with a flexible modeling language, sub-millisecond permission checks, and SDKs for major languages. OpenFGA is used by companies including Grafana Labs, Canonical, and Docker for fine-grained access control in multi-tenant applications.

Local-first personal AI agent with memory trees, desktop integrations, and private workspace context.

OpenHuman is an open-source, local-first personal AI agent from TinyHumans. It combines a desktop app, persistent memory trees, Obsidian-compatible storage, OAuth integrations, and local model support into a private assistant harness. It is most interesting for users who want agentic workflows and long-term memory without handing every context detail to a fully cloud-hosted assistant.

Real-time usage metering and billing for AI, API, and DevOps products

OpenMeter is an Apache-2.0 open-source metering platform that ingests usage events, aggregates them into meters, and supports limits, entitlements, and usage-based billing. It fits AI, API, and DevOps products that need token-level reporting, customer usage visibility, or finance-ready chargeback data. Teams can self-host the core platform or evaluate OpenMeter's managed offering.

Enterprise-grade sandbox for AI agent code execution

OpenSandbox is an open-source sandbox platform from Alibaba providing secure, isolated execution environments for AI coding agents. It supports Python, Java, JavaScript, and C# SDKs with a unified Sandbox Protocol for custom runtimes. Integrates with Docker and Kubernetes, offering isolation through gVisor, Kata Containers, and Firecracker microVMs with per-sandbox network controls.

High-performance Rust JavaScript toolchain

Oxc is a high-performance collection of JavaScript and TypeScript tools written in Rust by the VoidZero team. It includes a parser, linter, formatter, transpiler, minifier, and module resolver that run 50x faster than their JS equivalents. Oxc powers Rolldown and integrates with Vite, forming the backbone of a unified Rust-based toolchain. With 20K+ GitHub stars and MIT license, it provides drop-in replacements for ESLint, Prettier, and Babel with dramatic speed gains.

Data versioning and pipeline automation for ML

Pachyderm is a data versioning and pipeline automation platform that provides Git-like version control for datasets with automatic data lineage tracking. Acquired by HPE, it enables reproducible ML workflows by connecting data versioning to containerized processing pipelines. Features include automatic provenance tracking, incremental processing, and deduplication for efficient storage of large datasets.

Real-time ETL and RAG engine with Python API and Rust core

Pathway is an open-source Python ETL framework with a high-performance Rust engine for stream processing, real-time analytics, and RAG pipelines. It handles both batch and streaming data in a unified API, enabling live-updating vector indexes, real-time document processing, and AI agent memory that refreshes as new data arrives. 63,000+ GitHub stars, used for production RAG systems where static vector databases create stale context. Apache 2.0 licensed with enterprise cloud options.

Open-source TypeScript headless CMS and app framework

Payload is an open-source TypeScript-first headless CMS and app framework with 32K+ GitHub stars. Built on Next.js with PostgreSQL or MongoDB, it provides auto-generated REST and GraphQL APIs, a customizable admin panel, access control, localization, versioning, and file uploads. Config-as-code defines collections in TypeScript for full type safety. Features live preview, draft system, block-based editor, and extensible plugins. Self-hostable with no vendor lock-in.