Dokku

Deploy web apps anywhere

Zero-downtime deployment tool created by 37signals (Basecamp/HEY) that deploys Docker containers to any VPS or bare metal server over SSH without requiring Kubernetes. Manages rolling deploys, health checks, SSL via Let's Encrypt, container registry, and load balancing with Traefik. Simple YAML-based config. Ideal for small teams deploying Rails, Node.js, or any Dockerized app. Ships as a Ruby gem. 12K+ GitHub stars and a growing alternative to complex container orchestration.

Container orchestration at scale

Kubernetes (K8s) is the industry-standard open-source container orchestration platform originally developed by Google and now maintained by the CNCF. Automates deployment, scaling, self-healing, and networking of containerized workloads across clusters of machines. Runs everywhere from laptops (kind, k3s) to every major cloud (EKS, GKE, AKS), and is the foundation of modern cloud-native infrastructure.

Free self-hosted PaaS

Open-source self-hostable PaaS that turns any VPS into a Heroku-style platform. CapRover wraps Docker Swarm with a friendly web UI for one-click app deploys, automatic NGINX reverse proxy with free Let's Encrypt SSL, and a one-click app store for Postgres, Redis, MongoDB, WordPress, and dozens more. Define apps via captain-definition files, scale containers, view logs, and manage volumes — all without touching the Docker CLI. Free, MIT licensed.

Heterogeneous CPU-GPU inference and SFT for large MoE models

Open-source framework for running and fine-tuning large Mixture-of-Experts models with heterogeneous CPU-GPU execution, optimized kernels, limited VRAM and SGLang or LLaMA-Factory integrations.

Official Kubernetes and Helm reference stack built on the vLLM inference engine

Official vLLM reference implementation for scaling the existing inference engine on Kubernetes with Helm, request routing, KV-cache offload, autoscaling and Prometheus/Grafana observability.

Distributed inference orchestration above vLLM, SGLang and TensorRT-LLM

Open-source, datacenter-scale orchestration layer that coordinates vLLM, SGLang and TensorRT-LLM across nodes with disaggregated serving, KV-aware routing, multi-tier cache management and automatic scaling.

Open-source GPU control plane for scalable AI model serving

Open-source GPU cluster manager that configures vLLM, SGLang, TensorRT-LLM or custom engines, serves models through compatible APIs, and provisions SSH-accessible GPU instances across on-premises, Kubernetes and cloud environments.

Disaggregated KV cache storage and transfer for LLM serving

Open-source infrastructure for disaggregated LLM serving that pools KV caches across prefill and decode workers, with high-performance transfer, distributed storage and integrations for vLLM and SGLang.

Reusable KV cache infrastructure for scalable LLM inference

Open-source KV cache management layer that persists, offloads and reuses model key-value caches across requests and serving engines to reduce repeated prefill work and improve inference throughput.