Best tools for Self-Hosted Deployment

Fast and lightweight Docker Desktop alternative for macOS

OrbStack is a macOS application that replaces Docker Desktop with lightweight container and Linux VM management. Its docs emphasize fast starts, lower CPU and memory overhead, and native macOS integration with menu bar controls, file sharing, and network access to containers by name, with exact gains depending on workload. Supports Docker, Kubernetes, and full Linux VMs.

Build, share, and run containers

Industry-standard container platform for building, shipping, and running applications in isolated, reproducible environments. Package apps with all dependencies into portable containers using Dockerfiles and images. Docker Compose orchestrates multi-container applications. Docker Hub hosts millions of pre-built images. Docker Desktop provides GUI management on Mac/Windows. Essential for local development, CI/CD, and production deployments. The foundation of modern containerized infrastructure.

Identity-aware VPN and reverse proxy for zero-trust remote access

Identity-based remote access platform built on WireGuard that combines reverse proxy and VPN capabilities. Pangolin supports clientless browser access for web apps and client-based private-resource access across macOS, iOS, Windows, Linux, and Android, with zero-trust rules, peer-to-peer tunnels, automatic SSL, SSO/OIDC options, and cloud or self-hosted deployment.

Frontend cloud platform

Frontend cloud platform and the creators of Next.js, providing instant Git-push deployments, a global edge network, and serverless compute for modern web apps. Automatic preview URLs for every pull request, Edge Functions for low-latency dynamic content, Image Optimization, Web Analytics, and the Vercel AI SDK for building AI-powered apps. Supports Next.js, React, Svelte, Nuxt, Astro, and all major frameworks. Generous free tier for personal projects and used by enterprises like Washington Post.

Open-source identity and access management

Keycloak is an open-source IAM solution with 25K+ GitHub stars by Red Hat. Provides SSO, social login, LDAP/Active Directory federation, standard protocol support (OIDC, OAuth 2.0, SAML), fine-grained authorization, user federation, and admin console. Features identity brokering, multi-tenancy via realms, and client adapters for Java, JavaScript, and Node.js. Self-hosted with no per-user licensing, making it ideal for organizations needing full control over identity infrastructure.

Run LLMs locally with one command

Tool for running large language models locally on your machine with a simple CLI interface. Download and run Llama 3, Mistral, Gemma, Phi, Code Llama, and dozens of other open-source models with a single command. Features model management, GPU acceleration (NVIDIA/AMD/Apple Silicon), OpenAI-compatible API server, Modelfile for customization, and multi-model switching. Ideal for offline AI development, privacy-sensitive use cases, and local testing. 120K+ GitHub stars.

Self-hosted AI platform with ChatGPT-like interface for local and cloud LLMs.

Extensible, self-hosted AI platform with 290M+ Docker pulls and 124K+ GitHub stars. Supports Ollama, OpenAI-compatible APIs, and any Chat Completions backend. Features built-in RAG, multi-user RBAC, voice/video calls, Python function workspace, model builder, and web browsing. Runs entirely offline with enterprise features including SSO and audit logging.

2x faster LLM fine-tuning with 70% less VRAM on a single GPU

Unsloth is an open-source framework for fine-tuning large language models up to 2x faster while using 70% less VRAM. Built with custom Triton kernels, it supports 500+ model architectures including Llama 4, Qwen 3, and DeepSeek on consumer NVIDIA GPUs. Unsloth Studio adds a no-code web UI for dataset creation, training observability, model comparison, and GGUF export for Ollama and vLLM deployment.

Open-source identity provider for self-hosted SSO and access management

Authentik is an open-source Identity Provider supporting SAML, OAuth2/OIDC, LDAP, RADIUS, and SCIM for self-hosted single sign-on. It provides customizable authentication flows, multi-factor authentication, user management, and proxy-based SSO for applications without native support. Positioned as a modern Keycloak alternative with 22K+ GitHub stars, free Open Source use, and paid Enterprise/Enterprise Plus plans.

Self-hosted multi-model AI chat platform

LibreChat is an open-source ChatGPT-like interface with 35K+ GitHub stars supporting multiple AI providers in a single self-hosted platform. Connect OpenAI, Anthropic, Google, Mistral, local models via Ollama, and custom endpoints simultaneously. Features conversation branching, file uploads, code interpreter, plugins, presets, multi-user support with RBAC, and LDAP/SSO authentication. Privacy-focused alternative to commercial AI chat services with full data ownership.

All-in-one self-hosted AI app with RAG, agents, and multi-user support

AnythingLLM is an open-source, privacy-first AI application that turns any document into an interactive knowledge base. It bundles document ingestion, vector storage (built-in LanceDB), RAG pipelines, AI agents, and multi-user access into a single deployable package. Supports 30+ LLM providers including OpenAI, Anthropic, Ollama, and local models. With 62K+ GitHub stars and MIT license, it runs as a desktop app or Docker container with zero configuration required out of the box.

Lightweight server monitoring with Docker stats and alerts

Beszel is a lightweight, self-hosted server monitoring platform built in Go that tracks CPU, memory, disk, network, GPU, temperature, and Docker container metrics with historical data visualization and configurable alerts. Its simple hub-and-agent architecture deploys in minutes and consumes minimal resources compared to traditional monitoring stacks like Prometheus and Grafana.

Backend development framework with built-in infrastructure automation

Encore is a backend development framework for TypeScript and Go that automates infrastructure provisioning from application code. Developers define APIs, databases, cron jobs, and pub/sub topics using framework primitives, and Encore generates the necessary cloud infrastructure on AWS or GCP. Includes local development tooling with service catalog, tracing, and automatic API documentation.

Self-hosted AI platform with RAG, agents, and 40+ connectors

Onyx is an open-core, self-hostable AI knowledge platform for enterprise search, RAG chat, deep research, custom agents, and workplace connectors. It connects to 40+ apps, supports permission-aware retrieval, and offers Cloud, Docker/Kubernetes, and enterprise deployment paths for teams that need controlled internal AI search.

High-recall Postgres vector search at billion scale

VectorChord is a Postgres extension from the supervc-stack/VectorChord project that brings high-recall vector search to PostgreSQL. As the spiritual successor to pgvecto.rs, it combines IVF indexes with RaBitQ quantization to deliver Pinecone-class performance at billion-vector scale while keeping all data inside a single Postgres database — no separate vector store, no two-system sync, no rewrites when the workload grows.

Open data platform wrapping any SQL database with instant APIs

Directus is a database-first open data platform that wraps any existing SQL database with instant REST and GraphQL APIs, a no-code admin dashboard, and built-in authentication. Unlike traditional headless CMS platforms that impose their own data model, Directus introspects your existing schema and works on top of it — supporting PostgreSQL, MySQL, SQLite, MS SQL, MariaDB, and CockroachDB out of the box.

Git for data — version-controlled SQL database with branch, merge, and diff

Dolt is a SQL database that implements Git-style version control directly on structured data. Table changes can be staged, committed, branched, merged, diffed, and reverted through SQL workflows and a Git-like CLI. It speaks the MySQL wire protocol so existing MySQL clients, ORMs, and tools can connect with minimal driver changes. Dolt is used for AI training data management, reproducible analytics, collaborative data editing, and agent-memory experiments.

Automate your workflow from GitHub

GitHub's built-in CI/CD and workflow automation platform that runs directly in your repository. Define workflows in YAML triggered by Git events (push, PR, release), schedules, or manual dispatch. Massive marketplace of 20,000+ community-maintained actions for testing, building, deploying, and automating tasks. Supports matrix builds, caching, secrets, environments with approval gates, and self-hosted runners. Free for public repos with generous minutes for private repos.

Container orchestration at scale

Kubernetes (K8s) is the industry-standard open-source container orchestration platform originally developed by Google and now maintained by the CNCF. Automates deployment, scaling, self-healing, and networking of containerized workloads across clusters of machines. Runs everywhere from laptops (kind, k3s) to every major cloud (EKS, GKE, AKS), and is the foundation of modern cloud-native infrastructure.

Open-source multi-model AI chat framework with plugin ecosystem

LobeChat is a source-available AI chat and agent workspace for OpenAI, Claude, Gemini, Ollama, DeepSeek, and Qwen. It includes RAG, 10,000+ MCP-compatible plugins, Agent Groups, TTS/STT, Vercel/Docker self-hosting, and 79K+ GitHub stars.

Modular open-source identity infrastructure with Kratos, Hydra, and Keto

Ory provides a suite of modular open-source identity components: Kratos for user management and authentication, Hydra for OAuth2 and OIDC, Oathkeeper for API gateway authorization, and Keto for fine-grained permission management. Used by OpenAI and other major organizations. API-first design with Go-based microservices that deploy independently or together as Ory Network cloud.

Open-source authentication with self-hosting

SuperTokens is an open-source authentication solution with 14K+ GitHub stars providing email/password, passwordless, social login, MFA, session management, and user management. Designed for self-hosting with Docker — full control over user data with no vendor lock-in. Pre-built UI components for React, Vue, and vanilla JS. Backend SDKs for Node.js, Python, and Go. Managed cloud option also available. Emphasizes security with rotating refresh tokens and anti-CSRF protection by default.

Infrastructure as Code

HashiCorp's infrastructure-as-code tool for provisioning and managing cloud resources declaratively using HCL (HashiCorp Configuration Language). Write infrastructure definitions once and deploy to AWS, GCP, Azure, DigitalOcean, and 4,000+ providers. Features state management for tracking resources, plan/apply workflow for safe changes, modules for reusability, and workspaces for environment isolation. The industry standard for multi-cloud IaC with 48K+ GitHub stars.

Open-source background jobs and AI workflows for TypeScript

Trigger.dev is an open-source platform for building and deploying background jobs, AI agents, and long-running workflows in TypeScript. It eliminates serverless timeouts with durable task execution, automatic retries, queue-based concurrency control, and elastic scaling. Used by 30,000+ developers at companies like MagicSchool and Icon.com, it processes hundreds of millions of agent runs monthly. Backed by a $16M Series A led by Dalton Caldwell's Standard Capital fund.

Open-source high-performance key/value datastore

Valkey is a Linux Foundation-backed, BSD-3-Clause open-source fork of Redis 7.2.4 for caching, queues, and real-time data workloads. Current 9.1 and 8.1.8 releases continue performance, security, module, and cluster work while preserving Redis-compatible migration paths. It has 26K+ GitHub stars and managed-service support from AWS, Google, Oracle, Ericsson, and others.

Codebase knowledge graph MCP server for AI coding agents

Codebase Memory MCP is an MIT-licensed MCP server that turns a repository into a persistent code knowledge graph for AI coding agents. It gives Claude Code, Cursor, Codex-style agents, and other MCP clients structural queries for functions, classes, call chains, routes, and architecture, helping them explore large projects without repeatedly rereading files or relying only on broad search.

Self-hosted Heroku/Vercel alternative

Open-source, self-hostable PaaS alternative to Heroku, Vercel, and Netlify with 44K+ GitHub stars. Deploy static sites, APIs, full-stack apps, databases, and 280+ one-click services on your own VPS or bare metal via SSH. Features auto Let's Encrypt SSL, Git integration (GitHub/GitLab/Bitbucket/Gitea), S3 backups, Docker Swarm support, and a REST API for CI/CD automation. Self-hosted version is free forever with no features behind paywalls.

AI-native database for hybrid RAG retrieval

Infinity is an AI-native database from InfiniFlow that unifies dense vectors, sparse vectors, tensors, and full-text search in a single engine. Built for retrieval-augmented generation (RAG) at scale, it powers hybrid search workflows where lexical matching, semantic similarity, and reranking all happen against one storage layer instead of four loosely coupled services.

AMD's open-source local LLM server with GPU and NPU acceleration

Lemonade is AMD's open-source local AI serving platform for LLMs, image generation, speech recognition, and text-to-speech on your own hardware. Built in lightweight C++, it can detect CPU, GPU, and NPU backends and is extra optimized for Ryzen AI, Radeon, and Strix Halo PCs. Lemonade exposes OpenAI, Anthropic, and Ollama-compatible APIs, ships with a desktop model manager, and supports source-confirmed GGUF, FLM, and ONNX models across Windows, Linux, macOS, and Docker.

Infrastructure, instantly

Modern cloud platform for deploying full-stack apps, databases, and workers with instant provisioning and usage-based pricing. Deploy from GitHub or CLI with zero config for Node.js, Python, Go, Rust, and Docker. Built-in PostgreSQL, MySQL, Redis, and MongoDB with auto backups. Features private networking, environment management, cron jobs, TCP proxying, and real-time logs. Popular with indie hackers and startups for fast MVPs with a generous free trial including $5 monthly credits.

Turn scripts into workflows, UIs, and APIs at scale

Windmill is an open-source workflow engine and developer platform built in Rust that turns scripts in Python, TypeScript, Go, Bash, SQL, and other languages into auto-generated UIs, API endpoints, workflows, data pipelines, AI agents, and scheduled jobs. The project publishes performance benchmarks against Airflow/Prefect/Temporal, supports Docker/Kubernetes self-hosting, and offers paid enterprise features.

DiskANN-powered vector search extension for PostgreSQL

pgvectorscale is an open-source PostgreSQL extension from Timescale that complements pgvector with DiskANN-based approximate vector search. It is useful for teams that want faster embedding retrieval while keeping vectors, filters, and application data inside the Postgres ecosystem instead of adopting a separate hosted vector database.

Context compression for LLM apps and coding agents

Headroom is an Apache-2.0 context compression layer for LLM apps and coding agents. It compresses tool output, logs, files, RAG chunks, and agent history through a local library, proxy, wrapper, or MCP server, with retrieval hooks for bringing originals back when needed. Treat its savings numbers as Headroom-reported benchmarks, not independent aicoolies measurements.

Web platform for modern development

Jamstack-focused cloud platform specializing in deploying static sites, serverless functions, and modern web applications with Git-based CI/CD. Features instant rollbacks, deploy previews for every PR, split testing, edge functions, form handling, identity/auth, and a global CDN with automatic HTTPS. Native support for Next.js, Nuxt, Gatsby, Hugo, Astro, and all major static site generators. Free $0 forever plan plus Personal and Pro credit-based tiers for growing traffic and team workflows.

Open-source backend-as-a-service platform

Appwrite is an open-source BaaS platform with 56K+ GitHub stars providing authentication, databases, storage, functions, messaging, and real-time APIs out of the box. Self-hostable alternative to Firebase with 15+ client and server SDKs. Features OAuth login with 30+ providers, document-based database with queries, file storage with image transforms, serverless functions, and push notifications. Docker-based deployment with a web console for management.

Terraform pull request automation via GitHub/GitLab comments

Atlantis is a self-hosted Terraform pull request automation tool that runs plan and apply operations triggered by GitHub, GitLab, Bitbucket, or Azure DevOps comments. Type 'atlantis plan' on a PR to see infrastructure changes, then 'atlantis apply' to deploy. 9,100+ GitHub stars, Apache 2.0 licensed. Widely adopted as the standard for GitOps-style Terraform workflows, with locking to prevent concurrent modifications to the same resources.

Open-source vulnerability management aggregator

DefectDojo is an open-source vulnerability management platform with 4.7K+ GitHub stars that aggregates findings from 200+ security tools into a single view for ranking, triaging, and tracking remediation. It serves as the operating system for security teams by normalizing data from SAST, DAST, container scanners, and dependency checkers into a unified workflow with deduplication and metrics.

Rust-native multi-agent orchestration for production

GraphBit is a Rust-native, multi-agent orchestration framework built for production. It targets the gap between Python-first frameworks like LangGraph and the operational expectations of enterprise systems — predictable memory, low latency, deterministic concurrency, and the ability to embed an agent runtime in services that already run Rust without dragging in a Python interpreter.

Open-source personal AI agent for messaging apps

OpenClaw is a free, open-source AI agent framework that turns any LLM into an autonomous personal assistant accessible through messaging apps like WhatsApp, Telegram, Discord, and Signal. Running entirely on your local machine via a Node.js gateway, it connects AI models to system tools, browsers, files, and APIs for multi-step task execution with persistent memory across sessions.

100% private document Q&A powered by local LLMs

PrivateGPT enables fully private document interaction using GPT-powered RAG without any data leaving your machine. Ingest documents (PDF, DOCX, TXT, and more) and chat with them using local LLMs via Ollama or remote providers. Built on LlamaIndex with Qdrant vector storage. 57,200+ GitHub stars, Apache 2.0 licensed. The go-to solution for air-gapped environments, regulated industries, and anyone who needs document Q&A without cloud data exposure.

AI-powered incident management in Slack and Teams

Rootly is an AI-native incident management platform that runs entirely within Slack and Microsoft Teams, automating incident workflows from detection through postmortem. It reduces manual incident overhead with AI-generated summaries, automated role assignments, escalation paths, and postmortem drafts, holding SOC 2 Type II, GDPR, and HIPAA compliance certifications for enterprise use.

Run frontier AI models across a cluster of everyday devices

exo turns multiple local machines into a unified AI compute cluster for models that exceed a single device's memory. It automatically discovers devices, uses topology-aware auto parallelism to split work across available resources, and supports RDMA over Thunderbolt 5 for co-located clusters or standard networking for looser setups. The project exposes OpenAI Chat Completions, Claude Messages, OpenAI Responses, and Ollama-compatible APIs plus a dashboard for cluster management.

Sandboxes for coding agents — Linux VMs, Git, and deploys in one box

Freestyle is YC-backed sandbox infrastructure built for AI coding agents, shipping secure Linux VMs with nested virtualization, Git servers, and one-click web deploys. It lets agents run real workloads, branch repos, and deploy apps under short-lived identities while billing only for active compute. Used in production by vly.ai, Rork, and Vibeflow.

Modern task queue and workflow orchestration built on PostgreSQL

Hatchet is an open-source task queue and workflow orchestration platform designed as a modern alternative to Celery and BullMQ. Built on PostgreSQL for durability, it handles background jobs, AI agent workflows, RAG pipelines, and GPU task scheduling with TypeScript and Python SDKs. YC W24 batch with 7,400+ GitHub stars, MIT licensed. Supports fan-out, rate limiting, retries, and real-time observability through a web dashboard.

Open-source dev environment management with AI integration

Daytona is secure, elastic infrastructure for running AI-generated code in isolated sandboxes. It gives agents and developer workflows programmable environments with dedicated kernel, filesystem, network, vCPU, memory, and disk, backed by OCI/Docker compatibility, SDK/API access, and under-90ms sandbox startup. The project has 72,000+ GitHub stars and is AGPL-3.0 licensed.

Run LLMs as a single portable executable file

Llamafile by Mozilla packages a complete LLM — model weights, inference engine, and OpenAI-compatible API server — into a single executable file that runs on Mac, Windows, Linux, FreeBSD, and OpenBSD with no installation. Built on llama.cpp and Cosmopolitan Libc for cross-platform portability, it delivers GPU-accelerated inference when available and falls back to optimized CPU execution. Supports GGUF models with a built-in web chat UI and REST API for integration.

Industry-standard incident management and on-call alerting platform

PagerDuty is an enterprise incident management platform for on-call scheduling, alert routing, escalation policies, and incident response orchestration. It integrates with 750+ monitoring, ticketing, cloud, and collaboration tools, including Datadog, Slack, Jira, AWS, and Microsoft Teams. Current pricing lists a Free tier for up to 5 users, Professional from $21/user/mo annually ($25 monthly), Business from $41/user/mo annually ($49 monthly), and Enterprise custom.

Kubernetes-native framework for DevOps AI agents

kagent is a Kubernetes-native AI agent framework developed at Solo.io and accepted into the CNCF sandbox. It provides a structured environment for running DevOps-focused agents directly within Kubernetes clusters, with a dedicated kmcp toolkit for cloud-native operations. Unlike general-purpose agent frameworks, kagent targets platform engineers and SREs who need AI assistance with cluster management, troubleshooting, and infrastructure automation workflows.