Self-Hosted Tools

Offline-first AI assistant for local inference

Jan is an open-source offline-first AI assistant with 25K+ GitHub stars running LLMs locally without sending data externally. Features a ChatGPT-like interface with one-click model downloads from Hugging Face, conversation management, customizable prompts, and an OpenAI-compatible local API server. Supports GGUF models via llama.cpp with GPU acceleration on NVIDIA and Apple Silicon. Built with Electron for macOS, Windows, and Linux with full data privacy.

Kubernetes-native model inference platform

KServe is an open-source Kubernetes-native platform for deploying and managing ML model inference at scale. It provides standardized inference protocols, autoscaling including scale-to-zero, canary rollouts, A/B testing, and multi-model serving. KServe supports all major ML frameworks including TensorFlow, PyTorch, scikit-learn, XGBoost, and LLM runtimes like vLLM and Triton through pluggable serving runtimes.

Heterogeneous CPU-GPU inference and SFT for large MoE models

Open-source framework for running and fine-tuning large Mixture-of-Experts models with heterogeneous CPU-GPU execution, optimized kernels, limited VRAM and SGLang or LLaMA-Factory integrations.

Deploy web apps anywhere

Zero-downtime deployment tool created by 37signals (Basecamp/HEY) that deploys Docker containers to any VPS or bare metal server over SSH without requiring Kubernetes. Manages rolling deploys, health checks, SSL via Let's Encrypt, container registry, and load balancing with Traefik. Simple YAML-based config. Ideal for small teams deploying Rails, Node.js, or any Dockerized app. Ships as a Ruby gem. 12K+ GitHub stars and a growing alternative to complex container orchestration.

Declarative orchestration for data, AI, and infra

Kestra is an open-source orchestration platform that uses declarative YAML to define event-driven and scheduled workflows for data pipelines, infrastructure automation, and AI workloads. With over 1,200 plugins, it connects to databases, cloud services, APIs, and SaaS tools without custom glue code. Kestra reached version 1.0 LTS with agentic AI capabilities, SDKs for Python, TypeScript, Java, and Go, and SOC 2 compliance. Clients include Leroy Merlin, Huawei, Tencent, and Decathlon.

Open-source AI second brain with deep research and RAG

Khoj is an open-source personal AI app that serves as a self-hostable second brain. It connects to your documents — PDFs, Markdown, Notion, Word — and uses RAG to answer questions grounded in your knowledge base. Supports any local or cloud LLM including Llama, Claude, GPT, and Gemini. Features custom agents, scheduled automations, deep research mode, semantic search, and Obsidian, Emacs, and WhatsApp integrations. Over 33,000 GitHub stars, YC-backed.

Polyglot document intelligence framework with Rust core

Kreuzberg is a polyglot document intelligence framework with a high-performance Rust core that extracts text, metadata, images, and structured data from 91+ file formats. Available for Python, Ruby, Java, Go, PHP, C#, TypeScript, plus CLI, REST API, and MCP server. Features multiple OCR backends (Tesseract, EasyOCR, PaddleOCR), table extraction with structure preservation, and native async support.

Kubernetes operator for serving AI inference workloads

KubeAI is an Apache-2.0 Kubernetes operator for deploying and scaling AI inference workloads, including LLMs, embeddings, reranking, and speech-to-text. It gives platform teams OpenAI-compatible endpoints, model proxy/controller primitives, model caching, scale-from-zero behavior, and cluster-native resource management for self-hosted inference on Kubernetes.

Open-source MLOps platform for Kubernetes

Kubeflow is a CNCF open-source MLOps platform with 14,000+ GitHub stars for deploying and managing machine learning workflows on Kubernetes. It provides notebooks for experimentation, scalable training pipelines with distributed computing support, model serving with autoscaling, and comprehensive pipeline orchestration for teams running AI/ML workloads in cloud-native environments.

Open-source toolkit for quantizing, deploying, and serving LLMs and vision-language models

LMDeploy is an Apache-2.0 toolkit for self-hosting LLM and vision-language model inference with TurboMind and PyTorch engines. It combines continuous batching, blocked KV cache, tensor parallelism, AWQ and KV-cache quantization with OpenAI-compatible APIs, multi-GPU distribution, offline pipelines, and production metrics.

Open-source multi-type data labeling platform

Label Studio is an open-source data labeling tool by HumanSignal supporting images, text, audio, video, and time series. It offers ML-assisted pre-labeling, customizable XML-based annotation interfaces, multi-user review workflows, and REST API access. Used for computer vision, NLP, speech, and LLM fine-tuning including RLHF annotation pipelines.

AI copilot for the Lens Kubernetes IDE

Lens Prism is an AI copilot integrated into the Lens Kubernetes IDE (the world's most popular K8s desktop client) that troubleshoots clusters, explains errors in plain English, and helps manage multi-cluster environments visually. It simplifies Kubernetes complexity for developers who prefer visual tools over CLI, providing AI-powered debugging and cluster management within a familiar desktop interface.

Build custom AI inference servers in pure Python

Open-source, FastAPI-based serving engine from Lightning AI for building custom inference APIs — models, agents, RAG, and pipelines — with built-in batching, streaming, and multi-GPU autoscaling.

Free, open-source local AI inference engine

LocalAI is an open-source local AI inference engine with 44K+ GitHub stars that runs LLMs, image generation, audio transcription, and embeddings entirely on consumer hardware without GPU requirements. Provides an OpenAI API-compatible REST endpoint as a drop-in replacement, supporting 1000+ models including LLaMA, Mistral, and Phi families. Features include text-to-speech, speech-to-text, function calling, constrained grammar output, and multi-modal capabilities all running locally.

Open-source cross-platform file sharing over local network

LocalSend is a free, open-source application for secure peer-to-peer file and message sharing between nearby devices over your local network. It works on Windows, macOS, Linux, Android, iOS, and Fire OS without requiring an internet connection or third-party servers. Each device generates TLS/SSL certificates for encrypted HTTPS communication, making it a privacy-first alternative to AirDrop that works across all operating systems.

Enterprise-grade RAG and MCP knowledge base with one-click deployment

MaxKB is an enterprise-grade RAG platform with 21,000+ GitHub stars from the 1Panel team. It provides one-click deployment of knowledge bases with built-in LLM integration, MCP support, and a streamlined approach to document ingestion and retrieval that prioritizes operational simplicity over configuration complexity.

Multi-provider AI code completion as-you-type for Neovim

Neovim plugin that streams inline code completions from your choice of LLM (OpenAI, Claude, Gemini, Codestral, Ollama, Llama.cpp, and more), with no proprietary background binary.

Open-source zero-trust networking with WireGuard

NetBird is an open-source zero-trust networking platform that creates encrypted WireGuard overlay networks between devices without opening ports or configuring firewalls. It provides peer-to-peer connectivity with NAT traversal, access control policies, DNS management, and a web dashboard for team management. NetBird replaces traditional VPNs with a simpler, more secure mesh networking approach for self-hosted infrastructure and remote teams.

Extensibility-first open-source no-code/low-code platform for business apps

NocoBase is an open-source, self-hosted no-code and low-code platform built around a data-model-driven architecture and plugin-based microkernel. Unlike form-centric no-code tools, it separates data structure from UI, enabling unlimited block types and views per data collection. All functionality is delivered through plugins similar to WordPress. Features include AI Employees for in-app automation, visual workflow builder, RBAC permissions, and automatic REST/GraphQL API generation.

Self-hostable Airtable alternative with database power

NocoDB is a free, self-hostable source-available platform that turns any database into a smart spreadsheet interface. It offers grid, gallery, form, Kanban, and calendar views with support for rich field types including links, lookups, rollups, and formulas. NocoDB provides role-based access control, REST APIs, workflow automation, and integrations with services like Slack and Discord — making it a powerful Airtable alternative for teams who want full data ownership.

Low-code visual programming for event-driven apps

Node-RED is a flow-based, low-code development tool originally created by IBM in 2013 for wiring together hardware devices, APIs, and online services. Now an OpenJS Foundation project with nearly 23,000 GitHub stars, it provides a browser-based visual editor where flows are built by dragging and connecting nodes, then deployed to the Node.js runtime in a single click. Over 5,000 community-contributed nodes cover protocols like MQTT, Modbus, and OPC-UA alongside cloud APIs and databases.

Unified CI/CD and deployment platform with GPU support

Northflank is a unified platform for CI/CD, deployment, and infrastructure management that supports both traditional web applications and GPU-native AI workloads. It provides preview environments with full-stack database and AI model inclusion, BYOC deployment on any cloud, built-in observability, and automated scaling. Handles the complete deployment lifecycle from Git push to production with support for containers, databases, and GPU instances.

OpenAI API management gateway for 100+ LLM providers

One API is a self-hosted LLM API gateway that provides a unified OpenAI-compatible interface for managing multiple model providers including OpenAI, Azure, Anthropic, Google, and dozens of Chinese providers. It handles load balancing, quota management, rate limiting, token tracking, and channel-based routing through a web dashboard. Widely adopted in the Chinese developer ecosystem with over 18,000 GitHub stars.

Private, self-hosted research notebooks with flexible AI models, source chat, and podcasts

Open Notebook is an MIT-licensed, self-hosted alternative to NotebookLM for collecting sources, chatting over research, generating reusable transformations, and producing multi-speaker podcasts. Its Docker stack keeps notebook data under the user's control while supporting 18-plus model providers, including local Ollama and LM Studio workflows.

Open-source async coding agent you can run in your own sandbox

Open-source framework from LangChain AI for building your organization's internal coding agent — the same pattern Stripe's Minions, Ramp's Inspect, and Coinbase's Cloudbot follow. Built on LangGraph and Deep Agents, Open SWE runs each task in an isolated cloud sandbox (Modal, Daytona, Runloop, or LangSmith), invokes from Slack, Linear, or GitHub, orchestrates subagents, and opens pull requests autonomously — customizable end-to-end for your codebase and conventions.

Rust-based agent OS with built-in security, WASM sandboxing, and multi-agent runtime

OpenFang is an open-source agent operating system built in Rust that provides a secure multi-agent runtime with WASM sandboxing, auditability layers, and multi-channel communication. It goes beyond typical orchestration SDKs by treating agent security and operational isolation as first-class concerns, making it suitable for teams deploying agents in environments where trust boundaries and audit trails matter.

Real-time usage metering and billing for AI, API, and DevOps products

OpenMeter is an Apache-2.0 open-source metering platform that ingests usage events, aggregates them into meters, and supports limits, entitlements, and usage-based billing. It fits AI, API, and DevOps products that need token-level reporting, customer usage visibility, or finance-ready chargeback data. Teams can self-host the core platform or evaluate OpenMeter's managed offering.

Source-available team knowledge base and wiki with real-time collaboration

Outline is a fast, collaborative team knowledge base and wiki with a Markdown-compatible editor, nested collections, search with AI-assisted answers, integrations, and managed or self-hosted deployment.

Data versioning and pipeline automation for ML

Pachyderm is a data versioning and pipeline automation platform that provides Git-like version control for datasets with automatic data lineage tracking. Acquired by HPE, it enables reproducible ML workflows by connecting data versioning to containerized processing pipelines. Features include automatic provenance tracking, incremental processing, and deduplication for efficient storage of large datasets.

Behavioral control layer for reliable customer-facing AI agents

Parlant is an open-source framework that adds behavioral governance to conversational AI agents. Instead of relying on prompt engineering alone, it lets teams define explicit policies, conversation guidelines, and behavioral rules that agents follow predictably across multi-turn interactions. Parlant sits between the LLM and the user-facing interface, enforcing consistent agent behavior for customer support, sales, and service automation use cases.

Open-source TypeScript headless CMS and app framework

Payload is an open-source TypeScript-first headless CMS and app framework with 32K+ GitHub stars. Built on Next.js with PostgreSQL or MongoDB, it provides auto-generated REST and GraphQL APIs, a customizable admin panel, access control, localization, versioning, and file uploads. Config-as-code defines collections in TypeScript for full type safety. Features live preview, draft system, block-based editor, and extensible plugins. Self-hostable with no vendor lock-in.

Open-source design and prototyping

Open-source design and prototyping platform offering a free, web-based alternative to Figma and Sketch with self-hosting and no team-size limits. Penpot uses SVG and CSS as native formats for inherent web compatibility, with real-time multiplayer collaboration, vector editing, interactive prototyping, components with variants, design tokens, flex layouts, and Figma file import.

Privacy-friendly Google Analytics alternative

Plausible Analytics is an open-source, lightweight, privacy-friendly web analytics tool trusted by 17,000+ paying customers including Hugging Face and Basecamp. It provides essential website metrics on a single-page dashboard without cookies, personal data collection, or GDPR consent banners. The tracking script is 75x smaller than Google Analytics. Self-hostable via Docker or available as managed EU-hosted SaaS.

Internal developer portal for self-service engineering

Port is an internal developer portal platform that provides self-service interfaces for engineering teams. It offers a software catalog for tracking services, environments, and dependencies, along with self-service actions for common workflows like spinning up environments, deploying services, and managing resources. Features scorecards for engineering standards compliance and integrates with GitHub, GitLab, K8s, and cloud providers.

First commercially viable 1-bit LLMs that are 14x smaller and 8x faster

PrismML Bonsai delivers the first commercially viable 1-bit large language models with 8B, 4B, and 1.7B parameter variants. The 8B model runs in just 1GB of RAM versus 16GB for standard FP16 models, achieving 44 tokens per second on iPhone. Backed by $16.25M from Khosla Ventures and released under Apache 2.0, Bonsai makes capable LLMs practical for edge devices and resource-constrained environments.

Deep document understanding RAG engine

RAGFlow is an open-source RAG engine with 76K+ GitHub stars that provides deep document understanding for building knowledge-based AI applications. Optimizes chunking for 20+ document types including PDFs, Word docs, presentations, and images using layout-aware parsing. Features template-based chunking strategies, citation with source references, multi-recall retrieval combining keyword and semantic search, and a visual knowledge base management interface with drag-and-drop document upload.

Durable execution engine for workflows and AI agents

Restate is a durable execution engine that provides reliable workflow orchestration for AI agents and backend services. It runs as a single binary with no external dependencies, delivering sub-50ms latency and 94K+ actions per second. Supports TypeScript, Python, Go, Java, and Kotlin SDKs with built-in retries, sagas, and virtual object state. MIT licensed with 3,700+ GitHub stars.

Open-source AI coworker with persistent memory and tool use

Rowboat is an open-source AI coworker platform that provides persistent memory, tool use, and multi-agent orchestration in a chat-based interface. It enables teams to build AI assistants that remember context across sessions, access internal tools and databases, and coordinate specialized sub-agents for complex workflows. Over 9,300 GitHub stars.

GPU cloud platform for AI training and inference

RunPod is a GPU cloud platform providing on-demand and serverless GPU compute for AI training and inference workloads. It offers NVIDIA A100, H100, and RTX GPUs with per-second billing, serverless inference endpoints with auto-scaling, persistent storage, and Docker-based deployment. Popular with AI developers for its competitive pricing, fast provisioning, and developer-friendly API for deploying ML models at scale.

High-performance S3-compatible object storage built in Rust

RustFS is an open-source distributed object storage system built entirely in Rust, offering 2.3x faster performance than MinIO for small object payloads. It provides full S3 API compatibility, enabling seamless migration from MinIO, Ceph, and AWS S3 with existing SDKs and CLI tools. Released under Apache 2.0 license, it avoids MinIO's restrictive AGPL terms. Features include distributed architecture, erasure coding, WORM compliance, encryption via RustyVault, and a web management console.

AI-native state store with hybrid vector and full-text search

SeekDB is an open-source AI-native state store from the OceanBase ecosystem that combines MySQL-compatible data access with hybrid vector and full-text retrieval. It targets agent and AI application teams that need embedded or server deployment, copy-on-write style sandboxes, and searchable state without gluing together several separate storage layers.

Visual agent builder with 1000+ integrations

Sim is an open-source platform for building, deploying, and orchestrating AI agents with a visual workflow editor. Connects 1,000+ integrations and LLMs with drag-and-drop canvas design, AI-assisted Copilot for generating nodes from natural language, and built-in knowledge base for RAG. Trusted by 100K+ builders. Includes 11 pre-built workflow templates for quick deployment.

Self-hosted code understanding for humans and agents

Sourcebot is a self-hosted code intelligence platform that helps developers and AI agents understand large codebases through intelligent search, navigation, and inline-cited answers. Deployed as a Docker container with MCP server support, it indexes thousands of repositories without source code leaving your infrastructure.

Open-source browser infrastructure for AI agents at scale

Steel is an open-source browser API purpose-built for AI agents, providing managed headless browser sessions with anti-bot bypass, proxy rotation, CAPTCHA solving, and session persistence. It handles the infrastructure layer that browser automation agents like Browser Use and Stagehand run on top of. Self-hostable or available as a cloud service. Over 6,000 GitHub stars.

Open-source headless CMS for developers

Strapi is the leading open-source headless CMS with 65K+ GitHub stars providing a customizable API-first content management system. Auto-generates REST and GraphQL APIs from content types defined through a visual builder. Features role-based access control, media library, internationalization, draft/publish workflow, and a plugin marketplace. Built with Node.js and supports PostgreSQL, MySQL, SQLite, and MariaDB. Self-hostable with Strapi Cloud also available.

Open-source generalist AI agent for browser and code tasks

Suna is an open-source generalist AI agent that can autonomously browse the web, write and execute code, manage files, and interact with external services. It features a real-time browser automation engine, an isolated code execution sandbox, and integrations with popular APIs. Designed as an open-source alternative to commercial AI agent platforms. Over 9,000 GitHub stars with rapid community growth.

Open-source Firecracker sandboxes for long-running AI agents

Superserve is an open-source sandbox infrastructure layer for AI agents that need durable computers instead of short-lived shells. It runs isolated Firecracker microVMs, supports pause, resume, snapshot, fork, preview URLs, MCP connectivity, SDK/API control, Docker workloads, and self-hosting, while the hosted service adds pay-as-you-go agent sandboxes for teams.

Multi-model database for the AI era — document, graph, vector, and relational in one

SurrealDB is a multi-model database that natively combines document, graph, relational, key-value, and vector storage in a single engine. It eliminates the need for separate databases by handling structured queries, graph traversals, full-text search, and vector similarity in one SQL-like query language called SurrealQL. Built in Rust for performance and safety, it supports real-time subscriptions, row-level permissions, and embedded or distributed deployment modes.