Self-Hosted Tools

Run frontier AI models across a cluster of everyday devices

exo turns multiple local machines into a unified AI compute cluster for models that exceed a single device's memory. It automatically discovers devices, uses topology-aware auto parallelism to split work across available resources, and supports RDMA over Thunderbolt 5 for co-located clusters or standard networking for looser setups. The project exposes OpenAI Chat Completions, Claude Messages, OpenAI Responses, and Ollama-compatible APIs plus a dashboard for cluster management.

Open-source LLMOps platform for prompt management and evaluation

Agenta is an open-source LLMOps platform that combines prompt engineering playgrounds, prompt version management, LLM evaluation, and observability in a unified interface. It supports 50+ LLM models with side-by-side prompt comparison, A/B testing, human evaluation workflows, and OpenTelemetry-native tracing. Self-hostable with 4,000+ GitHub stars.

Zero Trust runtime security for Kubernetes and AI

AccuKnox provides Zero Trust runtime threat prevention for Kubernetes and cloud workloads with an AI-powered prompt firewall to prevent LLM injection attacks. Built on the open-source KubeArmor project, it manages Kubernetes identities via policy-as-code, enforces runtime security policies, and provides real-time workload protection for AI-native infrastructure environments.

Open-source AI coding agent with self-hosted deployment option

Refact.ai is an open-source/on-premise oriented AI coding agent for VS Code and JetBrains that supports BYOK model routing, codebase understanding, developer-tool integrations and self-hosted deployment. Its public site now warns that Refact Cloud is shutting down soon, so teams should treat hosted availability as a migration risk and validate the current enterprise support path.

Browser automation with AI vision — no XPath or DOM parsing needed

Skyvern automates browser-based workflows using LLMs and computer vision instead of brittle XPath or CSS selectors. It understands web pages visually, navigating forms, clicking buttons, and extracting data like a human would. Achieved 85.85% success rate on WebVoyager benchmark and SOTA on WRITE tasks for RPA. 21,000+ GitHub stars, AGPL-3.0 licensed. Skyvern Cloud offers managed usage-based hosting for teams that prefer not to self-host the infrastructure.

Open-source dev environment management with AI integration

Daytona is secure, elastic infrastructure for running AI-generated code in isolated sandboxes. It gives agents and developer workflows programmable environments with dedicated kernel, filesystem, network, vCPU, memory, and disk, backed by OCI/Docker compatibility, SDK/API access, and under-90ms sandbox startup. The project has 72,000+ GitHub stars and is AGPL-3.0 licensed.

Drag-and-drop LLM flow builder

Open-source protocol for connecting AI models to external tools and data sources, created by Anthropic. Provides a standardized way for LLMs to interact with APIs, databases, and local files through a universal client-server architecture. Rapidly adopted across the AI ecosystem as the standard interface between AI assistants and the tools they need to be useful.

Federated SQL and semantic search across live data for AI agents

MindsDB Query Engine is a self-hosted, SQL-compatible federated query layer for AI agents. It connects live databases, warehouses, SaaS apps, documents, and vector stores without requiring a separate ETL pipeline; adds knowledge bases for semantic and hybrid retrieval; and exposes the result through SQL, MCP, HTTP, and MySQL/PostgreSQL-compatible interfaces. It is separate from MindsHub, the same team's hosted agent workspace.

All-in-one open-source observability — logs, metrics, traces, RUM

OpenObserve is an open-source observability platform that unifies logs, metrics, traces, and real user monitoring in a single binary. It claims 140x lower storage costs than Elasticsearch through columnar storage and compression, with native OpenTelemetry support, a built-in query UI, dashboards, and alerts. Designed for AI and cloud-native workloads at petabyte scale. Over 15,000 GitHub stars.

Self-hosted proxy API for routing AI CLI accounts into OpenAI-compatible endpoints

CLIProxyAPI is an open-source Go proxy server that wraps Gemini CLI, Claude Code, OpenAI Codex, Grok Build, and related CLI account flows behind OpenAI/Gemini/Claude-compatible API endpoints. Use it carefully: it can touch OAuth sessions, auth files, logs, and provider account policies, so production use needs credential and ToS review.

Open-source AI code review with hybrid AST-LLM

Kodus is an open-source AI code review platform that combines AST analysis with LLM reasoning to reduce noisy comments. Kody learns team standards, supports GitHub, GitLab, Bitbucket, and Azure DevOps, is model-agnostic across Claude, GPT, Gemini, Llama and OpenAI-compatible endpoints, and offers free/community, $10/dev monthly or $8/dev annual Teams, and Enterprise options.

Agentic DevOps automation via ChatOps

Kubiya is an agentic automation platform for DevOps and platform teams that uses specialized agents with connectors for Kubernetes, AWS, GitHub, Jira, and Terraform to automate operational tasks through Slack or web portals. It provides Terraform module support for infrastructure-as-code configuration and manages agent behaviors with policy-based controls for enterprise-grade governance.

ELT platform with 350+ data connectors

Airbyte is an ELT platform with 350+ pre-built connectors for syncing data from any source to warehouses, lakes, and AI pipelines. It handles incremental syncs, schema evolution, and change data capture with a connector builder for custom integrations. Used by DoorDash, Replit, and thousands of data teams. Over 15,000 GitHub stars and $150M+ in funding.

TypeScript-native open-source auth library

Better Auth is an open-source TypeScript-native auth library with 10K+ GitHub stars providing a comprehensive, framework-agnostic solution. Features email/password, social OAuth, magic links, passkeys, 2FA, session management, and organization support. Works with Next.js, Nuxt, SvelteKit, Astro, and any Node.js framework. Database adapters for PostgreSQL, MySQL, SQLite, MongoDB, Drizzle, and Prisma. Zero vendor lock-in alternative to Clerk and Auth0.

50x faster LLM gateway with MCP support, built in Go

Bifrost is a high-performance open-source AI gateway built from scratch in Go. Unifies access to 15+ providers and 1,000+ models through a single OpenAI-compatible API with only 11 microsecond overhead per request at 5K RPS — 50x faster than LiteLLM. Features automatic failover, load balancing, semantic caching, and functions as both MCP client and MCP server. Apache 2.0 licensed.

Microsoft's framework for running 1-bit large language models on consumer CPUs

BitNet is Microsoft's official inference framework for 1-bit quantized large language models that enables running models with up to 100 billion parameters on standard consumer CPUs without requiring a GPU. By leveraging extreme quantization where weights use only 1.58 bits on average, BitNet achieves dramatic reductions in memory footprint and computational cost while maintaining competitive output quality for many practical use cases.

Open-source password management

Open-source password manager with end-to-end AES-256 encryption, zero-knowledge architecture, and full source code on GitHub for independent security audit. Bitwarden offers cross-platform clients, auto-fill, password generator, TOTP storage, encrypted sharing, self-hosting, and enterprise features like SSO, SCIM directory sync, plus a developer secrets manager for API keys and certs.

On-device AI inference engine for mobile and wearable applications

Cactus is a YC-backed low-latency AI engine for mobile and wearable devices that runs LLMs, transcription, embedding, and TTS models locally. It achieves 16-20 tok/sec on older devices and 70+ tok/sec on flagships with ARM SIMD kernels optimized for Snapdragon, Apple, and MediaTek processors. Supports Qwen, Gemma, Llama, DeepSeek with Flutter, React Native, and Kotlin SDKs.

Free self-hosted PaaS

Open-source self-hostable PaaS that turns any VPS into a Heroku-style platform. CapRover wraps Docker Swarm with a friendly web UI for one-click app deploys, automatic NGINX reverse proxy with free Let's Encrypt SSL, and a one-click app store for Postgres, Redis, MongoDB, WordPress, and dozens more. Define apps via captain-definition files, scale containers, view logs, and manage volumes — all without touching the Docker CLI. Free, MIT licensed.

State-of-the-art open-source text-to-speech with emotion control

Chatterbox is an open-source text-to-speech model by Resemble AI that delivers state-of-the-art voice synthesis with fine-grained emotion and style control. The model supports zero-shot voice cloning from short audio samples, produces natural-sounding speech across multiple speaking styles, and runs locally without cloud dependencies. With over 24,000 GitHub stars, it has become the leading open-source alternative to commercial TTS services for developers building voice-enabled AI applications.

Desktop AI productivity studio with 300+ assistants

Cherry Studio is an open-source desktop AI application with 42K+ GitHub stars providing unified access to 50+ LLM providers through a single Electron-based interface. Features 300+ pre-built AI assistants for different tasks, multi-model conversations, knowledge base with RAG support, real-time translation, image generation, and Mermaid diagram rendering. Supports topic-based chat management, message branching, and custom assistant creation. Available on macOS, Windows, and Linux.

Self-hosted cloud development environments for teams and AI agents

Coder provisions self-hosted cloud development environments on any infrastructure including Kubernetes, Docker, AWS, GCP, and Azure. Developers connect through VS Code, JetBrains IDEs, or browser-based editors to standardized environments with pre-configured dependencies. Features template-based provisioning, automatic shutdown, and audit logging. Over 12,800 GitHub stars with growing AI agent use cases.

Workflow orchestration engine

Netflix-originated workflow orchestration platform with JSON and code-based workflow definitions, human-in-the-loop support, and AI agent orchestration capabilities. With 18k+ GitHub stars, Conductor handles complex distributed workflows at massive scale, offering built-in retry logic, event-driven triggers, and visual workflow monitoring for microservice coordination.

The 5MB open-source agent daemon that hides nothing

CrabTalk is a lightweight five-megabyte daemon that streams every AI agent event to your client in real time including text deltas, tool calls, and thinking steps. It provides complete transparency into agent operations with one-curl installation and bring-your-own-model support. Designed as the observable alternative to opaque agent runtimes where you cannot see what the AI is actually doing.

Containerized sandboxes for AI coding agents

Dagger Container Use provides isolated container environments for AI coding agents, enabling multiple agents to work in separate sandboxed branches simultaneously. Built by the Dagger team, it ensures reproducibility and safety for autonomous code execution by giving each agent its own containerized workspace with full toolchain access.

Single-binary workflow engine with zero dependencies

Dagu is a local-first, self-contained workflow engine that runs as a single binary under 128MB of memory with no database, message broker, or runtime dependencies. Workflows are defined in declarative YAML and can orchestrate shell commands, Docker containers, SSH sessions, HTTP calls, and SQL queries. It includes a built-in Web UI with DAG visualization and Gantt charts, plus an AI agent that creates and debugs workflows from natural language via Slack or Telegram.

Visual database designer with Git-integrated schemas

DbSchema is a visual database designer supporting 80+ SQL and NoSQL databases that features Git integration for schema version control, interactive HTML documentation generation, and AI-assisted query building. It provides the best visual approach to designing and maintaining database schemas in a version-controlled environment, bridging the gap between visual design and code-managed infrastructure.

Instant isolated dev environments powered by Nix

Devbox is an open-source command-line tool that creates instant, reproducible development environments using Nix packages without requiring you to learn Nix. Define your project dependencies in a simple devbox.json file and get isolated shells with access to over 400,000 package versions. It eliminates dependency conflicts between projects and ensures every team member works in an identical environment, with support for devcontainers, Docker, and cloud deployment.

Kubernetes dashboard with 360-degree visibility

Devtron is an open-source Kubernetes management dashboard that provides a 360-degree view of cluster resources with fine-grained RBAC for multi-cluster environments. Its upcoming agentic AI feature automates debugging and cluster optimization, while the current platform offers centralized visibility, GitOps-based deployment workflows, and security policy enforcement across distributed Kubernetes infrastructure.

The smallest PaaS implementation

Dokku is a Docker-powered, open-source mini-Heroku that gives you the smallest PaaS implementation for deploying applications on your own server. Push with Git, build via Heroku buildpacks or Dockerfiles, and get automatic subdomains, SSL, zero-downtime deploys, and add-on plugins for databases and services. Ideal for self-hosted developers who want Heroku ergonomics without the cloud vendor bill.

Open-source PaaS alternative to Vercel, Heroku, and Netlify

Dokploy is a free open-source platform-as-a-service for self-hosting applications without cloud vendor lock-in. It provides automated deployments from Git repositories, built-in SSL certificates, database provisioning, Docker and Docker Compose support, and a clean web dashboard for managing multiple applications on your own servers. With 18,000+ GitHub stars, it fills the gap for teams wanting Vercel-like deployment simplicity on their own infrastructure.

Open-source control plane for AI workloads across multi-cloud GPU infrastructure

dstack is an open-source platform that orchestrates AI training and inference workloads across heterogeneous GPU infrastructure spanning multiple clouds, Kubernetes clusters, and bare-metal servers. It abstracts away cloud-specific APIs so teams define GPU requirements declaratively and dstack automatically provisions the cheapest available resources from AWS, GCP, Azure, Lambda, or on-premises hardware.

Cloud native runtime security for Kubernetes

Falco is a CNCF graduated open-source runtime security tool that detects unexpected behavior and threats across containers, Kubernetes, and cloud workloads in real time. Originally created by Sysdig, Falco monitors Linux kernel syscalls using eBPF and applies customizable detection rules to alert on malicious activity like container escapes, cryptojacking, unauthorized file access, and anomalous network connections. It supports 50+ alert output channels including SIEM integration.

Usage metering and billing infrastructure for AI, API, and SaaS products

Flexprice is an AGPL-3.0 open-source platform for real-time usage metering, usage-based pricing, credits, entitlements, and billing workflows. It helps engineering and finance teams turn token, API, and feature events into billable usage across managed-cloud or self-hosted deployments. Use it when a product needs finance-grade chargeback and customer usage controls, not only LLM traces.

Free open-source local AWS emulator as a drop-in LocalStack replacement

Floci is a free open-source AWS emulator designed as a lightweight drop-in replacement for LocalStack Community Edition. It runs on port 4566 with the same endpoint conventions, supporting S3, SQS, DynamoDB, RDS, ElastiCache, API Gateway, Cognito, IAM, and twenty-plus other services. The Docker image is ninety megabytes versus LocalStack's one gigabyte and starts in twenty-four milliseconds.

Free and open-source Kubernetes IDE for managing clusters visually

Freelens is a free open-source Kubernetes IDE that provides a visual desktop interface for managing clusters, workloads, and configurations. Forked from the original Lens project after its licensing change, Freelens offers the same powerful cluster management experience with real-time monitoring, log viewing, and resource editing under the MIT license.

Self-hosted customer identity management with no per-user pricing

FusionAuth is a customer identity and access management platform that can be self-hosted or cloud-deployed with no per-user fees. It supports OAuth2, OIDC, SAML, passwordless login, social providers, MFA, and advanced threat detection. Features a drag-and-drop theme builder for login page customization and supports multi-tenant application architectures with unlimited users on the community edition.

Natural language scripting for LLM-system interaction

GPTScript is an Apache 2.0 licensed framework with 3,300+ GitHub stars that enables natural language scripting where LLMs interact with local systems, APIs, and tools through simple prompt definitions. It supports multiple model providers including OpenAI-compatible APIs and local models, providing a lightweight approach to building AI agents that can execute CLI commands, call APIs, and process files.

Open-source GPU control plane for scalable AI model serving

Open-source GPU cluster manager that configures vLLM, SGLang, TensorRT-LLM or custom engines, serves models through compatible APIs, and provisions SSH-accessible GPU instances across on-premises, Kubernetes and cloud environments.

Bayesian git bisection for finding commits that caused flaky tests

Git Bayesect applies Bayesian inference to git bisection, solving the problem of finding commits that introduced non-deterministic bugs like flaky tests. Unlike standard git bisect which requires binary pass-fail results, Git Bayesect handles probabilistic outcomes where a test might pass sometimes and fail sometimes, using entropy minimization to efficiently narrow down the culprit commit.

Built-in CI/CD for GitLab

GitLab's built-in CI/CD pipeline system defined via .gitlab-ci.yml files in your repository. Features multi-stage pipelines, parallel jobs, matrix builds, environments with deployment tracking, merge train for serialized merges, auto DevOps for zero-config CI/CD, container registry, and security scanning (SAST/DAST). Supports self-hosted runners and Kubernetes executors. Tightly integrated with GitLab's merge requests and issue tracking. A leading alternative to GitHub Actions for GitLab users.

Instant GraphQL and REST APIs on any database

Hasura auto-generates real-time GraphQL and REST APIs directly from your database schema—PostgreSQL, MySQL, SQL Server, MongoDB, and more. It provides fine-grained row-level and column-level access control, event triggers on database changes, remote schema stitching, and real-time subscriptions out of the box. Available as a managed cloud service or self-hosted, Hasura eliminates weeks of boilerplate API development while maintaining full control over authorization logic.

AI-native API gateway by Alibaba with MCP server hosting and LLM routing

Higress is an open-source AI-native API gateway developed by Alibaba that combines traditional API management with LLM-specific capabilities like token-based rate limiting, model routing, prompt caching, and MCP server hosting. Built on Envoy and Istio, it provides enterprise-grade traffic management while natively understanding AI workload patterns including streaming responses, long-lived connections, and multi-model fallback chains.

Open-source natural-language browser automation framework for AI agents

An AGPL-3.0 TypeScript framework that drives a real browser from natural-language tasks — the self-hostable OSS framework from Hyperbrowser, distinct from the vendor's paid cloud browser product.

Offline-first AI assistant for local inference

Jan is an open-source offline-first AI assistant with 25K+ GitHub stars running LLMs locally without sending data externally. Features a ChatGPT-like interface with one-click model downloads from Hugging Face, conversation management, customizable prompts, and an OpenAI-compatible local API server. Supports GGUF models via llama.cpp with GPU acceleration on NVIDIA and Apple Silicon. Built with Electron for macOS, Windows, and Linux with full data privacy.

Open-source post-building layer for agents — tracing, evals, and online monitoring

Judgeval is the open-source post-building layer for AI agents from Judgment Labs, providing OpenTelemetry-based tracing, hosted and custom evaluation scorers, and online behavior monitoring for LLM-powered applications. Instrument any function with a single decorator, score live production traffic against faithfulness and instruction-adherence checks, and feed real-world failures back into reinforcement learning or supervised fine-tuning loops.

Kubernetes-native model inference platform

KServe is an open-source Kubernetes-native platform for deploying and managing ML model inference at scale. It provides standardized inference protocols, autoscaling including scale-to-zero, canary rollouts, A/B testing, and multi-model serving. KServe supports all major ML frameworks including TensorFlow, PyTorch, scikit-learn, XGBoost, and LLM runtimes like vLLM and Triton through pluggable serving runtimes.

Heterogeneous CPU-GPU inference and SFT for large MoE models

Open-source framework for running and fine-tuning large Mixture-of-Experts models with heterogeneous CPU-GPU execution, optimized kernels, limited VRAM and SGLang or LLaMA-Factory integrations.