Self-Hosted Platforms

OpenTelemetry-native observability with AI tracing, logs, traces, metrics, and session replay — self-hosted in 90 seconds.

Traceway is an open-source, OpenTelemetry-native observability platform that combines logs, traces, metrics, exceptions, session replay, and AI tracing in a single self-hosted system. MIT licensed with no open-core restrictions, it deploys in 90 seconds via Docker Compose and accepts OTLP/HTTP from any OTel SDK without a Collector or per-language vendor SDK.

Cross-platform on-device AI model runtime

Nexa SDK enables running frontier LLMs and multimodal models locally across PC, mobile, IoT, and wearables with automatic hardware acceleration for GPU, NPU, and CPU. It supports Qwen, Gemma, Llama, DeepSeek models with Python/C++ desktop SDKs, Android/iOS mobile SDKs, and Docker for edge deployment. Includes an OpenAI-compatible API server with chat and function calling support.

Lightweight OS for running AI agents in-process

agentOS is a portable open-source operating system for AI agents that delivers ~6ms cold starts at 32x lower cost than traditional sandboxes. Powered by WebAssembly and V8 isolates, it runs agents like Claude Code and Codex directly inside your process with granular permissions and host-managed tool access for S3, GitHub, and databases. Available as a simple npm package with no special infrastructure or vendor lock-in required.

Versatile microservice framework for any protocol

Armeria is an open-source microservice framework from the creator of Netty at LINE Corporation that supports gRPC, Thrift, REST, and GraphQL on a single server and port. It provides built-in decorators for metrics, distributed tracing, load balancing, authentication, rate limiting, circuit breakers, and automatic retries. The framework integrates seamlessly with Spring Boot, Dropwizard, and Reactive Streams while serving automated API documentation with interactive request testing.

Cloud-native POSIX filesystem on object storage

JuiceFS is a high-performance distributed POSIX filesystem built on object storage like S3 and metadata engines like Redis or MySQL. It enables seamless data sharing across thousands of clients with low latency and elastic throughput. JuiceFS ships with a Kubernetes CSI driver, Hadoop SDK compatibility, and FUSE mount support for AI training, big data analytics, and shared storage workloads. Apache 2.0 licensed with 13K+ GitHub stars.

Kafka-compatible streaming platform, no JVM required

Redpanda is a Kafka-compatible streaming data platform written in C++ using the Seastar framework. It eliminates the need for ZooKeeper and the JVM, delivering up to 10x lower tail latencies and significantly reduced operational complexity. Redpanda ships as a single binary with a built-in schema registry, HTTP proxy, and message broker. It supports the Kafka wire protocol, so existing producers, consumers, and tools work without code changes. Backed by $165M+ in funding with 12.0K GitHub stars.

Open-source deep learning text-to-speech toolkit

Coqui TTS is an open-source deep learning toolkit for text-to-speech synthesis, originally built by former Mozilla TTS engineers. It supports multi-speaker and multilingual synthesis, voice cloning from just six seconds of audio, and ships pre-trained models for 20+ languages. After Coqui shut down in 2023, the Idiap Research Institute forked and actively maintains it. With 45K+ GitHub stars, it remains the most popular open-source TTS framework in Python.

Modern open-source server management panel

1Panel is a modern open-source Linux server management panel built with Go that provides a clean web interface for managing websites, databases, containers, and system resources. It features a marketplace with 165+ one-click app installs including Nextcloud and Bitwarden, automatic SSL provisioning with Let's Encrypt, visual Docker container management, and built-in firewall configuration. 1Panel also supports native AI agent deployment through Ollama integration.

Simple open-source personal cloud system

CasaOS is an elegant open-source personal cloud operating system that turns any hardware into a private home server with a one-line installation. It provides a beautiful web dashboard for managing Docker containers, a curated app store with one-click installs for tools like Nextcloud and Jellyfin, and built-in file management. CasaOS runs on Raspberry Pi, Intel NUC, old laptops, and cloud VMs with full support for Ubuntu, Debian, and Raspberry Pi OS.

Container-native local AI model serving with Podman

RamaLama is an open-source tool that containerizes AI model inference using Podman or Docker, eliminating host system configuration complexity. It auto-detects GPUs (NVIDIA, AMD, Intel, Apple Silicon), pulls models from HuggingFace, Ollama, and OCI registries, and runs them in isolated rootless containers with read-only mounts and network isolation. Developed under the Containers project (Red Hat ecosystem), it brings familiar container workflows to local LLM serving.

Self-hosted AI accounting for freelancers and small teams

TaxHacker is an open-source, self-hosted AI accounting app that automatically extracts financial data from receipts, invoices, and bank statements using LLMs. It supports 170+ currencies and 14 cryptocurrencies with historical exchange rate conversion, multi-project accounting, and custom AI extraction fields. Works with OpenAI, Gemini, Mistral, or local models via Ollama—deploy with Docker and keep all financial data under your control.

Hot-swap between local LLM models via OpenAI-compatible API

llama-swap is an open-source tool that manages multiple local LLM models behind a single OpenAI-compatible API endpoint. It automatically loads and unloads models on demand, letting developers hot-swap between different models without restarting services. With 3.1K+ GitHub stars, it solves the common pain point of running multiple specialized models on limited hardware.

Google's production on-device LLM inference framework

LiteRT-LM is Google's official open-source framework for running large language models on-device across Android, iOS, Web, Desktop, and Raspberry Pi. Already deployed in Chrome and Pixel hardware, it provides production-grade on-device LLM inference with 1.4K+ GitHub stars. Apache 2.0 licensed.

Run and fine-tune Vision Language Models locally on Mac

Open-source Python package for running and fine-tuning Vision Language Models locally on Mac using Apple's MLX framework. Supports multimodal inference with images, audio, and video across Qwen, DeepSeek, Phi, and Gemma architectures. Features OpenAI-compatible API server, Gradio chat UI, and KV cache optimization. 3.8K+ GitHub stars.

Python web framework with HTMX, no JavaScript needed

FastHTML is an open-source Python web framework by Answer.AI that renders HTML directly from Python functions using HTMX. It eliminates the JavaScript build step entirely, letting developers create interactive web apps with pure Python. FastHTML is designed for AI demo apps, admin tools, and internal tooling where full-stack simplicity matters more than SPA complexity. Built by Jeremy Howard's team.

Native Linux containers on macOS via Apple Virtualization

Apple Containerization is Apple's official Swift package for running Linux containers natively on macOS using the Virtualization framework. It provides near-native performance without Docker Desktop's heavyweight VM, supporting OCI images, container networking, and a command-line interface. The library leverages Apple Silicon hardware acceleration for minimal overhead container execution on Mac development machines.

Self-hosted SSH and server management platform

Termix is a self-hosted SSH and server management platform that provides a modern web-based terminal, connection management, SFTP file transfer, and multi-device sync without subscription fees. It serves as an open-source alternative to Termius, offering team collaboration features, connection sharing, and a clean interface for managing SSH connections across servers, all deployable via Docker.

Open-source zero-trust networking with WireGuard

NetBird is an open-source zero-trust networking platform that creates encrypted WireGuard overlay networks between devices without opening ports or configuring firewalls. It provides peer-to-peer connectivity with NAT traversal, access control policies, DNS management, and a web dashboard for team management. NetBird replaces traditional VPNs with a simpler, more secure mesh networking approach for self-hosted infrastructure and remote teams.

High-performance WebAssembly runtime for cloud and AI

WasmEdge is a CNCF sandbox WebAssembly runtime optimized for cloud-native, edge, and AI workloads. It provides a lightweight, secure, and portable execution environment that is faster than containers and safer than native processes. WasmEdge supports LLM inference via LlamaEdge, serverless functions, microservices, and plugin extensions for networking, AI, and cryptography across Linux, macOS, and Windows.

OpenAI API management gateway for 100+ LLM providers

One API is a self-hosted LLM API gateway that provides a unified OpenAI-compatible interface for managing multiple model providers including OpenAI, Azure, Anthropic, Google, and dozens of Chinese providers. It handles load balancing, quota management, rate limiting, token tracking, and channel-based routing through a web dashboard. Widely adopted in the Chinese developer ecosystem with over 18,000 GitHub stars.

Open-source high-performance key/value datastore

Valkey is a Linux Foundation-backed open-source fork of Redis 7.2.4 under BSD 3-Clause license, created after Redis changed to restrictive licensing. It provides a drop-in Redis replacement for caching, message queues, and real-time data workloads. Valkey 9 adds JSON, Bloom filters, vector search, cluster scaling to 2000 nodes, and over one billion requests per second in benchmarks. Backed by AWS, Google, Oracle, and Ericsson.

Lightweight microVM execution layer for AI agent code sandboxing

Vercel Sandbox provides a lightweight microVM execution environment for running untrusted code generated by AI agents safely. It creates isolated sandboxes that prevent generated code from accessing the host system, network, or other processes. Designed for AI coding platforms that need to execute user or agent-generated code without security risks to the host infrastructure.

Heroku-like PaaS built on Kubernetes with YC backing

Porter is a YC-backed platform-as-a-service that provides a Heroku-like deployment experience on top of Kubernetes. It abstracts away cluster management while giving teams full access to underlying infrastructure when needed. Supports deploying from Git repos, Docker images, or Helm charts with automatic HTTPS, scaling, and preview environments. Runs on AWS, GCP, or Azure.

Backend development framework with built-in infrastructure automation

Encore is a backend development framework for TypeScript and Go that automates infrastructure provisioning from application code. Developers define APIs, databases, cron jobs, and pub/sub topics using framework primitives, and Encore generates the necessary cloud infrastructure on AWS or GCP. Includes local development tooling with service catalog, tracing, and automatic API documentation.