aicoolies logo

Self-Hosted Private AI Chat Stack

$0/mo

Run a complete private AI chat platform with document Q&A, multiple LLM providers, and zero cloud data exposure.

Share

What This Stack Does

This stack assembles the most popular self-hosted AI tools into a complete private platform. AnythingLLM provides the all-in-one foundation with document RAG, agents, and team management. LobeChat adds the most polished chat interface with 10,000+ MCP plugins. PrivateGPT delivers air-gapped document Q&A. Ollama serves as the local model engine. Llamafile enables zero-install portability for sharing AI. Open WebUI rounds out the stack as an alternative chat interface.

The Bottom Line

Start with Ollama as your local model server, then choose your interface based on needs: AnythingLLM for document-centric teams, LobeChat for the best chat experience, or PrivateGPT for maximum privacy. Many teams run multiple interfaces. The complete stack runs entirely on your hardware.

Stack Overview

ToolRolePricingOpen Source
AnythingLLMAll-in-One RAG PlatformFree desktop and self-hosted; Cloud Basic $50/mo / Pro $99/mo; Enterprise customYes
LobeChatChat InterfaceFree and open-source; self-hosted via Vercel or DockerYes
PrivateGPTAir-Gapped Document Q&AFree and open-source (Apache 2.0)Yes
OllamaLocal Model ServerFreeYes
LlamafilePortable LLMFree and open-source (Apache 2.0)Yes
Open WebUIAlternative Chat UICompletely free and open source; self-hostedNo