Skip to content
aicoolies logo
AnythingLLM logo

AnythingLLM

All-in-one self-hosted AI app with RAG, agents, and multi-user support

AnythingLLM is an open-source, privacy-first AI application that turns any document into an interactive knowledge base. It bundles document ingestion, vector storage (built-in LanceDB), RAG pipelines, AI agents, and multi-user access into a single deployable package. Supports 30+ LLM providers including OpenAI, Anthropic, Ollama, and local models. With 62K+ GitHub stars and MIT license, it runs as a desktop app or Docker container with zero configuration required out of the box.

Rate
Website
ShareShare on XShare on LinkedInShare on Reddit
Is this your product? →

About AnythingLLM

AnythingLLM by Mintplex Labs is the most popular open-source all-in-one AI application for teams that want ChatGPT-like capabilities without sending data to external servers. It handles the entire RAG pipeline internally: drag-and-drop document ingestion for PDFs, DOCX, TXT and more, automatic chunking with configurable overlap, vector storage via built-in LanceDB or external providers like Pinecone and Qdrant, and flexible LLM routing across 30+ providers including OpenAI, Anthropic, Ollama, and fully local models.

The platform ships with built-in AI agents that can browse the web, execute code, and interact with external tools. A Community Hub offers extensions and plugins including custom agent skills and reusable system prompts. Multi-user support with role-based access control, workspace isolation, and white-labeling makes it suitable for team deployments. Native MCP compatibility means AnythingLLM workspaces can be exposed as tools for Claude and other MCP-enabled AI systems.

The desktop app runs entirely offline on Mac, Windows, and Linux with no signup required. For teams, cloud hosting now starts with Basic at $50/month and Pro at $99/month, with Enterprise for on-premise and custom support packages. Self-hosting via Docker is completely free. The full REST API enables programmatic workspace and chat management. With 62K+ stars on GitHub, AnythingLLM is consistently recommended alongside Open WebUI as the top self-hosted AI solution on Reddit's r/LocalLLaMA community.

Pricing & Platform Specs

Pricing Summary

100% free and open-source under the MIT license ($0 software cost). AnythingLLM by Mintplex Labs provides a single-user desktop application (macOS, Windows, Linux) and multi-user self-hosted Docker deployment with zero-config embedded LanceDB vector storage. Connects natively to local runtimes (Ollama, LM Studio, LocalAI) and cloud LLMs (OpenAI, Anthropic, Gemini, Groq). Features multi-format document parsing (PDF, DOCX, CSV, audio, GitHub), authenticated web scraping, workspace isolation, and @agent tools. Optional managed AnythingLLM Cloud starts at $50/mo (Basic) and $99/mo (Pro), alongside custom Enterprise plans with SSO and SLAs.

full pricing breakdown →

Supported Platforms

Desktop (Mac/Win/Linux), Docker, Cloud hosted

Explore categories, tags & use cases

Alternatives

All AnythingLLM alternatives →
Ollama logo

Ollama

Run LLMs locally with one command

Tool for running large language models locally on your machine with a simple CLI interface. Download and run Llama 3, Mistral, Gemma, Phi, Code Llama, and dozens of other open-source models with a single command. Features model management, GPU acceleration (NVIDIA/AMD/Apple Silicon), OpenAI-compatible API server, Modelfile for customization, and multi-model switching. Ideal for offline AI development, privacy-sensitive use cases, and local testing. 120K+ GitHub stars.

Open Source
Open WebUI logo

Open WebUI

Self-hosted AI platform with ChatGPT-like interface for local and cloud LLMs.

Extensible, self-hosted AI platform with 290M+ Docker pulls and 124K+ GitHub stars. Supports Ollama, OpenAI-compatible APIs, and any Chat Completions backend. Features built-in RAG, multi-user RBAC, voice/video calls, Python function workspace, model builder, and web browsing. Runs entirely offline with enterprise features including SSO and audit logging.

Jan logo

Jan

Offline-first AI assistant for local inference

Jan is an open-source offline-first AI assistant with 25K+ GitHub stars running LLMs locally without sending data externally. Features a ChatGPT-like interface with one-click model downloads from Hugging Face, conversation management, customizable prompts, and an OpenAI-compatible local API server. Supports GGUF models via llama.cpp with GPU acceleration on NVIDIA and Apple Silicon. Built with Electron for macOS, Windows, and Linux with full data privacy.

Open Source
LobeChat logo

LobeChat

Open-source multi-model AI chat framework with plugin ecosystem

LobeChat is a source-available AI chat and agent workspace for OpenAI, Claude, Gemini, Ollama, DeepSeek, and Qwen. It includes RAG, 10,000+ MCP-compatible plugins, Agent Groups, TTS/STT, Vercel/Docker self-hosting, and 79K+ GitHub stars.

Open Source
Khoj logo

Khoj

Open-source AI second brain with deep research and RAG

Khoj is an open-source personal AI app that serves as a self-hostable second brain. It connects to your documents — PDFs, Markdown, Notion, Word — and uses RAG to answer questions grounded in your knowledge base. Supports any local or cloud LLM including Llama, Claude, GPT, and Gemini. Features custom agents, scheduled automations, deep research mode, semantic search, and Obsidian, Emacs, and WhatsApp integrations. Over 33,000 GitHub stars, YC-backed.

Open Source
Onyx logo

Onyx

Self-hosted AI platform with RAG, agents, and 40+ connectors

Onyx is an open-core, self-hostable AI knowledge platform for enterprise search, RAG chat, deep research, custom agents, and workplace connectors. It connects to 40+ apps, supports permission-aware retrieval, and offers Cloud, Docker/Kubernetes, and enterprise deployment paths for teams that need controlled internal AI search.

freemiumOpen Source

Side-by-Side Comparisons

LobeChat logo
LobeChat
vs
AnythingLLM logo
AnythingLLM

LobeChat vs AnythingLLM — Agent Workspace with 10K Plugins vs All-in-One RAG Platform

LobeChat and AnythingLLM are both open-source self-hosted AI platforms with massive GitHub communities, but they evolved in different directions. LobeChat is becoming an agent workspace with 10,000+ MCP plugins, Agent Groups, and scheduled tasks. AnythingLLM is a complete RAG platform with document ingestion, vector storage, agents, and team management. This comparison helps you choose between agent-centric and document-centric AI infrastructure.

LobeChatAnythingLLM
PrivateGPT logo
PrivateGPT
vs
AnythingLLM logo
AnythingLLM

PrivateGPT vs AnythingLLM — Air-Gapped Document Q&A vs All-in-One AI Platform

PrivateGPT and AnythingLLM are both open-source self-hosted AI platforms with 50K+ GitHub stars, but they prioritize different outcomes. PrivateGPT is laser-focused on 100% private document Q&A where no data ever leaves your machine. AnythingLLM bundles RAG, agents, multi-user management, and extensibility into a broader platform. This comparison helps privacy-conscious teams choose between dedicated document intelligence and versatile AI infrastructure.

PrivateGPTAnythingLLM
AnythingLLM logo
AnythingLLM
vs
Open WebUI logo
Open WebUI

AnythingLLM vs Open WebUI — All-in-One RAG Platform vs Customizable Chat Interface

AnythingLLM and Open WebUI are the two most popular self-hosted AI platforms, with a combined 110,000+ GitHub stars. AnythingLLM bundles RAG, agents, and multi-user management into a zero-config desktop app. Open WebUI focuses on being the most customizable and extensible ChatGPT-like interface for local and cloud models. This comparison helps you choose the right self-hosted AI foundation for your team.

AnythingLLMOpen WebUI

Community experience

Sources & verification

Sources checked
Content verified

Verification dates are editorial checks. Routine CMS saves and automatic updatedAt timestamps do not advance them.

FAQ

What is AnythingLLM?

AnythingLLM is an open-source, privacy-first AI application that turns any document into an interactive knowledge base. It bundles document ingestion, vector storage (built-in LanceDB), RAG pipelines, AI agents, and multi-user access into a single deployable package. Supports 30+ LLM providers including OpenAI, Anthropic, Ollama, and local models. With 62K+ GitHub stars and MIT license, it runs as a desktop app or Docker container with zero configuration required out of the box.

Is AnythingLLM free?

Yes — AnythingLLM is open source and free to use. 100% free and open-source under the MIT license ($0 software cost). AnythingLLM by Mintplex Labs provides a single-user desktop application (macOS, Windows, Linux) and multi-user self-hosted Docker deployment with zero-config embedded LanceDB vector storage. Connects natively to local runtimes (Ollama, LM Studio, LocalAI) and cloud LLMs (OpenAI, Anthropic, Gemini, Groq). Features multi-format document parsing (PDF, DOCX, CSV, audio, GitHub), authenticated web scraping, workspace isolation, and @agent tools. Optional managed AnythingLLM Cloud starts at $50/mo (Basic) and $99/mo (Pro), alongside custom Enterprise plans with SSO and SLAs.

Is AnythingLLM open source?

Yes — AnythingLLM is open source.

Is AnythingLLM still maintained?

Yes — AnythingLLM is active. Its listing was last verified on September 6, 2026.

What are the best AnythingLLM alternatives?

The first editor-selected AnythingLLM alternatives are Ollama, Open WebUI, Jan, and more.

How does AnythingLLM score in our review?

The published editorial review lists AnythingLLM at 86/100 overall across speed, privacy, and developer experience. Check the review's evidence status and test metadata for its verification level.