# ollama

Open-source AI coding agent for the terminal

Open-source terminal-based AI coding agent built in Go by the SST team, with a rich TUI (Bubble Tea) supporting 75+ model providers including OpenAI, Anthropic, Gemini, Bedrock, Groq, and OpenRouter. Features vim-like editing, persistent SQLite sessions, and LSP integration for 40+ languages. Fully free with no vendor lock-in, it has rapidly grown to 95k+ GitHub stars.

One desktop app for every LLM — private, cross-platform, extensible

Chatbox is a cross-platform desktop AI client supporting OpenAI, Claude, Gemini, DeepSeek, and local models via Ollama. All chat data stays on-device, making it ideal for privacy-conscious developers. Features include document analysis, code assistance with syntax highlighting, image generation, web search, and a local knowledge base for private Q&A. Available on Windows, macOS, Linux, Android, iOS, and web.

Open-source AI second brain with deep research and RAG

Khoj is an open-source personal AI app that serves as a self-hostable second brain. It connects to your documents — PDFs, Markdown, Notion, Word — and uses RAG to answer questions grounded in your knowledge base. Supports any local or cloud LLM including Llama, Claude, GPT, and Gemini. Features custom agents, scheduled automations, deep research mode, semantic search, and Obsidian, Emacs, and WhatsApp integrations. Over 33,000 GitHub stars, YC-backed.

All-in-one LLM CLI tool with shell assistant, RAG, and function calling

All-in-one LLM CLI written in Rust that gives unified access to 20+ AI providers (OpenAI, Claude, Gemini, Ollama, Groq, Mistral, DeepSeek, and more) through one terminal interface. Includes a shell assistant, interactive REPL with session management, RAG over local files and URLs, custom roles, function calling, and a built-in HTTP server exposing Chat Completions, Embeddings, and Rerank APIs plus an LLM Playground and Arena for model comparison.

Natural language interface for running code on your computer

Open-source AI coding assistant with a focus on privacy and local-first execution. Runs models on your machine using Ollama or connects to cloud providers when needed. Supports VS Code with code completion, chat, and inline editing. Targets developers who want full AI coding capabilities without sharing proprietary code with third-party services, offering complete data sovereignty.

Run LLMs locally with one command

Tool for running large language models locally on your machine with a simple CLI interface. Download and run Llama 3, Mistral, Gemma, Phi, Code Llama, and dozens of other open-source models with a single command. Features model management, GPU acceleration (NVIDIA/AMD/Apple Silicon), OpenAI-compatible API server, Modelfile for customization, and multi-model switching. Ideal for offline AI development, privacy-sensitive use cases, and local testing. 120K+ GitHub stars.

Unified API proxy for 100+ LLMs

Drop-in OpenAI-compatible proxy supporting 100+ LLM providers with load balancing, spend tracking, rate limiting, and fallback routing. Acts as a unified gateway for all your AI model calls, letting teams switch between providers, enforce budgets, and add reliability layers without changing application code. Essential infrastructure for multi-model AI architectures.

Open-source AI code assistant for any model

Open-source AI coding assistant that connects any LLM to your IDE. Supports VS Code and JetBrains with tab autocomplete, chat, and inline editing. Fully customizable with support for cloud and local models, making it the most flexible option for developers and teams who want AI-powered coding without vendor lock-in or restrictions on model choice and data privacy.