# Ollama

Run LLMs locally with one command

Tool for running large language models locally on your machine with a simple CLI interface. Download and run Llama 3, Mistral, Gemma, Phi, Code Llama, and dozens of other open-source models with a single command. Features model management, GPU acceleration (NVIDIA/AMD/Apple Silicon), OpenAI-compatible API server, Modelfile for customization, and multi-model switching. Ideal for offline AI development, privacy-sensitive use cases, and local testing. 120K+ GitHub stars.

Open-source AI coding agent for the terminal

Open-source terminal-based AI coding agent built in Go by the SST team, with a rich TUI (Bubble Tea) supporting 75+ model providers including OpenAI, Anthropic, Gemini, Bedrock, Groq, and OpenRouter. Features vim-like editing, persistent SQLite sessions, and LSP integration for 40+ languages. Fully free with no vendor lock-in, it has rapidly grown to 95k+ GitHub stars.

Unified API proxy for 100+ LLMs

Drop-in OpenAI-compatible proxy supporting 100+ LLM providers with load balancing, spend tracking, rate limiting, and fallback routing. Acts as a unified gateway for all your AI model calls, letting teams switch between providers, enforce budgets, and add reliability layers without changing application code. Essential infrastructure for multi-model AI architectures.

Natural language interface for running code on your computer

Open Interpreter is an open-source natural-language interface for computers. It runs Python, JavaScript, shell commands, and other code locally through a ChatGPT-like terminal workflow, with user approval before execution. It can use hosted providers or local models, but its main tradeoff is safety: approved commands can access local files, apps, and system resources.

All-in-one LLM CLI tool with shell assistant, RAG, and function calling

All-in-one LLM CLI written in Rust that gives unified access to 20+ AI providers (OpenAI, Claude, Gemini, Ollama, Groq, Mistral, DeepSeek, and more) through one terminal interface. Includes a shell assistant, interactive REPL with session management, RAG over local files and URLs, custom roles, function calling, and a built-in HTTP server exposing Chat Completions, Embeddings, and Rerank APIs plus an LLM Playground and Arena for model comparison.

One desktop app for every LLM — private, cross-platform, extensible

Chatbox is a cross-platform desktop AI client supporting OpenAI, Claude, Gemini, DeepSeek, and local models via Ollama. All chat data stays on-device, making it ideal for privacy-conscious developers. Features include document analysis, code assistance with syntax highlighting, image generation, web search, and a local knowledge base for private Q&A. Available on Windows, macOS, Linux, Android, iOS, and web.

Open-source AI second brain with deep research and RAG

Khoj is an open-source personal AI app that serves as a self-hostable second brain. It connects to your documents — PDFs, Markdown, Notion, Word — and uses RAG to answer questions grounded in your knowledge base. Supports any local or cloud LLM including Llama, Claude, GPT, and Gemini. Features custom agents, scheduled automations, deep research mode, semantic search, and Obsidian, Emacs, and WhatsApp integrations. Over 33,000 GitHub stars, YC-backed.

Multi-provider AI code completion as-you-type for Neovim

Neovim plugin that streams inline code completions from your choice of LLM (OpenAI, Claude, Gemini, Codestral, Ollama, Llama.cpp, and more), with no proprietary background binary.

Community-built, local-first terminal coding agent — bring your own model

An open-source terminal coding agent from the non-profit Nano Collective. Runs agentic coding on the model of your choice — local via Ollama or any OpenAI-compatible API — with no paid tiers and nothing gated behind a vendor.