Jan

Offline-first AI assistant for local inference

open-sourceOpen Source

Visit Website →

Jan is an open-source offline-first AI assistant with 25K+ GitHub stars running LLMs locally without sending data externally. Features a ChatGPT-like interface with one-click model downloads from Hugging Face, conversation management, customizable prompts, and an OpenAI-compatible local API server. Supports GGUF models via llama.cpp with GPU acceleration on NVIDIA and Apple Silicon. Built with Electron for macOS, Windows, and Linux with full data privacy.

ChatGPT-like experience on local hardware. 25K+ stars, privacy and offline-first.

One-click model downloads, conversation management, model switching. GGUF via llama.cpp.

OpenAI-compatible local API. GPU acceleration on NVIDIA CUDA and Apple Metal.

Cross-platform Electron desktop app. All data stays local.

Pricing

Free and open-source

Platforms

macOS, Windows, Linux

Use Cases

Local AI Workflows Code Generation

Alternatives

llmfit

Find which AI models actually run on your hardware in one command

llmfit is a Rust-based terminal tool that matches over 200 LLM models from 30+ providers against your exact hardware specs. The interactive TUI scores each model on fit, speed, VRAM usage, and context length, helping you avoid downloading models that won't run on your machine. It supports Ollama, llama.cpp, MLX, Docker Model Runner, and LM Studio backends.