aicoolies logo
Rig logo
Rig logo

Rig

Build modular, scalable LLM applications in Rust

freeopen sourceupdated Apr 21, 2026

Open-source Rust library for building scalable, modular, and ergonomic LLM-powered applications. Rig unifies 20+ model providers (OpenAI, Anthropic, Mistral, DeepSeek, Ollama, and more) and 10+ vector stores behind one trait-based interface, supports completion and embedding workflows, multi-turn streaming, and transcription/audio/image generation, with full GenAI Semantic Convention compatibility and WASM-ready core library — production agentic infra for Rust teams.

Rig is an open-source Rust library for building scalable, modular, and ergonomic LLM-powered applications. Developed by 0xPlaygrounds, it sits in the same niche as LangChain or LlamaIndex for the Rust ecosystem, giving developers a unified interface over more than 20 model providers — OpenAI, Anthropic, Google, Mistral, DeepSeek, Cohere, Groq, local Ollama, and more — plus 10+ vector-store integrations such as MongoDB Atlas Vector, LanceDB, Qdrant, SQLite, and in-memory stores. Rig supports LLM completion and embedding workflows as first-class concepts and is fully WASM-compatible in its core library.

The library is designed for production agentic workflows rather than hello-world demos. It exposes building blocks for multi-turn streaming, tool use, prompt pipelines, and retrieval-augmented generation, and ships full GenAI Semantic Convention compatibility so traces interoperate cleanly with OpenTelemetry-based observability stacks. Beyond text, Rig covers transcription, audio generation, and image generation capabilities, which lets teams stand up multimodal agents without bolting together three SDKs. Because everything runs over a common trait-based abstraction, swapping a model or vector store is a one-line change in most applications.

Rig is MIT-licensed and already used in real products — St. Jude's genomics chatbot, Coral Protocol's Rust SDK, the VT Code terminal coding agent, the Con terminal emulator's agent harness, and the Dria decentralized AI network all cite Rig as their LLM abstraction layer. The project is evolving quickly and the maintainers explicitly warn that breaking changes arrive with new features, so teams choosing Rig should track releases closely. For Rust-first engineering orgs building performance-sensitive agents, RAG services, or on-device AI where Python is not an option, Rig is the most complete and actively developed option in 2026.

Pricing

Free and open source (MIT) — Rust crate, no paid tier; pay only for the underlying model providers you plug in

Platforms

Rust library (crates.io), WASM-compatible core, runs on any platform with a Rust toolchain or WASM runtime

Categories

Tags

Use Cases

Related Tools

hyperagent

HyperAgent

Open-source natural-language browser automation framework for AI agents

An AGPL-3.0 TypeScript framework that drives a real browser from natural-language tasks — the self-hostable OSS framework from Hyperbrowser, distinct from the vendor's paid cloud browser product.

freeOpen Source
KaibanJS logo

KaibanJS

JavaScript framework for building and visualizing multi-agent workflows on a Kanban board

KaibanJS is an MIT-licensed JavaScript framework for defining AI agents, tasks, tools, and teams, then orchestrating their work through a Kanban-inspired runtime and visual board. It can run inside Node.js, React, or Next.js projects, supports custom UIs and headless workflows, and provides real-time task-state visibility for multi-agent applications.

Open SourceTelemetry
Sakana Fugu logo

Sakana Fugu

Multi-agent model API that orchestrates frontier models behind one OpenAI-compatible endpoint

Sakana Fugu is a hosted model-provider API that exposes a learned multi-agent system as one OpenAI-compatible model. It dynamically routes coding, code review, research, and reasoning tasks across a frontier-model pool, with Fugu for lower-latency work and Fugu Ultra for harder workloads where answer quality matters more than cost or speed.

paidTelemetry
LangChain logo

OpenWiki

LangChain CLI for maintaining agent-friendly codebase documentation

OpenWiki is LangChain’s open-source CLI for generating and maintaining an agent-focused wiki inside a codebase. It can create an openwiki/ documentation folder, update it from repository changes, add guidance to AGENTS.md or CLAUDE.md, and run via an interactive CLI or daily GitHub Action so coding agents have durable context without stuffing every detail into prompts.

Open SourceTelemetry
Accomplish Coworker logo

Accomplish Coworker

Open-source desktop AI coworker for browsing and code execution.

Accomplish Coworker is an MIT-licensed open-source AI coworker that runs on the desktop, combining computer-use style browsing with code execution so agents can research, implement, run, and debug workflows in one local environment.

Open SourceTelemetry
Headroom logo

Headroom

Context compression for LLM apps and coding agents

Headroom is an Apache-2.0 context compression layer for LLM apps and coding agents. It compresses tool output, logs, files, RAG chunks, and agent history through a local library, proxy, wrapper, or MCP server, with retrieval hooks for bringing originals back when needed. Treat its savings numbers as Headroom-reported benchmarks, not independent aicoolies measurements.

Open SourceTelemetry