aicoolies logo
Rig logo

Rig

Build modular, scalable LLM applications in Rust

Share
freeOpen Source
Visit Website →

Open-source Rust library for building scalable, modular, and ergonomic LLM-powered applications. Rig unifies 20+ model providers (OpenAI, Anthropic, Mistral, DeepSeek, Ollama, and more) and 10+ vector stores behind one trait-based interface, supports completion and embedding workflows, multi-turn streaming, and transcription/audio/image generation, with full GenAI Semantic Convention compatibility and WASM-ready core library — production agentic infra for Rust teams.

Rig is an open-source Rust library for building scalable, modular, and ergonomic LLM-powered applications. Developed by 0xPlaygrounds, it sits in the same niche as LangChain or LlamaIndex for the Rust ecosystem, giving developers a unified interface over more than 20 model providers — OpenAI, Anthropic, Google, Mistral, DeepSeek, Cohere, Groq, local Ollama, and more — plus 10+ vector-store integrations such as MongoDB Atlas Vector, LanceDB, Qdrant, SQLite, and in-memory stores. Rig supports LLM completion and embedding workflows as first-class concepts and is fully WASM-compatible in its core library.

The library is designed for production agentic workflows rather than hello-world demos. It exposes building blocks for multi-turn streaming, tool use, prompt pipelines, and retrieval-augmented generation, and ships full GenAI Semantic Convention compatibility so traces interoperate cleanly with OpenTelemetry-based observability stacks. Beyond text, Rig covers transcription, audio generation, and image generation capabilities, which lets teams stand up multimodal agents without bolting together three SDKs. Because everything runs over a common trait-based abstraction, swapping a model or vector store is a one-line change in most applications.

Rig is MIT-licensed and already used in real products — St. Jude's genomics chatbot, Coral Protocol's Rust SDK, the VT Code terminal coding agent, the Con terminal emulator's agent harness, and the Dria decentralized AI network all cite Rig as their LLM abstraction layer. The project is evolving quickly and the maintainers explicitly warn that breaking changes arrive with new features, so teams choosing Rig should track releases closely. For Rust-first engineering orgs building performance-sensitive agents, RAG services, or on-device AI where Python is not an option, Rig is the most complete and actively developed option in 2026.

Pricing

Free and open source (MIT) — Rust crate, no paid tier; pay only for the underlying model providers you plug in

Platforms

Rust library (crates.io), WASM-compatible core, runs on any platform with a Rust toolchain or WASM runtime

Categories

Tags

Use Cases

Related Tools

eve vercel

eve by Vercel

Filesystem-first framework for durable AI agents

Eve is Vercel's filesystem-first TypeScript framework for building durable AI agents as ordinary project files. It combines Markdown instructions and skills, typed tools, channels, connections, subagents, schedules, sandboxes, and evals with Vercel's agent runtime so teams can ship deployable agents without hand-rolling orchestration. The current beta fits Vercel-native backend agent projects.

open-sourceOpen Source
BrowserOS logo

BrowserOS

Open-source agentic browser that runs local AI agents in your browsing workflow.

BrowserOS is a privacy-first, open-source agentic browser for running AI assistants locally inside real browsing sessions instead of handing every task to a remote cloud browser.

open-sourceOpen Source
Agent Governance Toolkit logo

Agent Governance Toolkit

Microsoft’s open-source toolkit for adding policy enforcement, identity, sandboxing, and audit controls to production AI agents.

Agent Governance Toolkit is an open-source Microsoft project for teams moving AI agents from demos into controlled production workflows. It focuses on runtime policy enforcement, zero-trust identity, sandboxed execution, and reliability patterns around autonomous agents, giving security and platform teams a governance layer around tool calls and agent actions rather than another prompt-only guardrail.

open-sourceOpen SourceTelemetry

CLIProxyAPI

Self-hosted proxy API for routing AI CLI accounts into OpenAI-compatible endpoints

CLIProxyAPI is an open-source Go proxy server that wraps Gemini CLI, Claude Code, OpenAI Codex, Grok Build, and related CLI account flows behind OpenAI/Gemini/Claude-compatible API endpoints. Use it carefully: it can touch OAuth sessions, auth files, logs, and provider account policies, so production use needs credential and ToS review.

open-sourceOpen SourceTelemetry
xAI Python SDK logo

xAI Python SDK

Official Python SDK for the xAI API

The xAI Python SDK is the official Python client for the xAI API, giving developers a direct way to build Grok-powered apps without relying on community proxies or unofficial wrappers. It supports synchronous and asynchronous Python clients for chat completions, streaming responses, function/tool calling, and multimodal workflows, making it a clean fit for backend services, agents, notebooks, and developer tools that need programmatic xAI access.

open-sourceOpen Source
rampart

Rampart

Microsoft’s pytest-native red teaming framework for turning AI agent safety findings into CI tests.

RAMPART is an open-source Microsoft framework for safety and security testing of agentic AI applications. It brings red-team findings into a pytest-native workflow so teams can turn prompt injection, unsafe tool use, and behavioral boundary failures into repeatable regression tests. The strongest aicoolies angle is developer workflow: RAMPART makes agent safety part of CI/CD instead of a one-off security review.

open-sourceOpen Source