Skip to content
aicoolies logo
Manifest logo

Manifest

Smart LLM router that cuts inference costs up to 70%

Manifest is an open-source smart model router that intelligently routes LLM requests to the cheapest capable model, reducing inference costs by up to 70% without sacrificing output quality. It uses a 23-dimension scoring algorithm to evaluate 300+ models across providers including OpenAI, Anthropic, Google, and DeepSeek, with automatic fallbacks and budget controls. Manifest can be deployed as a cloud service, local plugin, or self-hosted Docker container with transparent routing logic.

About Manifest

Manifest is an open-source intelligent routing layer for LLM API calls that automatically selects the most cost-effective model capable of handling each request. Rather than hardcoding model selections or building custom routing logic, developers point their API calls through Manifest and let its 23-dimension scoring algorithm match requests to the optimal model from a pool of over 300 options across OpenAI, Anthropic, Google, DeepSeek, and other providers. The system analyzes request complexity, required capabilities, and cost constraints to make routing decisions in real time.

The routing engine goes beyond simple load balancing by evaluating models across dimensions including reasoning depth, code generation ability, multilingual support, context window requirements, and latency sensitivity. Automatic fallback chains ensure reliability when a primary model is unavailable or rate-limited, while budget controls let teams set spending limits per project, per user, or per time period. All routing decisions are fully transparent, with detailed logs showing why each model was selected and how much was saved compared to default routing.

Built in TypeScript with over 4,200 commits, Manifest offers flexible deployment options including a hosted cloud dashboard, a local OpenClaw plugin for IDE integration, and self-hosted Docker containers for teams that need to keep API keys and traffic within their infrastructure. The MIT-licensed project has attracted 4,300 GitHub stars and serves teams looking to reduce LLM costs without the engineering overhead of building and maintaining their own model selection infrastructure across multiple providers.

Pricing & Platform Specs

Pricing Summary

Free and open-source under the Apache-2.0 license. Developers pay only underlying model provider API costs.

Supported Platforms

TypeScript, Docker, cloud, local plugin

Explore categories, tags & use cases

Unified API proxy for 100+ LLMs

Drop-in OpenAI-compatible proxy supporting 100+ LLM providers with load balancing, spend tracking, rate limiting, and fallback routing. Acts as a unified gateway for all your AI model calls, letting teams switch between providers, enforce budgets, and add reliability layers without changing application code. Essential infrastructure for multi-model AI architectures.

Open Source

Unified API gateway for 200+ AI models

Unified API gateway providing access to 500+ AI models from leading providers through a single OpenAI-compatible interface. OpenRouter eliminates the need to manage separate keys, billing, and integrations across providers like OpenAI, Anthropic, Google, and Meta, with built-in plugins for web search, PDF processing, automatic fallback routing, and per-model cost tracking.

paid

Community experience

Sources & verification

Sources checked
Content verified

Verification dates are editorial checks. Routine CMS saves and automatic updatedAt timestamps do not advance them.

FAQ

What is Manifest?

Manifest is an open-source smart model router that intelligently routes LLM requests to the cheapest capable model, reducing inference costs by up to 70% without sacrificing output quality. It uses a 23-dimension scoring algorithm to evaluate 300+ models across providers including OpenAI, Anthropic, Google, and DeepSeek, with automatic fallbacks and budget controls. Manifest can be deployed as a cloud service, local plugin, or self-hosted Docker container with transparent routing logic.

Is Manifest free?

Yes — Manifest is open source and free to use. Free and open-source under the Apache-2.0 license. Developers pay only underlying model provider API costs.

Is Manifest open source?

Yes — Manifest is open source.

Is Manifest still maintained?

Yes — Manifest is active. Its listing was last verified on August 26, 2026.

What are the best Manifest alternatives?

The first editor-selected Manifest alternatives are LiteLLM, OpenRouter.