aicoolies logo
Manifest logo
Manifest logo

Manifest

Smart LLM router that cuts inference costs up to 70%

freemiumopen sourceupdated Apr 21, 2026
Visit Website →
Share

Manifest is an open-source smart model router that intelligently routes LLM requests to the cheapest capable model, reducing inference costs by up to 70% without sacrificing output quality. It uses a 23-dimension scoring algorithm to evaluate 300+ models across providers including OpenAI, Anthropic, Google, and DeepSeek, with automatic fallbacks and budget controls. Manifest can be deployed as a cloud service, local plugin, or self-hosted Docker container with transparent routing logic.

Manifest is an open-source intelligent routing layer for LLM API calls that automatically selects the most cost-effective model capable of handling each request. Rather than hardcoding model selections or building custom routing logic, developers point their API calls through Manifest and let its 23-dimension scoring algorithm match requests to the optimal model from a pool of over 300 options across OpenAI, Anthropic, Google, DeepSeek, and other providers. The system analyzes request complexity, required capabilities, and cost constraints to make routing decisions in real time.

The routing engine goes beyond simple load balancing by evaluating models across dimensions including reasoning depth, code generation ability, multilingual support, context window requirements, and latency sensitivity. Automatic fallback chains ensure reliability when a primary model is unavailable or rate-limited, while budget controls let teams set spending limits per project, per user, or per time period. All routing decisions are fully transparent, with detailed logs showing why each model was selected and how much was saved compared to default routing.

Built in TypeScript with over 4,200 commits, Manifest offers flexible deployment options including a hosted cloud dashboard, a local OpenClaw plugin for IDE integration, and self-hosted Docker containers for teams that need to keep API keys and traffic within their infrastructure. The MIT-licensed project has attracted 4,300 GitHub stars and serves teams looking to reduce LLM costs without the engineering overhead of building and maintaining their own model selection infrastructure across multiple providers.

Pricing

Free open source MIT; cloud dashboard available

Platforms

TypeScript, Docker, cloud, local plugin

Categories

Tags

Use Cases

Alternatives

Related Tools

Better Stack logo

Better Stack

Better Stack is a hosted observability and incident-management platform that combines uptime monitoring, on-call workflows, status pages, logs, traces, metrics, error tracking, session replay, and an AI SRE interface. It is aimed at teams that want one SaaS control plane for telemetry and incident response.

freemiumTelemetry
HyperDX logo

HyperDX

HyperDX is the ClickStack UI for ClickHouse-backed observability. It provides a frontend for exploring logs, traces, metrics, session replay, dashboards, and alerts, with an OpenTelemetry-centered deployment path for teams that want a self-hosted or ClickHouse-aligned observability stack.

open-sourceOpen SourceTelemetry
SigNoz logo

SigNoz

SigNoz is an OpenTelemetry-native observability platform for collecting and correlating logs, metrics, and traces. Teams can self-host it or use SigNoz Cloud, with dashboards, alerting, query workflows, and enterprise controls for cloud-native and AI application telemetry.

open-sourceOpen SourceTelemetry
Latitude logo

Latitude

Sentry-style observability for AI agent conversations

Latitude is an agent observability platform for teams that need to inspect LLM traces, conversations, issues, and evaluation feedback in one workflow. Its public repo and docs position it as a Sentry-style monitor for AI agents, with semantic search, issue detection, annotations, MCP-assisted fixes, and cloud or self-hosted deployment paths for production debugging.

freemiumOpen SourceTelemetry
Spotlight by Backplanes logo

Spotlight by Backplanes

Session reports for Claude Code and Codex runs

Spotlight by Backplanes turns completed Claude Code and Codex sessions into concise reports for engineering, security, and spend review. The CLI installs on macOS, Linux, or WSL 2, watches sessions after they finish, redacts PII and credentials locally before upload, then summarizes files touched, commands run, external domains reached, scope drift, risky actions, and next-session improvements.

freemiumTelemetry
Traceway logo

Traceway

OpenTelemetry-native observability with AI tracing, logs, traces, metrics, and session replay — self-hosted in 90 seconds.

Traceway is an open-source, OpenTelemetry-native observability platform that combines logs, traces, metrics, exceptions, session replay, and AI tracing in a single self-hosted system. MIT licensed with no open-core restrictions, it deploys in 90 seconds via Docker Compose and accepts OTLP/HTTP from any OTel SDK without a Collector or per-language vendor SDK.

open-sourceOpen Source