aicoolies logo
Manifest logo
Manifest logo

Manifest

Smart LLM router that cuts inference costs up to 70%

open sourceverified Aug 24, 2026

Manifest is an open-source smart model router that intelligently routes LLM requests to the cheapest capable model, reducing inference costs by up to 70% without sacrificing output quality. It uses a 23-dimension scoring algorithm to evaluate 300+ models across providers including OpenAI, Anthropic, Google, and DeepSeek, with automatic fallbacks and budget controls. Manifest can be deployed as a cloud service, local plugin, or self-hosted Docker container with transparent routing logic.

Manifest is an open-source intelligent routing layer for LLM API calls that automatically selects the most cost-effective model capable of handling each request. Rather than hardcoding model selections or building custom routing logic, developers point their API calls through Manifest and let its 23-dimension scoring algorithm match requests to the optimal model from a pool of over 300 options across OpenAI, Anthropic, Google, DeepSeek, and other providers. The system analyzes request complexity, required capabilities, and cost constraints to make routing decisions in real time.

The routing engine goes beyond simple load balancing by evaluating models across dimensions including reasoning depth, code generation ability, multilingual support, context window requirements, and latency sensitivity. Automatic fallback chains ensure reliability when a primary model is unavailable or rate-limited, while budget controls let teams set spending limits per project, per user, or per time period. All routing decisions are fully transparent, with detailed logs showing why each model was selected and how much was saved compared to default routing.

Built in TypeScript with over 4,200 commits, Manifest offers flexible deployment options including a hosted cloud dashboard, a local OpenClaw plugin for IDE integration, and self-hosted Docker containers for teams that need to keep API keys and traffic within their infrastructure. The MIT-licensed project has attracted 4,300 GitHub stars and serves teams looking to reduce LLM costs without the engineering overhead of building and maintaining their own model selection infrastructure across multiple providers.

Pricing

100% free and open source under the Apache-2.0 license ($0 software cost). Manifest is a 1-file declarative micro-backend framework auto-generating REST APIs, auth, and admin panels with zero software fees.

full pricing breakdown →

Platforms

TypeScript, Docker, cloud, local plugin

Categories

Tags

Use Cases

Related Tools

computed discovery: shared active categories · kept separate from editor-verified Alternatives

OpenLIT logo

OpenLIT

OpenTelemetry-native observability for LLM applications with evals and GPU monitoring

OpenLIT is an open-source AI engineering platform that provides OpenTelemetry-native observability for LLM applications. It combines distributed tracing, evaluation, prompt management, a secrets vault, and GPU telemetry in a single self-hostable stack. With 50+ integrations across LLM providers and frameworks, it lets teams monitor AI applications using their existing observability backends like Grafana, Datadog, or Jaeger.

Open Source
Grafana logo

Grafana

Open-source observability platform for metrics, logs, and traces visualization.

Grafana is the leading open-source platform for monitoring and observability visualization. It connects to virtually any data source — Prometheus, Elasticsearch, InfluxDB, PostgreSQL, CloudWatch, Datadog, and 150+ others — to create beautiful, interactive dashboards. Used by millions of users at companies like Bloomberg, JPMorgan, eBay, and PayPal. Grafana Cloud offers a fully managed experience with generous free tier. The CNCF ecosystem standard for metrics visualization.

freemiumOpen Source
Latitude logo

Latitude

Sentry-style observability for AI agent conversations

Latitude is an agent observability platform for teams that need to inspect LLM traces, conversations, issues, and evaluation feedback in one workflow. Its public repo and docs position it as a Sentry-style monitor for AI agents, with semantic search, issue detection, annotations, MCP-assisted fixes, and cloud or self-hosted deployment paths for production debugging.

freemiumOpen SourceTelemetry
Judgeval logo

Judgeval

Open-source post-building layer for agents — tracing, evals, and online monitoring

Judgeval is the open-source post-building layer for AI agents from Judgment Labs, providing OpenTelemetry-based tracing, hosted and custom evaluation scorers, and online behavior monitoring for LLM-powered applications. Instrument any function with a single decorator, score live production traffic against faithfulness and instruction-adherence checks, and feed real-world failures back into reinforcement learning or supervised fine-tuning loops.

Open Source
Sentrial logo

Sentrial

Production monitoring platform for AI agent reliability

Sentrial is a YC W26-backed monitoring platform for AI agent reliability in production. It semantically detects loops, hallucinations, tool misuse, and user frustration in real-time, then diagnoses root causes and recommends fixes. The platform claims 70% MTTR reduction via automated remediation including rollback, model retraining triggers, and webhooks. Sentrial positions itself as the Datadog for teams deploying autonomous AI agents at scale.

paid
Datadog logo

Datadog

Cloud-scale monitoring, security, and analytics platform for modern infrastructure.

Datadog is a cloud observability and security platform that unifies metrics, traces, logs, RUM, synthetics, APM, and security signals. Current pricing pages list 1,000+ integrations for Infrastructure Monitoring, with Pro from $15/host/month and Enterprise from $23/host/month when billed annually.

freemium

FAQ

What is Manifest?

Manifest is an open-source smart model router that intelligently routes LLM requests to the cheapest capable model, reducing inference costs by up to 70% without sacrificing output quality. It uses a 23-dimension scoring algorithm to evaluate 300+ models across providers including OpenAI, Anthropic, Google, and DeepSeek, with automatic fallbacks and budget controls. Manifest can be deployed as a cloud service, local plugin, or self-hosted Docker container with transparent routing logic.

Is Manifest free?

Yes — Manifest is open source and free to use. 100% free and open source under the Apache-2.0 license ($0 software cost). Manifest is a 1-file declarative micro-backend framework auto-generating REST APIs, auth, and admin panels with zero software fees.

Is Manifest open source?

Yes — Manifest is open source.

Is Manifest still maintained?

Yes — Manifest is active. Its listing was last verified on August 24, 2026.

What are the best Manifest alternatives?

The top editor-verified Manifest alternatives are LiteLLM, OpenRouter.