aicoolies logo

Laminar Review 2026: Agent Observability, Evals, and Self-Hosting

Laminar combines OpenTelemetry-native agent tracing, replay-oriented debugging, evaluations, datasets, SQL analysis, and self-hosting. This buyer's guide explains where the platform stands out, how Signals and Cloud pricing work, and which operational and licensing boundaries teams should evaluate.

reviewed by Raşit Akyol July 13, 2026

What Laminar is—and who should shortlist it

Laminar is an open-source observability platform built specifically around AI-agent execution rather than a generic application-monitoring suite with an LLM screen added later. Its public product surface joins OpenTelemetry-native tracing, a transcript-oriented trace view, evaluations, datasets, SQL analysis, browser-session recording, an agent debugger, and natural-language monitoring called Signals. The project is licensed under Apache-2.0, and its official GitHub repository showed 3,088 stars, 217 forks, an active main branch, and release v0.2.1 dated July 9, 2026 when this review was prepared. Those signals do not prove product quality, but they do establish that Laminar is a live, actively developed open-source project rather than an abandoned monitoring experiment.

The strongest buyer fit is a team operating multi-step agents whose failures are difficult to understand from conventional request logs. Laminar's model follows LLM turns, tool calls, control flow, sub-agents, evaluation scores, and browser sessions, so its value rises when a single run spans many decisions or external actions. Teams that only need uptime checks, host metrics, logs, and incident paging should not treat Laminar as a replacement for a broad APM or infrastructure-observability stack; its documentation and integrations are centered on AI behavior. The practical shortlist question is therefore not whether monitoring is needed, but whether the team must reconstruct, query, and improve what an agent decided across a long execution.

Tracing and debugging long-running agents

Tracing is the foundation of the product. Laminar documents automatic instrumentation for agent and model libraries including the Vercel AI SDK, Claude Agent SDK, OpenAI Agents SDK, LangChain, Browser Use, Stagehand, LiteLLM, OpenAI, Anthropic, and Gemini, while manual spans cover custom functions and providers. The trace view presents an agent run as a readable transcript of model turns, tools, and control flow instead of requiring every investigation to begin from a raw span tree. OpenTelemetry ingestion also matters for portability: teams can send OTLP data and query span-level inputs, outputs, token counts, costs, tags, status, and model metadata rather than accepting a purely proprietary event format.

Laminar's debugger is more ambitious than passive trace browsing. The documented workflow records a run, lets a developer or coding agent inspect the trace, changes the agent, and replays from a chosen boundary while serving earlier LLM responses from cache. That can reduce repeated cost and waiting time when the fault occurs late in a long run, although the benefit depends on whether the relevant integration and call sequence can be replayed safely. Browser-session recording adds another useful layer for web agents by aligning visual activity with the trace. Buyers should still separate replay from proof: one repaired run explains a case, while the evaluation layer is needed to show that a change generalizes across a fixed dataset.

Signals and production monitoring

Signals turn a plain-language instruction such as detecting a loop, failed checkout, repeated retry, or malformed tool call into structured events over traces. Each Signal combines a prompt, a JSON output schema, and trigger conditions; matching traces are compressed, investigated by an agent, and converted into findings with a summary, structured payload, and critical, warning, or info severity. Laminar says the compressed transcript averages about 10% of the original token count, preserves references for retrieving full span content, and can run on newly arriving traces or backfill a historical slice. Event records are queryable, clusterable, linked to their source traces, and eligible for alert rules.

The packaging boundary is important because open source does not mean every monitoring feature is free in every deployment. Laminar's current self-hosting documentation says the OSS Docker Compose and unlicensed Helm options include tracing, search, dashboards, SQL, evaluations, datasets, debugger, browser recording, and MCP access, but not Signals. Signals, event clusters, and email or Slack alerts require an enterprise license key for self-hosting; Laminar Cloud includes them. Cloud pricing also meters Signals separately from stored data: the Free, Hobby, and Pro tiers include $5, $15, and $50 of Signals usage, with paid-tier overages based on the input and output tokens used to read compressed traces.

Evaluations, datasets, and analysis

Laminar's evaluation framework is SDK-first and designed for repeatable offline checks before a prompt, model, or agent change ships. An evaluation contains datapoints, an executor, one or more evaluator functions, and a group name; each datapoint becomes a trace with executor and evaluator spans, while related runs can be compared over time. Evaluations can be launched as Python or TypeScript scripts, or through the lmnr CLI conventions in CI. This structure supports regression questions that a production trace alone cannot answer, such as whether a cheaper model preserves a task score or whether failures collected from live traffic have been added to the test dataset.

The analysis surface goes beyond vendor-defined charts. Laminar's SQL editor exposes spans, traces, logs, signal events, datasets, dataset history, and evaluation datapoints; it accepts SELECT queries only and can export results into a dataset or labeling queue. The same query surface is available through a project-key API, the CLI, and an MCP server for clients such as Claude Code, Cursor, or Codex. Custom dashboards and full-text trace search complement that route for recurring operational views. This combination is valuable for teams comfortable with SQL, but it also places some responsibility on the buyer to define useful time filters, metrics, and review queues rather than expecting a finished catalog of infrastructure dashboards.

Self-hosting, licensing, and operational burden

The Apache-2.0 repository provides two main self-host routes. Docker Compose is positioned for local, single-node, or lightweight deployments and runs the frontend, app server, PostgreSQL, ClickHouse, and Quickwit. The production-oriented Helm path adds RabbitMQ, Redis, and a dedicated processing consumer and is documented for Kubernetes environments such as EKS or GKE. That is a credible ownership path for teams with data-residency requirements, but it is not a zero-maintenance binary: backups, upgrades, TLS, object storage, database tuning, secrets, and capacity planning remain part of operating a multi-service observability system.

Self-hosted AI features also need an external model provider, but the current documentation does not support a Gemini-only claim. Chat-with-trace, SQL-with-AI, and licensed Signals can use one configured provider from Gemini, OpenAI or an OpenAI-compatible gateway, or AWS Bedrock; Gemini is one option, not the exclusive key requirement. The sharper limitation is commercial packaging: Signals and alert integrations still require the enterprise license in self-hosted mode even after an LLM provider is configured. Teams evaluating sovereignty should therefore distinguish trace data staying in their infrastructure from every feature being available in the free OSS package, then request license and support terms before committing production architecture.

Pricing, value, and final recommendation

Laminar Cloud prices storage by data volume rather than trace or observation count. As of July 13, 2026, Free is $0 with 1 GB, no overage, seven-day retention, one project, and one seat. Hobby is $30 per month with 3 GB included, $2 per additional GB, 30-day retention, unlimited projects and seats, and email support. Pro is $150 per month with 10 GB included, $1.50 per additional GB, six-month retention, unlimited projects and seats, and Slack support. Enterprise uses custom limits and pricing and adds on-premise options and dedicated support. Buyers should model both storage and Signals because the latter has separate included credits and token-based overage rates.

Laminar earns a strong shortlist recommendation for teams building long-running or browser-using agents that want tracing, SQL access, evals, replay-oriented debugging, and a real self-host path in one system. Its most compelling advantage is the workflow connection from a production trace to a dataset, replay, evaluation, and follow-up analysis, not any single dashboard. The caveats are equally concrete: production self-hosting is operationally substantial, free OSS excludes Signals and alerting, Cloud retention is short on the lower tiers, and this agent-focused product should sit beside rather than replace general infrastructure observability. Start with the free Cloud tier or a contained Docker deployment, validate trace usefulness and monthly data volume, then price licensed monitoring before standardizing.

Pros

  • OpenTelemetry-native tracing focused on LLM turns, tool calls, control flow, and sub-agents
  • Apache-2.0 repository with Docker Compose and production-oriented Helm deployment paths
  • Replay-oriented debugger connects recorded traces, code changes, reruns, and evaluations
  • Integrated SDK-first evaluations, datasets, labeling queues, and run comparison
  • SQL, API, CLI, and MCP access provide flexible routes into trace and evaluation data
  • Browser-session recording and natural-language Signals address long-running agent workflows

Cons

  • Signals, event clusters, and email or Slack alerts require a licensed self-hosted tier or Cloud
  • Production self-hosting involves PostgreSQL, ClickHouse, Quickwit, and additional Helm services
  • The Free Cloud tier is limited to 1 GB, seven-day retention, one project, and one seat
  • Signals usage has a separate token-based cost model in addition to stored-data pricing
  • Replay value depends on supported integrations and whether the target workflow is safe to reproduce
  • Laminar is agent-focused and should not be treated as a replacement for general APM and infrastructure monitoring

Verdict

Laminar is a strong shortlist choice for teams debugging long-running or browser-using AI agents and wanting tracing, evaluations, SQL access, and a genuine self-host path in one product. Its main trade-offs are a multi-service production footprint, lower-tier Cloud retention, and the fact that Signals and alerting are not included in the free self-hosted OSS package.

View Laminar on aicoolies

Pricing, platforms, and community stacks — explore the full tool page

Alternatives to Laminar

Langfuse logo

Langfuse

Open-source LLM engineering platform for observability

Langfuse is an open-source LLM engineering platform with 29K+ GitHub stars for tracing, evaluating, and monitoring AI applications. Acquired by ClickHouse, it provides detailed traces of LLM calls, prompt management with versioning, dataset-based evaluation, user feedback collection, and cost tracking. Framework-agnostic with native integrations for LangChain, LlamaIndex, OpenAI SDK, and Vercel AI SDK. Offers both self-hosted deployment and a managed cloud service.

open-sourceOpen Source
Helicone logo

Helicone

Open-source LLM observability through a single-line proxy

Helicone is an open-source LLM observability and AI gateway platform with proxy-based request logging, cost tracking, latency monitoring, caching, rate limits, user analytics, prompt tools, and HQL. It supports OpenAI, Anthropic, Azure, LiteLLM, Anyscale, Together AI, and OpenRouter integrations, and now presents itself as part of Mintlify while continuing managed and self-hosted gateway/observability workflows.

freemiumOpen Source
OpenLIT logo

OpenLIT

OpenTelemetry-native observability for LLM applications with evals and GPU monitoring

OpenLIT is an open-source AI engineering platform that provides OpenTelemetry-native observability for LLM applications. It combines distributed tracing, evaluation, prompt management, a secrets vault, and GPU telemetry in a single self-hostable stack. With 50+ integrations across LLM providers and frameworks, it lets teams monitor AI applications using their existing observability backends like Grafana, Datadog, or Jaeger.

open-sourceOpen Source
Laminar Review 2026: Agent Observability, Evals, and Self-Hosting — aicoolies