Alternatives to Portkey

2 editor-selected alternatives · Portkey overview →

source: tools.alternatives · stored order · active records only; review scores are annotations and never change membership or order

A directional evidence panel appears only when the substitute rationale, trade-offs, sources, and verification date have been recorded. Older selections without that panel remain visible but are unclassified under the new evidence contract.

Tokscale

open sourcefreeexplicit relation

Tokscale is a CLI tool that tracks token usage and costs across AI coding agents including Claude Code, Codex, OpenCode, Gemini CLI, Cursor, and more. Built with a native Rust core for high-performance processing, it provides detailed breakdowns of input, output, cache, and reasoning tokens with real-time pricing calculations via LiteLLM data. Features include interactive 2D/3D contribution graphs, web visualization dashboards, global leaderboards, and JSON export for cost analysis.

Tokscale is a free, open-source CLI and TUI tool licensed under MIT that monitors local token consumption, model costs, and multi-agent AI coding sessions without requiring cloud subscriptions or private API keys.

Weights & Biases

85/100freemiumexplicit relation

Weights & Biases is an AI developer platform for experiment tracking, artifact and model lineage, model monitoring, and Weave-based LLM evaluation. It helps teams log runs, compare metrics, manage datasets and model artifacts, and collaborate through dashboards, reports, alerts, SSO/RBAC controls, and hosted or self-managed deployment options.

Weights & Biases offers a Free personal tier (100GB storage), a Pro tier starting at $60/user/month for commercial team collaboration, and custom Enterprise contracts for dedicated single-tenant or VPC deployments.Review →

Open-source Portkey alternatives

Tokscale — see all open-source developer tools.

Free Portkey alternatives

Tokscale, Weights & Biases offer a free plan or free tier.

More AI Monitoring & Observability tools

same category, not editor-selected alternatives — see how Portkey compares →

OpenLITOpenLIT is an open-source AI engineering platform that provides OpenTelemetry-native observability for LLM applications. It combines distributed tracing, evaluation, prompt management, a secrets vault, and GPU telemetry in a single self-hostable stack. With 50+ integrations across LLM providers and frameworks, it lets teams monitor AI applications using their existing observability backends like Grafana, Datadog, or Jaeger.GrafanaGrafana is the leading open-source platform for monitoring and observability visualization. It connects to virtually any data source — Prometheus, Elasticsearch, InfluxDB, PostgreSQL, CloudWatch, Datadog, and 150+ others — to create beautiful, interactive dashboards. Used by millions of users at companies like Bloomberg, JPMorgan, eBay, and PayPal. Grafana Cloud offers a fully managed experience with generous free tier. The CNCF ecosystem standard for metrics visualization.LatitudeLatitude is an agent observability platform for teams that need to inspect LLM traces, conversations, issues, and evaluation feedback in one workflow. Its public repo and docs position it as a Sentry-style monitor for AI agents, with semantic search, issue detection, annotations, MCP-assisted fixes, and cloud or self-hosted deployment paths for production debugging.JudgevalJudgeval is the open-source post-building layer for AI agents from Judgment Labs, providing OpenTelemetry-based tracing, hosted and custom evaluation scorers, and online behavior monitoring for LLM-powered applications. Instrument any function with a single decorator, score live production traffic against faithfulness and instruction-adherence checks, and feed real-world failures back into reinforcement learning or supervised fine-tuning loops.SentrialSentrial is a YC W26-backed monitoring platform for AI agent reliability in production. It semantically detects loops, hallucinations, tool misuse, and user frustration in real-time, then diagnoses root causes and recommends fixes. The platform claims 70% MTTR reduction via automated remediation including rollback, model retraining triggers, and webhooks. Sentrial positions itself as the Datadog for teams deploying autonomous AI agents at scale.DatadogDatadog is a cloud observability and security platform that unifies metrics, traces, logs, RUM, synthetics, APM, and security signals. Current pricing pages list 1,000+ integrations for Infrastructure Monitoring, with Pro from $15/host/month and Enterprise from $23/host/month when billed annually.PostHogPostHog is an open-source product and data tools platform for analytics, session replay, feature flags, experiments, surveys, error tracking, web analytics, data warehouse, CDP and LLM observability workflows. It suits developer-led teams that want one integrated product OS instead of many separate tools.Arize PhoenixPhoenix by Arize is an open-source AI observability platform for tracing, evaluating, and debugging LLM applications. It captures prompt-response pairs, retrieval context, agent tool calls, and latency data through OpenTelemetry-based instrumentation. Provides experiment tracking, dataset management, and evaluation frameworks for systematically improving AI application quality. 10K+ GitHub stars.LangfuseLangfuse is an open-source LLM engineering platform with 29K+ GitHub stars for tracing, evaluating, and monitoring AI applications. Acquired by ClickHouse, it provides detailed traces of LLM calls, prompt management with versioning, dataset-based evaluation, user feedback collection, and cost tracking. Framework-agnostic with native integrations for LangChain, LlamaIndex, OpenAI SDK, and Vercel AI SDK. Offers both self-hosted deployment and a managed cloud service.

Portkey head-to-head

FAQ

Which Portkey alternative is listed first?

Tokscale is first in the editor-selected list of 2 Portkey alternatives. The stored order is editorial; review scores do not determine membership or position.

Are there open-source Portkey alternatives?

Yes — Tokscale are open source.

Are there free Portkey alternatives?

Yes — Tokscale, Weights & Biases offer a free plan or free tier.