Alternatives to LiteLLM

2 editor-selected alternatives · LiteLLM overview →

source: tools.alternatives · stored order · active records only; review scores are annotations and never change membership or order

A directional evidence panel appears only when the substitute rationale, trade-offs, sources, and verification date have been recorded. Older selections without that panel remain visible but are unclassified under the new evidence contract.

Tokscale

open sourcefreeexplicit relation

Tokscale is a CLI tool that tracks token usage and costs across AI coding agents including Claude Code, Codex, OpenCode, Gemini CLI, Cursor, and more. Built with a native Rust core for high-performance processing, it provides detailed breakdowns of input, output, cache, and reasoning tokens with real-time pricing calculations via LiteLLM data. Features include interactive 2D/3D contribution graphs, web visualization dashboards, global leaderboards, and JSON export for cost analysis.

Tokscale is a free, open-source CLI and TUI tool licensed under MIT that monitors local token consumption, model costs, and multi-agent AI coding sessions without requiring cloud subscriptions or private API keys.

New API

open sourceexplicit relation

New API is an open-source multi-tenant AI gateway that aggregates and distributes LLM API requests across providers like OpenAI, Claude, and Gemini through a unified proxy interface. It cross-converts requests into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats, with built-in channel management, quota control, token-based authentication, and billing capabilities. Deploy via Docker with SQLite or MySQL for centralized model management.

New API is a free and open-source self-hosted AI API gateway and management system licensed under GNU AGPLv3. Users deploy it on their own servers to aggregate upstream LLM providers (OpenAI, Claude, Gemini), manage token quotas, and route API calls with zero software licensing costs.

Open-source LiteLLM alternatives

Tokscale, New API — see all open-source developer tools.

Free LiteLLM alternatives

Tokscale offer a free plan or free tier.

More DevOps & Deployment tools

same category, not editor-selected alternatives — see how LiteLLM compares →

CiliumCilium is a CNCF Graduated, Apache-2.0 project for Kubernetes networking, security, and observability using eBPF. It can replace kube-proxy, enforce identity-aware L3-L7 network policies, and add Hubble flow observability plus Tetragon runtime-security signals. Current source checks support GKE Dataplane V2 using Cilium/eBPF and Azure CNI Powered by Cilium for AKS.OrbStackOrbStack is a macOS application that replaces Docker Desktop with lightweight container and Linux VM management. Its docs emphasize fast starts, lower CPU and memory overhead, and native macOS integration with menu bar controls, file sharing, and network access to containers by name, with exact gains depending on workload. Supports Docker, Kubernetes, and full Linux VMs.RayRay is an open-source distributed computing framework built for scaling AI and Python applications from a laptop to thousands of GPUs. It provides libraries for distributed training, hyperparameter tuning, model serving, reinforcement learning, and data processing under a single unified API. Ray's public site highlights OpenAI and other enterprise users. Maintained by Anyscale with Apache-2.0 open-source licensing.ActAct is an open-source tool that runs GitHub Actions workflows locally using Docker containers that match GitHub's execution environment. It provides instant feedback on workflow changes without pushing to a repository, supports matrix builds, secret management, and artifact handling. Act can also replace Makefiles by using workflow files as task definitions, making it useful for both CI/CD development and local task automation across development teams.ClerkClerk is a complete authentication and user management platform for React, Next.js, and modern JavaScript frameworks. It provides pre-built UI for sign-in, sign-up, user profiles, organizations, MFA, passkeys, JWT sessions, webhooks, and billing. The Hobby plan supports up to 50,000 monthly retained users per app, with Pro, Business, and Enterprise tiers for growing teams.DockerIndustry-standard container platform for building, shipping, and running applications in isolated, reproducible environments. Package apps with all dependencies into portable containers using Dockerfiles and images. Docker Compose orchestrates multi-container applications. Docker Hub hosts millions of pre-built images. Docker Desktop provides GUI management on Mac/Windows. Essential for local development, CI/CD, and production deployments. The foundation of modern containerized infrastructure.ModalModal is a serverless compute platform that lets developers run AI workloads on GPUs with a Python-first SDK. Functions deploy with decorators, auto-scale from zero to thousands of containers, and bill per second. It supports LLM inference, fine-tuning, batch jobs, and sandboxes, with current GPU options including B200, H200, H100, A100, L40S, A10, L4, and T4. Modal’s 2026 Series C valued the company at $4.65B.PangolinIdentity-based remote access platform built on WireGuard that combines reverse proxy and VPN capabilities. Pangolin supports clientless browser access for web apps and client-based private-resource access across macOS, iOS, Windows, Linux, and Android, with zero-trust rules, peer-to-peer tunnels, automatic SSL, SSO/OIDC options, and cloud or self-hosted deployment.ArgoCDArgo CD is the most popular GitOps continuous delivery tool for Kubernetes. It continuously monitors Git repositories and automatically syncs application state to match the desired configuration. A CNCF graduated project used by thousands of organizations for deploying to Kubernetes clusters.

LiteLLM head-to-head

FAQ

Which LiteLLM alternative is listed first?

Tokscale is first in the editor-selected list of 2 LiteLLM alternatives. The stored order is editorial; review scores do not determine membership or position.

Are there open-source LiteLLM alternatives?

Yes — Tokscale, New API are open source.

Are there free LiteLLM alternatives?

Yes — Tokscale offer a free plan or free tier.