aicoolies logo

# LLM Gateway

4 tools tagged

showing 4 of 4 tools

Bifrost logo

Bifrost

50x faster LLM gateway with MCP support, built in Go

Bifrost is a high-performance open-source AI gateway built from scratch in Go. Unifies access to 15+ providers and 1,000+ models through a single OpenAI-compatible API with only 11 microsecond overhead per request at 5K RPS — 50x faster than LiteLLM. Features automatic failover, load balancing, semantic caching, and functions as both MCP client and MCP server. Apache 2.0 licensed.

Open Source
Executor logo

Executor

MCP gateway and integration catalog for AI agents

Executor is an MIT-licensed integration layer and MCP gateway for AI agents. It gives Claude Code, Cursor, Codex, and other MCP-speaking clients one endpoint for connected OpenAPI specs, GraphQL APIs, MCP servers, Google Discovery sources, and custom JavaScript tools, with local, cloud, and self-hosted deployment options for teams centralizing tool access.

Open SourceTelemetry
MCP Context Forge logo

MCP Context Forge

IBM-backed ContextForge gateway for federating MCP, A2A, REST, and gRPC APIs

MCP Context Forge is IBM’s Apache-2.0 ContextForge project for operating a gateway, registry, and proxy across MCP servers, A2A agents, REST APIs, and gRPC services. It centralizes discovery, authentication, policy controls, federation, and observability, with deployment paths through PyPI, Docker, and Kubernetes.

Open Source
new-api logo

New API

Unified LLM API gateway and proxy hub

New API is an open-source multi-tenant AI gateway that aggregates and distributes LLM API requests across providers like OpenAI, Claude, and Gemini through a unified proxy interface. It cross-converts requests into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats, with built-in channel management, quota control, token-based authentication, and billing capabilities. Deploy via Docker with SQLite or MySQL for centralized model management.

Open Source