Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
agent-gateway
ai-gateway
ai-governance
api-gateway
claude-code
coding-agents
failover
gateway
guardrails
llm-cost
llm-gateway
llm-observability
llm-proxy
llm-router
load-balancing
mcp-gateway
model-context-protocol
model-router
openai-compatible
semantic-cache
Created
Mar 2025
Total stars
9,239
No data for this bucket