Created
Mar 19, 2025
•
(2 years ago)
Description
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Total stars
8,086
Topics
ai-gateway
gateway
gateway-services
generative-ai
guardrails
llm
llm-cost
llm-gateway
llm-observability
llmops
load-balancing
mcp-client
mcp-gateway
mcp-server
model-router
token-management
No data for this bucket