GitHub topics

ai-gateway

Mostly in LLM Infrastructure 68%

Repositories

47

Total stars

144,559

Trending

QuantumNous

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

Created Nov 2023

ai-gateway api-management claude deepseek gemini
Total 52,334
30 days +2,160
maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
30 days +862
casdoor

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

Created Oct 2020

agent agentic-ai agi ai-gateway auth
Total 14,933
30 days +321
vllm-project

An open, programmable decision layer for models and compute.

Created Aug 2025

ai-gateway guardrails inference kubernetes llm
Total 6,518
30 days +298
Calcium-Ion

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

Created Sep 2026

ai-gateway
Total 588
30 days +291
WizisCool

Modern web console for CLIProxyAPI v8+ with provider and OAuth management, live routing, request analytics, pricing, and MCP.

Created Sep 2026

ai-gateway cliproxyapi cpa dashboard golang
Total 466
30 days +256
yanstd888

9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

Created Nov 2026

9router 9routerx ai-gateway ai-proxy ai-routing
Total 255
30 days +255
seakee

A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.

Created May 2026

ai-gateway claude-code cliproxyapi codex cost-analysis
Total 4,096
30 days +233
higress-group

🤖 AI Gateway | AI Native API Gateway

Created Oct 2022

ai-gateway ai-native api-gateway cloud-native envoy
Total 9,810
30 days +222
yolorouter

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

Created Jul 2026

ai-gateway api-key-management claude-code-proxy litellm-alternative literouter
Total 390
30 days +184

Top

QuantumNous

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

Created Nov 2023

ai-gateway api-management claude deepseek gemini
Total 52,334
casdoor

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

Created Oct 2020

agent agentic-ai agi ai-gateway auth
Total 14,933
TykTechnologies

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

Created May 2014

ai ai-gateway api api-gateway api-management
Total 10,906
higress-group

🤖 AI Gateway | AI Native API Gateway

Created Oct 2022

ai-gateway ai-native api-gateway cloud-native envoy
Total 9,810
maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
tbphp

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

Created Jun 2025

ai-gateway anthropic api-gateway claude claude-code
Total 7,233
vllm-project

An open, programmable decision layer for models and compute.

Created Aug 2025

ai-gateway guardrails inference kubernetes llm
Total 6,518
weave-os

Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.

Created Apr 2026

agentic-coding ai-gateway anthropic claude-code codex
Total 5,624
octelium

A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure.

Created May 2025

abac ai-gateway api-gateway beyondcorp homelab
Total 4,205
seakee

A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.

Created May 2026

ai-gateway claude-code cliproxyapi codex cost-analysis
Total 4,096
nextlevelbuilder

GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.

Created Feb 2026

agent-orchestration ai-agent ai-gateway anthropic chatbot
Total 3,725
krakend

KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.

Created Dec 2017

ai-gateway api-gateway apis async backend-services
Total 2,705
theagentrouter

Manages Unified Access to Generative AI Services built on Envoy Gateway

Created Oct 2024

ai ai-gateway api-gateway envoy envoyproxy
Total 2,430
astaxie

TokenHub gives enterprises a private gateway to unify AI model access and governance, making every request controllable, traceable, and attributable.

Created Jun 2026

ai ai-gateway enterprise gateway
Total 1,450
ENTERPILOT

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

Created Dec 2025

ai-gateway anthropic go golang groq
Total 1,323
kittors

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

Created Feb 2026

ai-gateway anthropic api-gateway claude-code gemini-cli
Total 1,061
apache

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.

Created May 2017

access-control agent-monitoring ai-agent ai-gateway anthropic
Total 650
Calcium-Ion

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

Created Sep 2026

ai-gateway
Total 588
WizisCool

Modern web console for CLIProxyAPI v8+ with provider and OAuth management, live routing, request analytics, pricing, and MCP.

Created Sep 2026

ai-gateway cliproxyapi cpa dashboard golang
Total 466
dataiku

Privacy proxy for your OpenAI requests

Created Oct 2025

ai-gateway data-anonymization data-masking llm-security pii-detection
Total 456
caidaoli

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

Created Sep 2025

ai ai-gateway anthropic api-proxy claude-api
Total 446
yolorouter

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

Created Jul 2026

ai-gateway api-key-management claude-code-proxy litellm-alternative literouter
Total 390
packyme

LLM privacy gateway in Go — millisecond-latency PII and secret redaction. Used in production by PackyCode.

Created May 2026

ai-gateway data-redaction gitleaks golang grpc
Total 342
atopos31

Unified LLM gateway with weighted load balancing, observability & cost tracking. 统一的 LLM 网关,提供权重负载均衡、可观测性与费用追踪。

Created Aug 2025

ai ai-gateway claude claude-ai claude-code
Total 323
lij768423-svg

Grok2API & CPA egress quality guard with proxy recovery, quarantine, migration, and operations UI

Created Aug 2026

ai-gateway circuit-breaker grok2api patch proxy
Total 320
ferro-labs

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

Created Feb 2026

ai-gateway ai-infrastructure guardrails litellm llm
Total 295
yanstd888

9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

Created Nov 2026

9router 9routerx ai-gateway ai-proxy ai-routing
Total 255
Clivern

🦥 One gateway for your AI agents, APIs and MCP servers.

Created May 2019

a2a a2a-protocol ai-agents ai-gateway ai-security
Total 199
mydisha

Your friendly, blazing-fast, self-hostable AI gateway

Created May 2026

ai ai-gateway ai-router anthropic caveman
Total 167
voidmind-io

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Created Mar 2026

ai ai-gateway anthropic api-gateway docker
Total 149
helloxz

基于 ACP 协议的多 Agent Web 网关,让 CLI Agent 也能在浏览器中使用。

Created Aug 2026

acp ai-agent ai-gateway omp-webui pi-web-ui
Total 124
yreidev

把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。

Created Sep 2026

account-pool ai-gateway api-gateway claude codebuddy
Total 120
wso2

WSO2 AI Agent Manager is an open control plane designed for enterprises to deploy, manage, and govern AI agents at scale.

Created Nov 2025

agent ai ai-gateway
Total 120
openziti

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Created Feb 2026

agentic-ai ai-gateway ai-infrastructure ai-security anthropic
Total 109
murongg

A lightweight, self-hosted AI subscription gateway for internal teams, with account pooling, access control, and usage tracking.

Created Sep 2026

account-pooling ai-gateway claude cliproxyapi codex
Total 96
ShadowSafin

AI inference gateway and control plane for multi-provider routing, policies, caching, tools, and observability.

Created Oct 2026

ai ai-gateway api-gateway inference llm
Total 93
greynewell

Route inference across providers.

Created Sep 2024

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking
Total 93
adrianliechti

Inference Hub for AI at Scale

Created Sep 2023

ai-gateway azure-openai claude function-calling groq
Total 82
loxilb-io

Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb

Created Jul 2026

ai-gateway ebpf kubernetes kv-cache llm-inference
Total 71
PIXEL-API

基于 Sub2API 二开的 AI API 网关:多平台账号接入、账号共享与广场调度、Token 级计费与分账

Created May 2026

account-sharing ai-gateway api-gateway claude gemini
Total 65
qianfree

Team-API 专为团队、组织、企业打造的多租户大模型 API 网关。具备完整权限管理与审计能力,助力团队更好地使用AI大模型。支持Claude/OpenAI/Gemini等主力模。QQ交流群:1095286563

Created Apr 2026

ai-gateway claude gemini goframe openai
Total 64
DouDOU-start

插件化 AI 中转网关,平台能力以 gRPC 插件独立装载,支持多账号调度、计费与拼车共享,docker compose 一键自部署

Created Mar 2026

2api account-sharing ai-gateway claude-2api kiro-2api
Total 63
ZiChuanLan

OpenAI-compatible multi-channel LLM relay gateway with admin console

Created Jul 2026

ai-gateway anthropic api-gateway gemini golang
Total 55
nantian-gw

Nantian Gateway — Kubernetes Gateway API implementation with AI proxy, WASM plugin system, split control plane (Go) and data plane (Rust)

Created Jun 2026

ai-gateway gateway-api go ingress kubernetes
Total 55
OpenCSGs

CSGLite is a lightweight local LLM inference platform. One command downloads, loads, and chats with models. It ships a web UI, OpenAI-compatible API, llama.cpp inference, resumable downloads, marketplace browsing, and one-click AI app and coding-agent setup—all in a single cross-platform binary.

Created Mar 2026

ai-gateway cc-switch inference ollama-api
Total 53
LAGcomcom

Lamp Guide:zen-gate 的 Windows 桌面重构版。统一模型与渠道管理、聚合轮换、Agent 接入、日夜主题,提供完整安装向导。

Created Nov 2026

ai-gateway golang model-routing webview2 windows
Total 51
anthony-chaudhary

Agentic Runtime

Created Jun 2026

agent-kernel agentic-ai ai-agents ai-gateway claude-code
Total 50

Related

All topics →