Categories

LLM Infrastructure

Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.

Repos

200

Stars

636,933

30 days

+27,539

higress-group

🤖 AI Gateway | AI Native API Gateway

Created Oct 2022

ai-gateway ai-native api-gateway cloud-native envoy
Total 9,810
30 days +222
maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
30 days +862
tbphp

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

Created Jun 2025

ai-gateway anthropic api-gateway claude claude-code
Total 7,233
30 days +114
looplj

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

Created Sep 2025

agent agents ai anthropic anthropic-api
Total 5,487
30 days +135
theagentrouter

Manages Unified Access to Generative AI Services built on Envoy Gateway

Created Oct 2024

ai ai-gateway api-gateway envoy envoyproxy
Total 2,430
30 days +179
VoAPI

🎉 全新下一代高颜值、高性能、高扩展的智能AI大模型API聚合分发系统 | A new next-generation high-value, high-performance, and highly scalable intelligent AI large-model API aggregation and distribution

Created Sep 2024

ai ai-agents api-gateway chatgpt claude-code
Total 1,095
30 days +11
kittors

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

Created Feb 2026

ai-gateway anthropic api-gateway claude-code gemini-cli
Total 1,061
30 days +29
luqman-v1

High-performance Go proxy gateway for 9Router LLM routing — 32K RPS, 42MB RAM, CGO-free

Created Jul 2026

9router api-gateway claude deepseek gpt
Total 304
30 days +98
yanstd888

9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.

Created Nov 2026

9router 9routerx ai-gateway ai-proxy ai-routing
Total 255
30 days +255
vibe-coding-labs

JoyCode API 代理 — 协议翻译成 Anthropic/OpenAI 兼容格式,让 Claude Code 直接调用 JoyCode支持的模型,比如GLM 5.1等

Created Apr 2026

anthropic-api api-gateway claude-code fastapi llm
Total 218
30 days +6
kkddytd

Kiro 账号池管理系统 |自动注册Kiro账号 | 将 Amazon Q Developer API 转换为 OpenAI 兼容格式 | 支持多账号池、OIDC 自动认证、令牌自动刷新、Web 管理控制台 |AI账号管理工具

Created Feb 2026

account-pool amazon-q-developer api-gateway aws-kiro claude-api
Total 164
30 days +4
voidmind-io

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Created Mar 2026

ai ai-gateway anthropic api-gateway docker
Total 149
30 days +5
Zhengyuuuui

将 Qoder 的 AI 服务转化为兼容 OpenAI/Claude/Codex 格式的 API,支持每日签到领 Credits、多账号管理、模型上下文展示

Created Jul 2026

api-gateway claude golang llm openai
Total 125
30 days +47
yreidev

把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。

Created Sep 2026

account-pool ai-gateway api-gateway claude codebuddy
Total 120
30 days +113
xu20060420fan-cell

WorkBuddy / CodeBuddy / Trae / Qoder / MiniMax / 豆包 Doubao / 华为云 CodeArts 码道 多账号合集 → 统一 OpenAI 兼容网关 + Web 管理面板。账号池轮转、一键切号、断路冷却、会话粘性、全平台每日签到与保活、CodeArts 积分、成长任务一键完成,流式 + Responses API 适配。WorkBuddy2API / Trae2API / Qoder2API / MiniMax2API multi-account gateway · auto daily check-in · keep-alive · openai-compatible api · admin panel。账号凭证只落本机,不入库。

Created Oct 2026

account-pool admin-panel api-gateway check-in codearts
Total 111
30 days +111
ShadowSafin

AI inference gateway and control plane for multi-provider routing, policies, caching, tools, and observability.

Created Oct 2026

ai ai-gateway api-gateway inference llm
Total 93
30 days +4
greynewell

Route inference across providers.

Created Sep 2024

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking
Total 93
30 days +0
hypit-ai

Multi-tenant LLM API gateway for Claude and Codex — single Go binary, USD wallet, Alipay top-up, per-token caps, status-page health, fumadocs-style /docs.

Created May 2026

alipay anthropic api-gateway claude codex
Total 84
30 days +25
mibgb65-cloud

本地 AI API 令牌调度、额度观测与桌面代理网关,支持多账号、多厂商、失败重试、请求历史和系统托盘常驻。 Local AI API token scheduler, quota monitor, and desktop proxy gateway for OpenAI-compatible, Anthropic, DeepSeek, Kimi, and Xiaomi MiMo workflows.

Created Apr 2026

ai-proxy api-gateway local-proxy
Total 80
30 days +15
PIXEL-API

基于 Sub2API 二开的 AI API 网关:多平台账号接入、账号共享与广场调度、Token 级计费与分账

Created May 2026

account-sharing ai-gateway api-gateway claude gemini
Total 65
30 days +1
ZiChuanLan

OpenAI-compatible multi-channel LLM relay gateway with admin console

Created Jul 2026

ai-gateway anthropic api-gateway gemini golang
Total 55
30 days +14

Repos sorted by Jev.