Categories

LLM Infrastructure

Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.

Repos

200

Stars

636,960

30 days

+26,281

tbphp

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

Created Jun 2025

ai-gateway anthropic api-gateway claude claude-code
Total 7,233
30 days +105
looplj

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

Created Sep 2025

agent agents ai anthropic anthropic-api
Total 5,487
30 days +129
bricks-cloud

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

Created Jul 2023

ai anthropic api artificial-intelligence azure
Total 1,233
30 days +6
kittors

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

Created Feb 2026

ai-gateway anthropic api-gateway claude-code gemini-cli
Total 1,061
30 days +27
caidaoli

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

Created Sep 2025

ai ai-gateway anthropic api-proxy claude-api
Total 446
30 days +19
nghyane

Use Claude and GPT through one local gateway with OpenAI-compatible and Claude-native APIs.

Created Dec 2025

ai-tools anthropic claude codex gpt
Total 322
30 days +0
LAGcomcom

把 OpenCode Zen 免费模型装进你所有的 AI Agent —— Windows 托盘网关,OpenAI/Anthropic 兼容,自动适配 10+ Agent,限流自动切换

Created Oct 2026

anthropic free-models go llm-gateway openai-compatible
Total 306
30 days +117
inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Created Jan 2025

agnostic anthropic api deepseek-v4-pro gateway
Total 208
30 days +7
mydisha

Your friendly, blazing-fast, self-hostable AI gateway

Created May 2026

ai ai-gateway ai-router anthropic caveman
Total 167
30 days +17
voidmind-io

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Created Mar 2026

ai ai-gateway anthropic api-gateway docker
Total 149
30 days +5
openziti

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Created Feb 2026

agentic-ai ai-gateway ai-infrastructure ai-security anthropic
Total 109
30 days +9
omarluq

Blazing fast LLMs API Gateway written in Go ⚡️

Created Jan 2026

anthropic bedrock claude claude-ai claude-api
Total 102
30 days +2
greynewell

Route inference across providers.

Created Sep 2024

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking
Total 93
30 days +0
hypit-ai

Multi-tenant LLM API gateway for Claude and Codex — single Go binary, USD wallet, Alipay top-up, per-token caps, status-page health, fumadocs-style /docs.

Created May 2026

alipay anthropic api-gateway claude codex
Total 84
30 days +25
MiXaiLL76

High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection

Created Jan 2026

ai ai-router air anthropic claude
Total 58
30 days +3
ZiChuanLan

OpenAI-compatible multi-channel LLM relay gateway with admin console

Created Jul 2026

ai-gateway anthropic api-gateway gemini golang
Total 55
30 days +14

Repos sorted by Jev.