GitHub topics

llm-proxy

Mostly in LLM Infrastructure 87%

Repositories

16

Total stars

14,680

Trending

maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
30 days +862
zexadev

Gemini web → OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary · 把 Gemini 网页反代成 OpenAI 兼容 / Gemini 原生 API,付费号 cookie 直接用 4 Argon

Created May 2026

api-proxy chrome-fingerprint free-gemini-api gemini gemini-4-argon
Total 940
30 days +297
yolorouter

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

Created Jul 2026

ai-gateway api-key-management claude-code-proxy litellm-alternative literouter
Total 390
30 days +184
kittors

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

Created Feb 2026

ai-gateway anthropic api-gateway claude-code gemini-cli
Total 1,061
30 days +29
ferro-labs

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

Created Feb 2026

ai-gateway ai-infrastructure guardrails litellm llm
Total 294
30 days +27
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
30 days +20
caidaoli

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

Created Sep 2025

ai ai-gateway anthropic api-proxy claude-api
Total 446
30 days +19
hotchpotch

Get an OpenAI-compatible API from your ChatGPT subscription. Unofficial, lightweight Go server for OpenAI SDKs and existing tools, with no per-token charges within your Codex limits.

Created May 2026

chat-completions chatgpt codex docker golang
Total 97
30 days +16
ikhsan3adi

Convert Google Gemini web into OpenAI-compatible API. Zero cost, single static binary.

Created Aug 2026

9router ai-agent ai-proxy free-ai free-token
Total 61
30 days +13
murongg

A lightweight, self-hosted AI subscription gateway for internal teams, with account pooling, access control, and usage tracking.

Created Sep 2026

account-pooling ai-gateway claude cliproxyapi codex
Total 96
30 days +11

Top

maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
kittors

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

Created Feb 2026

ai-gateway anthropic api-gateway claude-code gemini-cli
Total 1,061
zexadev

Gemini web → OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary · 把 Gemini 网页反代成 OpenAI 兼容 / Gemini 原生 API,付费号 cookie 直接用 4 Argon

Created May 2026

api-proxy chrome-fingerprint free-gemini-api gemini gemini-4-argon
Total 940
apache

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.

Created May 2017

access-control agent-monitoring ai-agent ai-gateway anthropic
Total 650
caidaoli

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

Created Sep 2025

ai ai-gateway anthropic api-proxy claude-api
Total 446
yolorouter

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

Created Jul 2026

ai-gateway api-key-management claude-code-proxy litellm-alternative literouter
Total 390
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
ferro-labs

Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.

Created Feb 2026

ai-gateway ai-infrastructure guardrails litellm llm
Total 294
voidmind-io

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Created Mar 2026

ai ai-gateway anthropic api-gateway docker
Total 149
openziti

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Created Feb 2026

agentic-ai ai-gateway ai-infrastructure ai-security anthropic
Total 109
omarluq

Blazing fast LLMs API Gateway written in Go ⚡️

Created Jan 2026

anthropic bedrock claude claude-ai claude-api
Total 102
hotchpotch

Get an OpenAI-compatible API from your ChatGPT subscription. Unofficial, lightweight Go server for OpenAI SDKs and existing tools, with no per-token charges within your Codex limits.

Created May 2026

chat-completions chatgpt codex docker golang
Total 97
murongg

A lightweight, self-hosted AI subscription gateway for internal teams, with account pooling, access control, and usage tracking.

Created Sep 2026

account-pooling ai-gateway claude cliproxyapi codex
Total 96
greynewell

Route inference across providers.

Created Sep 2024

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking
Total 93
ikhsan3adi

Convert Google Gemini web into OpenAI-compatible API. Zero cost, single static binary.

Created Aug 2026

9router ai-agent ai-proxy free-ai free-token
Total 61
hugalafutro

Multi-Provider AI Gateway, "Because we have LiteLLM at home" No personal logs by design. Model autodiscovery, Failover groups, High availability, Android companion app, and more!

Created Apr 2026

ai ai-tools android-app anthropic-api discovery
Total 58

Related

All topics →