Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
Created Nov 2023
Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.
Repos
200
Stars
636,960
Last 30 days
+26,281
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
Created Nov 2023
🤖 AI Gateway | AI Native API Gateway
Created Oct 2022
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Created Mar 2025
An open, programmable decision layer for models and compute.
Created Aug 2025
Manages Unified Access to Generative AI Services built on Envoy Gateway
Created Oct 2024
A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.
Created Sep 2026
Privacy proxy for your OpenAI requests
Created Oct 2025
A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.
Created Jul 2026
LLM privacy gateway in Go — millisecond-latency PII and secret redaction. Used in production by PackyCode.
Created May 2026
Grok2API & CPA egress quality guard with proxy recovery, quarantine, migration, and operations UI
Created Aug 2026
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
Created Nov 2026
Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Created Mar 2026
把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。
Created Sep 2026
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Created Feb 2026
AI inference gateway and control plane for multi-provider routing, policies, caching, tools, and observability.
Created Oct 2026
Route inference across providers.
Created Sep 2024
Inference Hub for AI at Scale
Created Sep 2023
Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb
Created Jul 2026
插件化 AI 中转网关,平台能力以 gRPC 插件独立装载,支持多账号调度、计费与拼车共享,docker compose 一键自部署
Created Mar 2026
OpenAI-compatible multi-channel LLM relay gateway with admin console
Created Jul 2026
CSGLite is a lightweight local LLM inference platform. One command downloads, loads, and chats with models. It ships a web UI, OpenAI-compatible API, llama.cpp inference, resumable downloads, marketplace browsing, and one-click AI app and coding-agent setup—all in a single cross-platform binary.
Created Mar 2026
Lamp Guide:zen-gate 的 Windows 桌面重构版。统一模型与渠道管理、聚合轮换、Agent 接入、日夜主题,提供完整安装向导。
Created Nov 2026
Repos sorted by Jev.