Categories

LLM Infrastructure

Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.

Repos

200

Stars

636,933

30 days

+26,248

router-for-me

Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series, GPT Series, Grok Series, Claude model through API

Created Jul 2025

antigravity claude claude-code codex devin
Total 59,184
30 days +3,455
QuantumNous

Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.

Created Nov 2023

ai-gateway api-management claude deepseek gemini
Total 52,334
30 days +2,080
The-Vibe-Company

An open-source engine that turns continuous content streams into search and monitoring. Durable ingestion, hybrid search, alerts, and plugins for formats, models and business rules.

Created May 2023

ai api chatbot chatgpt database
Total 39,691
30 days +123
Tencent

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

Created Jul 2025

agent agentic ai chatbot dsh-plugin
Total 37,868
30 days +3,034
tbphp

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

Created Jun 2025

ai-gateway anthropic api-gateway claude claude-code
Total 7,233
30 days +105
looplj

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

Created Sep 2025

agent agents ai anthropic anthropic-api
Total 5,487
30 days +129
MartialBE

OpenAI 接口管理 & 分发系统,改自songquanpeng/one-api。支持更多模型,加入统计页面,完善非openai模型的函数调用。

Created Sep 2023

chatgpt openai openai-api
Total 2,901
30 days +17
stulzq

Azure OpenAI Service Proxy. Convert OpenAI official API request to Azure OpenAI API request. Support GPT-4,Embeddings,Langchain. Adapter from OpenAI to Azure OpenAI.

Created Mar 2023

azure azure-openai chatgpt gpt-4 langchain
Total 1,333
30 days +1
bricks-cloud

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

Created Jul 2023

ai anthropic api artificial-intelligence azure
Total 1,234
30 days +6
VoAPI

🎉 全新下一代高颜值、高性能、高扩展的智能AI大模型API聚合分发系统 | A new next-generation high-value, high-performance, and highly scalable intelligent AI large-model API aggregation and distribution

Created Sep 2024

ai ai-agents api-gateway chatgpt claude-code
Total 1,095
30 days +11
kittors

Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

Created Feb 2026

ai-gateway anthropic api-gateway claude-code gemini-cli
Total 1,061
30 days +27
YangYuHou

A project converting the Qwen web page to an API.

Created Apr 2026

2api docker go openai typescript
Total 976
30 days +16
zhu327

A proxy for converting the OpenAI API protocol to the Google Gemini Pro protocol.

Created Dec 2023

chatgpt chatgpt-api gemini gemini-pro gemini-pro-vision
Total 720
30 days +0
modelbus

oneapi-pro is an enterprise-grade AI API Gateway built on oneapi(one-api). It has undergone a full architectural redesign, adding support for subscription plans, active-active clusters, precise billing. 本项目与new-api | sub2api不同之处是oneapi-pro是面向企业AI网关的应用场景,并不适用于中转站

Created Jul 2026

one-api one-api-pro oneapi openai
Total 689
30 days +11
ntthanh2603

✨Reverse-engineered API for Gemini web app. It can be used as a genuine API key from OpenAI, Gemini, and Claude.

Created Dec 2025

ai api chatbot claude docker
Total 676
30 days +78
diemus

A proxy for Azure OpenAI API that can convert an OpenAI request into an Azure OpenAI request.

Created Mar 2023

ai azure azure-openai chatgpt gpt3
Total 630
30 days +1
kaito-project

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Created Sep 2023

ai buildkit chatgpt docker fine-tuning
Total 544
30 days +6
caidaoli

Self-hosted AI API gateway for Claude Code, Codex and Gemini: pool API keys and subscription accounts behind one endpoint with failover, protocol conversion and cost tracking.

Created Sep 2025

ai ai-gateway anthropic api-proxy claude-api
Total 446
30 days +19
messkan

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

Created Nov 2025

ai badgerdb cache claude cost-optimization
Total 427
30 days +4
atopos31

Unified LLM gateway with weighted load balancing, observability & cost tracking. 统一的 LLM 网关,提供权重负载均衡、可观测性与费用追踪。

Created Aug 2025

ai ai-gateway claude claude-ai claude-code
Total 323
30 days +7
iimeta

企业级 LLM API 快速集成系统,支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等,简洁的页面风格,轻量高效且稳定,支持Docker一键部署。

Created Nov 2023

api chatgpt claude deepseek ernie-bot
Total 307
30 days +3
luqman-v1

High-performance Go proxy gateway for 9Router LLM routing — 32K RPS, 42MB RAM, CGO-free

Created Jul 2026

9router api-gateway claude deepseek gpt
Total 304
30 days +95
iimeta

企业级 LLM API 快速集成系统,支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等,简洁的页面风格,轻量高效且稳定,支持Docker一键部署。

Created Nov 2023

api chatgpt claude deepseek ernie-bot
Total 256
30 days +0
teilomillet

A lightweight, production-ready RAG (Retrieval Augmented Generation) library in Go.

Created Jul 2024

ai chromadb document-search embeddings golang
Total 228
30 days +2
inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Created Jan 2025

agnostic anthropic api deepseek-v4-pro gateway
Total 208
30 days +7
mydisha

Your friendly, blazing-fast, self-hostable AI gateway

Created May 2026

ai ai-gateway ai-router anthropic caveman
Total 167
30 days +17
soulteary

Convert different model APIs into the OpenAI API format out of the box.

Created Dec 2023

api-proxy azure-openai azure-openai-api gemini-pro golang
Total 160
30 days +0
voidmind-io

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Created Mar 2026

ai ai-gateway anthropic api-gateway docker
Total 149
30 days +5
Zhengyuuuui

将 Qoder 的 AI 服务转化为兼容 OpenAI/Claude/Codex 格式的 API,支持每日签到领 Credits、多账号管理、模型上下文展示

Created Jul 2026

api-gateway claude golang llm openai
Total 125
30 days +43
yreidev

把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。

Created Sep 2026

account-pool ai-gateway api-gateway claude codebuddy
Total 120
30 days +108
omarluq

Blazing fast LLMs API Gateway written in Go ⚡️

Created Jan 2026

anthropic bedrock claude claude-ai claude-api
Total 102
30 days +2
hotchpotch

Get an OpenAI-compatible API from your ChatGPT subscription. Unofficial, lightweight Go server for OpenAI SDKs and existing tools, with no per-token charges within your Codex limits.

Created May 2026

chat-completions chatgpt codex docker golang
Total 97
30 days +16
llmariner

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

Created Mar 2024

ai autoscaling fine-tuning gpu inference
Total 97
30 days +0
aqstack

mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.

Created Dec 2025

caching cost-optimization golang kubernetes llm
Total 94
30 days +0
greynewell

Route inference across providers.

Created Sep 2024

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking
Total 93
30 days +0
hypit-ai

Multi-tenant LLM API gateway for Claude and Codex — single Go binary, USD wallet, Alipay top-up, per-token caps, status-page health, fumadocs-style /docs.

Created May 2026

alipay anthropic api-gateway claude codex
Total 84
30 days +25
adrianliechti

Inference Hub for AI at Scale

Created Sep 2023

ai-gateway azure-openai claude function-calling groq
Total 82
30 days +1
dev2k6

OpenAI-compatible proxy server for CommandCode API. Exposes /v1/chat/completions and /v1/models endpoints so any OpenAI-compatible client can use CommandCode models through a local HTTP server.

Created May 2026

apillm commandcode openai proxyserver
Total 75
30 days +1
rasonyang

Self-hosted voice gateway in Go that speaks the OpenAI Realtime (GA) WebSocket protocol and runs a cascaded ASR → LLM → TTS pipeline behind it. Keep clients unchanged while swapping speech and LLM providers at runtime

Created Sep 2026

asr call-center callcenter cascaded-pipeline dashscope
Total 65
30 days +5
PIXEL-API

基于 Sub2API 二开的 AI API 网关:多平台账号接入、账号共享与广场调度、Token 级计费与分账

Created May 2026

account-sharing ai-gateway api-gateway claude gemini
Total 65
30 days +1
qianfree

Team-API 专为团队、组织、企业打造的多租户大模型 API 网关。具备完整权限管理与审计能力,助力团队更好地使用AI大模型。支持Claude/OpenAI/Gemini等主力模。QQ交流群:1095286563

Created Apr 2026

ai-gateway claude gemini goframe openai
Total 64
30 days +7
chukwuemekawisdom

将Claude 的网页服务转为 Api 服务,支持识图,文件上传,思考输出……

Created Mar 2025

claude claude2api cursor cursor2api grok
Total 61
30 days +1
D3-vin

OpenAI-compatible proxy for Z.AI (GLM models)

Created Jul 2026

glm openai proxy z-ai
Total 58
30 days +4
MiXaiLL76

High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection

Created Jan 2026

ai ai-router air anthropic claude
Total 58
30 days +3
ZiChuanLan

OpenAI-compatible multi-channel LLM relay gateway with admin console

Created Jul 2026

ai-gateway anthropic api-gateway gemini golang
Total 55
30 days +14
iimeta

企业级 LLM API 快速集成系统,支持OpenAI、Azure、文心一言、讯飞星火、通义千问、智谱GLM、Gemini、DeepSeek、Anthropic Claude以及OpenAI格式的模型等,简洁的页面风格,轻量高效且稳定,支持Docker一键部署。

Created Nov 2023

api chatgpt claude deepseek ernie-bot
Total 50
30 days +0
oldweipro

Claude 聊天接口适配到 OpenAI API 标准接口。

Created Jul 2023 Archived

chatgpt chatgpt-api claude openai openai-api
Total 103
30 days +0

Repos sorted by Jev.