Categories

LLM Infrastructure

Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.

Repos

200

Stars

636,933

30 days

+27,539

Mag1cFall

将AI Studio Playground和Build反代成API | AI Studio to OpenAI, Anthropic & Gemini Compatible API

Created Aug 2025

ai-studio aistudio api api-proxy camoufox
Total 1,038
30 days +649
diemus

A proxy for Azure OpenAI API that can convert an OpenAI request into an Azure OpenAI request.

Created Mar 2023

ai azure azure-openai chatgpt gpt3
Total 630
30 days +1
geekai-pub

基于 Go 实现的 OpenAI HTTP 代理(云函数、lambda 函数、自己部署均可)

Created Mar 2023

go openai-api proxy stream tencent-cloud
Total 525
30 days +0
WizisCool

Modern web console for CLIProxyAPI v8+ with provider and OAuth management, live routing, request analytics, pricing, and MCP.

Created Sep 2026

ai-gateway cliproxyapi cpa dashboard golang
Total 466
30 days +256
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
30 days +20
nghyane

Use Claude and GPT through one local gateway with OpenAI-compatible and Claude-native APIs.

Created Dec 2025

ai-tools anthropic claude codex gpt
Total 322
30 days +0
lij768423-svg

Grok2API & CPA egress quality guard with proxy recovery, quarantine, migration, and operations UI

Created Aug 2026

ai-gateway circuit-breaker grok2api patch proxy
Total 320
30 days +5
luqman-v1

High-performance Go proxy gateway for 9Router LLM routing — 32K RPS, 42MB RAM, CGO-free

Created Jul 2026

9router api-gateway claude deepseek gpt
Total 304
30 days +98
vibe-coding-labs

JoyCode API 代理 — 协议翻译成 Anthropic/OpenAI 兼容格式,让 Claude Code 直接调用 JoyCode支持的模型,比如GLM 5.1等

Created Apr 2026

anthropic-api api-gateway claude-code fastapi llm
Total 218
30 days +6
inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Created Jan 2025

agnostic anthropic api deepseek-v4-pro gateway
Total 208
30 days +7
montevive

🚀 Autocache - Intelligent Anthropic API Cache Proxy Automatically inject cache-control fields into Claude API requests to reduce costs by up to 90% and latency by up to 85%. Works as a transparent drop-in replacement for popular AI platforms like n8n, Flowise, Make.com, LangChain, and LlamaIndex—no code changes required

Created Oct 2025

agent agentic-ai ai cache claude
Total 178
30 days +2
Zhengyuuuui

将 Qoder 的 AI 服务转化为兼容 OpenAI/Claude/Codex 格式的 API,支持每日签到领 Credits、多账号管理、模型上下文展示

Created Jul 2026

api-gateway claude golang llm openai
Total 125
30 days +47
aqstack

mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.

Created Dec 2025

caching cost-optimization golang kubernetes llm
Total 94
30 days +0
perk11

Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand

Created Jul 2024

large-models llms localllm proxy
Total 88
30 days +0
hypit-ai

Multi-tenant LLM API gateway for Claude and Codex — single Go binary, USD wallet, Alipay top-up, per-token caps, status-page health, fumadocs-style /docs.

Created May 2026

alipay anthropic api-gateway claude codex
Total 84
30 days +25
ikhsan3adi

Convert Google Gemini web into OpenAI-compatible API. Zero cost, single static binary.

Created Aug 2026

9router ai-agent ai-proxy free-ai free-token
Total 61
30 days +13
D3-vin

OpenAI-compatible proxy for Z.AI (GLM models)

Created Jul 2026

glm openai proxy z-ai
Total 58
30 days +4
hugalafutro

Multi-Provider AI Gateway, "Because we have LiteLLM at home" No personal logs by design. Model autodiscovery, Failover groups, High availability, Android companion app, and more!

Created Apr 2026

ai ai-tools android-app anthropic-api discovery
Total 58
30 days +0

Repos sorted by Jev.