Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
Created Nov 2023
Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.
Repos
200
Stars
636,933
Last 30 days
+26,248
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
Created Nov 2023
Ultrafast serverless GPU inference, sandboxes, and background jobs
Created Nov 2023
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
Created Jul 2023
Gemini web → OpenAI-compatible + native Gemini API, self-hosted, no API key. Gemini 4 Argon from a paid account cookie, strict_model (429 instead of a silent downgrade), cookie pool with auto-renewal, proxy pool, admin panel, image & video generation, single Go binary · 把 Gemini 网页反代成 OpenAI 兼容 / Gemini 原生 API,付费号 cookie 直接用 4 Argon
Created May 2026
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
Created Jan 2026
llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
Created Mar 2026
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
Created Jan 2025
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Created Jul 2025
Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Created Mar 2026
把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。
Created Sep 2026
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Created Feb 2026
Selfhost modern LLM stacks. Run the whole fleet from your terminal
Created Jun 2026
OpenAI-compatible multi-channel LLM relay gateway with admin console
Created Jul 2026
Stop paying for AI APIs during development. LocalCloud runs everything locally - GPT-level models, databases, all free.
Created Jun 2025
Repos sorted by Jev.