Repositories
12
Total stars
15,147
Trending
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Created Mar 2025
A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.
Created Jul 2026
Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.
Created Oct 2026
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Created Feb 2026
Consistent hashing with bounded loads in Golang
Created Mar 2018
Top
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Created Mar 2025
Consistent hashing with bounded loads in Golang
Created Mar 2018
A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.
Created Jul 2026
Merge Ingress Controller for Kubernetes
Created Sep 2018
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Created Feb 2026
Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.
Created Oct 2026
GoCast is a tool for controlled BGP route announcements from a host
Created Oct 2018
Route inference across providers.
Created Sep 2024
Bond-cni is for fail-over and high availability of networking in cloudnative orchestration
Created Dec 2017
A minimal-memory AnchorHash (consistent-hash) implementation for Go
Created Mar 2019
Go implementations of random, round-robin, least-connections and Maglev load balancing algorithms.
Created Mar 2025