GitHub topics

load-balancing

Mostly in LLM Infrastructure 33%

Repositories

12

Total stars

15,147

Trending

net-merge

Use all your internet connections at once on Windows, macOS, Linux and Android: per-connection load balancing over Wi-Fi, Ethernet, mobile data and phone tethers

Created Oct 2026

android bandwidth-aggregation downloader golang linux
Total 3,413
30 days +2,034
maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
30 days +862
yolorouter

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

Created Jul 2026

ai-gateway api-key-management claude-code-proxy litellm-alternative literouter
Total 390
30 days +184
kekawia

Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.

Created Oct 2026

bandwidth-aggregation dual-wan failover load-balancing multi-homing
Total 102
30 days +65
openziti

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Created Feb 2026

agentic-ai ai-gateway ai-infrastructure ai-security anthropic
Total 109
30 days +9
buraksezer

Consistent hashing with bounded loads in Golang

Created Mar 2018

awesome awesome-go consistent-hashing consistent-hashing-library consistenthash
Total 789
30 days +3

Top

maximhq

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Created Mar 2025

agent-gateway ai-gateway ai-governance api-gateway claude-code
Total 9,796
net-merge

Use all your internet connections at once on Windows, macOS, Linux and Android: per-connection load balancing over Wi-Fi, Ethernet, mobile data and phone tethers

Created Oct 2026

android bandwidth-aggregation downloader golang linux
Total 3,413
buraksezer

Consistent hashing with bounded loads in Golang

Created Mar 2018

awesome awesome-go consistent-hashing consistent-hashing-library consistenthash
Total 789
yolorouter

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

Created Jul 2026

ai-gateway api-key-management claude-code-proxy litellm-alternative literouter
Total 390
jakubkulhan

Merge Ingress Controller for Kubernetes

Created Sep 2018

ingress ingress-controller ingress-controllers k8s kubernetes
Total 139
openziti

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

Created Feb 2026

agentic-ai ai-gateway ai-infrastructure ai-security anthropic
Total 109
kekawia

Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.

Created Oct 2026

bandwidth-aggregation dual-wan failover load-balancing multi-homing
Total 102
mayuresh82

GoCast is a tool for controlled BGP route announcements from a host

Created Oct 2018

anycast bgp consul docker exabgp
Total 101
greynewell

Route inference across providers.

Created Sep 2024

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking
Total 93
k8snetworkplumbingwg

Bond-cni is for fail-over and high availability of networking in cloudnative orchestration

Created Dec 2017

active-backup alb bonding-cni cni failover
Total 77
wdamron

A minimal-memory AnchorHash (consistent-hash) implementation for Go

Created Mar 2019

anchorhash consistent-hashing load-balancing
Total 76
catwithtudou

Go implementations of random, round-robin, least-connections and Maglev load balancing algorithms.

Created Mar 2025

algorithms consistent-hashing distributed-systems go load-balancing
Total 62

Related

All topics →