Categories / LLM Infrastructure
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
Last push 1 month ago
agentic-ai
ai-gateway
ai-infrastructure
ai-security
anthropic
e2e-encryption
llm-gateway
llm-proxy
llm-security
load-balancing
non-human-identity
ollama
openapi-compatible
openziti
self-hosted
semantic-routing
vllm
zero-trust
zero-trust-networking
zrok
Created
Feb 2026
Total stars
109
Last 7 days
0
Last 30 days
+9
Last 12 months
+109
README badge
[](https://bestofgo.dev/openziti/llm-gateway)