Categories / LLM Infrastructure

Route inference across providers.

Last push 4 months ago

ai-gateway ai-infrastructure anthropic api-gateway cost-tracking golang inference inference-routing llm llm-proxy llm-router load-balancing mist-stack model-routing model-serving multi-model observability openai provider-abstraction token-tracking

Created

Sep 2024

Total stars

93

7 days

0

30 days

0

12 months

+14

Star trends

README badge

Best of Go badge for greynewell/infermux
[![Best of Go](https://bestofgo.dev/badge/greynewell/infermux.svg)](https://bestofgo.dev/greynewell/infermux)