Categories / LLM Infrastructure

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

Last push 3 years ago

cluster-manager hacktoberfest inference llm llmops mlops

Created

Jul 2023

Total stars

282

7 days

0

30 days

0

12 months

+10

Star trends

README badge

Best of Go badge for tensorchord/openmodelz
[![Best of Go](https://bestofgo.dev/badge/tensorchord/openmodelz.svg)](https://bestofgo.dev/tensorchord/openmodelz)