AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Last push 4 days ago

ai autoscaler faster-whisper inference-operator k8s kubernetes llm ollama ollama-operator openai-api vllm vllm-operator whisper

Created

Oct 2023

Total stars

1,294

7 days

+5

30 days

+11

12 months

+221

Star trends

README badge

Best of Go badge for kubeai-project/kubeai
[![Best of Go](https://bestofgo.dev/badge/kubeai-project/kubeai.svg)](https://bestofgo.dev/kubeai-project/kubeai)