kubeai-project / kubeai
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
Last push 4 days ago
ai
autoscaler
faster-whisper
inference-operator
k8s
kubernetes
llm
ollama
ollama-operator
openai-api
vllm
vllm-operator
whisper
Created
Oct 2023
Total stars
1,294
Last 7 days
+5
Last 30 days
+11
Last 12 months
+221
README badge
[](https://bestofgo.dev/kubeai-project/kubeai)