Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Last push 20 hours ago

deepseek k8s kimi-k2 llama llm llm-inference model-as-a-service model-serving multi-node-kubernetes oracle-cloud pd-disaggregation qwen sglang vllm

Created

May 2025

Total stars

529

7 days

+4

30 days

+11

12 months

+225

Star trends

README badge

Best of Go badge for ome-projects/ome
[![Best of Go](https://bestofgo.dev/badge/ome-projects/ome.svg)](https://bestofgo.dev/ome-projects/ome)