Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Created May 2025
deepseek
k8s
kimi-k2
llama
llm
Total
529