Repositories
16
Total stars
42,956
Trending
Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb
Created Jul 2026
Ultrafast serverless GPU inference, sandboxes, and background jobs
Created Nov 2023
LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving
Created Feb 2024
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
Created Jan 2026
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Created May 2025
Agentic Runtime
Created Jun 2026
Context optimization for AI coding agents — lower token cost and latency without sacrificing accuracy.
Created Jun 2026
Top
Ultrafast serverless GPU inference, sandboxes, and background jobs
Created Nov 2023
LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving
Created Feb 2024
CLI for running large numbers of coding agents in parallel with git worktrees
Created May 2025
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Created May 2025
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
Created Jan 2026
Finetune LLMs on K8s by using Runbooks
Created Jun 2023
Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.
Created Jul 2025
开源的智能体项目 支持6种聊天平台 Onebotv11一对多连接 流式信息 agent 对话keyboard气泡生成 支持10+大模型接口(持续更新) 具有将多种大模型接口转化为带有上下文的通用格式的能力.
Created Jan 2024
This project allows to launch your Telegram bot in a few minutes to communicate with free or paid AI models via OpenRouter.
Created Jul 2025
Context optimization for AI coding agents — lower token cost and latency without sacrificing accuracy.
Created Jun 2026
Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb
Created Jul 2026
Agentic Runtime
Created Jun 2026