Repositories

16

Total stars

42,956

Trending

gitleaks

Find secrets with Gitleaks 🔑

Created Jan 2018

ai-powered ci-cd cicd cli data-loss-prevention
Total 31,252
30 days +1,110
kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Created Mar 2019

artificial-intelligence cncf genai hacktoberfest istio
Total 6,258
30 days +126
loxilb-io

Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb

Created Jul 2026

ai-gateway ebpf kubernetes kv-cache llm-inference
Total 71
30 days +66
beam-cloud

Ultrafast serverless GPU inference, sandboxes, and background jobs

Created Nov 2023

autoscaler cloudrun cuda developer-productivity distributed-computing
Total 1,860
30 days +32
kubernetes-sigs

LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving

Created Feb 2024

llm-inference sig-apps
Total 910
30 days +26
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
30 days +20
matrixhub-ai

An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.

Created Jan 2026

artificial-intelligence dynamo huggingface kubernetes llm
Total 366
30 days +13
ome-projects

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Created May 2025

deepseek k8s kimi-k2 llama llm
Total 529
30 days +11
anthony-chaudhary

Agentic Runtime

Created Jun 2026

agent-kernel agentic-ai ai-agents ai-gateway claude-code
Total 50
30 days +7
rossoctl

Context optimization for AI coding agents — lower token cost and latency without sacrificing accuracy.

Created Jun 2026

agentic-ai ai ai-agents claude-code claude-code-plugin
Total 75
30 days +4

Top

gitleaks

Find secrets with Gitleaks 🔑

Created Jan 2018

ai-powered ci-cd cicd cli data-loss-prevention
Total 31,252
kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Created Mar 2019

artificial-intelligence cncf genai hacktoberfest istio
Total 6,258
beam-cloud

Ultrafast serverless GPU inference, sandboxes, and background jobs

Created Nov 2023

autoscaler cloudrun cuda developer-productivity distributed-computing
Total 1,860
kubernetes-sigs

LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving

Created Feb 2024

llm-inference sig-apps
Total 910
devflowinc

CLI for running large numbers of coding agents in parallel with git worktrees

Created May 2025

agentic-ai ai codegen go golang
Total 585
ome-projects

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Created May 2025

deepseek k8s kimi-k2 llama llm
Total 529
matrixhub-ai

An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.

Created Jan 2026

artificial-intelligence dynamo huggingface kubernetes llm
Total 366
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
substratusai

Finetune LLMs on K8s by using Runbooks

Created Jun 2023

kubernetes kubernetes-operator llm-inference llm-serving llm-training
Total 169
lordmathis

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

Created Jul 2025

llama-cpp llama-server llamacpp llm llm-inference
Total 162
Hoshinonyaruko

开源的智能体项目 支持6种聊天平台 Onebotv11一对多连接 流式信息 agent 对话keyboard气泡生成 支持10+大模型接口(持续更新) 具有将多种大模型接口转化为带有上下文的通用格式的能力.

Created Jan 2024

ai-agents ai-agents-framework chatbot llm llm-api
Total 138
gitctrlx

Llama from scratch in Go.

Created Aug 2025

llama llm llm-inference
Total 105
Lifailon

This project allows to launch your Telegram bot in a few minutes to communicate with free or paid AI models via OpenRouter.

Created Jul 2025

ai ai-integration chat-bot go gpt
Total 88
rossoctl

Context optimization for AI coding agents — lower token cost and latency without sacrificing accuracy.

Created Jun 2026

agentic-ai ai ai-agents claude-code claude-code-plugin
Total 75
loxilb-io

Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb

Created Jul 2026

ai-gateway ebpf kubernetes kv-cache llm-inference
Total 71
anthony-chaudhary

Agentic Runtime

Created Jun 2026

agent-kernel agentic-ai ai-agents ai-gateway claude-code
Total 50

Related

All topics →