Repositories

24

Total stars

17,512

Trending

dsx-ai-factory

NVIDIA Kubernetes Engine (NVKE). A management plane for GPU Kubernetes on bare metal.

Created Aug 2026

bare-metal cluster-api gpu kubernetes nvidia
Total 1,241
30 days +1,225
T-Crypt

Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.

Created Oct 2026

comfyui golang gpu inference llama-cpp
Total 300
30 days +275
Project-HAMi

Heterogeneous GPU Sharing on Kubernetes

Created Sep 2021

ascend cambricon cncf device-plugin gpu-acceleration
Total 5,042
30 days +263
NVIDIA

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

Created Feb 2019

cuda gpu kubernetes nvidia
Total 2,994
30 days +62
dsx-ai-factory

Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

Created Apr 2026

cloud-functions gpu inference kubernetes nvidia
Total 270
30 days +31
NVIDIA

NVIDIA hardware telemetry for Prometheus.

Created Aug 2021

dcgm dcgm-exporter gpu metrics nvidia
Total 1,939
30 days +31
defilantech

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Created Nov 2025

ai apple-silicon autoscaling edge-computing gguf
Total 267
30 days +30
utkuozdemir

Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML

Created Jun 2021

ai cryptocurrency gaming inference llm
Total 1,598
30 days +29
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
30 days +20
ngthaihoc

This project is inspired by CMP40HX-Unlock. If you find it useful, please consider giving a star to both the original author and this repository.

Created Sep 2026

cmp developer-tools leagueoflegends linux mining
Total 68
30 days +13

Top

Project-HAMi

Heterogeneous GPU Sharing on Kubernetes

Created Sep 2021

ascend cambricon cncf device-plugin gpu-acceleration
Total 5,042
NVIDIA

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

Created Feb 2019

cuda gpu kubernetes nvidia
Total 2,994
NVIDIA

NVIDIA hardware telemetry for Prometheus.

Created Aug 2021

dcgm dcgm-exporter gpu metrics nvidia
Total 1,939
utkuozdemir

Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML

Created Jun 2021

ai cryptocurrency gaming inference llm
Total 1,598
dsx-ai-factory

NVIDIA Kubernetes Engine (NVKE). A management plane for GPU Kubernetes on bare metal.

Created Aug 2026

bare-metal cluster-api gpu kubernetes nvidia
Total 1,241
parca-dev

eBPF based always-on CPU/GPU profiler auto-discovering targets in Kubernetes and systemd, zero code changes or restarts needed!

Created May 2021

c continuous-profiling cpp cuda ebpf
Total 752
raids-lab

Crater is a cloud-native AI training & inference platform.

Created Jun 2025

buildkit deep-learning envd fumadocs helm-charts
Total 579
kaito-project

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Created Sep 2023

ai buildkit chatgpt docker fine-tuning
Total 544
leptonai

GPUd automates monitoring, diagnostics, and issue identification for GPUs

Created Aug 2024

gpu kubernetes monitoring nvidia nvidia-gpu
Total 499
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
T-Crypt

Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.

Created Oct 2026

comfyui golang gpu inference llama-cpp
Total 300
dsx-ai-factory

Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

Created Apr 2026

cloud-functions gpu inference kubernetes nvidia
Total 270
defilantech

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Created Nov 2025

ai apple-silicon autoscaling edge-computing gguf
Total 267
ianmarmour

A cross-platform go bot that tracks for availability of stock from Nvidia's store and adds a cart to your checkout.

Created Sep 2020

bot gpu nvidia nvidia-clerk nvidia-gpu
Total 223
NexusGPU

Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

Created Nov 2024

ai amd-gpu autoscaling dynamic-resource-allocation gpu
Total 171
pmady

KEDA External gRPC Scaler for GPU workloads - native NVML metrics via DaemonSet, no Prometheus required

Created Mar 2026

ai-infrastructure autoscaling daemonset gpu gpu-autoscaling
Total 136
wendylabsinc

Build, deploy, and debug robot apps with your coding agent. Supports Jetson, Raspberry Pi, Linux, and simulation.

Created Apr 2025

ai-harness developer-tools dragonwing edge edge-computing
Total 104
ai-runway

✈️ Kubernetes-native platform for deploying and managing AI inference across multiple providers

Created Dec 2025

ai cloudnative dynamo inference kubernetes
Total 103
mayooot

Easier than K8s to lift and lower the gpu number of docker container and scale capacity size of volume.

Created Dec 2023

ai-infra docker golang gpu nvidia
Total 82
BugRoger

Prometheus Exporter for NVIDIA GPUs using NVML

Created Jan 2018

kubernetes nvidia nvml prometheus
Total 81
ngthaihoc

This project is inspired by CMP40HX-Unlock. If you find it useful, please consider giving a star to both the original author and this repository.

Created Sep 2026

cmp developer-tools leagueoflegends linux mining
Total 68
coldzerofear

Easily manage virtual GPU resource pools in Kubernetes clusters.

Created Dec 2024

cuda deviceplugin dra gpu gpu-sharing
Total 66
kai-scheduler

Node-level enforcement and metrics for fractional GPU allocations made by KAI Scheduler.

Created Jul 2026

cloud-native go gpu gpu-sharing kai-scheduler
Total 59
eBay

nvidiagpubeat is an elastic beat that uses NVIDIA System Management Interface (nvidia-smi) to monitor NVIDIA GPU devices and can ingest metrics into Elastic search cluster, with support for both 6.x and 7.x versions of beats. nvidia-smi is a command line utility, based on top of the NVIDIA Management Library (NVML), intended to aid in the management and monitoring of NVIDIA GPU devices.

Created Jan 2019

beats ebay elasticbeats elasticsearch golang
Total 56

Related

All topics →