Repositories

14

Total stars

27,956

Trending

NVIDIA

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

Created Feb 2019

cuda gpu kubernetes nvidia
Total 2,994
30 days +62
Dharshaneshwaran

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Created Oct 2026

cuda distributed-inference fault-tolerance gguf golang
Total 56
30 days +56
beam-cloud

Ultrafast serverless GPU inference, sandboxes, and background jobs

Created Nov 2023

autoscaler cloudrun cuda developer-productivity distributed-computing
Total 1,860
30 days +32
hybridgroup

Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.

Created Sep 2017

computer-vision computervision cuda dnn face-tracking
Total 7,529
30 days +25
hybridgroup

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

Created Sep 2025

arduino-uno-q cuda gguf golang jetson-orin-nano
Total 676
30 days +20
replicate

Containers for machine learning

Created Feb 2021

ai containers cuda docker machine-learning
Total 9,507
30 days +18
jitllm

Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

Created Sep 2026

cuda inference inference-acceleration inference-engine inference-server
Total 58
30 days +10
mumax
mumax / 3

GPU-accelerated micromagnetic simulator

Created Sep 2013

cuda finite-difference-time-domain go micromagnetics scientific-computing
Total 508
30 days +4
raketenkater

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Created Mar 2026

cuda gguf golang inference-server llama-cpp
Total 284
30 days +3
parca-dev

eBPF based always-on CPU/GPU profiler auto-discovering targets in Kubernetes and systemd, zero code changes or restarts needed!

Created May 2021

c continuous-profiling cpp cuda ebpf
Total 752
30 days +2

Top

replicate

Containers for machine learning

Created Feb 2021

ai containers cuda docker machine-learning
Total 9,507
hybridgroup

Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, OpenCV Contrib, and OpenVINO.

Created Sep 2017

computer-vision computervision cuda dnn face-tracking
Total 7,529
uber

A GPU-powered real-time analytics storage and query engine.

Created Sep 2018

analytics cgo cuda data database
Total 3,081
NVIDIA

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

Created Feb 2019

cuda gpu kubernetes nvidia
Total 2,994
beam-cloud

Ultrafast serverless GPU inference, sandboxes, and background jobs

Created Nov 2023

autoscaler cloudrun cuda developer-productivity distributed-computing
Total 1,860
parca-dev

eBPF based always-on CPU/GPU profiler auto-discovering targets in Kubernetes and systemd, zero code changes or restarts needed!

Created May 2021

c continuous-profiling cpp cuda ebpf
Total 752
hybridgroup

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

Created Sep 2025

arduino-uno-q cuda gguf golang jetson-orin-nano
Total 676
gorgonia

package cu provides an idiomatic interface to the CUDA Driver API.

Created Feb 2017

cuda cuda-driver-api go golang
Total 535
mumax
mumax / 3

GPU-accelerated micromagnetic simulator

Created Sep 2013

cuda finite-difference-time-domain go micromagnetics scientific-computing
Total 508
raketenkater

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Created Mar 2026

cuda gguf golang inference-server llama-cpp
Total 284
coldzerofear

Easily manage virtual GPU resource pools in Kubernetes clusters.

Created Dec 2024

cuda deviceplugin dra gpu gpu-sharing
Total 66
jitllm

Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory

Created Sep 2026

cuda inference inference-acceleration inference-engine inference-server
Total 58
Dharshaneshwaran

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Created Oct 2026

cuda distributed-inference fault-tolerance gguf golang
Total 56
sahandsafizadeh

Deep Learning framework in Go with Tensors, AutoGrad, and GPU acceleration

Created Jun 2024

autograd cuda deep-learning go neural-network
Total 50

Related

All topics →