Categories / LLM Infrastructure

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Last push 2 weeks ago

Created

Oct 2026

Total stars

56

7 days

0

30 days

+56

12 months

+56

Star trends

README badge

Best of Go badge for Dharshaneshwaran/hyperpod
[![Best of Go](https://bestofgo.dev/badge/Dharshaneshwaran/hyperpod.svg)](https://bestofgo.dev/Dharshaneshwaran/hyperpod)