Categories / LLM Infrastructure

llm-d

llm-d / llm-d-inference-sim

A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

Last push 11 hours ago

incubating

Created

Apr 2025

Total stars

243

7 days

+6

30 days

+25

12 months

+186

Star trends

README badge

Best of Go badge for llm-d/llm-d-inference-sim
[![Best of Go](https://bestofgo.dev/badge/llm-d/llm-d-inference-sim.svg)](https://bestofgo.dev/llm-d/llm-d-inference-sim)