Categories / LLM Infrastructure

llm-d

llm-d / llm-d-inference-sim

A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

Last push 8 hours ago

incubating

Created

Apr 2025

Total stars

243

7 days

+7

30 days

+26

12 months

+186

Star trends

README badge

Best of Go badge for llm-d/llm-d-inference-sim
[![Best of Go](https://bestofgo.dev/badge/llm-d/llm-d-inference-sim.svg)](https://bestofgo.dev/llm-d/llm-d-inference-sim)