vllm-project

vllm-project

GitHub

Repositories

2

Total stars

11,520

Top repositories

An open, programmable decision layer for models and compute.

Created Aug 2025

ai-gateway guardrails inference kubernetes llm
Total 6,350

Cost-efficient and pluggable Infrastructure components for GenAI inference

Created Jun 2024

Total 5,170