Categories / LLM Infrastructure

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

Last push 3 months ago

Created

Nov 2025

Total stars

427

7 days

+1

30 days

+4

12 months

+427

Star trends

README badge

Best of Go badge for messkan/prompt-cache
[![Best of Go](https://bestofgo.dev/badge/messkan/prompt-cache.svg)](https://bestofgo.dev/messkan/prompt-cache)