Categories / LLM Infrastructure
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response
Last push 3 months ago
ai
badgerdb
cache
claude
cost-optimization
go
langchain
llm
middleware
mistral
openai
performance
rag
rag-ai
semantic-search
vector-database
Created
Nov 2025
Total stars
427
Last 7 days
+1
Last 30 days
+4
Last 12 months
+427
README badge
[](https://bestofgo.dev/messkan/prompt-cache)