mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.

caching cost-optimization golang kubernetes llm openai proxy semantic-cache

Created

Dec 2025

Total stars

94

Star trends