Repository

mostlygeek / llama-swap

Created Oct 4, 2024

• (2 years ago)

Description

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

5,672

golang llama llamacpp localllama localllm openai openai-api vllm

day week month year