mostlygeek

mostlygeek / llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

golang llama llamacpp localllama localllm openai openai-api vllm

Created

Oct 2024

Total stars

6,141

Star trends