thushan / olla High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends. Created May 2025 ai amd golang intel llama-cpp Total 338