Categories / LLM Infrastructure
Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand
Last push 3 days ago
Created
Jul 2024
Total stars
88
Last 7 days
0
Last 30 days
0
Last 12 months
+7
README badge
[](https://bestofgo.dev/perk11/large-model-proxy)