Categories / LLM Infrastructure
βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!
Last push 2 months ago
huggingface
inference
inference-platform
kubernetes
llamacpp
llm
modelscope
ollama
sglang
text-generation-inference
vllm
Created
Nov 2023
Total stars
315
Last 7 days
+1
Last 30 days
+1
Last 12 months
+54
README badge
[](https://bestofgo.dev/InftyAI/llmaz)