Repositories
23
Total stars
264,954
Trending
Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.
Created Oct 2024
A secure low code deception runtime framework, leveraging AI for System Virtualization.
Created May 2022
Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.
Created Oct 2026
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Created Sep 2025
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Created May 2025
Top
Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.
Created Oct 2024
A secure low code deception runtime framework, leveraging AI for System Virtualization.
Created May 2022
ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more, with features like streaming, interactive chat, prompt files, image/audio I/O, MCP tool calls, and an experimental agent mode for safe, multi-step automation.
Created May 2023
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Created Sep 2025
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Created Sep 2023
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Created May 2025
A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.
Created Dec 2023
🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
Created Apr 2024
LLaMA-2 in native Go
Created Jul 2023
OpenShield is a new generation security layer for AI models
Created Jun 2024
Inference Hub for AI at Scale
Created Sep 2023
A client/server for LLaMA (Large Language Model Meta AI) that can run ANYWHERE.
Created Mar 2023
Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.
Created Oct 2026