An open, programmable decision layer for models and compute.
Created Aug 2025
Repositories
34
Total stars
18,464
An open, programmable decision layer for models and compute.
Created Aug 2025
Manages Unified Access to Generative AI Services built on Envoy Gateway
Created Oct 2024
Solana DeFi Security: On-Chain Governance Risk Analysis for Multisig, Timelock, and Upgrade Authorit
Created Nov 2026
Snapshot gets GPU pods ready in seconds instead of minutes — by restoring a fully initialized GPU worker instead of starting one from scratch. Kubernetes-native checkpoint & restore that runs alongside your existing stack.
Created Jul 2026
llm-d Router: The intelligent entry point for inference requests
Created May 2025
Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.
Created Apr 2026
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Created Nov 2025
Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML
Created Jun 2021
An open, programmable decision layer for models and compute.
Created Aug 2025
Manages Unified Access to Generative AI Services built on Envoy Gateway
Created Oct 2024
Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML
Created Jun 2021
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
Created Sep 2019
High-performance serverless GPU task orchestration — the scheduling layer behind wavespeed.ai
Created Oct 2025
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Created Sep 2023
llm-d Router: The intelligent entry point for inference requests
Created May 2025
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
Created Jul 2023
Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.
Created Apr 2026
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Created Nov 2025
AI terminal assistant for any OpenAI-compatible API. Features interactive chat TUI, command generation, code explanation, and streaming responses. Works with Ollama, OpenAI, LM Studio, and more.
Created Aug 2023
LLaMA-2 in native Go
Created Jul 2023
Snapshot gets GPU pods ready in seconds instead of minutes — by restoring a fully initialized GPU worker instead of starting one from scratch. Kubernetes-native checkpoint & restore that runs alongside your existing stack.
Created Jul 2026
Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.
Created Nov 2024
Solana DeFi Security: On-Chain Governance Risk Analysis for Multisig, Timelock, and Upgrade Authorit
Created Nov 2026
KEDA External gRPC Scaler for GPU workloads - native NVML metrics via DaemonSet, no Prometheus required
Created Mar 2026
Translation layer that maps any Kubernetes framework's Custom Resource Definitions (CRDs) into a standardized, generic structure.
Created Jul 2025
AI inference gateway and control plane for multi-provider routing, policies, caching, tools, and observability.
Created Oct 2026
Route inference across providers.
Created Sep 2024
Inference Platform Simulation
Created Jun 2025
Local inference, optimized for your hardware
Created Jun 2025
go binding for mxnet c_predict_api to do inference with pre-trained model
Created Dec 2016
CSGLite is a lightweight local LLM inference platform. One command downloads, loads, and chats with models. It ships a web UI, OpenAI-compatible API, llama.cpp inference, resumable downloads, marketplace browsing, and one-click AI app and coding-agent setup—all in a single cross-platform binary.
Created Mar 2026