Repositories

11

Total stars

4,367

Trending

najmuzzaman-mohammad

open source grok bot. gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.

Created Mar 2026

agents ai-agents ai-teammates autonomous-agents claude-code
Total 1,584
30 days +80
Dharshaneshwaran

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Created Oct 2026

cuda distributed-inference fault-tolerance gguf golang
Total 56
30 days +56
hehehai

Voice input for macOS on local models: transcribe, translate and rewrite in any app. The successor of Voxt.

Created Feb 2026

apple-silicon asr dictation go local-llm
Total 914
30 days +30
defilantech

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Created Nov 2025

ai apple-silicon autoscaling edge-computing gguf
Total 267
30 days +30
orneryd

Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph traversal, and writes. Using Neo4j Bolt/Cypher and qdrant's gRPC means you can switch with no changes while adding intelligent features like schemas, managed embeddings, reranking+llm, GPU accel, Auto-TLP, Policy-based Memory Decay, and MCP server.

Created Dec 2025

bolt cypher database enterprise-solutions golang
Total 932
30 days +23
anthony-chaudhary

Agentic Runtime

Created Jun 2026

agent-kernel agentic-ai ai-agents ai-gateway claude-code
Total 50
30 days +7
raketenkater

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Created Mar 2026

cuda gguf golang inference-server llama-cpp
Total 284
30 days +3
Ritiksuman07

A hedge fund on your local machine. Terminal-native algo trading engine in Go with local LLM inference (Ollama), Bubble Tea TUI, paper/live trading, and zero cloud dependency. BYOB.

Created Apr 2026

algorithmic-trading bubbletea fintech go golang
Total 73
30 days +1

Top

najmuzzaman-mohammad

open source grok bot. gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.

Created Mar 2026

agents ai-agents ai-teammates autonomous-agents claude-code
Total 1,584
orneryd

Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph traversal, and writes. Using Neo4j Bolt/Cypher and qdrant's gRPC means you can switch with no changes while adding intelligent features like schemas, managed embeddings, reranking+llm, GPU accel, Auto-TLP, Policy-based Memory Decay, and MCP server.

Created Dec 2025

bolt cypher database enterprise-solutions golang
Total 932
hehehai

Voice input for macOS on local models: transcribe, translate and rewrite in any app. The successor of Voxt.

Created Feb 2026

apple-silicon asr dictation go local-llm
Total 914
raketenkater

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Created Mar 2026

cuda gguf golang inference-server llama-cpp
Total 284
defilantech

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

Created Nov 2025

ai apple-silicon autoscaling edge-computing gguf
Total 267
raiyanyahya

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Created Jun 2026

ai-agents bubbletea cli docker fastapi
Total 105
Ritiksuman07

A hedge fund on your local machine. Terminal-native algo trading engine in Go with local LLM inference (Ollama), Bubble Tea TUI, paper/live trading, and zero cloud dependency. BYOB.

Created Apr 2026

algorithmic-trading bubbletea fintech go golang
Total 73
Dharshaneshwaran

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Created Oct 2026

cuda distributed-inference fault-tolerance gguf golang
Total 56
tara-vision

DevOps & Cloud SI Assistant that runs locally on taraengine for complete privacy.

Created Jan 2026

agentic-ai ai-assisted-coding cli-ai-agent devops golang
Total 51
localcloud-sh

Stop paying for AI APIs during development. LocalCloud runs everything locally - GPT-level models, databases, all free.

Created Jun 2025

ai ai-app ai-development ai-development-tools ai-infrastructure
Total 51
anthony-chaudhary

Agentic Runtime

Created Jun 2026

agent-kernel agentic-ai ai-agents ai-gateway claude-code
Total 50

Related

All topics →