Repositories

15

Total stars

18,201

Trending

T-Crypt

Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.

Created Oct 2026

comfyui golang gpu inference llama-cpp
Total 300
30 days +275
pardnchiu

A local AI agent harness in Go that runs 24/7 with auto-built tools, MCP, and Ollama

Created Feb 2026

agentic-ai ai ai-agent ai-agents ai-assistant
Total 622
30 days +179
qualcomm

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Created Aug 2024

gemma4 go gpt-oss granite4 hexagon
Total 8,545
30 days +104
beclab

Open-Source Personal Cloud OS for Always-On Agents

Created Apr 2024

agentic-ai ai-agents cloud-native data-privacy edge-ai
Total 5,373
30 days +68
ardanlabs

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

Created Nov 2025

golang local-ai local-inference
Total 873
30 days +26
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
30 days +20
qaribhaider

A small utility to use Ollama models in LM Studio (and vice versa via symlinking) without duplicating disk space

Created Aug 2025

ai golang llm lmstudio local-ai
Total 189
30 days +13
streamcoreai

Open-source realtime voice agent server in Go with WebRTC (WHIP), barge-in, streaming STT/LLM/TTS pipelines, plugin system, multi-language SDKs, SIP telephony, ESP32 support & fully local mode.

Created Mar 2026

agent-framework ai-voice-agent conversational-ai esp32 go
Total 248
30 days +12
mlhher

The AI agent that always stays sharp. 200k+ tokens of work in a 64k context. Sandboxed for unattended overnight runs. Sub-10ms Go CLI, any model.

Created Feb 2026

agent ai-agent ai-coding-assistant ai-skills autonomous-agents
Total 457
30 days +10
initializ

Forge is the open-source runtime for Anthropic's Agent Skills standard — built for the agent that runs next to a service, in your environment, on infrastructure you already operate. Write a SKILL.md. Compile to a portable, hardened agent. Deploy it anywhere containers run: Kubernetes, on-prem, air-gapped, embedded in CI, or as an A2A endpoint.

Created Feb 2026

a2a a2a-protocol agent-cli ai-agents ai-agents-cli
Total 221
30 days +4

Top

qualcomm

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Created Aug 2024

gemma4 go gpt-oss granite4 hexagon
Total 8,545
beclab

Open-Source Personal Cloud OS for Always-On Agents

Created Apr 2024

agentic-ai ai-agents cloud-native data-privacy edge-ai
Total 5,373
ardanlabs

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

Created Nov 2025

golang local-ai local-inference
Total 873
magicrew

Turn documents into AI-ready Markdown with visual understanding

Created Aug 2026

document-ai docx-to-markdown local-ai markdown multimodal
Total 718
pardnchiu

A local AI agent harness in Go that runs 24/7 with auto-built tools, MCP, and Ollama

Created Feb 2026

agentic-ai ai ai-agent ai-agents ai-assistant
Total 622
mlhher

The AI agent that always stays sharp. 200k+ tokens of work in a 64k context. Sandboxed for unattended overnight runs. Sub-10ms Go CLI, any model.

Created Feb 2026

agent ai-agent ai-coding-assistant ai-skills autonomous-agents
Total 457
thushan

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Created May 2025

ai amd golang intel llama-cpp
Total 338
T-Crypt

Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.

Created Oct 2026

comfyui golang gpu inference llama-cpp
Total 300
streamcoreai

Open-source realtime voice agent server in Go with WebRTC (WHIP), barge-in, streaming STT/LLM/TTS pipelines, plugin system, multi-language SDKs, SIP telephony, ESP32 support & fully local mode.

Created Mar 2026

agent-framework ai-voice-agent conversational-ai esp32 go
Total 248
initializ

Forge is the open-source runtime for Anthropic's Agent Skills standard — built for the agent that runs next to a service, in your environment, on infrastructure you already operate. Write a SKILL.md. Compile to a portable, hardened agent. Deploy it anywhere containers run: Kubernetes, on-prem, air-gapped, embedded in CI, or as an A2A endpoint.

Created Feb 2026

a2a a2a-protocol agent-cli ai-agents ai-agents-cli
Total 221
qaribhaider

A small utility to use Ollama models in LM Studio (and vice versa via symlinking) without duplicating disk space

Created Aug 2025

ai golang llm lmstudio local-ai
Total 189
raiyanyahya

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Created Jun 2026

ai-agents bubbletea cli docker fastapi
Total 105
vorojar

Open-source offline voice dictation — a free alternative to Typeless. 100% local, zero internet, ideal for air-gapped & classified environments. SenseVoice + DirectML GPU, ~34MB, hotkey-driven. 纯离线语音输入,Typeless 免费平替,数据永不出设备,适合党政机关等涉密场景。

Created Dec 2025

air-gapped dictation directml local-ai offline
Total 93
tomohiro-owada

Markdown vector search MCP server for Claude Code. Natural language search for markdown files using multilingual-e5-small embeddings.

Created Oct 2025

claude-code developer-tools documentation embeddings golang
Total 64
canonical

Local inference, optimized for your hardware

Created Jun 2025

ai inference llm local-ai model-serving
Total 55

Related

All topics →