GitHub topics

llama

Mostly in LLM Infrastructure 30%

Repositories

23

Total stars

264,954

Trending

ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Created Jun 2023

deepseek gemma glm go golang
Total 187,899
30 days +4,300
mudler

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Created Mar 2023

agents ai api audio-generation decentralized
Total 50,508
30 days +838
mostlygeek

Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.

Created Oct 2024

ai golang llama llm localllama
Total 6,284
30 days +269
k8sgpt-ai

Giving Kubernetes Superpowers to everyone

Created Mar 2023

ai devops kubernetes llama openai
Total 8,350
30 days +95
beelzebub-labs

A secure low code deception runtime framework, leveraging AI for System Virtualization.

Created May 2022

acis agentic-ai-security cloudnative cloudsecurity cybersecurity
Total 2,257
30 days +57
Dharshaneshwaran

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Created Oct 2026

cuda distributed-inference fault-tolerance gguf golang
Total 56
30 days +56
aandrew-me

AI Chatbots in terminal for free

Created Apr 2023

ai chatbot chatgpt cli go
Total 3,301
30 days +29
hybridgroup

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

Created Sep 2025

arduino-uno-q cuda gguf golang jetson-orin-nano
Total 676
30 days +20
ome-projects

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Created May 2025

deepseek k8s kimi-k2 llama llm
Total 529
30 days +11
mlhher

The AI agent that always stays sharp. 200k+ tokens of work in a 64k context. Sandboxed for unattended overnight runs. Sub-10ms Go CLI, any model.

Created Feb 2026

agent ai-agent ai-coding-assistant ai-skills autonomous-agents
Total 457
30 days +10

Top

ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Created Jun 2023

deepseek gemma glm go golang
Total 187,899
mudler

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Created Mar 2023

agents ai api audio-generation decentralized
Total 50,508
k8sgpt-ai

Giving Kubernetes Superpowers to everyone

Created Mar 2023

ai devops kubernetes llama openai
Total 8,350
mostlygeek

Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.

Created Oct 2024

ai golang llama llm localllama
Total 6,284
aandrew-me

AI Chatbots in terminal for free

Created Apr 2023

ai chatbot chatgpt cli go
Total 3,301
beelzebub-labs

A secure low code deception runtime framework, leveraging AI for System Virtualization.

Created May 2022

acis agentic-ai-security cloudnative cloudsecurity cybersecurity
Total 2,257
gotzmann

llama.go is like llama.cpp in pure Golang!

Created Mar 2023

alpaca chatgpt dalai gpt gpt3
Total 1,404
kardolus

ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more, with features like streaming, interactive chat, prompt files, image/audio I/O, MCP tool calls, and an experimental agent mode for safe, multi-step automation.

Created May 2023

agent agentic-ai azure chatgpt cli
Total 970
hybridgroup

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

Created Sep 2025

arduino-uno-q cuda gguf golang jetson-orin-nano
Total 676
kaito-project

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Created Sep 2023

ai buildkit chatgpt docker fine-tuning
Total 544
ome-projects

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Created May 2025

deepseek k8s kimi-k2 llama llm
Total 529
mlhher

The AI agent that always stays sharp. 200k+ tokens of work in a 64k context. Sandboxed for unattended overnight runs. Sub-10ms Go CLI, any model.

Created Feb 2026

agent ai-agent ai-coding-assistant ai-skills autonomous-agents
Total 457
sammcj

Parse files (e.g. code repos) and websites to clipboard or a file for ingestions by AI / LLMs

Created Jul 2024

ai codegen ingest llama llm
Total 391
adalkiran

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

Created Dec 2023

deep-learning educational-project go golang large-language-models
Total 318
nekomeowww

🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

Created Apr 2024

ai kubernetes kubernetes-operators llama llamacpp
Total 243
nikolaydubina

LLaMA-2 in native Go

Created Jul 2023

inference large-language-model llama llama2 llm
Total 191
goccy

llama.cpp in pure Go

Created Aug 2026

ai golang golang-library llama llm
Total 177
gitctrlx

Llama from scratch in Go.

Created Aug 2025

llama llm llm-inference
Total 105
openshieldai

OpenShield is a new generation security layer for AI models

Created Jun 2024

ai artificial-intelligence firewall golang guardian
Total 87
adrianliechti

Inference Hub for AI at Scale

Created Sep 2023

ai-gateway azure-openai claude function-calling groq
Total 82
pluja

Turn natual language into commands. Your CLI tasks, now as easy as a conversation. Run it 100% offline, or use OpenAI's models.

Created Nov 2023

ai assistant bash cli golang
Total 63
avilum

A client/server for LLaMA (Large Language Model Meta AI) that can run ANYWHERE.

Created Mar 2023

ai client-server facebook llama llm
Total 62
Dharshaneshwaran

Pools consumer laptops into one local runtime for Meta Llama models. Measures the free VRAM each machine reports, splits the model across CUDA and Metal devices through llama.cpp RPC, and rebuilds the pipeline when a worker drops out.

Created Oct 2026

cuda distributed-inference fault-tolerance gguf golang
Total 56

Related

All topics →