RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.
Created Dec 2023
Running and serving large language models, LLM API gateways and proxies, and retrieval-augmented generation (RAG) systems.
Repos
200
Stars
636,933
Last 30 days
+26,248
RAGFlow is an agent-native database: a Retrieval-Augmented Generation (RAG) engine that grew into context infrastructure.
Created Dec 2023
An open-source engine that turns continuous content streams into search and monitoring. Durable ingestion, hybrid search, alerts, and plugins for formats, models and business rules.
Created May 2023
Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.
Created Oct 2024
Manages Unified Access to Generative AI Services built on Envoy Gateway
Created Oct 2024
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
Created Jul 2023
✨Reverse-engineered API for Gemini web app. It can be used as a genuine API key from OpenAI, Gemini, and Claude.
Created Dec 2025
A proxy for Azure OpenAI API that can convert an OpenAI request into an Azure OpenAI request.
Created Mar 2023
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Created Sep 2023
llm-d Router: The intelligent entry point for inference requests
Created May 2025
LightningRAG is a full-stack Vue + Gin starter with a decoupled frontend and backend, plus built-in, extensible RAG (retrieval-augmented generation): knowledge bases, vector search, and integrations with many LLM and vector-store providers
Created Mar 2026
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response
Created Nov 2025
一个本地优先的AI知识库系统(RAG),用于把本地文档接入辅导搜索与大模型对话流程。目前支持md、txt、pdf(文本)、xlsx、cvs类型。支持mcp服务
Created Mar 2026
An Open Standard for Packaging, Distributing and Running LLMs in Cloud-Native Environments
Created Aug 2024
A lightweight, production-ready RAG (Retrieval Augmented Generation) library in Go.
Created Jul 2024
Distributed KV cache scheduling & offloading libraries
Created Apr 2025
🚀 Autocache - Intelligent Anthropic API Cache Proxy Automatically inject cache-control fields into Claude API requests to reduce costs by up to 90% and latency by up to 85%. Works as a transparent drop-in replacement for popular AI platforms like n8n, Flowise, Make.com, LangChain, and LlamaIndex—no code changes required
Created Oct 2025
Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Created Mar 2026
AI inference gateway and control plane for multi-provider routing, policies, caching, tools, and observability.
Created Oct 2026
A client/server for LLaMA (Large Language Model Meta AI) that can run ANYWHERE.
Created Mar 2023
Multi-Provider AI Gateway, "Because we have LiteLLM at home" No personal logs by design. Model autodiscovery, Failover groups, High availability, Android companion app, and more!
Created Apr 2026
High-performance proxy router for LLM APIs with automatic load balancing, rate limiting, and fail2ban protection
Created Jan 2026
A simple API server for performing Retrieval-Augmented Generation (RAG) of text based on content from a PostgreSQL database using pgvector.
Created Nov 2025
Local inference, optimized for your hardware
Created Jun 2025
Stop paying for AI APIs during development. LocalCloud runs everything locally - GPT-level models, databases, all free.
Created Jun 2025
A Go library implementation of LightRAG - an advanced Retrieval-Augmented Generation (RAG) system that uniquely combines vector databases with graph database relationships to enhance knowledge retrieval.
Created Mar 2025 Archived
Repos sorted by Jev.