GitHub topics

stream-processing

Mostly in Stream Processing 28%

Repositories

28

Total stars

31,261

Trending

ThreeDotsLabs

Building event-driven applications the easy way in Go.

Created Nov 2018

cqrs event-driven event-sourcing events go
Total 9,981
30 days +54
redpanda-data

Fancy stream processing made operationally mundane

Created Mar 2016

amqp cqrs data-engineering data-ops etl
Total 8,812
30 days +24
PeerDB-io

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Created Apr 2023

bigquery cdc clickhouse cloud-native distributed-systems
Total 3,325
30 days +20
reugn

A lightweight stream processing library for Go

Created Apr 2019

aerospike data-pipeline data-stream etl kafka
Total 2,180
30 days +3
aleksandarskrbic

Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios

Created Dec 2025

apache-kafka apache-spark chaos-engineering consumer-lag data-engineering
Total 166
30 days +2
mariomac

A Go port of the Java Streams API. Type-safe and functional Go Streams processing

Created Dec 2021

generics go golang stream-processing type-parameters
Total 173
30 days +2
fulminate-io

Machine is a workflow/pipeline library for processing data

Created Oct 2020

codespaces github-actions golang golang-library golang-package
Total 168
30 days +1
vsouza

Golang Kafka consumer and producer example

Created May 2017

examples golang kafka producer-consumer stream-processing
Total 174
30 days +1

Top

ThreeDotsLabs

Building event-driven applications the easy way in Go.

Created Nov 2018

cqrs event-driven event-sourcing events go
Total 9,981
redpanda-data

Fancy stream processing made operationally mundane

Created Mar 2016

amqp cqrs data-engineering data-ops etl
Total 8,812
PeerDB-io

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Created Apr 2023

bigquery cdc clickhouse cloud-native distributed-systems
Total 3,325
reugn

A lightweight stream processing library for Go

Created Apr 2019

aerospike data-pipeline data-stream etl kafka
Total 2,180
francoispqt

high performance JSON encoder/decoder with stream API for Golang

Created Apr 2018

decoder encoder go golang json
Total 2,135
vladimirvivien

A stream processing API for Go (now with generic type support)

Created Sep 2015

data-stream go golang stream-processing streaming-api
Total 845
gazette

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

Created Oct 2017

brokers event-sourcing golang stream-processing streaming-platforms
Total 798
nmaquet

Kasper is a lightweight library for processing Kafka topics.

Created Feb 2017

golang-library kafka stream-processing
Total 436
vectorengine

VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

Created Jan 2020

clickhouse column-store distributed-database iot olap
Total 293
talariadb

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

Created Apr 2020

big-data column-store database prestodb real-time
Total 231
streamnative

The serverless framework purpose-built for event streaming applications.

Created Sep 2020

apache-pulsar connectors event-streaming pulsar-functions pulsar-io
Total 228
schollz

Pluck text in a fast and intuitive way 🐓

Created Aug 2017

extract-information finite-state-machine regex stream-processing
Total 215
logrange

High performance data aggregating storage

Created Aug 2018

database go golang log-aggregation logging
Total 190
bytewatch

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

Created Dec 2018

binlog change-data-capture mariadb mysql mysql-kafka
Total 177
vsouza

Golang Kafka consumer and producer example

Created May 2017

examples golang kafka producer-consumer stream-processing
Total 174
mariomac

A Go port of the Java Streams API. Type-safe and functional Go Streams processing

Created Dec 2021

generics go golang stream-processing type-parameters
Total 173
fulminate-io

Machine is a workflow/pipeline library for processing data

Created Oct 2020

codespaces github-actions golang golang-library golang-package
Total 168
aleksandarskrbic

Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios

Created Dec 2025

apache-kafka apache-spark chaos-engineering consumer-lag data-engineering
Total 166
runreveal

A blazingly fast event stream processing library powering the reveald event processing daemon.

Created Mar 2023

events go golang logs message-queue
Total 150
rmoff

A Golang client for ksqlDB

Created Jul 2020

kafka kafka-streams sql stream-processing
Total 70
devnw

stream is a concurrency pattern implementation using Go generics. a.k.a. my accidentally awesome library

Created Dec 2021

concurrency concurrency-patterns generic-programming generics go
Total 67
blendle

Ship changes in Postgres 🐘 to Kafka 📖

Created Oct 2017

golang kafka postgresql stream-processing
Total 67
vaerohq

Complete log pipeline solution in Python. Runs fast in Go.

Created Dec 2022

events go logs observability pipeline
Total 66
project-flogo

Elegant stream processing pipeline written entirely in Golang

Created Aug 2018

edge flogo stream-processing streaming
Total 66
maxim2266

csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.

Created Sep 2016

csv csv-format etl etl-framework etl-pipeline
Total 66
thibauts

Simple, high-performance event streaming broker

Created Feb 2021

broker event-streaming messaging pubsub stream-processing
Total 63
itsubaki

Stream processing library in Go

Created Jul 2017

complex-event-processing stream-processing
Total 60
KafScale

Kafka-compatible streaming that keeps your data in S3. Stateless brokers, standard Kafka clients, Apache 2.0.

Created Dec 2025

bento connect data-pipelines diskless-kafka golang
Total 59

Related

All topics →