GitHub topics

bigdata

Repositories

12

Total stars

25,922

Trending

juicedata

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Created Jan 2021

bigdata cloud-native distributed-systems filesystem go
Total 14,774
30 days +210
volcano-sh

A Cloud Native Batch System (Project under CNCF)

Created Mar 2019

ai batch-systems bigdata gene golang
Total 6,105
30 days +77
marmotdata

The open source knowledgehouse for your company. Marmot knows what your data means, governs who may use it and runs every query your people and agents make, checked and recorded. Catalog, lineage, governed SQL and an MCP server in one Go binary.

Created Mar 2025

agentic-ai ai-agents bigdata data-catalog data-collaboration
Total 640
30 days +14
apache

A general purpose Distributed Systems Framework

Created Jan 2014

airavata bigdata cloudnative gateways java
Total 162
30 days +7
transferia

Open Source Cloud Native Ingestion engine

Created Jun 2024

bigdata cdc clickhouse elt go
Total 199
30 days +5
grailbio

A serverless cluster computing system for the Go programming language

Created Sep 2019

bigdata cluster computing etl go
Total 557
30 days +2
zeromicro

Data syncing in golang for ClickHouse.

Created Nov 2020

bigdata clickhouse go golang kafka-consumer
Total 979
30 days +1
kubernetes-retired

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

Created Jun 2017

bigdata hpc k8s-sig-scheduling kubernetes machine-learning
Total 1,091
30 days +1

Top

juicedata

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Created Jan 2021

bigdata cloud-native distributed-systems filesystem go
Total 14,774
volcano-sh

A Cloud Native Batch System (Project under CNCF)

Created Mar 2019

ai batch-systems bigdata gene golang
Total 6,105
kubernetes-retired

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

Created Jun 2017

bigdata hpc k8s-sig-scheduling kubernetes machine-learning
Total 1,091
zeromicro

Data syncing in golang for ClickHouse.

Created Nov 2020

bigdata clickhouse go golang kafka-consumer
Total 979
marmotdata

The open source knowledgehouse for your company. Marmot knows what your data means, governs who may use it and runs every query your people and agents make, checked and recorded. Catalog, lineage, governed SQL and an MCP server in one Go binary.

Created Mar 2025

agentic-ai ai-agents bigdata data-catalog data-collaboration
Total 640
minio

High Performance HTTP Sidecar Load Balancer

Created Mar 2020

bigdata kubernetes load-balancer minio-servers proxy
Total 583
grailbio

A serverless cluster computing system for the Go programming language

Created Sep 2019

bigdata cluster computing etl go
Total 557
arvados

An open source platform for managing and analyzing biomedical big data

Created Apr 2013

arvados aws azure bigdata bioinformatics
Total 422
sirkon

Code generator for fast log file parsers

Created Jul 2017

bigdata datamining log-parsing logs-analysis logs-parsing
Total 323
transferia

Open Source Cloud Native Ingestion engine

Created Jun 2024

bigdata cdc clickhouse elt go
Total 199
apache

A general purpose Distributed Systems Framework

Created Jan 2014

airavata bigdata cloudnative gateways java
Total 162
apache

A collection of tools and best practices to take ShardingSphere into the cloud

Created Mar 2022

bigdata cloud database database-cluster database-plus
Total 87

Related

All topics →