Repositories

10

Total stars

15,601

Trending

datazip-inc

OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

Created Oct 2024

apache-iceberg cdc change-data-capture data-ingestion data-pipeline
Total 2,038
30 days +480
galaxy-io

Pluggable data replication with checkpointing, batching, and integrity events

Created Jun 2026

change-data-capture data data-collection data-integration data-pipeline
Total 333
30 days +110
cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Created Nov 2020

airbyte attack-surface-management aws azure bigquery
Total 6,564
30 days +27
rudderlabs

Privacy and Security focused Segment-alternative, in Golang and React

Created Jul 2019

bigquery cdp customer-data customer-data-lake customer-data-pipeline
Total 4,524
30 days +18
slingdata-io

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

Created Oct 2020

elt etl extract load
Total 929
30 days +12
transferia

Open Source Cloud Native Ingestion engine

Created Jun 2024

bigdata cdc clickhouse elt go
Total 199
30 days +5
renart-data

Open source data platform for SQL and Python pipelines, notebooks and dashboards, with type checking, scheduling and definitions in Git.

Created Apr 2026

dashboards data-engineering data-pipeline data-platform developer-tools
Total 96
30 days +3
realdatadriven

ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

Created Dec 2024

data-engineering data-lake data-lakehouse data-quality data-quality-checks
Total 57
30 days +2
raystack

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

Created Mar 2021

airflow analytics analytics-engineering automation bigquery
Total 770
30 days +2

Top

cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

Created Nov 2020

airbyte attack-surface-management aws azure bigquery
Total 6,564
rudderlabs

Privacy and Security focused Segment-alternative, in Golang and React

Created Jul 2019

bigquery cdp customer-data customer-data-lake customer-data-pipeline
Total 4,524
datazip-inc

OLake Go: open-source replication from databases, Kafka and S3 to Apache Iceberg and Parquet. Sources: Postgres, MySQL, MongoDB, Oracle, MSSQL, DB2, Kafka, S3. Formerly datazip-inc/olake. Table maintenance lives in datazip-inc/olake-fusion.

Created Oct 2024

apache-iceberg cdc change-data-capture data-ingestion data-pipeline
Total 2,038
slingdata-io

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

Created Oct 2020

elt etl extract load
Total 929
raystack

Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.

Created Mar 2021

airflow analytics analytics-engineering automation bigquery
Total 770
galaxy-io

Pluggable data replication with checkpointing, batching, and integrity events

Created Jun 2026

change-data-capture data data-collection data-integration data-pipeline
Total 333
transferia

Open Source Cloud Native Ingestion engine

Created Jun 2024

bigdata cdc clickhouse elt go
Total 199
renart-data

Open source data platform for SQL and Python pipelines, notebooks and dashboards, with type checking, scheduling and definitions in Git.

Created Apr 2026

dashboards data-engineering data-pipeline data-platform developer-tools
Total 96
airbytehq

Airbyte's CLI for managing local Airbyte installations

Created Mar 2024

elt go golang
Total 91
realdatadriven

ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

Created Dec 2024

data-engineering data-lake data-lakehouse data-quality data-quality-checks
Total 57

Related

All topics →