GitHub topics

deduplication

Repositories

11

Total stars

65,766

Trending

restic

Fast, secure, efficient backup program

Created Apr 2014

backup dedupe deduplication go restic
Total 37,355
30 days +688
kopia

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

Created Dec 2015

backup cloud deduplication encryption google-cloud-storage
Total 14,774
30 days +385
PlakarKorp

plakar is a backup solution powered by Kloset and ptar

Created Mar 2021

backups deduplication deduption
Total 2,188
30 days +97
prometheus

Prometheus Alertmanager

Created Jul 2013

alertmanager deduplication email hacktoberfest monitoring
Total 8,706
30 days +51
cupcakearmy

Config driven, easy backup cli for restic.

Created Jun 2019

backup cli config config-driven deduplication
Total 1,884
30 days +13
PlakarKorp

A Golang package that implements CDC chunkers with a generic interface

Created Sep 2023

cdc deduplication golang
Total 147
30 days +2
Siddhant-K-code

Context intelligence layer for LLM agents: persistent memory with write-time dedup, sensitivity tagging, conflict detection, and hierarchical decay. ~12ms. No LLM calls. MIT.

Created Dec 2025

ai-agents anthropic compression context-optimization deduplication
Total 198
30 days +1
laktak

Check your files for data corruption and run quick file deduplication

Created Oct 2019

backup bitrot-detection btrfs cloud-backup data-degradation
Total 184
30 days +1

Top

restic

Fast, secure, efficient backup program

Created Apr 2014

backup dedupe deduplication go restic
Total 37,355
kopia

Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

Created Dec 2015

backup cloud deduplication encryption google-cloud-storage
Total 14,774
prometheus

Prometheus Alertmanager

Created Jul 2013

alertmanager deduplication email hacktoberfest monitoring
Total 8,706
PlakarKorp

plakar is a backup solution powered by Kloset and ptar

Created Mar 2021

backups deduplication deduption
Total 2,188
cupcakearmy

Config driven, easy backup cli for restic.

Created Jun 2019

backup cli config config-driven deduplication
Total 1,884
Siddhant-K-code

Context intelligence layer for LLM agents: persistent memory with write-time dedup, sensitivity tagging, conflict detection, and hierarchical decay. ~12ms. No LLM calls. MIT.

Created Dec 2025

ai-agents anthropic compression context-optimization deduplication
Total 198
laktak

Check your files for data corruption and run quick file deduplication

Created Oct 2019

backup bitrot-detection btrfs cloud-backup data-degradation
Total 184
F483

Quickly detect already witnessed data.

Created May 2017

command-line command-line-tool deduplication duplicate-values duplicates
Total 156
PlakarKorp

A Golang package that implements CDC chunkers with a generic interface

Created Sep 2023

cdc deduplication golang
Total 147
tsileo

You personal database. Mirror of https://git.sr.ht/~tsileo/blobstash

Created Apr 2014

backup blob-store blobstash content-addressed deduplication
Total 103
samber

🧬 x/sync/singleflight but with generics, batching, sharding and nullable result

Created Mar 2024

cache channel concurrent deduplication generics
Total 71

Related

All topics →