Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
-
Updated
Sep 21, 2023 - Java
Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
DedupBench is a benchmarking tool for content-defined chunking techniques used in data deduplication. It currently supports eleven unique CDC techniques and five different vector instruction sets.
Fast content-defined chunking in Go.
CDCZip is a deduplication filter meant for use as long range match finder preprocessor for use alongside other compression algorithms.
Find (partial content) duplicate files.
A Rust library for Content-Defined Chunking (CDC).
Print FastCDC rolling hash chunks and checksums.
Synclet is a content-defined, chunk-based file synchronization and backup tool that detects and syncs only the actual changes—efficiently, intelligently, and reliably.
Open-source, self-hostable file sync for people and AI agents, with a Rust daemon and CLI, native macOS Finder integration, scoped sharing, and S3-compatible storage.
The CAVS Hub command-line client — wire Git LFS to content-defined, deduplicated transfers so only changed bytes travel on push/pull.
Open-source toolkit for lossless, reference-based reconstruction of large binary artifacts using deterministic CDC and compact SBD1 seeds.
Clojure implementation of Rabin-Karp rolling hash and chunker
Coldkeep is a correctness-first, content-addressed cold-storage engine with deterministic restore, staged integrity verification, safe garbage collection, deduplication, transform-aware packed storage, stable storage semantics, and a reusable engine/catalog core. v1.x is complete; v2.x focuses on local-first productization.
A FUSE-based filesystem implementing content-defined chunking and deduplication in Rust.
Add a description, image, and links to the content-defined-chunking topic page so that developers can more easily learn about it.
To associate your repository with the content-defined-chunking topic, visit your repo's landing page and select "manage topics."