Splitting Data with Content-Defined Chunking

Written by
Link to Post


In this post you’ll learn what Content-Defined Chunking (CDC) is and how you can use it to split large data into smaller blocks in a deterministic way. These blocks can be found again in other data later, even if the location of the block is different than the first time. I wrote a small Go package to do the splitting, which performs really well. 1 points posted by kenny

Article Tags:
Article Categories:

Comments are closed.