Splitting Data with Content-Defined Chunking

Written by
mbergoon
Link to Post

https://blog.gopheracademy.com/advent-2018/split-data-with-cdc

In this post you’ll learn what Content-Defined Chunking (CDC) is and how you can use it to split large data into smaller blocks in a deterministic way. These blocks can be found again in other data later, even if the location of the block is different than the first time. I wrote a small Go package to do the splitting, which performs really well. 1 points posted by kenny

Article Tags:
Article Categories:
golang

Comments are closed.