Original post

For another project, I need to deduplicate “on the fly” a stream of file served from a plugin through grpc. I struggled to find a chunker package with this capability, so a friend and I developed our own. This is a pure go implementation of the FastCDC algorithm with a copyleft license. I had no prior knowledge of CDC algorithm family and really learned a lot while developing this package. This is also my first open source go package and I would appreciate any feedback.