b3c14d4132
* DistCp to support checksum validation when copy blocks in parallel * address review comments * add checksums comparison test for combine mode (cherry picked from commit c765584eb231f8482f5b90b7e8f61f9f7a931d09)
DistCp (distributed copy) is a tool used for large inter/intra-cluster copying. It uses Map/Reduce to effect its distribution, error handling and recovery, and reporting. It expands a list of files and directories into input to map tasks, each of which will copy a partition of the files specified in the source list.