Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
hadoop/hadoop-tools/hadoop-distcp
History
KAI XIE c1a2b29c0f HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919) 
* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

(cherry picked from commit c765584eb2)
(cherry picked from commit b3c14d4132)

Conflicts:
	hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/util/TestDistCpUtils.java
 		2019-08-18 18:55:59 -07:00
..
src HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919) 2019-08-18 18:55:59 -07:00
README HADOOP-11437. Remove the version and author information from distcp's README file (Brahma Reddy Battula via aw) 2015-02-11 15:47:36 -08:00
pom.xml HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka. 2019-05-29 17:39:49 +09:00

README 

DistCp (distributed copy) is a tool used for large inter/intra-cluster copying. 
It uses Map/Reduce to effect its distribution, error handling and recovery, 
and reporting. It expands a list of files and directories into input to map tasks, 
each of which will copy a partition of the files specified in the source list.