hadoop

History

Steve Loughran 6999acf520 HADOOP-16202. Enhanced openFile(): mapreduce and YARN changes. (#2584/2) These changes ensure that sequential files are opened with the right read policy, and split start/end is passed in. As well as offering opportunities for filesystem clients to choose fetch/cache/seek policies, the settings ensure that processing text files on an s3 bucket where the default policy is "random" will still be processed efficiently. This commit depends on the associated hadoop-common patch, which must be committed first. Contributed by Steve Loughran. Change-Id: Ic6713fd752441cf42ebe8739d05c2293a5db9f94		2022-04-24 17:33:05 +01:00
..
src	HADOOP-16202. Enhanced openFile(): mapreduce and YARN changes. (#2584/2)	2022-04-24 17:33:05 +01:00
README	HADOOP-11437. Remove the version and author information from distcp's README file (Brahma Reddy Battula via aw)	2015-02-11 15:47:36 -08:00
pom.xml	HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000 )	2022-03-08 17:27:04 +09:00

README

DistCp (distributed copy) is a tool used for large inter/intra-cluster copying. 
It uses Map/Reduce to effect its distribution, error handling and recovery, 
and reporting. It expands a list of files and directories into input to map tasks, 
each of which will copy a partition of the files specified in the source list.