Yongjun Zhang
|
f028e3d7bc
|
HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit eddd823cd6 )
|
2016-01-29 12:13:18 -08:00 |
Yongjun Zhang
|
4c8131b1bf
|
HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a9c69ebeb7 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
|
2016-01-15 10:12:15 -08:00 |
Xiaoyu Yao
|
a9cbfd717c
|
HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore.
(cherry picked from commit c2e2e13455 )
|
2016-01-11 17:16:43 -08:00 |
Zhe Zhang
|
87d614c70b
|
HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
|
2016-01-11 09:57:01 -08:00 |
Akira Ajisaka
|
c5c663c05d
|
HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
(cherry picked from commit f94d892704 )
|
2015-11-13 21:53:23 +09:00 |
Kihwal Lee
|
dae9f0ef53
|
Addendum to MAPREDUCE-6451
(cherry picked from commit b24fe06483 )
|
2015-10-30 16:06:50 -05:00 |
Kihwal Lee
|
52819fe4ef
|
MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla.
(cherry picked from commit 2868ca0328 )
|
2015-10-30 14:57:57 -05:00 |
Haohui Mai
|
ee04add696
|
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
|
2015-10-13 15:24:29 -07:00 |
Haohui Mai
|
f6b0fcdc75
|
Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu."
This reverts commit a412edf5c4 .
|
2015-10-10 03:25:16 -07:00 |
Haohui Mai
|
a412edf5c4
|
HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu.
|
2015-10-09 22:38:13 -07:00 |
Harsh J
|
03e370e306
|
MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit 66dad854c0 )
|
2015-09-28 13:14:20 +05:30 |
Tsuyoshi Ozawa
|
52cc2ca488
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab )
|
2015-09-22 12:54:44 +09:00 |
Steve Loughran
|
988749e6ea
|
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
|
2015-09-13 14:25:06 +01:00 |
Yongjun Zhang
|
b085c5ef6f
|
HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp. (Yufei Gu via Yongjun Zhang)
(cherry picked from commit 0bc15cb6e6 )
|
2015-08-20 08:10:34 -07:00 |
Robert Kanter
|
3f79ee7494
|
HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter)
(cherry picked from commit aaafa0b2ee )
|
2015-06-30 16:50:42 -07:00 |
Colin Patrick Mccabe
|
3dec58dd78
|
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
(cherry picked from commit 7dba7005b7 )
|
2015-05-26 12:40:41 -07:00 |
Jing Zhao
|
5caea4cd46
|
HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase.
(cherry picked from commit 0790275f05 )
|
2015-05-18 13:26:09 -07:00 |
Ravi Prakash
|
122262a1fb
|
HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak)
|
2015-04-24 13:39:48 -07:00 |
Ravi Prakash
|
aa34aa5caa
|
HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak)
|
2015-04-21 16:50:40 -07:00 |
Jing Zhao
|
d4dd97eabd
|
HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao.
(cherry picked from commit 4c097e473b )
|
2015-04-15 12:39:09 -07:00 |
Colin Patrick Mccabe
|
386b90a700
|
HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe)
(cherry picked from commit 932730df7d )
|
2015-04-03 14:08:53 -07:00 |
Haohui Mai
|
9e114ee607
|
HDFS-8036. Use snapshot path as source when using snapshot diff report in DistCp. Contributed by Jing Zhao.
|
2015-04-01 16:51:09 -07:00 |
Tsuyoshi Ozawa
|
24b60a7d1a
|
HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula.
(cherry picked from commit e074952bd6 )
|
2015-03-27 23:16:37 +09:00 |
Yongjun Zhang
|
be0d228ed1
|
HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang)
(cherry-picked from commit 65ee02d9ed50e026c2d37ec80babd4176075ff84)
|
2015-03-25 15:50:28 -07:00 |
Tsuyoshi Ozawa
|
77297017d8
|
HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
(cherry picked from commit ef9946cd52 )
|
2015-03-17 16:09:38 +09:00 |
Tsuyoshi Ozawa
|
b46f9e72db
|
HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa)
|
2015-03-09 19:53:55 +09:00 |
Tsuyoshi Ozawa
|
ccde4aed18
|
MAPREDUCE-5657. Backport '[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments.' Contributed by Akira AJISAKA.
|
2015-03-09 12:00:04 +09:00 |
Jing Zhao
|
b2ccf54c14
|
HDFS-7535. Utilize Snapshot diff report for distcp. Contributed by Jing Zhao.
(cherry picked from commit ed70fa142c )
|
2015-03-04 10:32:39 -08:00 |
Vinod Kumar Vavilapalli
|
6604613bc5
|
MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public API in DistCp. Contributed by Jing Zhao.
(cherry picked from commit 5af693fde2 )
|
2015-03-03 16:29:36 -08:00 |
Akira Ajisaka
|
f7a724ca9e
|
HADOOP-10976. Backport "moving the source code of hadoop-tools docs to the directory under hadoop-tools" to branch-2. Contributed by Masatake Iwasaki.
(cherry picked from commit 9112f093cd )
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
|
2015-02-28 17:06:58 -08:00 |
Haohui Mai
|
a1e4a12dc0
|
HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu.
|
2014-12-09 20:46:44 -08:00 |
Jing Zhao
|
582f96e41d
|
HADOOP-11354. ThrottledInputStream doesn't perform effective throttling. Contributed by Ted Yu.
|
2014-12-08 11:09:34 -08:00 |
Allen Wittenauer
|
afde00a0f5
|
MAPREDUCE-6109. Fix minor typo in distcp -p usage text (Charles Lamb via aw)
|
2014-09-25 11:28:50 -07:00 |
Allen Wittenauer
|
ea1fb1461a
|
HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw)
|
2014-09-24 15:39:55 -07:00 |
Alejandro Abdelnur
|
c77bd85b62
|
HDFS-6134 and HADOOP-10150 subtasks.
|
2014-08-28 15:03:08 -07:00 |
Andrew Wang
|
59c91b22d7
|
MAPREDUCE-5971. Move the default options for distcp -p to DistCpOptionSwitch. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1611218 13f79535-47bb-0310-9956-ffa450edef68
|
2014-07-16 23:43:00 +00:00 |
Andrew Wang
|
a18dce22b9
|
HADOOP-10666. Remove Copyright /d/d/d/d Apache Software Foundation from the source files license header. Contributed by Henry Saputra.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1603026 13f79535-47bb-0310-9956-ffa450edef68
|
2014-06-16 23:27:03 +00:00 |
Uma Maheswara Rao G
|
2f25a4f3a4
|
Merged from trunk to branch-2. MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1602116 13f79535-47bb-0310-9956-ffa450edef68
|
2014-06-12 10:59:28 +00:00 |
Jing Zhao
|
50acb4032f
|
MAPREDUCE-5899. Merge change r1596931 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1596937 13f79535-47bb-0310-9956-ffa450edef68
|
2014-05-22 18:50:20 +00:00 |
Chris Nauroth
|
d20f565b4c
|
MAPREDUCE-5809. Merging change r1595283 from trunk to branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1595290 13f79535-47bb-0310-9956-ffa450edef68
|
2014-05-16 18:32:15 +00:00 |
Tsz-wo Sze
|
6b7d074a54
|
svn merge -c 1592703 from trunk for MAPREDUCE-5402. In DynamicInputFormat, change MAX_CHUNKS_TOLERABLE, MAX_CHUNKS_IDEAL, MIN_RECORDS_PER_CHUNK and SPLIT_RATIO to be configurable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1592704 13f79535-47bb-0310-9956-ffa450edef68
|
2014-05-06 10:25:10 +00:00 |
Jonathan Turner Eagles
|
e0cd544a53
|
MAPREDUCE-5639. Port DistCp2 document to trunk (Akira AJISAKA via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1590131 13f79535-47bb-0310-9956-ffa450edef68
|
2014-04-25 20:32:09 +00:00 |
Chris Nauroth
|
f0d3664d83
|
MAPREDUCE-5852. Merging change r1589006 from trunk to branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1589007 13f79535-47bb-0310-9956-ffa450edef68
|
2014-04-21 23:49:28 +00:00 |
Aaron Myers
|
c5b5947777
|
HADOOP-10459. distcp V2 doesn't preserve root dir's attributes when -p is specified. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1584233 13f79535-47bb-0310-9956-ffa450edef68
|
2014-04-03 00:56:12 +00:00 |
Aaron Myers
|
71a7f2b72b
|
MAPREDUCE-5014. Extending DistCp through a custom CopyListing is not possible. (Contributed by Srikanth Sundarrajan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1584232 13f79535-47bb-0310-9956-ffa450edef68
|
2014-04-03 00:49:52 +00:00 |
Jing Zhao
|
d611f42c37
|
Merge r1578669 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1578676 13f79535-47bb-0310-9956-ffa450edef68
|
2014-03-18 00:10:22 +00:00 |
Jing Zhao
|
c21e39b79b
|
HADOOP-10295. Merge change r1563019 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1563020 13f79535-47bb-0310-9956-ffa450edef68
|
2014-01-30 23:58:56 +00:00 |
Daryn Sharp
|
92fc940ea8
|
svn merge -c 1548175 FIXES: HADOOP-10129. Distcp may succeed when it fails (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1548176 13f79535-47bb-0310-9956-ffa450edef68
|
2013-12-05 15:51:28 +00:00 |
Jonathan Turner Eagles
|
f35f88b1cf
|
MAPREDUCE-5586. TestCopyMapper#testCopyFailOnBlockSizeDifference fails when run from hadoop-tools/hadoop-distcp directory (jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1532890 13f79535-47bb-0310-9956-ffa450edef68
|
2013-10-16 20:28:13 +00:00 |
Jonathan Turner Eagles
|
85b5e96f10
|
MAPREDUCE-5585. TestCopyCommitter#testNoCommitAction Fails on JDK7 (jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1532878 13f79535-47bb-0310-9956-ffa450edef68
|
2013-10-16 20:06:53 +00:00 |