Commit Graph

10878 Commits

Author SHA1 Message Date
Jason Lowe de31bff67d MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
(cherry picked from commit 9fbd579ab5)
2016-01-15 16:54:03 +00:00
Junping Du a03532e04e YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.
(cherry picked from commit fc6d3a3b23)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit e09222306f)
2016-01-15 08:53:48 -08:00
Akira Ajisaka 8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b53173)
2016-01-15 10:58:20 +09:00
Akira Ajisaka 91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran 1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel)
(cherry picked from commit 80734bc346)
2016-01-15 10:41:56 +09:00
Jason Lowe 4ab508ead4 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf8895259)
2016-01-14 23:48:12 +00:00
Jason Lowe fe77cb1df0 Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
(cherry picked from commit 651c23e8ef)
2016-01-14 23:43:09 +00:00
Benoy Antony 6cfeb84a36 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-14 14:42:04 -08:00
Benoy Antony 6ceee07357 HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang. 2016-01-14 14:42:04 -08:00
Benoy Antony 5a50651e5b HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore. 2016-01-14 14:42:04 -08:00
Arpit Agarwal 3266709b5d HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou) 2016-01-14 14:18:21 -08:00
Yongjun Zhang f2eea3a1b4 HDFS-9648. TestStartup.testImageChecksum is broken by HDFS-9569's message change. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit 817cc1f02a)
2016-01-14 13:06:23 -08:00
Yongjun Zhang a7d33b934a Revert "HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge."
This reverts commit b3fa190297.
2016-01-14 13:06:03 -08:00
Akira Ajisaka 6816481c72 MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki.
(cherry picked from commit 5cc44d18aa)
(cherry picked from commit 7c4be15991)
2016-01-15 00:44:52 +09:00
Akira Ajisaka b3fa190297 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit 722d9e569ee6891e71274e758474063f25f5babf)
2016-01-15 00:32:07 +09:00
Akira Ajisaka 4417c3b6d2 YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
(cherry picked from commit 62b0d61513)
(cherry picked from commit ffca0ebfff)
2016-01-14 14:00:18 +09:00
Akira Ajisaka d4d368d4e8 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
(cherry picked from commit 7b0964f354)
(cherry picked from commit 6efee8907a)
2016-01-14 10:41:45 +09:00
Lei Xu 894345e2f0 HDFS-9493. Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk. (Tony Wu via lei)
(cherry picked from commit fd8065a763)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestMetaSave.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManagerTestUtil.java
2016-01-13 16:34:13 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) e3e09aa1e7 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
Putting CHANGES.txt entry under 2.6.3 after the backport.
2016-01-13 15:05:43 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
2016-01-13 14:56:35 -08:00
Kihwal Lee 8df0db3d18 Supplement to HDFS-9047.
(cherry picked from commit c722b62908)
2016-01-13 11:09:50 -06:00
Jason Lowe a22a7f61e4 MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
(cherry picked from commit f657b54281)
2016-01-12 23:59:06 +00:00
cnauroth c3f4cb927a HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
(cherry picked from commit 2605e78e44)
2016-01-12 15:42:00 -08:00
Lei Xu 39f07295fb HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
(cherry picked from commit 126705f67e)
2016-01-12 12:21:00 -08:00
Yongjun Zhang 6650387bfb HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang)
(cherry picked from commit 25051c3bd0)
2016-01-12 09:23:40 -08:00
Jason Lowe a8292161fc YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
(cherry picked from commit 13de8359a1)
2016-01-12 15:57:44 +00:00
Jason Lowe 7c419bc9e5 Update CHANGES.txt for recent commits to 2.7 and 2.6
(cherry picked from commit c77c35f83c)
2016-01-12 15:45:37 +00:00
Wangda Tan 00fca06b43 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
(cherry picked from commit 9e792da014)
2016-01-12 12:56:12 +08:00
Akira Ajisaka 3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
2016-01-12 13:35:03 +09:00
Xiaoyu Yao 74c05e5359 Correct commit message for HDFS-9584
(cherry picked from commit 103d3cfc4e)
2016-01-11 19:01:11 -08:00
Xiaoyu Yao a9cbfd717c HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore.
(cherry picked from commit c2e2e13455)
2016-01-11 17:16:43 -08:00
Jian He 8172921f6d Missing file for YARN-4580 2016-01-11 17:00:17 -08:00
Jian He e73bf71e10 YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S
(cherry picked from commit b8942be888)
2016-01-11 16:45:48 -08:00
Arpit Agarwal 319c71b89b HDFS-9639. Fix up CHANGES.txt 2016-01-11 15:11:30 -08:00
Arpit Agarwal 476f7d0be3 HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou) 2016-01-11 15:10:21 -08:00
Jason Lowe bf6d50cda3 Add MR-5982 and MR-6492 to 2.6.4
(cherry picked from commit e5df366707)
2016-01-11 18:33:25 +00:00
Zhe Zhang 87d614c70b HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
2016-01-11 09:57:01 -08:00
Junping Du d7e10f8174 MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
(cherry picked from commit 8c1adeaa26)
(cherry picked from commit 51073c910c)
2016-01-11 06:14:58 -08:00
cnauroth e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fcea)
(cherry picked from commit 813841e10b)
2016-01-09 22:18:30 -08:00
cnauroth f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b)
(cherry picked from commit debd13387d)
2016-01-08 20:19:18 -08:00
Jian He 17d29b515f YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S
(cherry picked from commit 109e528ef5)
2016-01-08 15:52:03 -08:00
Zhe Zhang eef26388ca HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen.
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
2016-01-08 13:20:02 -08:00
Kihwal Lee d1cbc8442c HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee.
(cherry picked from commit 38c4c14472)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-01-08 11:16:40 -06:00
Akira Ajisaka 852033ca62 YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.
(cherry picked from commit 52b77577c4)
(cherry picked from commit 3905435d3d)
2016-01-08 01:13:44 +09:00
Steve Loughran 092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
Vinayakumar B 3303326dd9 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang)
(cherry picked from commit 6702e7d66a)
(cherry picked from commit 08f39bd5d1)
2016-01-07 14:21:18 +05:30
Vinayakumar B a14baa05b0 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang)
(cherry picked from commit 34cd7cd765)
(cherry picked from commit aa710bd461)
2016-01-07 12:11:55 +05:30
Haohui Mai bb6f03d597 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:39:51 -08:00
cnauroth 506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2)
(cherry picked from commit 4753676a34)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-06 11:17:01 -08:00
Sangjin Lee ae535ec93e MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
(cherry picked from commit f6f16118d3)
(cherry picked from commit 28fd4c70ca)
2016-01-06 08:44:37 -08:00