Commit Graph

10673 Commits

Author SHA1 Message Date
Karthik Kambatla a1ff0b4145 YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)
(cherry picked from commit 321072ba81)
2016-01-13 12:09:58 -08:00
Kihwal Lee 2ea99ee35f Supplement to HDFS-9047.
(cherry picked from commit c722b62908)
2016-01-13 11:09:17 -06:00
Wangda Tan c0b97865e8 YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
(cherry picked from commit c0537bcd2c)
2016-01-13 13:19:01 +08:00
Jason Lowe 0af01092b6 MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
(cherry picked from commit f657b54281)
2016-01-12 23:58:01 +00:00
cnauroth 2605e78e44 HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
2016-01-12 15:41:46 -08:00
Lei Xu 63b8be149a HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 2016-01-12 12:21:29 -08:00
Colin Patrick Mccabe 181437cccf HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP address (cmccabe)
(cherry picked from commit 30c7dfd8ba)
2016-01-12 10:46:57 -08:00
Yongjun Zhang 5e2416b901 HDFS-9569. Log the name of the fsimage being loaded for better supportability. (Yongjun Zhang)
(cherry picked from commit 25051c3bd0)
2016-01-12 09:24:54 -08:00
Jason Lowe d164cdcda1 YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
(cherry picked from commit 13de8359a1)
2016-01-12 15:57:07 +00:00
Jason Lowe 8d34d899e4 Update CHANGES.txt for recent commits to 2.7 and 2.6
(cherry picked from commit c77c35f83c)
2016-01-12 15:45:21 +00:00
Jing Zhao 313f03bfda HDFS-9621. Consolidate FSDirStatAndListingOp#createFileStatus to let its INodesInPath parameter always include the target INode. Contributed by Jing Zhao. 2016-01-11 22:48:36 -08:00
Akira Ajisaka 93b7ef8aec YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67.
(cherry picked from commit da1e3e3c57)
2016-01-12 15:13:38 +09:00
Wangda Tan 15e174fe79 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
(cherry picked from commit 9e792da014)
2016-01-12 12:54:09 +08:00
Akira Ajisaka df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
2016-01-12 13:34:44 +09:00
Xiaoyu Yao c5f63e637a Correct commit message for HDFS-9584
(cherry picked from commit 103d3cfc4e)
2016-01-11 19:00:17 -08:00
Xiaoyu Yao 521f60c094 HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore.
(cherry picked from commit c2e2e13455)
2016-01-11 17:12:43 -08:00
Jian He c4aed35200 Missing file for YARN-4580 2016-01-11 17:05:11 -08:00
Jian He 591e7fb221 YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S
(cherry picked from commit b8942be888)
2016-01-11 16:45:14 -08:00
Arpit Agarwal 68a32a79b5 HDFS-9639. Inconsistent Logging in BootstrapStandby. (Contributed by Xiaobing Zhou) 2016-01-11 15:09:43 -08:00
Jason Lowe 6944e7ef44 Add MR-5982 and MR-6492 to 2.6.4
(cherry picked from commit e5df366707)
2016-01-11 18:32:48 +00:00
Zhe Zhang 17dfa04be6 HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-01-11 09:53:20 -08:00
Junping Du 51073c910c MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
(cherry picked from commit 8c1adeaa26)
2016-01-11 06:13:53 -08:00
Rohith Sharma K S da42b01645 Add YARN-3849 to Release 2.6.4 entry in CHANGES.txt
(cherry picked from commit 76e7270851)
2016-01-11 12:18:12 +05:30
cnauroth 813841e10b HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fcea)
2016-01-09 22:18:22 -08:00
Benoy Antony 4e5f77b7f5 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony)
(cherry picked from commit dec8dfdfa6)
2016-01-09 13:43:15 -08:00
Steve Loughran 80734bc346 HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 2016-01-09 11:10:20 +00:00
cnauroth debd13387d HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b)
2016-01-08 20:19:11 -08:00
Jian He d4ff8fd5d8 YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S
(cherry picked from commit 109e528ef5)
2016-01-08 15:51:33 -08:00
Lei Xu 699d420497 HDFS-9493. Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk. (Tony Wu via lei)
(cherry picked from commit fd8065a763)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestMetaSave.java
2016-01-08 15:10:41 -08:00
Zhe Zhang 40dabae236 HDFS-9626. TestBlockReplacement#testBlockReplacement fails occasionally. Contributed by Xiao Chen.
Change-Id: I5cee398dfc361121d8b666ffd1203cc14a4ace24
2016-01-08 13:19:14 -08:00
Kihwal Lee 8d04b7c272 HDFS-9574. Reduce client failures during datanode restart. Contributed by Kihwal Lee.
(cherry picked from commit 38c4c14472)
2016-01-08 11:15:12 -06:00
rohithsharmaks 20bb5c403e Revert "HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)"
This reverts commit 2b252844e0.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit ed18527e38)
2016-01-08 14:37:01 +05:30
Xuan 2cbbf76c3d YARN-4438. Implement RM leader election with curator. Contributed by Jian He
(cherry picked from commit 89022f8d4b)
2016-01-07 14:34:14 -08:00
Steve Loughran ee9611719f HADOOP-12573. TestRPC.testClientBackOff failing. (Xiao Chen via stevel) 2016-01-07 16:18:25 +00:00
Akira Ajisaka 3905435d3d YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.
(cherry picked from commit 52b77577c4)
2016-01-08 01:13:30 +09:00
Steve Loughran c6f7c30a8d HADOOP-12597. In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name. (Surendra Singh Lilhore via stevel) 2016-01-07 16:00:37 +00:00
Steve Loughran c329cab92c HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel) 2016-01-07 15:03:59 +00:00
Steve Loughran 38181e1dcd HADOOP-12655. TestHttpServer.testBindAddress patch - move from improvement to bug fix 2016-01-07 15:03:05 +00:00
Steve Loughran 83932ced71 HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider than expected. (Wei-Chiu Chuang via stevel) 2016-01-07 14:51:34 +00:00
Steve Loughran ccd2be99cc HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. (BELUGA BEHR via stevel) 2016-01-07 14:45:19 +00:00
Steve Loughran 29747001f0 HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:47 +00:00
Steve Loughran d9459ffa00 YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel) 2016-01-07 14:30:07 +00:00
Vinayakumar B 08f39bd5d1 HDFS-9619. SimulatedFSDataset sometimes can not find blockpool for the correct namenode (Contributed by Wei-Chiu Chuang)
(cherry picked from commit 6702e7d66a)
2016-01-07 14:20:39 +05:30
Vinayakumar B aa710bd461 HDFS-9600. do not check replication if the block is under construction (Contributed by Phil Yang)
(cherry picked from commit 34cd7cd765)
2016-01-07 11:30:57 +05:30
rohithsharmaks 2c841e6564 HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)
(cherry picked from commit 2b252844e0)
2016-01-07 10:43:52 +05:30
rohithsharmaks 4865642e7c YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
(cherry picked from commit 791c1639ae)
2016-01-07 09:39:37 +05:30
Haohui Mai 71006d5c22 HDFS-9047. Retire libwebhdfs. Contributed by Haohui Mai. 2016-01-06 16:13:43 -08:00
Junping Du 818cd0e90d Add YARN-2975, YARN-3893, YARN-2902 and YARN-4354 to Release 2.6.4 entry in CHANGES.txt
(cherry picked from commit b6c9d3fab9)
2016-01-06 14:28:43 -08:00
cnauroth 4753676a34 HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2)
2016-01-06 11:16:18 -08:00
Arpit Agarwal 2e6990cdf2 HDFS-9498. Move code that tracks blocks with future generation stamps to BlockManagerSafeMode. (Contributed by Mingliang Liu) 2016-01-06 10:44:51 -08:00