7410 Commits

Author SHA1 Message Date
Andrew Wang
a17544e5e3 HDFS-7139. Unit test for creating encryption zone on root path. (Zhe Zhang via wang)
(cherry picked from commit 63198bfba7b899b33f26c079bc8241dad1bdbc57)
2014-09-24 16:40:40 -07:00
Allen Wittenauer
ea1fb1461a HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw) 2014-09-24 15:39:55 -07:00
cnauroth
6e5194099c HADOOP-11064. UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes. Contributed by Chris Nauroth.
(cherry picked from commit cbf0ae742ae3db964550df11c4044d3e16013959)
2014-09-24 15:33:18 -07:00
Karthik Kambatla
30165d4cdd YARN-2596. TestWorkPreservingRMRestart fails with FairScheduler. (kasha)
(cherry picked from commit 39c87344e16a08ab69e25345b3bce92aec92db47)
2014-09-24 15:24:17 -07:00
Andrew Wang
3cf28210ec HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. (Zhe Zhang via wang) 2014-09-24 12:11:45 -07:00
Haohui Mai
53c2288dc6 HDFS-7049. TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2. Contributed by Juan Yu. 2014-09-24 12:07:26 -07:00
Vinod Kumar Vavilapalli
5d251d99d6 YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.
(cherry picked from commit d78b452a4f413c6931a494c33df0666ce9b44973)
2014-09-24 11:29:01 -07:00
Jason Lowe
d5d9fd3255 MAPREDUCE-6104. TestJobHistoryParsing.testPartialJob fails in branch-2. Contributed by Mit Desai
(cherry picked from commit 7af4c3888bf7be0822dc880170e5e3d09e9280f1)
2014-09-24 16:10:28 +00:00
Allen Wittenauer
e5a531a8a7 YARN-2161. Fix build on macosx: YARN parts (Binglin Chang via aw) 2014-09-24 08:48:42 -07:00
Allen Wittenauer
151281bfca HDFS-6534. Fix build on macosx: HDFS parts (Binglin Chang via aw) 2014-09-24 08:35:31 -07:00
Karthik Kambatla
b34858c1f8 HADOOP-11017. Addendum to fix RM HA. KMS delegation token secret manager should be able to use zookeeper as store. (Arun Suresh via kasha)
(cherry picked from commit ef784a2e08c2452026a85ae382a956ff7deecbd0)
2014-09-23 17:08:23 -07:00
cnauroth
fd3003d63b HDFS-7130. TestDataTransferKeepalive fails intermittently on Windows. Contributed by Chris Nauroth.
(cherry picked from commit b93d9603a25b6b93f67c69503130164eef047876)
2014-09-23 14:44:26 -07:00
Andrew Wang
0d116b18de HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb.
(cherry picked from commit f48686a1ad81823000534665a76264bba51182f4)
2014-09-23 14:10:40 -07:00
Zhijie Shen
19cfe2f800 YARN-2569. Added the log handling APIs for the long running services. Contributed by Xuan Gong.
(cherry picked from commit 5338ac416ab8ab3e7e0a7bfb4a53151fc457f673)
2014-09-23 10:38:27 -07:00
cnauroth
ac3b62dae7 HDFS-7126. TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.
(cherry picked from commit a1fd804a314481065c849cb8e1d7c75494e24660)
2014-09-23 08:22:04 -07:00
Steve Loughran
273fb3a78c HADOOP-11111 MiniKDC to use locale EN_US for case conversions: hadoop-common/CHANGES.TXT 2014-09-23 10:56:55 +01:00
Steve Loughran
88792c1b29 HADOOP-11111 MiniKDC to use locale EN_US for case conversions 2014-09-23 10:54:58 +01:00
Karthik Kambatla
024bcfdc0d YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha)
(cherry picked from commit f5578207d2d20aa71adf12aa9f6c37b00ee9b8dc)
2014-09-23 00:03:47 -07:00
Karthik Kambatla
8ba8521de5 YARN-1959. Fix headroom calculation in FairScheduler. (Anubhav Dhoot via kasha)
(cherry picked from commit 568d3dc2bbe43b7d2833d5da2b0e6d75eb86e5dd)
2014-09-22 23:51:45 -07:00
junping_du
34ee084c3d YARN-2584. TestContainerManagerSecurity fails on trunk. (Contributed by Jian He)
(cherry picked from commit a9a55db0650b5e6b7d88afb883b88aba7a13cd44)
2014-09-22 22:47:59 -07:00
Colin Patrick Mccabe
cac7063b31 HDFS-7001. Tests in TestTracing should not depend on the order of execution. (iwasakims via cmccabe)
(cherry picked from commit 7b8df93ce1b7204a247e64b394d57eef748e73aa)
2014-09-22 17:22:42 -07:00
Karthik Kambatla
3984435661 YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha)
(cherry picked from commit 43efdd30b52f4ee8967a03dac4d548095d6cafdb)
2014-09-22 16:10:20 -07:00
Karthik Kambatla
24a814771e YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha)
(cherry picked from commit 23e17ce0ffba11a08c033b753573a756532cd1c2)
2014-09-22 15:42:36 -07:00
Colin Patrick Mccabe
d7b0e9382d HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe)
(cherry picked from commit 912ad32b03c1e023ab88918bfa8cb356d1851545)
2014-09-22 11:52:01 -07:00
Zhijie Shen
b8d645539d MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev. 2014-09-22 10:41:55 -07:00
Jian He
3ce97a9efd YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot
(cherry picked from commit 0a641496c706fc175e7bf66d69ebf71c7d078e84)
2014-09-22 10:32:44 -07:00
cnauroth
39bcc57c3e HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.
(cherry picked from commit 26cba7f35ff24262afa5d8f9ed22f3a7f01d9a71)
2014-09-22 09:07:41 -07:00
Jason Lowe
f4534746fb MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov
(cherry picked from commit 7039b98e1c459e9e0d8caa28cdaa2868e2bde2eb)
2014-09-22 15:22:58 +00:00
Karthik Kambatla
c1a3819a4d YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha)
(cherry picked from commit 9721e2c1feb5aecea3a6dab5bda96af1cd0f8de3)
2014-09-21 23:14:27 -07:00
Vinayakumar B
1fe3086bdb HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B)
(cherry picked from commit eab15af12c114eef4e9abd9af2ba03b0ab2cc441)
2014-09-22 11:29:04 +05:30
Karthik Kambatla
1714af0618 YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha)
(cherry picked from commit c50fc92502934aa2a8f84ea2466d4da1e3eace9d)
2014-09-21 13:15:45 -07:00
cnauroth
4a77729a1c HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth.
(cherry picked from commit b6fd5ccbce25f390c0e348d296b4fe1f8b9b738f)
2014-09-21 12:37:37 -07:00
cnauroth
465ba7fe31 HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth.
(cherry picked from commit 0795fe3721cf86ed89d5e9058c977a1113247d08)
2014-09-20 21:01:52 -07:00
cnauroth
3ad3f034bb HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth.
(cherry picked from commit 47491f9a119faf75abaa56f676ae93460583bd3f)
2014-09-20 20:53:38 -07:00
Alejandro Abdelnur
897ced1a20 HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu)
(cherry picked from commit db890eef3208cc557476fa510f7a253ba22bc68a)

Conflicts:
	hadoop-project/pom.xml
2014-09-20 08:24:34 -07:00
cnauroth
cadba3067f HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth.
(cherry picked from commit f85cc14eb49a46e81d2edcdc1ffe4d0852f193a5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
2014-09-19 22:04:13 -07:00
cnauroth
9ee5e26cbb HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang.
(cherry picked from commit 332e2e23ba6f0748a46c0bda76f426d9cad73edd)
2014-09-19 21:06:04 -07:00
Andrew Wang
eec927f3fc HADOOP-11112. TestKMSWithZK does not use KEY_PROVIDER_URI. (tucu via wang)
(cherry picked from commit b6ceef90e52c05fd95bfb40bff61fa7e1802787f)
2014-09-19 17:42:11 -07:00
Kihwal Lee
b55aa50ec6 HDFS-7046. HA NN can NPE upon transition to active. Contributed by
Kihwal Lee.
(cherry picked from commit 9e355719653c5e7b48b601090634882e4f29a743)
2014-09-19 17:08:30 -05:00
Andrew Wang
ee508c1b32 HADOOP-10970. Cleanup KMS configuration keys. (wang)
(cherry picked from commit adf0b67a7104bd457b20c95ff78dd48753dcd699)
2014-09-19 15:03:26 -07:00
Allen Wittenauer
0037b8f67b YARN-2460. Remove obsolete entries from yarn-default.xml (Ray Chiang via aw) 2014-09-19 14:08:04 -07:00
Jason Lowe
bdb864e5e1 MAPREDUCE-6091. YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view. Contributed by Sangjin Lee
(cherry picked from commit 951847ba94442b8d928435decfbea9ea20882912)
2014-09-19 20:17:44 +00:00
Allen Wittenauer
5f6129feb4 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) 2014-09-19 11:32:00 -07:00
Jian He
07981c8f60 YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen
(cherry picked from commit 444acf8ea795e4bc782f1ce3b5ef7a1a47d1d27d)
2014-09-19 11:28:22 -07:00
Colin Patrick Mccabe
5520ca6ec3 HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe)
(cherry picked from commit 25fd69a8f9defb21a5c0e3b7243657d9e8080319)
2014-09-19 09:20:55 -07:00
Kihwal Lee
35fccfda3e HDFS-7065. Pipeline close recovery race can cause block corruption.
Contributed by Kihwal Lee.
(cherry picked from commit bf27b9ca574592ef603e126bacb9b6a37c9eb5c6)
2014-09-19 09:01:27 -05:00
Kihwal Lee
2a6c9f0725 HDFS-6948. DN rejects blocks if it has older UC block. Contributed by
Eric Payne.
(cherry picked from commit f02d934fedf00f0ce43d6f3f9b06d89ccc6851a5)
2014-09-19 08:52:16 -05:00
Zhijie Shen
9333ee3068 YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.
(cherry picked from commit 6fe5c6b746a40019b9a43676c33efec0f971c4b9)
2014-09-18 22:02:53 -07:00
Andrew Wang
58d9cc0914 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang)
(cherry picked from commit 8e73084491c9f317bc8cc3590f93ca67a63687a8)
2014-09-18 18:14:10 -07:00
Aaron T. Myers
71e6a4a735 HADOOP-11109. Site build is broken. Contributed by Jian He.
(cherry picked from commit 0e2b64f2029cabbbf05a132625244427f8bf9518)
2014-09-18 18:00:07 -07:00