Commit Graph

17843 Commits

Author SHA1 Message Date
Inigo Goiri 7336d0123d HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack.
(cherry picked from commit 8783613696)
2018-05-17 19:27:51 -07:00
Inigo Goiri cdc16b3a2f HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
(cherry picked from commit 53b807a6a8)
2018-05-17 17:04:23 -07:00
Inigo Goiri ccd7d50faf HDFS-13556. TestNestedEncryptionZones does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit a97a2042f2)
2018-05-17 16:54:17 -07:00
Inigo Goiri 6b2d86debe HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 65476458fa)
2018-05-17 14:49:03 -07:00
Inigo Goiri d3457b38e6 HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 26f1e22fc9)
2018-05-17 13:36:16 -07:00
Inigo Goiri fb0a258b3c HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu.
(cherry picked from commit c0ec061e28)
2018-05-17 09:22:48 -07:00
Kihwal Lee 0943112d85 HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee.
(cherry picked from commit 0ce6290de6)
2018-05-17 09:28:17 -05:00
Inigo Goiri fcf0b6a8dd HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu.
(cherry picked from commit 454de3b543)
2018-05-16 19:24:00 -07:00
Inigo Goiri 16e89a2771 HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 55d5549087)
2018-05-16 10:10:08 -07:00
Inigo Goiri 0a2cdd2730 HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 6b67161ca3)
2018-05-16 09:32:39 -07:00
Inigo Goiri eadfb55195 HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu.
(cherry picked from commit 63480976a0)
2018-05-15 15:36:30 -07:00
Inigo Goiri 1b4c39fd2f HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 2d6195c0af)
2018-05-15 11:22:12 -07:00
Inigo Goiri d1b17f997c HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu.
(cherry picked from commit eaca7980ad)
2018-05-15 10:29:04 -07:00
Inigo Goiri 9a722150c6 HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 92ebd466c7)
2018-05-15 10:22:52 -07:00
Weiwei Yang c48dce09a2 YARN-8278. DistributedScheduling is not working in HA. Contributed by Bibin A Chundatt.
(Cherry picked from commit 2bb647bb91)
2018-05-15 18:55:31 +08:00
Haibo Chen 237078c7d6 YARN-8130 Race condition when container events are published for KILLED applications. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 2d00a0c71b)
2018-05-15 11:50:47 +05:30
Hanisha Koneru b00c0a08a3 HDFS-13544. Improve logging for JournalNode in federated cluster.
(cherry picked from commit 6beb25ab7e)
2018-05-14 10:16:06 -07:00
Xiao Chen 220e38ec02 HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure.
(cherry picked from commit 960940e0e0)
2018-05-14 09:29:22 -07:00
Naganarasimha ee7b2fd5de YARN-8288. Fix wrong number of table columns in Resource Model doc. Contributed by Weiwei Yang.
(cherry picked from commit 8a2b5914f3)
2018-05-15 00:12:45 +08:00
Sammi Chen a700d05f72 Add 2.9.1 release notes and changes documents
(cherry picked from commit f3f544b004)
2018-05-14 15:18:19 +08:00
Vrushali C 67255cd000 YARN-8247 Incorrect HTTP status code returned by ATSv2 for non-whitelisted users. Contributed by Rohith Sharma K S
(cherry picked from commit 3c95ca4f21)
2018-05-14 10:32:33 +05:30
Rushabh Shah 9519c2ce1e HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota
(cherry picked from commit a5449d3631)
2018-05-12 12:26:25 -05:00
Jason Lowe e628206c26 YARN-8244. TestContainerSchedulerQueuing.testStartMultipleContainers failed. Contributed by Jim Brennan
(cherry picked from commit dc912994a1)
2018-05-11 14:17:19 -05:00
Inigo Goiri 3b57a236ed HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu.
(cherry picked from commit d50c4d71dc)
2018-05-11 09:49:21 -07:00
Weiwei Yang 4e46dc764f YARN-7003. DRAINING state of queues is not recovered after RM restart. Contributed by Tao Yang. 2018-05-11 11:04:50 +08:00
Inigo Goiri 054a17387c HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang.
(cherry picked from commit 1da8d4190d)
2018-05-10 09:42:01 -07:00
Inigo Goiri d72a4b6303 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 1049e180a7.
2018-05-10 09:24:45 -07:00
bibinchundatt c198550cc7 YARN-8201. Skip stacktrace of few exception from ClientRMService. Contributed by Bilwa S T.
(cherry picked from commit cc0310a526)
2018-05-10 09:32:45 +05:30
Inigo Goiri e466b4e2a7 HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang.
(cherry picked from commit 914b98a713)
2018-05-09 16:53:09 -07:00
Inigo Goiri 1049e180a7 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit 63803e7051)
2018-05-09 13:56:58 -07:00
Yongjun Zhang 21bf02023c Revert "HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem"
This reverts commit 218a21a0f0.
2018-05-08 22:22:06 -07:00
Rohith Sharma K S f13ec73c29 YARN-8253. HTTPS Ats v2 api call fails with 'bad HTTP parsed'. Contributed by Charan Hebri.
(cherry picked from commit 7450583721)
2018-05-08 12:32:25 +05:30
Xiao Chen fe66ed7da5 HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi.
(cherry picked from commit 696a4be0da)
2018-05-07 15:39:33 -07:00
Xiao Chen 08cb6548c0 Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah."
This reverts commit 583fa6ed48.

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit f9692eecf0029a1682ffda48551ac45507144ff0)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit 752092a860)
2018-05-07 13:56:26 -07:00
Xiao Chen 22384580b2 Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445."
This reverts commit 9f19c3b03e.
2018-05-07 13:56:26 -07:00
Weiwei Yang a0b7abf278 YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty. Contributed by Tao Yang.
(Cherry picked from commit 67f239c42f)
2018-05-07 13:59:50 +08:00
Rushabh Shah d9fae993b4 HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah
(cherry picked from commit 4cdbdce752)
2018-05-04 15:43:24 -05:00
Inigo Goiri 21442dcaa3 HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin.
(cherry picked from commit a3b416f69d)
2018-05-03 11:26:00 -07:00
Rohith Sharma K S 317deaafc4 YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad.
(cherry picked from commit ee2ce923a9)
2018-05-03 18:21:11 +05:30
Daniel Templeton 184ecec29c HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently
(Contributed by Gabor Bota via Daniel Templeton)

Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204
(cherry picked from commit 87c23ef643)
(cherry picked from commit 57e4115436)
2018-05-02 17:18:59 -07:00
Weiwei Yang c2ed611885 YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang.
(Cherry picked from commit 251f528814)
2018-05-02 18:07:34 +08:00
Yiqun Lin 01e924a2ce
YARN-6385. Fix checkstyle warnings in TestFileSystemApplicationHistoryStore
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3265b55119)
2018-05-02 18:16:09 +09:00
Jason Lowe e5ef506dc1
HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e07156e8b0)
2018-05-02 17:32:26 +09:00
Bibin A Chundatt e6e2146ae0
MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 1a95a4524a)
2018-05-02 16:35:18 +09:00
Yiqun Lin 221db515aa HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri.
(cherry picked from commit 37269261d1)
(cherry picked from commit 5fef28d0d4)
2018-05-02 15:06:53 +08:00
Inigo Goiri d5aa4b9a9a HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang.
(cherry picked from commit 9e2cfb2d3f)
2018-05-01 08:14:14 -07:00
Weiwei Yang f12c78120e YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang.
(Cherry picked from commit 2d319e3793)
2018-05-01 10:19:08 +08:00
Inigo Goiri 0e31e014f3 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 2018-04-30 15:22:30 -07:00
Inigo Goiri af9bc982ce HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang.
(cherry picked from commit eb7fe1d588)
2018-04-28 09:06:58 -07:00
Inigo Goiri d83254312b HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S.
(cherry picked from commit 484440602c)
2018-04-27 16:29:23 -07:00