5151 Commits

Author SHA1 Message Date
Inigo Goiri
06c87edf51 HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak.
(cherry picked from commit 8d4926f38bf53b32453cd2bc7322c8818f752f85)
2018-06-14 10:00:26 -07:00
Rohith Sharma K S
0af3bea05d YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
(cherry picked from commit 2df73dace06cfd2b3193a14cd455297f8f989617)
2018-06-12 17:30:02 +05:30
Inigo Goiri
8059390798 HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam. 2018-06-11 13:47:08 -07:00
Chao Sun
4049fa37af HDFS-13664. Refactor ConfiguredFailoverProxyProvider to make inheritance easier. Contributed by Chao Sun.
(cherry picked from commit fba1c42adc1c8ae57951e1865ec2ab05c8707bdf)
2018-06-08 16:44:36 -07:00
Yiqun Lin
1465830f7e HDFS-13644. Backport HDFS-10376 to branch-2. Contributed by Zsolt Venczel. 2018-06-07 18:10:52 +08:00
Inigo Goiri
65d6943b4f HDFS-13652. Randomize baseDir for MiniDFSCluster in TestBlockScanner. Contributed by Anbang Hu.
(cherry picked from commit a28848104f2a067669f9b1706cd0da05ba71bcb7)
2018-06-04 18:14:34 -07:00
Rushabh Shah
0caf40efe5 HDFS-13281 Namenode#createFile should be /.reserved/raw/ aware.. Contributed by Rushabh S Shah
(cherry picked from commit e2289c8d1496a5eff88e6bcb8776a11d45371ffc)
(cherry picked from commit 4ecb7aaf77d3f63e2ee006b32f5e25e95fde1831)
2018-06-04 10:07:24 -05:00
Inigo Goiri
c8f183edd3 HDFS-13637. RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE. Contributed by CR Hota.
(cherry picked from commit e11d67404945d80db2eb8a99453606419dbdc938)
2018-06-01 17:01:02 -07:00
Chao Sun
87e805ba4d HDFS-13602. Add checkOperation(WRITE) checks in FSNamesystem. Contributed by Chao Sun.
(cherry picked from commit ff013d2c952272f3176dcf624251b05d610503b5)
2018-05-31 17:44:39 -07:00
Inigo Goiri
6b9ef2d5b7 HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA. Contributed by Anbang Hu. 2018-05-30 10:10:25 -07:00
Yiqun Lin
cb962139ee HDFS-13626. Fix incorrect username when deny the setOwner operation. Contributed by Zsolt Venczel. 2018-05-30 16:55:39 +08:00
Inigo Goiri
86736cb279 HDFS-13591. TestDFSShell#testSetrepLow fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 9dbf4f01665d5480a70395a24519cbab5d4db0c5)
2018-05-28 16:36:06 -07:00
Inigo Goiri
27091d2d16 HDFS-13620. Randomize the test directory path for TestHDFSFileSystemContract. Contributed by Anbang Hu. 2018-05-25 19:48:16 -07:00
Inigo Goiri
1542484161 HDFS-13618. Fix TestDataNodeFaultInjector test failures on Windows. Contributed by Xiao Liang.
(cherry picked from commit a8e9ee3fdf3aa1b889dfdd3bade91ba754ed9ee1)
2018-05-25 09:12:44 -07:00
Andrew Wang
097347c857 HDFS-13611. Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient.
(cherry picked from commit c9b63deb533274ca8ef4939f6cd13f728a067f7b)
2018-05-24 09:56:54 -07:00
Inigo Goiri
c5ff9553fb HDFS-13587. TestQuorumJournalManager fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit c13dea87d9de7a9872fc8b0c939b41b1666a61e5)
2018-05-23 11:37:55 -07:00
Inigo Goiri
411a2f609b HDFS-13588. Fix TestFsDatasetImpl test failures on Windows. Contributed by Xiao Liang. 2018-05-23 09:48:35 -07:00
Andrew Wang
0f0d29a8d1 HDFS-13601. Optimize ByteString conversions in PBHelper. 2018-05-22 23:58:11 -07:00
Inigo Goiri
8f45d119a1 HDFS-13590. Backport HDFS-12378 to branch-2. Contributed by Lukas Majercak. 2018-05-18 11:07:12 -07:00
Inigo Goiri
1af41dadc2 HDFS-13593. TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 9775ecb2355d7bed3514fcd54bf69e8351c4ab99)
2018-05-18 09:47:50 -07:00
Inigo Goiri
b0e0ec1648 HDFS-13592. TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly. Contributed by Anbang Hu.
(cherry picked from commit 57b893de3d36d20f65ee81b5cc3cfef12594b75b)
2018-05-18 09:40:10 -07:00
Inigo Goiri
a5ec44c655 HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
(cherry picked from commit 53b807a6a8486cefe0b036f7893de9f619bd44a1)
2018-05-17 17:04:59 -07:00
Inigo Goiri
6df8fa1bc9 HDFS-13556. TestNestedEncryptionZones does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit a97a2042f210e9db97646baad6f56064d672f447)
2018-05-17 16:55:01 -07:00
Inigo Goiri
315ffd1ada HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 65476458fa05656010809be632356e4015b59a17)
2018-05-17 14:49:37 -07:00
Inigo Goiri
b87cd6354b HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 26f1e22fc9ee326e9c76503d347552faeb6c2d3b)
2018-05-17 13:36:53 -07:00
Inigo Goiri
33dfbed8d2 HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu.
(cherry picked from commit c0ec061e280c0d3e5299c0735c8b8697e0f31216)
2018-05-17 09:23:11 -07:00
Kihwal Lee
033b25cbe9 HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee.
(cherry picked from commit 0ce6290de6a08beab01cb5184d366d97c9abd811)
2018-05-17 09:29:08 -05:00
Inigo Goiri
d2a3bd1430 HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu.
(cherry picked from commit 454de3b543c8b00a9ab566c7d1c64d7e4cffee0f)
2018-05-16 19:24:36 -07:00
Inigo Goiri
9c96822096 HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 55d5549087183cb9c8d805e33267acabe9537667)
2018-05-16 10:10:37 -07:00
Inigo Goiri
d163f72310 HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu. 2018-05-16 09:33:16 -07:00
Inigo Goiri
3d48a895a6 HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu.
(cherry picked from commit 63480976a008bab0b84f4da08b1099867e5a9a6b)
2018-05-15 15:36:58 -07:00
Inigo Goiri
cdb80d6dcb HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu.
(cherry picked from commit 2d6195c0af4a1840172899ce70bca4ca549eb713)
2018-05-15 11:22:41 -07:00
Inigo Goiri
cc9203615a HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu.
(cherry picked from commit eaca7980ad2a750f6b0025a706062740c2ddded2)
2018-05-15 10:29:44 -07:00
Inigo Goiri
4ae1ed5b17 HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu.
(cherry picked from commit 92ebd466c75275118107e6ec665cf50e337a29e7)
2018-05-15 10:23:28 -07:00
Hanisha Koneru
c998c126b8 HDFS-13544. Improve logging for JournalNode in federated cluster.
(cherry picked from commit 6beb25ab7e4f5454dba0315a296081e61753f301)
2018-05-14 10:21:59 -07:00
Sammi Chen
eabc588d22 Add 2.9.1 release notes and changes documents 2018-05-14 15:36:30 +08:00
Inigo Goiri
d88d9f2874 HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu. 2018-05-11 09:50:40 -07:00
Yiqun Lin
11794e5eda HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota. 2018-05-11 18:56:59 +08:00
Yiqun Lin
b83ff77409 Revert "HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota."
This reverts commit d4a141e7b014f23d2b3bb1aa215a8799fdc5315e.
2018-05-11 18:53:12 +08:00
Yiqun Lin
d4a141e7b0 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota.
(cherry picked from commit a922b9c82cc564e86dc0ef84bcc3597cb7b7c211)
2018-05-11 15:06:45 +08:00
Chris Douglas
b2acaa52d2 HDFS-13272. DataNodeHttpServer to have configurable HttpServer2 threads. Contributed by Erik Krogen 2018-05-10 14:53:39 -07:00
Inigo Goiri
a756d3e7c8 HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang.
(cherry picked from commit 914b98a713f70667d4380ac752f6c4de931520d9)
2018-05-09 16:53:45 -07:00
Xiao Chen
5679920793 HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi.
(cherry picked from commit 696a4be0daac00dd3bb64801d9fbe659aef9e089)
2018-05-07 15:51:33 -07:00
Xiao Chen
d7f0af0b65 Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445."
This reverts commit 2444d70a40e2d264cff03f80b1bf59a72318c510.
2018-05-07 14:11:13 -07:00
Inigo Goiri
e7b5c0091d HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin.
(cherry picked from commit a3b416f69dc3965f247603f657df33bd74fd723e)
2018-05-03 11:26:51 -07:00
Yiqun Lin
06632c0665 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri.
(cherry picked from commit 37269261d1232bc71708f30c76193188258ef4bd)
(cherry picked from commit 5fef28d0d4b27c5df31d325650e46f5ab5f5630f)
2018-05-02 15:02:24 +08:00
Inigo Goiri
9fd93ee533 HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 2018-05-01 08:15:07 -07:00
Inigo Goiri
cb3414a279 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 2018-04-30 15:24:21 -07:00
Inigo Goiri
c0c788aafc HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 2018-04-28 09:07:56 -07:00
Inigo Goiri
c8441811fd HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S.
(cherry picked from commit 484440602c5b69fbd8106010603c61ae051056dd)
2018-04-27 16:30:07 -07:00