Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,366 Commits 326 Branches 371 Tags
Commit Graph

7028 Commits

Author SHA1 Message Date
Takanobu Asanuma
499a90f152
HDFS-13628. Update Archival Storage doc for Provided Storage 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 04757e5864bd4904fd5a59d143fff480814700e4)
 2018-05-28 19:06:58 +09:00
Inigo Goiri
c7d77a3bfe HDFS-13620. Randomize the test directory path for TestHDFSFileSystemContract. Contributed by Anbang Hu. 
(cherry picked from commit 8605a38514b4f7a2a549c7ecf8e1421e61bb4d67)
 2018-05-25 19:45:48 -07:00
Inigo Goiri
71ab85adce HDFS-13619. TestAuditLoggerWithCommands fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 13d25289076b39daf481fb1ee15939dbfe4a6b23)
 2018-05-25 13:33:05 -07:00
Inigo Goiri
2d3d7a67f2 HDFS-13618. Fix TestDataNodeFaultInjector test failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit a8e9ee3fdf3aa1b889dfdd3bade91ba754ed9ee1)
 2018-05-25 09:11:07 -07:00
Andrew Wang
31d597f0c7 HDFS-13611. Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient. 
(cherry picked from commit c9b63deb533274ca8ef4939f6cd13f728a067f7b)
 2018-05-24 09:56:37 -07:00
Inigo Goiri
f57e91a348 HDFS-13493. Reduce the HttpServer2 thread count on DataNodes. Contributed by Erik Krogen. 
(cherry picked from commit cddbbe5f690e4617413f6e986adc6fa900629f03)
 2018-05-23 12:12:40 -07:00
Inigo Goiri
a138496379 HDFS-13587. TestQuorumJournalManager fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit c13dea87d9de7a9872fc8b0c939b41b1666a61e5)
 2018-05-23 11:36:34 -07:00
Bharat Viswanadham
d0d3d5b2ad HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. Contributed by Hanisha Koneru 
(cherry picked from commit bc6d9d4c796d3c9d27dbbe3266031bf2adecde4f)
 2018-05-23 10:23:45 -07:00
Inigo Goiri
0c268a0755 HDFS-13588. Fix TestFsDatasetImpl test failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit c0c9b7a8ef2618b7641a0452d9277abd26815de2)
 2018-05-23 09:47:10 -07:00
Sammi Chen
7d71b3a1cc HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen. 
(cherry picked from commit 34e8b9f9a86fb03156861482643fba11bdee1dd4)
 2018-05-23 19:12:04 +08:00
Andrew Wang
d47c0fc39a HDFS-13601. Optimize ByteString conversions in PBHelper. 
(cherry picked from commit 1d2640b6132e8308c07476badd2d1482be68a298)
 2018-05-22 23:55:35 -07:00
Inigo Goiri
8a86269c51 HDFS-13593. TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 9775ecb2355d7bed3514fcd54bf69e8351c4ab99)
 2018-05-18 09:46:29 -07:00
Inigo Goiri
da5eff8325 HDFS-13592. TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly. Contributed by Anbang Hu. 
(cherry picked from commit 57b893de3d36d20f65ee81b5cc3cfef12594b75b)
 2018-05-18 09:38:23 -07:00
Inigo Goiri
df54cdbaea HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 53b807a6a8486cefe0b036f7893de9f619bd44a1)
 2018-05-17 17:03:56 -07:00
Inigo Goiri
f67865ed7e HDFS-13556. TestNestedEncryptionZones does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit a97a2042f210e9db97646baad6f56064d672f447)
 2018-05-17 16:53:53 -07:00
Inigo Goiri
8c463a2a9c HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 65476458fa05656010809be632356e4015b59a17)
 2018-05-17 14:48:40 -07:00
Inigo Goiri
e5ff9f3922 HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 26f1e22fc9ee326e9c76503d347552faeb6c2d3b)
 2018-05-17 13:35:40 -07:00
Inigo Goiri
b0c89690ed HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu. 
(cherry picked from commit c0ec061e280c0d3e5299c0735c8b8697e0f31216)
 2018-05-17 09:22:29 -07:00
Kihwal Lee
4f1ec6a515 HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee. 
(cherry picked from commit 0ce6290de6a08beab01cb5184d366d97c9abd811)
 2018-05-17 09:26:13 -05:00
Inigo Goiri
1d1806f862 HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu. 
(cherry picked from commit 454de3b543c8b00a9ab566c7d1c64d7e4cffee0f)
 2018-05-16 19:23:33 -07:00
Arpit Agarwal
45dd200a2c HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed by Ajay Kumar. 2018-05-16 11:28:51 -07:00
Inigo Goiri
e12ddd9394 HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 55d5549087183cb9c8d805e33267acabe9537667)
 2018-05-16 10:09:18 -07:00
Inigo Goiri
5310542fb4 HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 6b67161ca33881d5f3d7606a57786e9c960759a1)
 2018-05-16 09:32:15 -07:00
Inigo Goiri
899a7ec2fb HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu. 
(cherry picked from commit 63480976a008bab0b84f4da08b1099867e5a9a6b)
 2018-05-15 15:36:03 -07:00
Inigo Goiri
34fbc1c2eb HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 2d6195c0af4a1840172899ce70bca4ca549eb713)
 2018-05-15 11:21:44 -07:00
Inigo Goiri
c168329cc4 HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu. 
(cherry picked from commit eaca7980ad2a750f6b0025a706062740c2ddded2)
 2018-05-15 10:28:01 -07:00
Inigo Goiri
583b9b418a HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 92ebd466c75275118107e6ec665cf50e337a29e7)
 2018-05-15 10:22:19 -07:00
Hanisha Koneru
4f55941390 HDFS-13544. Improve logging for JournalNode in federated cluster. 
(cherry picked from commit 6beb25ab7e4f5454dba0315a296081e61753f301)
 2018-05-14 10:14:38 -07:00
Xiao Chen
6e731eb20d HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure. 
(cherry picked from commit 960940e0e08f7839775f2d8a352b444d104d36b4)
 2018-05-14 09:29:14 -07:00
Sammi Chen
e5281d9f8b Add 2.9.1 release notes and changes documents 2018-05-14 15:26:00 +08:00
Inigo Goiri
e332e011ae HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu. 
(cherry picked from commit d50c4d71dc42576f96ae5c268856fd1a7795f936)
 2018-05-11 09:48:45 -07:00
Yiqun Lin
3665217d50 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota. 
(cherry picked from commit a922b9c82cc564e86dc0ef84bcc3597cb7b7c211)
 2018-05-11 15:09:54 +08:00
Inigo Goiri
e3ff9e36df HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang. 
(cherry picked from commit 914b98a713f70667d4380ac752f6c4de931520d9)
 2018-05-09 16:52:45 -07:00
Inigo Goiri
c649c76566 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit 63803e7051dcfcd8e3d28a8b3217b7735a00b7d8)
 2018-05-09 13:56:06 -07:00
Xiao Chen
6f3bbf364c HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi. 
(cherry picked from commit 696a4be0daac00dd3bb64801d9fbe659aef9e089)
 2018-05-07 15:39:24 -07:00
Xiao Chen
d762932d79 Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445." 
This reverts commit 128b09ee4392428467c1bcd7cf9c08fadf4ba2b5.
 2018-05-07 13:47:52 -07:00
Inigo Goiri
524dde4006 HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin. 
(cherry picked from commit a3b416f69dc3965f247603f657df33bd74fd723e)
 2018-05-03 11:25:30 -07:00
Yiqun Lin
5fef28d0d4 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri. 
(cherry picked from commit 37269261d1232bc71708f30c76193188258ef4bd)
 2018-05-02 14:56:15 +08:00
Inigo Goiri
4aadfb3c92 HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 9e2cfb2d3f1a18984d07c81f9c46626dd842402a)
 2018-05-01 08:13:30 -07:00
Inigo Goiri
4c13e7e3a0 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 
(cherry picked from commit fc074a359c44e84dd9612be2bd772763f943eb04)
 2018-04-30 13:31:03 -07:00
Inigo Goiri
ce62991648 HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit eb7fe1d588de903be2ff6e20384c25c184881532)
 2018-04-28 09:05:59 -07:00
Inigo Goiri
9923fa2490 HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S. 
(cherry picked from commit 484440602c5b69fbd8106010603c61ae051056dd)
 2018-04-27 16:29:41 -07:00
Inigo Goiri
f26f764857 HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari. 
(cherry picked from commit f469628bba350ba79bc6a0d38f9dc1cb5eb65c77)
 2018-04-27 15:14:18 -07:00
Yiqun Lin
e097998c22 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri. 
(cherry picked from commit 0a293de00d5f123c7c8248459aa8ae88a45f39b1)
 2018-04-27 10:39:21 +08:00
Inigo Goiri
921a3e1678 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li. 
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
 2018-04-26 13:01:16 -07:00
Yiqun Lin
999ea44b9f HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
 2018-04-25 15:23:54 +08:00
Yiqun Lin
ea2863f2b5 HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit b06601acce38ed60b726b99e2830f38a1ee3d2b5)
 2018-04-24 11:27:14 +08:00
Inigo Goiri
5b2427cd73 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 
(cherry picked from commit df92a17e02fe86279a6f4e413719d0a465b50837)
 2018-04-23 19:12:53 -07:00
Bharat Viswanadham
caf4d5000e HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. Contributed by Bharat Viswanadham 
(cherry picked from commit 9b5375e0c1ee8c634a5accb7415ec27440543a60)
 2018-04-23 16:10:28 -07:00
Chris Douglas
cf272c5179 HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 
(cherry picked from commit f411de6a79a0a87f03c09366cfe7a7d0726ed932)
 2018-04-23 11:13:52 -07:00