Commit Graph

4865 Commits

Author SHA1 Message Date
Inigo Goiri d88d9f2874 HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu. 2018-05-11 09:50:40 -07:00
Yiqun Lin 11794e5eda HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota. 2018-05-11 18:56:59 +08:00
Yiqun Lin b83ff77409 Revert "HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota."
This reverts commit d4a141e7b0.
2018-05-11 18:53:12 +08:00
Yiqun Lin d4a141e7b0 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota.
(cherry picked from commit a922b9c82c)
2018-05-11 15:06:45 +08:00
Chris Douglas b2acaa52d2 HDFS-13272. DataNodeHttpServer to have configurable HttpServer2 threads. Contributed by Erik Krogen 2018-05-10 14:53:39 -07:00
Inigo Goiri a756d3e7c8 HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang.
(cherry picked from commit 914b98a713)
2018-05-09 16:53:45 -07:00
Xiao Chen 5679920793 HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi.
(cherry picked from commit 696a4be0da)
2018-05-07 15:51:33 -07:00
Xiao Chen d7f0af0b65 Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445."
This reverts commit 2444d70a40.
2018-05-07 14:11:13 -07:00
Inigo Goiri e7b5c0091d HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin.
(cherry picked from commit a3b416f69d)
2018-05-03 11:26:51 -07:00
Yiqun Lin 06632c0665 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri.
(cherry picked from commit 37269261d1)
(cherry picked from commit 5fef28d0d4)
2018-05-02 15:02:24 +08:00
Inigo Goiri 9fd93ee533 HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 2018-05-01 08:15:07 -07:00
Inigo Goiri cb3414a279 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 2018-04-30 15:24:21 -07:00
Inigo Goiri c0c788aafc HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 2018-04-28 09:07:56 -07:00
Inigo Goiri c8441811fd HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S.
(cherry picked from commit 484440602c)
2018-04-27 16:30:07 -07:00
Inigo Goiri ae32e2140c HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari.
(cherry picked from commit f469628bba)
2018-04-27 15:16:46 -07:00
Yiqun Lin 87c9fff352 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri.
(cherry picked from commit 0a293de00d)
2018-04-27 10:41:16 +08:00
Inigo Goiri 1c3d746fc0 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li.
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
2018-04-26 13:14:08 -07:00
Wei-Chiu Chuang a5fc638235 HDFS-13492. Limit httpfs binds to certain IP addresses in branch-2. Contributed by Wei-Chiu Chuang. 2018-04-26 09:55:03 -07:00
Yiqun Lin 33ffc96085 HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri.
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
2018-04-25 15:25:16 +08:00
Yiqun Lin cc5416d94a HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri.
(cherry picked from commit b06601acce)
2018-04-24 11:29:06 +08:00
Inigo Goiri db9da432b9 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang.
(cherry picked from commit df92a17e02)
2018-04-23 19:14:03 -07:00
Chris Douglas 99e82e2c2c HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang
(cherry picked from commit f411de6a79)
(cherry picked from commit cf272c5179)
(cherry picked from commit 956ab12ede)
2018-04-23 11:15:28 -07:00
Yiqun Lin a975250303 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri.
(cherry picked from commit b6dae26f44)
2018-04-21 14:53:12 +08:00
Inigo Goiri a3c1735951 HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar.
(cherry picked from commit 1134af9ad1)
2018-04-19 14:58:02 -07:00
Xiao Chen 2444d70a40 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445.
(cherry picked from commit 6503593711)
2018-04-18 22:43:24 -05:00
Shashikant Banerjee 228869e5f9
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247)
2018-04-19 08:38:11 +09:00
Erik Krogen 8f341c673f
HDFS-12828. OIV ReverseXML Processor fails with escaped characters
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a90)
2018-04-18 14:40:45 +09:00
Inigo Goiri b4b10786c3 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 2018-04-17 15:18:01 -07:00
Wei Yan 8d720daa49 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e47)
2018-04-17 15:06:48 -07:00
Yiqun Lin 88cb461c87 HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21)
2018-04-17 11:27:30 +08:00
Yiqun Lin a7721082dc HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie. 2018-04-13 17:59:35 +08:00
Inigo Goiri 20472bdfd2 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 7e692425d5.
2018-04-12 08:44:17 -07:00
Akira Ajisaka f055a53b43
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu.
(cherry picked from commit 113af12cfb)
2018-04-12 17:48:45 +09:00
Akira Ajisaka be627ccfe3
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd)
2018-04-12 10:49:07 +09:00
Inigo Goiri 940d3e6f74 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042)
2018-04-11 12:04:18 -07:00
Inigo Goiri 9af5823dbb HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:42:17 -07:00
Wei Yan c65ac673a1 HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri.
(cherry picked from commit 8433f6256c)
2018-04-11 09:08:11 -07:00
Yiqun Lin ea51ef44fc HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a4)
2018-04-10 15:39:46 +08:00
Yiqun Lin 9baebf4b27 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6)
2018-04-10 14:47:55 +08:00
Inigo Goiri 78ec00155e HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin.
(cherry picked from commit e9b9f48dad)
2018-04-09 10:11:38 -07:00
Inigo Goiri 7e692425d5 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit ac32b3576d)
2018-04-09 09:18:42 -07:00
Yiqun Lin 14827da747 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd6)
2018-04-08 12:07:44 +08:00
Sean Mackrory b412958f70 HDFS-13176. WebHdfs file path gets truncated when having semicolon inside. Contributed by Zsolt Venczel. 2018-04-06 07:41:58 -06:00
Wei Yan 689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c293)
2018-04-05 13:23:07 -07:00
Inigo Goiri 4276a858f8 HDFS-13337. Backport HDFS-4275 to branch-2.9. Contributed by Xiao Liang. 2018-04-03 13:55:44 -07:00
Inigo Goiri 254ec1e4d3 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 09:29:20 -07:00
Xiao Chen 251fc1fb40 HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
(cherry picked from commit 57374c4737)
2018-04-02 22:55:03 -07:00
Inigo Goiri c6a013c9e0 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e343201)
2018-03-31 09:47:36 -07:00
Konstantin V Shvachko de419e2777 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
(cherry picked from commit acfd764fcc)
2018-03-30 19:08:12 -07:00
Arpit Agarwal 7e5c8faeb7 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 13:08:04 -07:00