Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,440 Commits 326 Branches 371 Tags
Commit Graph

4847 Commits

Author SHA1 Message Date
Yiqun Lin
33ffc96085 HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
 2018-04-25 15:25:16 +08:00
Yiqun Lin
cc5416d94a HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit b06601acce38ed60b726b99e2830f38a1ee3d2b5)
 2018-04-24 11:29:06 +08:00
Inigo Goiri
db9da432b9 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 
(cherry picked from commit df92a17e02fe86279a6f4e413719d0a465b50837)
 2018-04-23 19:14:03 -07:00
Chris Douglas
99e82e2c2c HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 
(cherry picked from commit f411de6a79a0a87f03c09366cfe7a7d0726ed932)
(cherry picked from commit cf272c5179a9cb4b524016c0fca7c69c9eaa92f1)
(cherry picked from commit 956ab12ede390e1eea0a66752e0e6711f47b4b94)
 2018-04-23 11:15:28 -07:00
Yiqun Lin
a975250303 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri. 
(cherry picked from commit b6dae26f4490bbd03360b8df19ef00cf843430f3)
 2018-04-21 14:53:12 +08:00
Inigo Goiri
a3c1735951 HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 1134af9ad1daf683204df8f95a8f03d7baaa74d4)
 2018-04-19 14:58:02 -07:00
Xiao Chen
2444d70a40 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 
(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)
 2018-04-18 22:43:24 -05:00
Shashikant Banerjee
228869e5f9
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:38:11 +09:00
Erik Krogen
8f341c673f
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
 2018-04-18 14:40:45 +09:00
Inigo Goiri
b4b10786c3 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 2018-04-17 15:18:01 -07:00
Wei Yan
8d720daa49 HDFS-13466. RBF: Add more router-related information to the UI. 
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
 2018-04-17 15:06:48 -07:00
Yiqun Lin
88cb461c87 HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
 2018-04-17 11:27:30 +08:00
Yiqun Lin
a7721082dc HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie. 2018-04-13 17:59:35 +08:00
Inigo Goiri
20472bdfd2 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit 7e692425d538454abf69b07f6e8fd686a1171ac8.
 2018-04-12 08:44:17 -07:00
Akira Ajisaka
f055a53b43
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu. 
(cherry picked from commit 113af12cfb240ea9a7189bb2701693466eb8e993)
 2018-04-12 17:48:45 +09:00
Akira Ajisaka
be627ccfe3
HDFS-13427. Fix the section titles of transparent encryption document. 
(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)
 2018-04-12 10:49:07 +09:00
Inigo Goiri
940d3e6f74 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 18de6f2042b70f9f0d7a2620c60de022768a7b13)
 2018-04-11 12:04:18 -07:00
Inigo Goiri
9af5823dbb HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
 2018-04-11 10:42:17 -07:00
Wei Yan
c65ac673a1 HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 
(cherry picked from commit 8433f6256c7c67b583466c35f51b1918a4b77b02)
 2018-04-11 09:08:11 -07:00
Yiqun Lin
ea51ef44fc HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
 2018-04-10 15:39:46 +08:00
Yiqun Lin
9baebf4b27 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
 2018-04-10 14:47:55 +08:00
Inigo Goiri
78ec00155e HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 
(cherry picked from commit e9b9f48dad5ebb58ee529f918723089e8356c480)
 2018-04-09 10:11:38 -07:00
Inigo Goiri
7e692425d5 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576da4cc463dff85118163ccfff02215fc)
 2018-04-09 09:18:42 -07:00
Yiqun Lin
14827da747 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
 2018-04-08 12:07:44 +08:00
Sean Mackrory
b412958f70 HDFS-13176. WebHdfs file path gets truncated when having semicolon inside. Contributed by Zsolt Venczel. 2018-04-06 07:41:58 -06:00
Wei Yan
689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:23:07 -07:00
Inigo Goiri
4276a858f8 HDFS-13337. Backport HDFS-4275 to branch-2.9. Contributed by Xiao Liang. 2018-04-03 13:55:44 -07:00
Inigo Goiri
254ec1e4d3 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 09:29:20 -07:00
Xiao Chen
251fc1fb40 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:55:03 -07:00
Inigo Goiri
c6a013c9e0 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 
(cherry picked from commit dc8e3432013153ac11d31d6b462aa96f8ca2c443)
 2018-03-31 09:47:36 -07:00
Konstantin V Shvachko
de419e2777 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 19:08:12 -07:00
Arpit Agarwal
7e5c8faeb7 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 13:08:04 -07:00
Yiqun Lin
f5aa36e194 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
 2018-03-28 11:59:36 -07:00
Inigo Goiri
6b187d2ee0 HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
 2018-03-27 10:33:31 -07:00
Inigo Goiri
90609f3561 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
 2018-03-26 09:44:34 -07:00
Yiqun Lin
622664648c HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
 2018-03-26 20:03:20 +08:00
Wei Yan
69c08f3dd3 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
 2018-03-23 10:39:08 -07:00
Inigo Goiri
3db8c7ff68 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
 2018-03-22 13:37:06 -07:00
Kihwal Lee
d2c3a56ad8 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b0b2f630b682bff927dbd74c251c26e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
 2018-03-22 12:31:52 -05:00
Inigo Goiri
06bebcc7d2 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b80438bfbdf7e5af853b9044a63bd1352c)
 2018-03-22 09:23:25 -07:00
Konstantin V Shvachko
52752840f8 HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)
 2018-03-21 17:21:28 -07:00
Inigo Goiri
8bbd560805 HDFS-13250. Addendum to fix branch-2 compilation. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:38:17 -07:00
Yiqun Lin
0b6d5a0731 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bbb9d6e3ec56024a0a9d3d56a229edcf)
 2018-03-21 11:42:21 +08:00
Yiqun Lin
fb77ac6243 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407ebd885fed69d9cf7f4dd17d3ba1acb60)
 2018-03-21 10:55:43 +08:00
weiy
4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Inigo Goiri
f278494a5f HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 14:59:01 -07:00
Inigo Goiri
5e917a1501 Revert "HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak." 
This reverts commit 972c322301fcbabdabe86e7427c8097347d40efa.
 2018-03-16 14:26:09 -07:00
Inigo Goiri
972c322301 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5d3e39f546200f9e696f62ea4cf000d)
 2018-03-16 10:31:02 -07:00
Inigo Goiri
4615c0bba2 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a471422ddb26dd54e706f09f0fe09925c)
 2018-03-16 09:15:23 -07:00
Inigo Goiri
3a5f50fa6e Revert "HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri." 
This reverts commit ccf07fdafd74d5d5782deaed9839a4122e463d4b.
 2018-03-16 09:12:30 -07:00