6931 Commits

Author SHA1 Message Date
Yiqun Lin
99766992e6 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
2018-03-28 11:04:36 +08:00
Inigo Goiri
c1fc87dcce HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
2018-03-27 10:32:07 -07:00
Inigo Goiri
0dc16559ee HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
2018-03-26 09:43:28 -07:00
Yiqun Lin
1e01ddfe4f HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
2018-03-26 18:36:22 +08:00
Lei Xu
4859cd7cc9 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:53:30 -07:00
weiy
d17aa8d052 HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
2018-03-23 08:40:04 -07:00
Inigo Goiri
59ab86311c HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
2018-03-22 13:33:24 -07:00
Kihwal Lee
c245ecedda HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b0b2f630b682bff927dbd74c251c26e)
2018-03-22 12:28:34 -05:00
Inigo Goiri
485348a337 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b80438bfbdf7e5af853b9044a63bd1352c)
2018-03-22 09:22:16 -07:00
Konstantin V Shvachko
21db4e9efe HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)
2018-03-21 16:51:33 -07:00
Yiqun Lin
0db4b587c6 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bbb9d6e3ec56024a0a9d3d56a229edcf)
2018-03-21 11:40:02 +08:00
Yiqun Lin
131546002d HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong.
(cherry picked from commit 69fe4407ebd885fed69d9cf7f4dd17d3ba1acb60)
2018-03-21 10:53:24 +08:00
weiy
c804b28462 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:05:33 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
0bd99621c5 Preparing for 3.1.0 development 2018-03-19 15:16:54 -07:00
Inigo Goiri
08ff1586d5 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 10:29:19 -07:00
Xiaoyu Yao
78b05fde6c HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain. 2018-03-15 11:02:27 -07:00
Inigo Goiri
e71bc00a47 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 2018-03-15 10:32:30 -07:00
Xiaoyu Yao
da777a5498 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar. 2018-03-15 10:18:44 -07:00
Inigo Goiri
6de135169e HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 2018-03-15 10:14:35 -07:00
fang zhenyi
5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-15 16:12:07 +09:00
Xiao Chen
5ff22d4c3a HDFS-13246. FileInputStream redundant closes in readReplicasFromCache. Contributed by liaoyuxiangqin. 2018-03-14 21:59:51 -07:00
Yiqun Lin
3a0f4bc0d5 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:06:04 +08:00
Inigo Goiri
41fc7f80be HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 2018-03-14 13:14:36 -07:00
Xiaoyu Yao
f83716b7f2 HDFS-13251. Avoid using hard coded datanode data dirs in unit tests. Contributed by Ajay Kumar. 2018-03-14 11:26:58 -07:00
Xiaoyu Yao
0be0f1ce1d HDFS-13275. Adding log for BlockPoolManager#refreshNamenodes failures. Contributed by Ajay Kumar. 2018-03-14 10:38:00 -07:00
Arpit Agarwal
4c57fb0cd9 HDFS-13257. Code cleanup: INode never throws QuotaExceededException. Contributed by Tsz Wo Nicholas Sze. 2018-03-14 09:42:48 -07:00
Xiaoyu Yao
a34d83d2fd HDFS-13249. Document webhdfs support for getting snapshottable directory list. Contributed by Lokesh Jain. 2018-03-14 09:14:26 -07:00
Sammi Chen
ad1b988a82 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen. 2018-03-14 14:39:53 +08:00
Yiqun Lin
76be6cbf6c HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 2018-03-14 11:20:59 +08:00
Arpit Agarwal
9714fc1dd4 HDFS-336. dfsadmin -report should report number of blocks from datanode. Contributed by Bharat Viswanadham. 2018-03-13 16:39:17 -07:00
Arpit Agarwal
39537b7c84 HDFS-13235. DiskBalancer: Update Documentation to add newly added options. Contributed by Bharat Viswanadham. 2018-03-13 16:35:51 -07:00
Xiao Chen
8211a3d469 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 2018-03-13 10:48:45 -07:00
Xiao Chen
f82d38dcb3 Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma."
This reverts commit 84c10955863eca1e300aeeac1d9cd7a1186144b6.
2018-03-13 10:36:16 -07:00
Xiao Chen
3b8dbc2cb7 HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 2018-03-13 10:14:05 -07:00
Xiao Chen
d6931c30c5 HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 2018-03-13 10:07:26 -07:00
Xiao Chen
84c1095586 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 2018-03-13 09:58:03 -07:00
Chris Douglas
b2b9ce5859 HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain 2018-03-13 09:43:22 -07:00
Xiaoyu Yao
0355ec20eb HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain. 2018-03-12 20:41:37 -07:00
Chris Douglas
45d1b0fdcc HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 2018-03-12 20:05:39 -07:00
Yiqun Lin
19292bc264 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 2018-03-13 11:03:31 +08:00
Yiqun Lin
7fab787de7 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 2018-03-13 10:30:20 +08:00
Akira Ajisaka
319defafc1
HDFS-12156. TestFSImage fails without -Pnative 2018-03-13 11:26:56 +09:00
Yiqun Lin
4afd50b106 HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin. 2018-03-13 10:15:51 +08:00
Inigo Goiri
91c82c90f0 HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 2018-03-12 17:28:15 -07:00
Chris Douglas
39a5fbae47 HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma 2018-03-12 14:29:44 -07:00
Chris Douglas
ddb67ca707 HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov 2018-03-12 13:43:27 -07:00
Anu Engineer
cceb68ffea HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger. 2018-03-12 12:07:22 -07:00
Inigo Goiri
ac627f561f HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 2018-03-12 09:58:56 -07:00
Yiqun Lin
4743d4a2c7 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 2018-03-10 11:28:55 +08:00
Inigo Goiri
8133cd5305 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 2018-03-09 18:25:05 -08:00