Commit Graph

6773 Commits

Author SHA1 Message Date
Yiqun Lin c903efeb51 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1)
2018-03-28 11:05:58 +08:00
Inigo Goiri 7cc06217de HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f)
2018-03-27 10:32:56 -07:00
Inigo Goiri b8e82a4f66 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b282984)
2018-03-26 09:43:59 -07:00
Yiqun Lin fdcd139c55 HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f0)
2018-03-26 18:37:40 +08:00
Lei Xu beb98bb419 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:51:40 -07:00
Wei Yan f4d6fee96b HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a09084)
2018-03-23 08:55:26 -07:00
Arpit Agarwal 26b08e002f
HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula.
(cherry picked from commit 46c93453e9)
2018-03-23 18:12:48 +09:00
Inigo Goiri 50b6dc9f3e HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a2)
2018-03-22 13:35:24 -07:00
Kihwal Lee 7212c98ba5 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.
(cherry picked from commit 66461ed98b)
2018-03-22 12:29:21 -05:00
Inigo Goiri 471f758673 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.
(cherry picked from commit 3d0ee8b804)
2018-03-22 09:22:46 -07:00
Konstantin V Shvachko 987d90aa4c HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.
(cherry picked from commit 8d898ab25f)
2018-03-21 17:17:41 -07:00
Yiqun Lin e65db99799 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit 2caba999bb)
2018-03-21 11:41:14 +08:00
weiy 62a819d5ee HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:15:53 -07:00
Inigo Goiri c6b1125a24 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak.
(cherry picked from commit 08ff1586d5)
2018-03-16 10:30:34 -07:00
Inigo Goiri ba9a656ffa HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri.
(cherry picked from commit e71bc00a47)
2018-03-15 10:35:20 -07:00
Inigo Goiri 6b8a60b62a HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar.
(cherry picked from commit 6de135169e)
2018-03-15 10:15:46 -07:00
Inigo Goiri cfa7cc2aa4 HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan.
(cherry picked from commit 41fc7f80be)
2018-03-14 13:15:51 -07:00
Sammi Chen e97234f274 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen.
(cherry picked from commit ad1b988a82)
2018-03-14 14:51:51 +08:00
Yiqun Lin a105069729 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri.
(cherry picked from commit 76be6cbf6c)
2018-03-14 11:31:35 +08:00
Xiao Chen fc6f3e2a6f HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma.
(cherry picked from commit 8211a3d469)
2018-03-13 11:18:22 -07:00
Xiao Chen f23ef858ff Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma."
This reverts commit 752e116f41.
2018-03-13 10:39:50 -07:00
Xiao Chen c0aa249a1d HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma.
(cherry picked from commit 3b8dbc2cb7)
2018-03-13 10:14:39 -07:00
Xiao Chen 8f4bfb3ed5 HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham.
(cherry picked from commit d6931c30c5)
2018-03-13 10:08:09 -07:00
Xiao Chen 752e116f41 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma.
(cherry picked from commit 84c1095586)
2018-03-13 09:58:50 -07:00
Xiaoyu Yao 2a93ba690c HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar.
(cherry picked from commit 107c177782)
2018-03-12 20:23:52 -07:00
Yiqun Lin 840c83bf7a HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 2018-03-13 11:13:15 +08:00
Chris Douglas a03c8ea61f HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
2018-03-12 20:06:22 -07:00
Yiqun Lin 430cdfefc0 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 2018-03-13 10:41:44 +08:00
Akira Ajisaka 89105a623b
HDFS-12156. TestFSImage fails without -Pnative
(cherry picked from commit 319defafc1)
2018-03-13 11:27:46 +09:00
Inigo Goiri 177dd6580d HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong.
(cherry picked from commit 91c82c90f0)
2018-03-12 17:30:00 -07:00
Chris Douglas 2210593dad HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov
(cherry picked from commit ddb67ca707)
(cherry picked from commit c9364b3bce)
2018-03-12 13:55:10 -07:00
Inigo Goiri 29cf29a853 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin.
(cherry picked from commit ac627f561f)
2018-03-12 10:05:43 -07:00
Yiqun Lin 2e607f2103 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
(cherry picked from commit 4743d4a2c7)
2018-03-10 11:32:12 +08:00
Inigo Goiri 465c3f0e24 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S.
(cherry picked from commit 8133cd5305)
2018-03-09 18:27:17 -08:00
Inigo Goiri c453fcb23f HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu.
(cherry picked from commit afe1a3ccd5)
2018-03-09 17:20:29 -08:00
Hanisha Koneru bd2ebf031c HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham.
(cherry picked from commit 4eeff62f69)
2018-03-09 15:49:09 -08:00
Lokesh Jain 80aabd72c2
HDFS-13190. Document WebHDFS support for snapshot diff
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Xiaoyu Yao <xyao@apache.org>
(cherry picked from commit 7b0dc31020)
2018-03-09 15:07:34 -08:00
Hanisha Koneru dec53bb9e1 HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus.
(cherry picked from commit 9a082fbe6e)
2018-03-09 13:39:49 -08:00
Yiqun Lin f879504fe1 HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 2018-03-09 15:48:36 +08:00
Inigo Goiri 68cff8c235 HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun.
(cherry picked from commit 0c2b969e01)
2018-03-08 09:33:24 -08:00
Hanisha Koneru 0b1e9665df HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei.
(cherry picked from commit 19ae4429f9)
2018-03-07 14:22:01 -08:00
Yiqun Lin 253ef33f80 HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 2018-03-07 16:07:05 +08:00
Xiaoyu Yao b74df5523c HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru.
(cherry picked from commit edf9445708)
2018-03-06 18:30:10 -08:00
Xiao Chen 283d48a4f7 HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell.
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
2018-03-06 09:58:09 -08:00
Xiao Chen d28db463c2 HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen.
(cherry picked from commit c75105f07b)
2018-03-02 16:47:36 -08:00
Xiaoyu Yao 908ca63c03 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar.
(cherry picked from commit f20e10b2dd)
2018-02-28 09:48:12 -08:00
Xiaoyu Yao ce356dcbf6 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru.
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
2018-02-28 08:44:14 -08:00
Inigo Goiri 0eff245d3d HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong.
(cherry picked from commit d86f301d46)
2018-02-27 17:41:42 -08:00
Yiqun Lin 09017aee90 HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin.
(cherry picked from commit 1e85a995d1)
2018-02-27 10:52:49 +08:00
Chao Sun 26395aef67 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun.
(cherry picked from commit ae290a4bb4)
2018-02-26 16:18:51 -08:00