Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,799 Commits 326 Branches 371 Tags
Commit Graph

4965 Commits

Author SHA1 Message Date
Yiqun Lin
f5aa36e194 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
 2018-03-28 11:59:36 -07:00
Inigo Goiri
6b187d2ee0 HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
 2018-03-27 10:33:31 -07:00
Inigo Goiri
90609f3561 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
 2018-03-26 09:44:34 -07:00
Yiqun Lin
622664648c HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
 2018-03-26 20:03:20 +08:00
Wei Yan
69c08f3dd3 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
 2018-03-23 10:39:08 -07:00
Inigo Goiri
3db8c7ff68 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
 2018-03-22 13:37:06 -07:00
Kihwal Lee
d2c3a56ad8 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b0b2f630b682bff927dbd74c251c26e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
 2018-03-22 12:31:52 -05:00
Inigo Goiri
06bebcc7d2 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b80438bfbdf7e5af853b9044a63bd1352c)
 2018-03-22 09:23:25 -07:00
Konstantin V Shvachko
52752840f8 HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)
 2018-03-21 17:21:28 -07:00
Inigo Goiri
8bbd560805 HDFS-13250. Addendum to fix branch-2 compilation. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:38:17 -07:00
Yiqun Lin
0b6d5a0731 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bbb9d6e3ec56024a0a9d3d56a229edcf)
 2018-03-21 11:42:21 +08:00
Yiqun Lin
fb77ac6243 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407ebd885fed69d9cf7f4dd17d3ba1acb60)
 2018-03-21 10:55:43 +08:00
weiy
4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Inigo Goiri
f278494a5f HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 14:59:01 -07:00
Inigo Goiri
5e917a1501 Revert "HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak." 
This reverts commit 972c322301fcbabdabe86e7427c8097347d40efa.
 2018-03-16 14:26:09 -07:00
Inigo Goiri
972c322301 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5d3e39f546200f9e696f62ea4cf000d)
 2018-03-16 10:31:02 -07:00
Inigo Goiri
4615c0bba2 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a471422ddb26dd54e706f09f0fe09925c)
 2018-03-16 09:15:23 -07:00
Inigo Goiri
3a5f50fa6e Revert "HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri." 
This reverts commit ccf07fdafd74d5d5782deaed9839a4122e463d4b.
 2018-03-16 09:12:30 -07:00
Inigo Goiri
b1b10007a4 HDFS-12919. RBF: Support erasure coding methods in RouterRpcServer. Contributed by Inigo Goiri. 2018-03-15 11:30:52 -07:00
Inigo Goiri
ccf07fdafd HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a471422ddb26dd54e706f09f0fe09925c)
 2018-03-15 10:51:04 -07:00
Yiqun Lin
3fad968624 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:12:25 +08:00
Inigo Goiri
299b40ff8b HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80beb32f4a1fac73faf7c9116ad5ee3420)
 2018-03-14 13:16:32 -07:00
Yiqun Lin
b3d56cb835 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c33f866794f27ca2560ca7c7b2fa0e7)
 2018-03-14 11:25:08 +08:00
Chris Douglas
340cd5f1b1 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc04a86be91a9b72073cdc30bec04d3b)
(cherry picked from commit 09940b1eb3b7ed764149f4a993c1857e9c6ad938)
(cherry picked from commit a03c8ea61f6e30a9d462571ace23858b6e0fd1c9)
 2018-03-12 20:08:46 -07:00
Yiqun Lin
38c21ec651 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 
(cherry picked from commit 19292bc264cada5117ec76063d36cc88159afdf4)
 2018-03-13 11:06:53 +08:00
Yiqun Lin
5edbd1a258 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 
(cherry picked from commit 7fab787de72756863a91c2358da5c611afdb80e9)
 2018-03-13 10:33:12 +08:00
Akira Ajisaka
b0c80f1c81
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc105c0d0b69b83828b578d9c453036f5)
 2018-03-13 11:29:44 +09:00
Yiqun Lin
2ca6cf3170 HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin. 
(cherry picked from commit 4afd50b10650a72162c40cf86dea44676013f262)
 2018-03-13 10:18:23 +08:00
Inigo Goiri
7fded36e4c HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f05ea75fe59c6ffad3dc3fcac1429e9e)
 2018-03-12 17:30:45 -07:00
Inigo Goiri
737dca1959 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 2018-03-12 12:54:42 -07:00
Anu Engineer
88c749a903 HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger. 2018-03-12 12:14:21 -07:00
Inigo Goiri
457895d50f Revert "HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin." 
This reverts commit ab0f12708452f22d3780a30b354f7f8a24366500.
 2018-03-12 11:44:06 -07:00
Inigo Goiri
ab0f127084 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 
(cherry picked from commit ac627f561f0946e98a650850fb507536cbd2f2c4)
 2018-03-12 10:04:51 -07:00
Yiqun Lin
3a34924896 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. 
(cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d)
 2018-03-10 11:33:44 +08:00
Inigo Goiri
0dadcf9ea3 HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S. 
(cherry picked from commit 8133cd5305d7913453abb2d48da12f672c0ce334)
 2018-03-09 18:28:59 -08:00
Inigo Goiri
4b6b07690e HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu. 
(cherry picked from commit afe1a3ccd56a12fec900360a8a2855c080728e65)
 2018-03-09 17:21:10 -08:00
Yiqun Lin
aa748c6bca HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan. 
(cherry picked from commit 122805b43acff2b094bd984fa76dbc8d2e110edd)
 2018-03-09 15:51:56 +08:00
Kihwal Lee
0aa52d4085 HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. Contributed by Manoj Govindassamy. 2018-03-08 14:22:17 -06:00
Inigo Goiri
95f34ce462 HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun. 
(cherry picked from commit 0c2b969e0161a068bf9ae013c4b95508dfb90a8a)
(cherry picked from commit 44abf77d9b371b0d06569bd4881356ac157b490e)
 2018-03-08 10:24:41 -08:00
Yiqun Lin
a5d9691b54 HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin. 
(cherry picked from commit 58ea2d7a65ccd8b7775021bae1d24b9e5561e67b)
 2018-03-07 15:51:42 +08:00
Xiaoyu Yao
313fdb9968 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru. 
(cherry picked from commit edf9445708ffb7a9e59cb933e049b540f99add1e)
 2018-03-06 20:01:51 -08:00
Xiaoyu Yao
4f3c4e4514 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8faf0b50d435039f69ea35f592856ca04d378809)
 2018-03-06 18:49:13 -08:00
Xiao Chen
0882725c88 HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 2018-03-05 09:44:42 -08:00
Yiqun Lin
08cd911b69 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 
(cherry picked from commit a9c14b11193adeaa31389578f4cb90fa79cad8c3)
 2018-02-28 10:25:49 +08:00
Inigo Goiri
2f18785f39 HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d464683f8d392dad50e83f50d823e862e)
 2018-02-27 17:42:28 -08:00
Yiqun Lin
1b0aa0e87a HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 
(cherry picked from commit 1e85a995d1c7fe3dbf4b36a481feb5fdeeb6015b)
 2018-02-27 10:54:37 +08:00
Wei Yan
54803ebe49 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 
(cherry picked from commit 6ce9f79cc9b2107e5953a39d05b22966aff0b7ff)
 2018-02-26 15:32:27 -08:00
Kihwal Lee
4b43f2aa56 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 
(cherry picked from commit 451265a83d8798624ae2a144bc58fa41db826704)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockRecoveryWorker.java
 2018-02-26 10:58:07 -06:00
Arpit Agarwal
79af42f095 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 15:12:36 -08:00
Xiao Chen
80f7165374 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 
(cherry picked from commit 51088d323359587dca7831f74c9d065c2fccc60d)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
 2018-02-23 14:00:33 -08:00