Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,413 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4834 Commits

Author SHA1 Message Date
Inigo Goiri 20472bdfd2 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit 7e692425d5.
 2018-04-12 08:44:17 -07:00
Akira Ajisaka f055a53b43
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu. 
(cherry picked from commit 113af12cfb)
 2018-04-12 17:48:45 +09:00
Akira Ajisaka be627ccfe3
HDFS-13427. Fix the section titles of transparent encryption document. 
(cherry picked from commit c7cd362afd)
 2018-04-12 10:49:07 +09:00
Inigo Goiri 940d3e6f74 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 18de6f2042)
 2018-04-11 12:04:18 -07:00
Inigo Goiri 9af5823dbb HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
 2018-04-11 10:42:17 -07:00
Wei Yan c65ac673a1 HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 
(cherry picked from commit 8433f6256c)
 2018-04-11 09:08:11 -07:00
Yiqun Lin ea51ef44fc HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a4)
 2018-04-10 15:39:46 +08:00
Yiqun Lin 9baebf4b27 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6)
 2018-04-10 14:47:55 +08:00
Inigo Goiri 78ec00155e HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 
(cherry picked from commit e9b9f48dad)
 2018-04-09 10:11:38 -07:00
Inigo Goiri 7e692425d5 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576d)
 2018-04-09 09:18:42 -07:00
Yiqun Lin 14827da747 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd6)
 2018-04-08 12:07:44 +08:00
Sean Mackrory b412958f70 HDFS-13176. WebHdfs file path gets truncated when having semicolon inside. Contributed by Zsolt Venczel. 2018-04-06 07:41:58 -06:00
Wei Yan 689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c293)
 2018-04-05 13:23:07 -07:00
Inigo Goiri 4276a858f8 HDFS-13337. Backport HDFS-4275 to branch-2.9. Contributed by Xiao Liang. 2018-04-03 13:55:44 -07:00
Inigo Goiri 254ec1e4d3 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 09:29:20 -07:00
Xiao Chen 251fc1fb40 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737)
 2018-04-02 22:55:03 -07:00
Inigo Goiri c6a013c9e0 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 
(cherry picked from commit dc8e343201)
 2018-03-31 09:47:36 -07:00
Konstantin V Shvachko de419e2777 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc)
 2018-03-30 19:08:12 -07:00
Arpit Agarwal 7e5c8faeb7 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 13:08:04 -07:00
Yiqun Lin f5aa36e194 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1)
 2018-03-28 11:59:36 -07:00
Inigo Goiri 6b187d2ee0 HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f)
 2018-03-27 10:33:31 -07:00
Inigo Goiri 90609f3561 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b282984)
 2018-03-26 09:44:34 -07:00
Yiqun Lin 622664648c HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f0)
 2018-03-26 20:03:20 +08:00
Wei Yan 69c08f3dd3 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a09084)
 2018-03-23 10:39:08 -07:00
Inigo Goiri 3db8c7ff68 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a2)
 2018-03-22 13:37:06 -07:00
Kihwal Lee d2c3a56ad8 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
 2018-03-22 12:31:52 -05:00
Inigo Goiri 06bebcc7d2 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b804)
 2018-03-22 09:23:25 -07:00
Konstantin V Shvachko 52752840f8 HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f)
 2018-03-21 17:21:28 -07:00
Inigo Goiri 8bbd560805 HDFS-13250. Addendum to fix branch-2 compilation. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 2018-03-21 11:38:17 -07:00
Yiqun Lin 0b6d5a0731 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bb)
 2018-03-21 11:42:21 +08:00
Yiqun Lin fb77ac6243 HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong. 
(cherry picked from commit 69fe4407eb)
 2018-03-21 10:55:43 +08:00
weiy 4aa34324b2 HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:23:16 -07:00
Inigo Goiri f278494a5f HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 2018-03-16 14:59:01 -07:00
Inigo Goiri 5e917a1501 Revert "HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak." 
This reverts commit 972c322301.
 2018-03-16 14:26:09 -07:00
Inigo Goiri 972c322301 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5)
 2018-03-16 10:31:02 -07:00
Inigo Goiri 4615c0bba2 HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a47)
 2018-03-16 09:15:23 -07:00
Inigo Goiri 3a5f50fa6e Revert "HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri." 
This reverts commit ccf07fdafd.
 2018-03-16 09:12:30 -07:00
Inigo Goiri b1b10007a4 HDFS-12919. RBF: Support erasure coding methods in RouterRpcServer. Contributed by Inigo Goiri. 2018-03-15 11:30:52 -07:00
Inigo Goiri ccf07fdafd HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a47)
 2018-03-15 10:51:04 -07:00
Yiqun Lin 3fad968624 HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang. 2018-03-15 11:12:25 +08:00
Inigo Goiri 299b40ff8b HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80be)
 2018-03-14 13:16:32 -07:00
Yiqun Lin b3d56cb835 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c)
 2018-03-14 11:25:08 +08:00
Chris Douglas 340cd5f1b1 HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
(cherry picked from commit a03c8ea61f)
 2018-03-12 20:08:46 -07:00
Yiqun Lin 38c21ec651 HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 
(cherry picked from commit 19292bc264)
 2018-03-13 11:06:53 +08:00
Yiqun Lin 5edbd1a258 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 
(cherry picked from commit 7fab787de7)
 2018-03-13 10:33:12 +08:00
Akira Ajisaka b0c80f1c81
HDFS-12156. TestFSImage fails without -Pnative 
(cherry picked from commit 319defafc1)
 2018-03-13 11:29:44 +09:00
Yiqun Lin 2ca6cf3170 HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin. 
(cherry picked from commit 4afd50b106)
 2018-03-13 10:18:23 +08:00
Inigo Goiri 7fded36e4c HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong. 
(cherry picked from commit 91c82c90f0)
 2018-03-12 17:30:45 -07:00
Inigo Goiri 737dca1959 HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin. 2018-03-12 12:54:42 -07:00
Anu Engineer 88c749a903 HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger. 2018-03-12 12:14:21 -07:00