Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,449 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

6795 Commits

Author SHA1 Message Date
Inigo Goiri 5fe2b97dd0 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 18de6f2042)
 2018-04-11 12:03:57 -07:00
Inigo Goiri 670abc4121 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
 2018-04-11 10:41:40 -07:00
Wei Yan 8433f6256c HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:51:47 -07:00
Rakesh Radhakrishnan afbdd8fdcf HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f89594f0b8)
 2018-04-10 23:43:28 +05:30
Inigo Goiri fe7a70e586 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit 877f963a05.
 2018-04-10 10:08:34 -07:00
Weiwei Yang 1a0ce93696 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 
(cherry picked from commit 6729047a8b)
 2018-04-10 22:16:25 +08:00
Yiqun Lin d4e438ff63 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a4)
 2018-04-10 15:38:18 +08:00
Yiqun Lin 0a216c3285 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6)
 2018-04-10 14:34:25 +08:00
Inigo Goiri 877f963a05 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576d)
 2018-04-09 09:18:03 -07:00
Yiqun Lin c3d8eda9bd HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd6)
 2018-04-08 12:05:32 +08:00
Manoj Govindassamy 218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem 
(cherry picked from commit 133d7ca76e)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
 2018-04-06 15:19:01 -07:00
Arpit Agarwal 492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh. 
(cherry picked from commit b91305119b)
 2018-04-06 15:19:01 -07:00
Wei Yan 9638c3fe67 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c293)
 2018-04-05 13:19:05 -07:00
Lei Xu 9fe337096d HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
 2018-04-05 09:54:15 -07:00
Yiqun Lin f2d89d7bf9 HDFS-13364. Addendum to fix branch-3.0 compilation. 2018-04-05 09:52:50 +08:00
Yiqun Lin 794ecb0284 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit 2be64eb201)
 2018-04-03 15:26:02 +08:00
Xiao Chen ce37f586f5 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737)
 2018-04-02 22:49:03 -07:00
Inigo Goiri 8266696aa3 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 
(cherry picked from commit dc8e343201)
 2018-03-31 09:47:06 -07:00
Konstantin V Shvachko 4ba5efa96f HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc)
 2018-03-30 19:05:01 -07:00
Yiqun Lin 7483acf484
HDFS-13349. Unresolved merge conflict in ViewFs.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-03-30 23:28:59 +09:00
Xiao Chen cd74a281a7 HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 
(cherry picked from commit 2c6cfad5a3)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirEncryptionZoneOp.java
 2018-03-29 16:07:09 -07:00
Arpit Agarwal 198f2bc35e HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:09 -07:00
Yiqun Lin c903efeb51 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1)
 2018-03-28 11:05:58 +08:00
Inigo Goiri 7cc06217de HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f)
 2018-03-27 10:32:56 -07:00
Inigo Goiri b8e82a4f66 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b282984)
 2018-03-26 09:43:59 -07:00
Yiqun Lin fdcd139c55 HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f0)
 2018-03-26 18:37:40 +08:00
Lei Xu beb98bb419 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:51:40 -07:00
Wei Yan f4d6fee96b HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a09084)
 2018-03-23 08:55:26 -07:00
Arpit Agarwal 26b08e002f
HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 46c93453e9)
 2018-03-23 18:12:48 +09:00
Inigo Goiri 50b6dc9f3e HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri. 
(cherry picked from commit e196d158a2)
 2018-03-22 13:35:24 -07:00
Kihwal Lee 7212c98ba5 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b)
 2018-03-22 12:29:21 -05:00
Inigo Goiri 471f758673 HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S. 
(cherry picked from commit 3d0ee8b804)
 2018-03-22 09:22:46 -07:00
Konstantin V Shvachko 987d90aa4c HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f)
 2018-03-21 17:17:41 -07:00
Yiqun Lin e65db99799 HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit 2caba999bb)
 2018-03-21 11:41:14 +08:00
weiy 62a819d5ee HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:15:53 -07:00
Inigo Goiri c6b1125a24 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5)
 2018-03-16 10:30:34 -07:00
Inigo Goiri ba9a656ffa HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a47)
 2018-03-15 10:35:20 -07:00
Inigo Goiri 6b8a60b62a HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar. 
(cherry picked from commit 6de135169e)
 2018-03-15 10:15:46 -07:00
Inigo Goiri cfa7cc2aa4 HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan. 
(cherry picked from commit 41fc7f80be)
 2018-03-14 13:15:51 -07:00
Sammi Chen e97234f274 HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen. 
(cherry picked from commit ad1b988a82)
 2018-03-14 14:51:51 +08:00
Yiqun Lin a105069729 HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri. 
(cherry picked from commit 76be6cbf6c)
 2018-03-14 11:31:35 +08:00
Xiao Chen fc6f3e2a6f HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 8211a3d469)
 2018-03-13 11:18:22 -07:00
Xiao Chen f23ef858ff Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma." 
This reverts commit 752e116f41.
 2018-03-13 10:39:50 -07:00
Xiao Chen c0aa249a1d HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3b8dbc2cb7)
 2018-03-13 10:14:39 -07:00
Xiao Chen 8f4bfb3ed5 HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham. 
(cherry picked from commit d6931c30c5)
 2018-03-13 10:08:09 -07:00
Xiao Chen 752e116f41 HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 84c1095586)
 2018-03-13 09:58:50 -07:00
Xiaoyu Yao 2a93ba690c HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar. 
(cherry picked from commit 107c177782)
 2018-03-12 20:23:52 -07:00
Yiqun Lin 840c83bf7a HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong. 2018-03-13 11:13:15 +08:00
Chris Douglas a03c8ea61f HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer 
(cherry picked from commit 45d1b0fdcc)
(cherry picked from commit 09940b1eb3)
 2018-03-12 20:06:22 -07:00
Yiqun Lin 430cdfefc0 HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin. 2018-03-13 10:41:44 +08:00