Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,192 Commits 326 Branches 371 Tags
Commit Graph

6975 Commits

Author SHA1 Message Date
Inigo Goiri
18b6a2a2ee HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 1134af9ad1daf683204df8f95a8f03d7baaa74d4)
 2018-04-19 14:57:09 -07:00
Xiao Chen
128b09ee43 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 
(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)
 2018-04-18 22:29:59 -05:00
Shashikant Banerjee
a13b3edfd8
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:36:32 +09:00
Bharat Viswanadham
63c1b9d50c HDFS-13464. Fix javadoc in FsVolumeList#handleVolumeFailures. Contributed by Shashikant Banerjee 
(cherry picked from commit bf7694d020ea787c542abc504b55ad1bd1137010)
 2018-04-18 08:24:52 -07:00
Mukul Kumar Singh
a07ba66ee9 HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. Contributed by Shashikant Banerjee. 2018-04-18 16:30:40 +05:30
Mukul Kumar Singh
d99c8aa898 HDFS-13463. Fix javadoc in FsDatasetImpl#checkAndUpdate. Contributed by Shashikant Banerjee. 2018-04-18 16:30:24 +05:30
Erik Krogen
fb350e8112
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
 2018-04-18 14:40:01 +09:00
Wei Yan
5d50f716e7 HDFS-13466. RBF: Add more router-related information to the UI. 
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
 2018-04-17 15:03:12 -07:00
Inigo Goiri
4be0fa28da HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 
(cherry picked from commit c9b33514b8d11db44b5f95b4df43789ed45c47a7)
 2018-04-17 14:20:23 -07:00
Bharat Viswanadham
fc11555caf HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh 
(cherry picked from commit a68b04370f2423f3fa2adb06961fa1818628f2b5)
 2018-04-17 12:41:54 -07:00
Yiqun Lin
1d776f22f9 HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
 2018-04-17 11:25:14 +08:00
Arpit Agarwal
43a2af5569 HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar. 2018-04-16 14:18:41 -07:00
Xiao Chen
805e33b62c HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-16 11:58:10 -07:00
Wei-Chiu Chuang
ca8bb322be HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota. 
(cherry picked from commit e66e287efe2b43e710137a628f03c7df3ebdf498)
 2018-04-13 12:18:49 -07:00
Wei-Chiu Chuang
696d786063 HDFS-11900. Hedged reads thread pool creation not synchronized. Contributed by John Zhuge. 2018-04-13 10:16:23 -07:00
Xiaoyu Yao
867135af28 HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and Chao Sun. 2018-04-13 10:14:47 -07:00
Yongjun Zhang
56acbe476b HDFS-13315. Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Contributed by Yongjun Zhang. 2018-04-13 10:14:24 -07:00
Chris Douglas
ffc39ec3ab HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-04-13 10:11:35 -07:00
Bharat Viswanadham
8df8cad019 HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee. 
(cherry picked from commit fa8b88ab2b272b29cf116a5de038d78fc4357b9d)
 2018-04-13 09:05:24 -07:00
Yiqun Lin
16763d8229 HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie. 
(cherry picked from commit 0725953efec89b35b7586b846abb01f7c5963b37)
 2018-04-13 17:57:15 +08:00
Akira Ajisaka
5531c31f16
HDFS-13436. Fix javadoc of package-info.java 
(cherry picked from commit 9b0b9f2af2f6827d7430f995d3203c4cb7ef7e48)
 2018-04-13 13:24:42 +09:00
Inigo Goiri
671e407ced Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit 8c9dab978e2bdcbd6558c9e12b177c5bdca04393.
 2018-04-12 08:43:12 -07:00
Akira Ajisaka
5f4762d950
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu. 
(cherry picked from commit 113af12cfb240ea9a7189bb2701693466eb8e993)
 2018-04-12 17:48:14 +09:00
Akira Ajisaka
2d82a21b84
HDFS-13427. Fix the section titles of transparent encryption document. 
(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)
 2018-04-12 10:46:14 +09:00
Inigo Goiri
3c1cd08f04 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 18de6f2042b70f9f0d7a2620c60de022768a7b13)
 2018-04-11 12:03:40 -07:00
Inigo Goiri
d032112e6b HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
 2018-04-11 10:41:13 -07:00
Wei Yan
32efc77799 HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 
(cherry picked from commit 0c93d43f3d624a4fd17b3b050443d9e7e20d4f0a)
 2018-04-11 08:38:52 -07:00
Rakesh Radhakrishnan
3414bf6dbb HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f89594f0b80e8efffdcb887daa4a18a2b0a228b3)
 2018-04-10 23:40:26 +05:30
Weiwei Yang
b104de3f64 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 2018-04-10 22:13:08 +08:00
Yiqun Lin
5eb32396d7 HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
 2018-04-10 15:36:48 +08:00
Yiqun Lin
9a86cb0494 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
 2018-04-10 14:31:59 +08:00
Wangda Tan
25bf1d3ac6 Updated branch-3.1 to track 3.1.1 
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
 2018-04-09 10:58:50 -07:00
Inigo Goiri
1c9038bae5 HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 
(cherry picked from commit e9b9f48dad5ebb58ee529f918723089e8356c480)
 2018-04-09 10:09:55 -07:00
Inigo Goiri
8c9dab978e HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576da4cc463dff85118163ccfff02215fc)
 2018-04-09 09:17:35 -07:00
Yiqun Lin
ac5703207d HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
 2018-04-08 12:03:35 +08:00
Wangda Tan
a336561e2b Added CHANGES/RELEASES/Jdiff for 3.1.0 release 
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
 2018-04-05 15:52:02 -07:00
Wei Yan
89efe30f65 HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:13:16 -07:00
Lei Xu
2543a9dd77 HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
 2018-04-05 10:01:05 -07:00
Yiqun Lin
b89dc00302 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit 2be64eb201134502a92f7239bef8aa780771ca0b)
 2018-04-03 15:23:39 +08:00
Xiao Chen
dcb2176c5d HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:48:54 -07:00
Inigo Goiri
3c9983547c HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar. 
(cherry picked from commit dc8e3432013153ac11d31d6b462aa96f8ca2c443)
 2018-03-31 09:46:44 -07:00
Konstantin V Shvachko
4ce45a8ec7 HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 18:57:18 -07:00
Xiao Chen
2960592c6f HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 
(cherry picked from commit 2c6cfad5a31ca4d9126ecd2b3c43cca8543aacb4)
 2018-03-29 16:07:01 -07:00
Arpit Agarwal
d54e19a913 HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:14 -07:00
Yiqun Lin
99766992e6 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri. 
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
 2018-03-28 11:04:36 +08:00
Inigo Goiri
c1fc87dcce HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma. 
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
 2018-03-27 10:32:07 -07:00
Inigo Goiri
0dc16559ee HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong. 
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
 2018-03-26 09:43:28 -07:00
Yiqun Lin
1e01ddfe4f HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin. 
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
 2018-03-26 18:36:22 +08:00
Lei Xu
4859cd7cc9 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:53:30 -07:00
weiy
d17aa8d052 HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
 2018-03-23 08:40:04 -07:00