Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,537 Commits 326 Branches 371 Tags
Commit Graph

6667 Commits

Author SHA1 Message Date
Kihwal Lee
0943112d85 HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee. 
(cherry picked from commit 0ce6290de6a08beab01cb5184d366d97c9abd811)
 2018-05-17 09:28:17 -05:00
Inigo Goiri
fcf0b6a8dd HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu. 
(cherry picked from commit 454de3b543c8b00a9ab566c7d1c64d7e4cffee0f)
 2018-05-16 19:24:00 -07:00
Inigo Goiri
16e89a2771 HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 55d5549087183cb9c8d805e33267acabe9537667)
 2018-05-16 10:10:08 -07:00
Inigo Goiri
0a2cdd2730 HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 6b67161ca33881d5f3d7606a57786e9c960759a1)
 2018-05-16 09:32:39 -07:00
Inigo Goiri
eadfb55195 HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu. 
(cherry picked from commit 63480976a008bab0b84f4da08b1099867e5a9a6b)
 2018-05-15 15:36:30 -07:00
Inigo Goiri
1b4c39fd2f HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 2d6195c0af4a1840172899ce70bca4ca549eb713)
 2018-05-15 11:22:12 -07:00
Inigo Goiri
d1b17f997c HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu. 
(cherry picked from commit eaca7980ad2a750f6b0025a706062740c2ddded2)
 2018-05-15 10:29:04 -07:00
Inigo Goiri
9a722150c6 HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 92ebd466c75275118107e6ec665cf50e337a29e7)
 2018-05-15 10:22:52 -07:00
Hanisha Koneru
b00c0a08a3 HDFS-13544. Improve logging for JournalNode in federated cluster. 
(cherry picked from commit 6beb25ab7e4f5454dba0315a296081e61753f301)
 2018-05-14 10:16:06 -07:00
Xiao Chen
220e38ec02 HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure. 
(cherry picked from commit 960940e0e08f7839775f2d8a352b444d104d36b4)
 2018-05-14 09:29:22 -07:00
Sammi Chen
a700d05f72 Add 2.9.1 release notes and changes documents 
(cherry picked from commit f3f544b00475583c4c9fe52be0d2004390979bd0)
 2018-05-14 15:18:19 +08:00
Inigo Goiri
3b57a236ed HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu. 
(cherry picked from commit d50c4d71dc42576f96ae5c268856fd1a7795f936)
 2018-05-11 09:49:21 -07:00
Yongjun Zhang
21bf02023c Revert "HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem" 
This reverts commit 218a21a0f0013523a80eddf28c5f152ccf3b2212.
 2018-05-08 22:22:06 -07:00
Xiao Chen
fe66ed7da5 HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi. 
(cherry picked from commit 696a4be0daac00dd3bb64801d9fbe659aef9e089)
 2018-05-07 15:39:33 -07:00
Xiao Chen
22384580b2 Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445." 
This reverts commit 9f19c3b03eac43e549a33e5c8e92c7a39432d736.
 2018-05-07 13:56:26 -07:00
Inigo Goiri
d5aa4b9a9a HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 9e2cfb2d3f1a18984d07c81f9c46626dd842402a)
 2018-05-01 08:14:14 -07:00
Inigo Goiri
0e31e014f3 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak. 2018-04-30 15:22:30 -07:00
Inigo Goiri
af9bc982ce HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang. 
(cherry picked from commit eb7fe1d588de903be2ff6e20384c25c184881532)
 2018-04-28 09:06:58 -07:00
Inigo Goiri
a71d184f4f HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li. 
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
 2018-04-26 13:13:02 -07:00
Yiqun Lin
caffd538af HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri. 
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
 2018-04-25 15:39:16 +08:00
Inigo Goiri
7bb2709c4a HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 
(cherry picked from commit df92a17e02fe86279a6f4e413719d0a465b50837)
 2018-04-23 19:13:25 -07:00
Lei Xu
463fcfb50a Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. 
(cherry picked from commit f6ecb76d0b919b9836600fe28ec9e637b223cd54)

Conflicts:
	hadoop-project-dist/pom.xml
 2018-04-23 14:17:29 -07:00
Chris Douglas
956ab12ede HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 
(cherry picked from commit f411de6a79a0a87f03c09366cfe7a7d0726ed932)
(cherry picked from commit cf272c5179a9cb4b524016c0fca7c69c9eaa92f1)
 2018-04-23 11:15:15 -07:00
Arpit Agarwal
e8f62357c0 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:09:16 -07:00
Sangjin Lee
6becb3de0b
HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov. 
(cherry picked from commit f40969a141ec6aff254c41e4185cc61ea9e4e554)
 2018-04-20 21:10:39 -07:00
Xiao Chen
9f19c3b03e HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 
(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)
 2018-04-18 22:35:30 -05:00
Erik Krogen
1f8fd96eaf
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
 2018-04-18 14:40:24 +09:00
Inigo Goiri
282bbd56e8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 
(cherry picked from commit c9b33514b8d11db44b5f95b4df43789ed45c47a7)
 2018-04-17 14:29:20 -07:00
Wei-Chiu Chuang
dc01e323ed HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota. 
(cherry picked from commit e66e287efe2b43e710137a628f03c7df3ebdf498)
(cherry picked from commit ca8bb322be5e21ce00bb49cecfc4f515b49d2a37)
 2018-04-13 12:20:01 -07:00
Akira Ajisaka
64105868e9
HDFS-13436. Fix javadoc of package-info.java 
(cherry picked from commit 9b0b9f2af2f6827d7430f995d3203c4cb7ef7e48)
 2018-04-13 13:25:19 +09:00
Lei Xu
3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Akira Ajisaka
94daa4f3b3
HDFS-13427. Fix the section titles of transparent encryption document. 
(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)
 2018-04-12 10:46:40 +09:00
Rakesh Radhakrishnan
afbdd8fdcf HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f89594f0b80e8efffdcb887daa4a18a2b0a228b3)
 2018-04-10 23:43:28 +05:30
Weiwei Yang
1a0ce93696 HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka. 
(cherry picked from commit 6729047a8ba273d27edcc6a1a9d397a096f44d84)
 2018-04-10 22:16:25 +08:00
Manoj Govindassamy
218a21a0f0 HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem 
(cherry picked from commit 133d7ca76e3d4b60292d57429d4259e80bec650a)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
 2018-04-06 15:19:01 -07:00
Arpit Agarwal
492a597942 HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh. 
(cherry picked from commit b91305119b434d23b99ae7e755aea6639f48b6ab)
 2018-04-06 15:19:01 -07:00
Lei Xu
9fe337096d HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu). 
(cherry picked from commit 1cbf23df145af01692b8aaa438642b64e330cd05)
 2018-04-05 09:54:15 -07:00
Xiao Chen
ce37f586f5 HADOOP-15317. Improve NetworkTopology chooseRandom's loop. 
(cherry picked from commit 57374c4737ab0fccf52dae3cea911fc6bd90e1b7)
 2018-04-02 22:49:03 -07:00
Konstantin V Shvachko
4ba5efa96f HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie. 
(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)
 2018-03-30 19:05:01 -07:00
Yiqun Lin
7483acf484
HDFS-13349. Unresolved merge conflict in ViewFs.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-03-30 23:28:59 +09:00
Xiao Chen
cd74a281a7 HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge. 
(cherry picked from commit 2c6cfad5a31ca4d9126ecd2b3c43cca8543aacb4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirEncryptionZoneOp.java
 2018-03-29 16:07:09 -07:00
Arpit Agarwal
198f2bc35e HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal. 2018-03-28 12:49:09 -07:00
Lei Xu
beb98bb419 Update 3.0.1 jdiff file and jdiff stable api version 2018-03-23 11:51:40 -07:00
Wei Yan
f4d6fee96b HDFS-12512. RBF: Add WebHDFS. 
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
 2018-03-23 08:55:26 -07:00
Arpit Agarwal
26b08e002f
HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 46c93453e9eb66f91b677777e011abc96113f9b0)
 2018-03-23 18:12:48 +09:00
Kihwal Lee
7212c98ba5 HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong. 
(cherry picked from commit 66461ed98b0b2f630b682bff927dbd74c251c26e)
 2018-03-22 12:29:21 -05:00
Konstantin V Shvachko
987d90aa4c HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan. 
(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)
 2018-03-21 17:17:41 -07:00
weiy
62a819d5ee HDFS-13215. RBF: Move Router to its own module. 2018-03-19 23:15:53 -07:00
Inigo Goiri
c6b1125a24 HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak. 
(cherry picked from commit 08ff1586d5d3e39f546200f9e696f62ea4cf000d)
 2018-03-16 10:30:34 -07:00
Inigo Goiri
ba9a656ffa HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit e71bc00a471422ddb26dd54e706f09f0fe09925c)
 2018-03-15 10:35:20 -07:00