Commit Graph

6999 Commits

Author SHA1 Message Date
Sammi Chen e5281d9f8b Add 2.9.1 release notes and changes documents 2018-05-14 15:26:00 +08:00
Inigo Goiri e332e011ae HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu.
(cherry picked from commit d50c4d71dc)
2018-05-11 09:48:45 -07:00
Yiqun Lin 3665217d50 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota.
(cherry picked from commit a922b9c82c)
2018-05-11 15:09:54 +08:00
Inigo Goiri e3ff9e36df HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang.
(cherry picked from commit 914b98a713)
2018-05-09 16:52:45 -07:00
Inigo Goiri c649c76566 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.
(cherry picked from commit 63803e7051)
2018-05-09 13:56:06 -07:00
Xiao Chen 6f3bbf364c HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi.
(cherry picked from commit 696a4be0da)
2018-05-07 15:39:24 -07:00
Xiao Chen d762932d79 Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445."
This reverts commit 128b09ee43.
2018-05-07 13:47:52 -07:00
Inigo Goiri 524dde4006 HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin.
(cherry picked from commit a3b416f69d)
2018-05-03 11:25:30 -07:00
Yiqun Lin 5fef28d0d4 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri.
(cherry picked from commit 37269261d1)
2018-05-02 14:56:15 +08:00
Inigo Goiri 4aadfb3c92 HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang.
(cherry picked from commit 9e2cfb2d3f)
2018-05-01 08:13:30 -07:00
Inigo Goiri 4c13e7e3a0 HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak.
(cherry picked from commit fc074a359c)
2018-04-30 13:31:03 -07:00
Inigo Goiri ce62991648 HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang.
(cherry picked from commit eb7fe1d588)
2018-04-28 09:05:59 -07:00
Inigo Goiri 9923fa2490 HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S.
(cherry picked from commit 484440602c)
2018-04-27 16:29:41 -07:00
Inigo Goiri f26f764857 HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari.
(cherry picked from commit f469628bba)
2018-04-27 15:14:18 -07:00
Yiqun Lin e097998c22 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri.
(cherry picked from commit 0a293de00d)
2018-04-27 10:39:21 +08:00
Inigo Goiri 921a3e1678 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li.
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
2018-04-26 13:01:16 -07:00
Yiqun Lin 999ea44b9f HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri.
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
2018-04-25 15:23:54 +08:00
Yiqun Lin ea2863f2b5 HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri.
(cherry picked from commit b06601acce)
2018-04-24 11:27:14 +08:00
Inigo Goiri 5b2427cd73 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang.
(cherry picked from commit df92a17e02)
2018-04-23 19:12:53 -07:00
Bharat Viswanadham caf4d5000e HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. Contributed by Bharat Viswanadham
(cherry picked from commit 9b5375e0c1)
2018-04-23 16:10:28 -07:00
Chris Douglas cf272c5179 HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang
(cherry picked from commit f411de6a79)
2018-04-23 11:13:52 -07:00
Arpit Agarwal 1f486a0649 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:09:02 -07:00
Yiqun Lin 3f72d077ff HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri.
(cherry picked from commit b6dae26f44)
2018-04-21 13:35:04 +08:00
Sangjin Lee 9f648f6e59 HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov.
(cherry picked from commit f40969a141)
2018-04-20 20:36:31 -07:00
Inigo Goiri 18b6a2a2ee HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar.
(cherry picked from commit 1134af9ad1)
2018-04-19 14:57:09 -07:00
Xiao Chen 128b09ee43 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445.
(cherry picked from commit 6503593711)
2018-04-18 22:29:59 -05:00
Shashikant Banerjee a13b3edfd8
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247)
2018-04-19 08:36:32 +09:00
Bharat Viswanadham 63c1b9d50c HDFS-13464. Fix javadoc in FsVolumeList#handleVolumeFailures. Contributed by Shashikant Banerjee
(cherry picked from commit bf7694d020)
2018-04-18 08:24:52 -07:00
Mukul Kumar Singh a07ba66ee9 HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. Contributed by Shashikant Banerjee. 2018-04-18 16:30:40 +05:30
Mukul Kumar Singh d99c8aa898 HDFS-13463. Fix javadoc in FsDatasetImpl#checkAndUpdate. Contributed by Shashikant Banerjee. 2018-04-18 16:30:24 +05:30
Erik Krogen fb350e8112
HDFS-12828. OIV ReverseXML Processor fails with escaped characters
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a90)
2018-04-18 14:40:01 +09:00
Wei Yan 5d50f716e7 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e47)
2018-04-17 15:03:12 -07:00
Inigo Goiri 4be0fa28da HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak.
(cherry picked from commit c9b33514b8)
2018-04-17 14:20:23 -07:00
Bharat Viswanadham fc11555caf HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh
(cherry picked from commit a68b04370f)
2018-04-17 12:41:54 -07:00
Yiqun Lin 1d776f22f9 HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21)
2018-04-17 11:25:14 +08:00
Arpit Agarwal 43a2af5569 HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar. 2018-04-16 14:18:41 -07:00
Xiao Chen 805e33b62c HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-16 11:58:10 -07:00
Wei-Chiu Chuang ca8bb322be HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.
(cherry picked from commit e66e287efe)
2018-04-13 12:18:49 -07:00
Wei-Chiu Chuang 696d786063 HDFS-11900. Hedged reads thread pool creation not synchronized. Contributed by John Zhuge. 2018-04-13 10:16:23 -07:00
Xiaoyu Yao 867135af28 HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and Chao Sun. 2018-04-13 10:14:47 -07:00
Yongjun Zhang 56acbe476b HDFS-13315. Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Contributed by Yongjun Zhang. 2018-04-13 10:14:24 -07:00
Chris Douglas ffc39ec3ab HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer 2018-04-13 10:11:35 -07:00
Bharat Viswanadham 8df8cad019 HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee.
(cherry picked from commit fa8b88ab2b)
2018-04-13 09:05:24 -07:00
Yiqun Lin 16763d8229 HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie.
(cherry picked from commit 0725953efe)
2018-04-13 17:57:15 +08:00
Akira Ajisaka 5531c31f16
HDFS-13436. Fix javadoc of package-info.java
(cherry picked from commit 9b0b9f2af2)
2018-04-13 13:24:42 +09:00
Inigo Goiri 671e407ced Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun."
This reverts commit 8c9dab978e.
2018-04-12 08:43:12 -07:00
Akira Ajisaka 5f4762d950
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu.
(cherry picked from commit 113af12cfb)
2018-04-12 17:48:14 +09:00
Akira Ajisaka 2d82a21b84
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd)
2018-04-12 10:46:14 +09:00
Inigo Goiri 3c1cd08f04 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042)
2018-04-11 12:03:40 -07:00
Inigo Goiri d032112e6b HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:41:13 -07:00