Commit Graph

6847 Commits

Author SHA1 Message Date
Xiao Chen d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen.
(cherry picked from commit c75105f07b)
2018-03-02 16:47:19 -08:00
Xiaoyu Yao a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar.
(cherry picked from commit f20e10b2dd)
2018-02-28 09:47:57 -08:00
Xiaoyu Yao b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru.
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
2018-02-28 08:38:32 -08:00
Yiqun Lin d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang.
(cherry picked from commit a9c14b1119)
2018-02-28 10:20:32 +08:00
Inigo Goiri b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong.
(cherry picked from commit d86f301d46)
2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze 3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze 7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Arpit Agarwal 7da0b78cf2 HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:21 -08:00
Yiqun Lin e54c76625f HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin.
(cherry picked from commit 1e85a995d1)
2018-02-27 10:51:32 +08:00
Chao Sun c58cec2507 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun.
(cherry picked from commit ae290a4bb4)
2018-02-26 16:17:36 -08:00
Wei Yan 6ca6ae7910 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan.
(cherry picked from commit 6ce9f79cc9)
2018-02-26 15:20:50 -08:00
Kihwal Lee 33f82323b0 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee.
(cherry picked from commit 451265a83d)
2018-02-26 10:29:28 -06:00
Arpit Agarwal cb260a2d34 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 14:52:44 -08:00
Arpit Agarwal 9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Arpit Agarwal c5602ea124 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:26:20 -08:00
Xiaoyu Yao 57095b68dc HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain.
(cherry picked from commit 1e84e46f16)
2018-02-23 19:35:36 -08:00
Xiao Chen 25f18619f8 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException.
(cherry picked from commit 51088d3233)
2018-02-23 14:00:17 -08:00
Xiaoyu Yao efbbcf9221 HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao.
(cherry picked from commit e978e1d9064fc794ea83217d0af2315d4167211e)
2018-02-23 09:01:45 -08:00
Gabor Bota b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31c)
2018-02-23 13:56:26 +09:00
Anu Engineer 4aa4bb46af HDFS-13175. Add more information for checking argument in DiskBalancerVolume.
Contributed by  Lei (Eddy) Xu.

(cherry picked from commit 121e1e1280)
2018-02-20 19:58:58 -08:00
Yiqun Lin 538c473f49 HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin.
(cherry picked from commit 8896d20b91)
2018-02-20 10:14:09 +08:00
fang zhenyi 55669df4f9
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4d4dde5112)
2018-02-18 22:22:06 +09:00
Arpit Agarwal c880a87101 HDFS-13058. Fix dfs.namenode.shared.edits.dir in TestJournalNode. Contributed by Bharat Viswanadham. 2018-02-16 10:29:29 -08:00
Arpit Agarwal f43f32bd31 HDFS-13153. Enable HDFS diskbalancer by default. Contributed by Ajay Kumar. 2018-02-16 09:38:51 -08:00
Bharat Viswanadham 1fb2f020e2
HDFS-13151. Fix the javadoc error in ReplicaInfo
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit a1e05e0292)
2018-02-16 16:23:29 +09:00
Kihwal Lee 4cdc57f6a4 HDFS-13112. Token expiration edits may cause log corruption or deadlock. Contributed by Daryn Sharp.
(cherry picked from commit 47473952e5)
2018-02-15 15:34:46 -06:00
Kihwal Lee 8b9376a089 xattr api cleanup
(cherry picked from commit da59acd8ca)
2018-02-15 11:13:56 -06:00
Steve Loughran 401a0ee38d HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions.
Contributed by Andras Bokor.

(cherry picked from commit f20dc0d577)
2018-02-14 16:21:22 +00:00
Brahma Reddy Battula fb088564a2 HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula.
(cherry picked from commit 35c17351ca)
2018-02-12 22:16:41 +05:30
Arpit Agarwal e82abfd64b HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao. 2018-02-12 07:17:50 -08:00
Yiqun Lin 543f3abbee HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin. 2018-02-09 13:57:42 +08:00
Steve Loughran 996796f104 HADOOP-15214. Make Hadoop compatible with Guava 21.0.
Contributed by Igor Dvorzhak
2018-02-08 10:55:54 -08:00
Xiaoyu Yao 8faf0b50d4 HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao. 2018-02-08 08:59:48 -08:00
Yongjun Zhang f491f717e9 HDFS-13115. In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted. Contributed by Yongjun Zhang. 2018-02-07 12:58:09 -08:00
Jitendra Pandey b061215ecf HDFS-11701. NPE from Unresolved Host causes permanent DFSInputStream failures. Contributed by Lokesh Jain. 2018-02-07 11:22:36 -08:00
Brahma Reddy Battula 01bd6ab18f HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang. 2018-02-07 23:10:33 +05:30
Xiao Chen e5c2fdddd6 HDFS-12933. Improve logging when DFSStripedOutputStream failed to write some blocks. Contributed by chencan. 2018-02-06 22:54:53 -08:00
Tsz-Wo Nicholas Sze 4fadcf1631 HDFS-13107. Add Mover Cli Unit Tests for Federated cluster. Contributed by Bharat Viswanadham 2018-02-06 16:59:26 -08:00
Sean Mackrory b14db95c35 HDFS-13106. Need to exercise all HDFS APIs for EC. Contributed by Haibo Yan. 2018-02-06 16:39:00 -07:00
Tsz-Wo Nicholas Sze 4d1bf33d0f HDFS-12947. Limit the number of Snapshots allowed to be created for a Snapshottable Directory. Contributed by Shashikant Banerjee 2018-02-06 14:46:44 -08:00
Anu Engineer 4304fcd5bd HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 2018-02-06 13:43:45 -08:00
Yongjun Zhang 4e9a59ce16 HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang. 2018-02-02 22:58:44 -08:00
Wei-Chiu Chuang 2021f4bdce HDFS-11187. Optimize disk access for last partial chunk checksum of Finalized replica. Contributed by Wei-Chiu Chuang. 2018-02-02 17:18:42 -08:00
Hanisha Koneru 0ef639235b HDFS-13073. Cleanup code in InterQJournalProtocol.proto. Contributed by Bharat Viswanadham. 2018-02-02 16:28:03 -08:00
Akira Ajisaka 4aef8bd2ef
HDFS-13048. LowRedundancyReplicatedBlocks metric can be negative 2018-02-02 14:34:07 +09:00
Yiqun Lin b0627c891b HDFS-13068. RBF: Add router admin option to manage safe mode. Contributed by Yiqun Lin. 2018-02-02 11:25:41 +08:00
Anu Engineer aa45faf0b2 HDFS-12942. Synchronization issue in FSDataSetImpl#moveBlock. Contributed by Ajay Kumar. 2018-02-01 18:03:01 -08:00
Hanisha Koneru dd50f53997 HDFS-13062. Provide support for JN to use separate journal disk per namespace. Contributed by Bharat Viswanadham. 2018-02-01 12:28:17 -08:00
Xiaoyu Yao b3ae11d597 HDFS-12997. Move logging to slf4j in BlockPoolSliceStorage and Storage. Contributed by Ajay Kumar. 2018-02-01 10:45:34 -08:00
Inigo Goiri 6ca7204ceb HDFS-13043. RBF: Expose the state of the Routers in the federation. Contributed by Inigo Goiri. 2018-02-01 10:37:14 -08:00