Commit Graph

17894 Commits

Author SHA1 Message Date
Yiqun Lin 8262b63c8c HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin.
(cherry picked from commit 58ea2d7a65)
2018-03-07 15:29:16 +08:00
Xiaoyu Yao 07a966ede3 HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru.
(cherry picked from commit edf9445708)
2018-03-06 18:29:42 -08:00
Allen Wittenauer 1a8e6a52a5
HADOOP-15279. increase maven heap size recommendations
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
(cherry picked from commit d4cc50f622)
2018-03-06 13:55:11 -08:00
Xiao Chen 2d93a7381e HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell.
(cherry picked from commit 92c15e19272a8bb59f8704c44d4cd713d3a58bcb)
2018-03-06 09:58:01 -08:00
Steve Loughran e8ecd4fa1d HADOOP-15289. FileStatus.readFields() assertion incorrect.
Contributed by Steve Loughran.

(cherry picked from commit 12ecb55ffe)
2018-03-06 10:06:11 +00:00
Sen Zhao 429e9d6c19
YARN-7736. Fix itemization in YARN federation document
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
2018-03-05 11:54:49 -08:00
Steve Loughran 1901987ffe HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions.
Contributed by Aaron Fabbri.

(cherry picked from commit 8110d6a0d5)
2018-03-05 14:08:12 +00:00
Ajay Kumar 92e2e6c22e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3dc30bc24e)
2018-03-04 07:19:33 -08:00
Xiao Chen d35baf157e HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen.
(cherry picked from commit c75105f07b)
2018-03-02 16:47:19 -08:00
Gergely Novák 162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e7767)
2018-03-02 16:21:41 -08:00
Jason Lowe 9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang
(cherry picked from commit 83798f15f8)
2018-03-02 10:00:59 -06:00
Weiwei Yang 46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G 37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen.
(cherry picked from commit 22928c0c60)
2018-03-01 22:40:11 +05:30
Billie Rinaldi 5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh
(cherry picked from commit 5ed689e33a)
2018-03-01 08:01:38 -08:00
Nanda kumar 749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db1)
2018-03-01 19:04:23 +09:00
Anu Engineer f0c70a3494 HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar. 2018-02-28 10:46:20 -08:00
Xiaoyu Yao a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar.
(cherry picked from commit f20e10b2dd)
2018-02-28 09:47:57 -08:00
Xiaoyu Yao b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru.
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
2018-02-28 08:38:32 -08:00
Steve Loughran abfe1eaf29 HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
Contributed by Steve Loughran

(cherry picked from commit edc9f1451b)
2018-02-28 14:43:10 +00:00
Steve Loughran b580196a16 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17.
Contributed by Steve Loughran.
2018-02-28 13:09:22 +00:00
Yiqun Lin d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang.
(cherry picked from commit a9c14b1119)
2018-02-28 10:20:32 +08:00
Inigo Goiri b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong.
(cherry picked from commit d86f301d46)
2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze 3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze 7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Wangda Tan 164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda)
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
2018-02-27 13:20:05 -08:00
Wangda Tan 6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda)
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
2018-02-27 13:19:57 -08:00
Arpit Agarwal ab2674a1ee MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:27:48 -08:00
Arpit Agarwal 7da0b78cf2 HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:21 -08:00
Billie Rinaldi b22eaa05a1 MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-27 08:50:02 -08:00
Arpit Agarwal a2e824f9c6 HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar. 2018-02-27 08:48:24 -08:00
Arpit Agarwal 4d1d1d7aec HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar. 2018-02-27 07:38:40 -08:00
Yiqun Lin e54c76625f HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin.
(cherry picked from commit 1e85a995d1)
2018-02-27 10:51:32 +08:00
Chao Sun c58cec2507 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun.
(cherry picked from commit ae290a4bb4)
2018-02-26 16:17:36 -08:00
Eric Yang 9b37d18693 YARN-7963. Updated MockServiceAM unit test to prevent test hang.
Contributed by Chandni Singh
2018-02-26 18:53:14 -05:00
Wei Yan 6ca6ae7910 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan.
(cherry picked from commit 6ce9f79cc9)
2018-02-26 15:20:50 -08:00
Arpit Agarwal 0ccd7138a7 HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively. Contributed by Nishant Bangarwa. 2018-02-26 13:58:54 -08:00
Konstantinos Karanasos eb8765bbe9 YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang.
(cherry picked from commit e85188101c)
2018-02-26 12:17:08 -08:00
Kihwal Lee 33f82323b0 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee.
(cherry picked from commit 451265a83d)
2018-02-26 10:29:28 -06:00
Arpit Agarwal cb260a2d34 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 14:52:44 -08:00
Arpit Agarwal 9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Arpit Agarwal c5602ea124 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:26:20 -08:00
Xiaoyu Yao 57095b68dc HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain.
(cherry picked from commit 1e84e46f16)
2018-02-23 19:35:36 -08:00
Arpit Agarwal 83ac13a59a HADOOP-15255. Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar. 2018-02-23 15:37:41 -08:00
Jason Lowe de7a079554 YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan
(cherry picked from commit 8e728f39c9)
2018-02-23 16:06:08 -06:00
Xiao Chen 25f18619f8 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException.
(cherry picked from commit 51088d3233)
2018-02-23 14:00:17 -08:00
Kihwal Lee 1f0952bfc7 HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp. 2018-02-23 13:13:20 -06:00
Xiaoyu Yao efbbcf9221 HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao.
(cherry picked from commit e978e1d9064fc794ea83217d0af2315d4167211e)
2018-02-23 09:01:45 -08:00
Sunil G 40feeeeec7 YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora.
(cherry picked from commit d1cd573687)
2018-02-23 16:50:59 +05:30
Sunil G c152187275 YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák.
(cherry picked from commit cc683952d2)
2018-02-23 16:11:20 +05:30
Gabor Bota b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31c)
2018-02-23 13:56:26 +09:00