Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,935 Commits 326 Branches 371 Tags
Commit Graph

17935 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Gergely Novák
162e99c696
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e99a1e77671fa0e74a652bc2221bbe01d1a579d3)
 2018-03-02 16:21:41 -08:00
Jason Lowe
9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8602ef580a7885876de114b2425da89)
 2018-03-02 10:00:59 -06:00
Weiwei Yang
46b14efb05 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-02 10:33:17 +08:00
Sunil G
37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 
(cherry picked from commit 22928c0c60de3ccbd6b27ac3a410e7566ce4136b)
 2018-03-01 22:40:11 +05:30
Billie Rinaldi
5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 
(cherry picked from commit 5ed689e33ac0becfc36d5fa424466bb1732aa59b)
 2018-03-01 08:01:38 -08:00
Nanda kumar
749abde043
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 55d04a6db10d0e58cfe0ff82fa646bb6ba57aaac)
 2018-03-01 19:04:23 +09:00
Anu Engineer
f0c70a3494 HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar. 2018-02-28 10:46:20 -08:00
Xiaoyu Yao
a795302539 HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 
(cherry picked from commit f20e10b2dd59f99d9af009bbbb60a067b9893e69)
 2018-02-28 09:47:57 -08:00
Xiaoyu Yao
b241491173 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 
(cherry picked from commit 90fbe5c6834a6685e65542fa69e396fad2678927)
 2018-02-28 08:38:32 -08:00
Steve Loughran
abfe1eaf29 HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake. 
Contributed by Steve Loughran

(cherry picked from commit edc9f1451b4af79069cd4b1d608b0fa68648ee72)
 2018-02-28 14:43:10 +00:00
Steve Loughran
b580196a16 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17. 
Contributed by Steve Loughran.
 2018-02-28 13:09:22 +00:00
Yiqun Lin
d975c104f5 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 
(cherry picked from commit a9c14b11193adeaa31389578f4cb90fa79cad8c3)
 2018-02-28 10:20:32 +08:00
Inigo Goiri
b375bcfd6b HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong. 
(cherry picked from commit d86f301d464683f8d392dad50e83f50d823e862e)
 2018-02-27 17:40:29 -08:00
Tsz-Wo Nicholas Sze
3141e17d83 HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee 2018-02-27 15:38:05 -08:00
Tsz-Wo Nicholas Sze
7abcea0378 HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee 2018-02-27 15:37:48 -08:00
Wangda Tan
164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda) 
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
 2018-02-27 13:20:05 -08:00
Wangda Tan
6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda) 
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
 2018-02-27 13:19:57 -08:00
Arpit Agarwal
ab2674a1ee MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham. 2018-02-27 10:27:48 -08:00
Arpit Agarwal
7da0b78cf2 HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham. 2018-02-27 10:18:21 -08:00
Billie Rinaldi
b22eaa05a1 MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-27 08:50:02 -08:00
Arpit Agarwal
a2e824f9c6 HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar. 2018-02-27 08:48:24 -08:00
Arpit Agarwal
4d1d1d7aec HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar. 2018-02-27 07:38:40 -08:00
Yiqun Lin
e54c76625f HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin. 
(cherry picked from commit 1e85a995d1c7fe3dbf4b36a481feb5fdeeb6015b)
 2018-02-27 10:51:32 +08:00
Chao Sun
c58cec2507 HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun. 
(cherry picked from commit ae290a4bb4e514e2fe9b40d28426a7589afe2a3f)
 2018-02-26 16:17:36 -08:00
Eric Yang
9b37d18693 YARN-7963. Updated MockServiceAM unit test to prevent test hang. 
Contributed by Chandni Singh
 2018-02-26 18:53:14 -05:00
Wei Yan
6ca6ae7910 HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan. 
(cherry picked from commit 6ce9f79cc9b2107e5953a39d05b22966aff0b7ff)
 2018-02-26 15:20:50 -08:00
Arpit Agarwal
0ccd7138a7 HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively. Contributed by Nishant Bangarwa. 2018-02-26 13:58:54 -08:00
Konstantinos Karanasos
eb8765bbe9 YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang. 
(cherry picked from commit e85188101c6c74b348a2fb6aa0f4e85c81b4a28c)
 2018-02-26 12:17:08 -08:00
Kihwal Lee
33f82323b0 HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee. 
(cherry picked from commit 451265a83d8798624ae2a144bc58fa41db826704)
 2018-02-26 10:29:28 -06:00
Arpit Agarwal
cb260a2d34 HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula. 2018-02-24 14:52:44 -08:00
Arpit Agarwal
9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Arpit Agarwal
c5602ea124 HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh. 2018-02-24 14:26:20 -08:00
Xiaoyu Yao
57095b68dc HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain. 
(cherry picked from commit 1e84e46f1621fe694f806bfc41d3b2a06c9500b6)
 2018-02-23 19:35:36 -08:00
Arpit Agarwal
83ac13a59a HADOOP-15255. Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar. 2018-02-23 15:37:41 -08:00
Jason Lowe
de7a079554 YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan 
(cherry picked from commit 8e728f39c961f034369b43e087d68d01aa4a0e7d)
 2018-02-23 16:06:08 -06:00
Xiao Chen
25f18619f8 HDFS-13164. File not closed if streamer fail with DSQuotaExceededException. 
(cherry picked from commit 51088d323359587dca7831f74c9d065c2fccc60d)
 2018-02-23 14:00:17 -08:00
Kihwal Lee
1f0952bfc7 HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp. 2018-02-23 13:13:20 -06:00
Xiaoyu Yao
efbbcf9221 HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao. 
(cherry picked from commit e978e1d9064fc794ea83217d0af2315d4167211e)
 2018-02-23 09:01:45 -08:00
Sunil G
40feeeeec7 YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora. 
(cherry picked from commit d1cd573687fa3466a5ceb9a525141a8c3a8f686f)
 2018-02-23 16:50:59 +05:30
Sunil G
c152187275 YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák. 
(cherry picked from commit cc683952d2c1730109497aa78dd53629e914d294)
 2018-02-23 16:11:20 +05:30
Gabor Bota
b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31ce25fbe5fa173bce36da2950d74a475)
 2018-02-23 13:56:26 +09:00
Eric Yang
7fac69ea48 YARN-7942. Add check for JAAS configuration for Yarn Service. 
Contributed by Billie Rinaldi
(Cherry-picked from commit 95904f6b3ccd1d167088086472eabdd85b2d148d)
 2018-02-22 16:19:26 -05:00
Eric Yang
13922cc32d YARN-7836. Added error check for updating service components. 
(Contributed by Gour Saha)
(Cherry-picked from commit 190969006d4a7f9ef86d67bba472f7dc5642668a)
 2018-02-22 16:11:22 -05:00
Jason Lowe
bfbd43f2f7 YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf 
(cherry picked from commit 3132709b46a35f70cf5278f3ace677e6e18a1d03)
 2018-02-21 16:55:06 -06:00
Steve Loughran
958b445047 HADOOP-15247. Move commons-net up to 3.6. 
Contributed by Steve Loughran.

(cherry picked from commit 004b722372de67635a24e71b264b3b604df4b693)
 2018-02-21 10:41:20 +00:00
Sunil G
e53da3914a YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne. 
(cherry picked from commit bdd2a184d78379d99c802a43ebec7d2cef0bbaf7)
 2018-02-21 14:57:43 +05:30
Sunil G
21af27995d YARN-7223. Document GPU isolation feature. Contributed by Wangda Tan. 
(cherry picked from commit 86b227a1fbe26b992c5498cfdd3b1691b4362ee9)
 2018-02-21 14:17:18 +05:30
Anu Engineer
4aa4bb46af HDFS-13175. Add more information for checking argument in DiskBalancerVolume. 
Contributed by  Lei (Eddy) Xu.

(cherry picked from commit 121e1e1280c7b019f6d2cc3ba9eae1ead0dd8408)
 2018-02-20 19:58:58 -08:00
Eric Yang
7506e100fc YARN-7940. Fixed a bug in ServiceAM ZooKeeper initialization. 
(Contributed by Billie Rinaldi)

(cherry-picked from commit 7280c5af82d36a9be15448293210d871f680f55e)
 2018-02-20 14:16:46 -05:00
Yiqun Lin
538c473f49 HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin. 
(cherry picked from commit 8896d20b91520053a6bbfb680adb345cd24f4142)
 2018-02-20 10:14:09 +08:00