Commit Graph

4285 Commits

Author SHA1 Message Date
Arpit Agarwal 9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Jason Lowe de7a079554 YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan
(cherry picked from commit 8e728f39c9)
2018-02-23 16:06:08 -06:00
Sunil G 40feeeeec7 YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora.
(cherry picked from commit d1cd573687)
2018-02-23 16:50:59 +05:30
Sunil G c152187275 YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák.
(cherry picked from commit cc683952d2)
2018-02-23 16:11:20 +05:30
Gabor Bota b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31c)
2018-02-23 13:56:26 +09:00
Eric Yang 7fac69ea48 YARN-7942. Add check for JAAS configuration for Yarn Service.
Contributed by Billie Rinaldi
(Cherry-picked from commit 95904f6b3c)
2018-02-22 16:19:26 -05:00
Eric Yang 13922cc32d YARN-7836. Added error check for updating service components.
(Contributed by Gour Saha)
(Cherry-picked from commit 190969006d)
2018-02-22 16:11:22 -05:00
Jason Lowe bfbd43f2f7 YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf
(cherry picked from commit 3132709b46)
2018-02-21 16:55:06 -06:00
Sunil G e53da3914a YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
(cherry picked from commit bdd2a184d7)
2018-02-21 14:57:43 +05:30
Sunil G 21af27995d YARN-7223. Document GPU isolation feature. Contributed by Wangda Tan.
(cherry picked from commit 86b227a1fb)
2018-02-21 14:17:18 +05:30
Eric Yang 7506e100fc YARN-7940. Fixed a bug in ServiceAM ZooKeeper initialization.
(Contributed by Billie Rinaldi)

(cherry-picked from commit 7280c5af82)
2018-02-20 14:16:46 -05:00
Jason Lowe 94def88889 YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
(cherry picked from commit 9497215084)
2018-02-19 14:22:52 -06:00
Jason Lowe 1481adbabe Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 6f64530fc3.
2018-02-19 08:23:29 -06:00
fang zhenyi 55669df4f9
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4d4dde5112)
2018-02-18 22:22:06 +09:00
Rohith Sharma K S 7ee3713f73 YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri.
(cherry picked from commit 87bdde6943)
2018-02-18 14:05:59 +05:30
Arun Suresh 950566230c YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh)
(cherry picked from commit a1e56a6286)
2018-02-17 03:26:13 -08:00
Wangda Tan f878ddb067 YARN-7328. ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores. (lovekesh bansal via wangda)
Change-Id: Ibb1faf0beefec079dae2208986976b2f64650672
(cherry picked from commit ca1043ab90)
2018-02-17 13:03:58 +08:00
Sunil G d6eb001da9 YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
(cherry picked from commit aae629913c)
2018-02-16 13:56:44 +05:30
Jason Lowe 6f64530fc3 YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 2018-02-15 17:14:39 -06:00
Konstantinos Karanasos 41708402a1 YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
(cherry picked from commit 0b489e564c)
2018-02-15 14:25:34 -08:00
Eric Payne c81415dd2a Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit 1fcc3eac88.
2018-02-14 14:34:07 -06:00
Wangda Tan 4eb98f70ee YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda)
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
(cherry picked from commit 042ef2fa7b)
2018-02-14 23:21:22 +08:00
Eric Payne 1fcc3eac88 YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
(cherry picked from commit c5e6e3de1c)
2018-02-13 10:20:35 -06:00
Jason Lowe 5f7ef73b7a YARN-7914. Fix exit code handling for short lived Docker containers. Contributed by Shane Kumpf
(cherry picked from commit 5a1db60ab1)
2018-02-12 15:51:32 -06:00
Jason Lowe aad3958e50 YARN-7917. Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens. Contributed by Shane Kumpf
(cherry picked from commit 3414fd1243)
2018-02-12 09:30:06 -06:00
Wangda Tan 101cf2599e YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda)
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
(cherry picked from commit d02e42cee4)
2018-02-12 10:39:42 +08:00
Wangda Tan 3b20413acf YARN-7697. NM goes down with OOM due to leak in log-aggregation. (Xuan Gong via wangda)
Change-Id: Ie4fc7979d834e25f37a033c314f3efceeb8f4a9e
(cherry picked from commit d4c98579e3)
2018-02-12 10:39:34 +08:00
Wangda Tan 1e6d2972b8 YARN-5848. Remove unnecessary public/crossdomain.xml from YARN UIv2 sub project. (Sunil G via wangda)
Change-Id: Ie295f88232192e6b520c335b0332383cc6a232c0
(cherry picked from commit 789a185c16)
2018-02-12 10:39:27 +08:00
Wangda Tan 47a2e18670 YARN-7906. Fix mvn site fails with error: Multiple sources of package comments found for package o.a.h.y.client.api.impl. (Akira Ajisaka via wangda)
Change-Id: I20221d97446e97f208d587eacbc60448c11ffd48
(cherry picked from commit e795833d8c)
2018-02-12 10:39:21 +08:00
Weiwei Yang 388f4d11d7 YARN-7838. Support AND/OR constraints in Distributed Shell. Contributed by Weiwei Yang. 2018-02-11 14:21:55 +08:00
Eric Yang c97d5bceb2 YARN-7909. Add charset to YARN Service REST API. (Contributed by Eric Yang) 2018-02-09 20:01:25 -05:00
Jian He ddec08d7cc YARN-7827. Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404. Contributed by Sunil G 2018-02-08 21:32:40 -08:00
Yufei Gu 1bc03ddf97 YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand. 2018-02-08 12:32:43 -08:00
Jian He eb2449d539 YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf 2018-02-08 11:35:30 -08:00
Jason Lowe 456705a07c YARN-7815. Make the YARN mounts added to Docker containers more restrictive. Contributed by Shane Kumpf 2018-02-07 13:09:08 -06:00
Billie Rinaldi 266da25c04 Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi."
This reverts commit e14f03dfbf.
2018-02-07 07:17:00 -08:00
Billie Rinaldi aa461f9091 YARN-7516. Add security check for trusted docker images. Contributed by Eric Yang 2018-02-07 07:09:45 -08:00
Robert Kanter 814d701d46 YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations method (snemeth via rkanter) 2018-02-06 14:36:49 -08:00
Anu Engineer 4304fcd5bd HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 2018-02-06 13:43:45 -08:00
Weiwei Yang bff858e910 YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. Contributed by Sunil G. 2018-02-06 19:33:04 +08:00
Sunil G 72415c39cf YARN-7866. [UI2] Error to be displayed correctly while accessing kerberized cluster without kinit. Contributed by Sunil G. 2018-02-06 16:00:34 +05:30
Sunil G 2c326088ae YARN-7850. [UI2] Log Aggregation status to be displayed in Application Page. Contributed by Gergely Novák. 2018-02-06 15:32:09 +05:30
Jian He 87429affce YARN-7889. Missing kerberos token when check for RM REST API availability. Contributed by Eric Yang 2018-02-05 22:56:25 -08:00
Billie Rinaldi a196ee9362 YARN-7890. NPE during container relaunch. Contributed by Jason Lowe 2018-02-05 18:04:09 -08:00
Jason Lowe 60656bceca YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang 2018-02-05 17:16:04 -06:00
Miklos Szegedi c7101fe21b YARN-7879. NM user is unable to access the application filecache due to permissions. Contributed by Jason Lowe. 2018-02-02 16:48:57 -08:00
Konstantinos Karanasos 50723889cc YARN-7778. Merging of placement constraints defined at different levels. Contributed by Weiwei Yang. 2018-02-02 14:46:20 -08:00
Jian He b6e50fad53 YARN-7831. YARN Service CLI should use hadoop.http.authentication.type to determine authentication method. Contributed by Eric Yang 2018-02-02 14:38:33 -08:00
Jian He f9a4d4cf23 YARN-7868. Provide improved error message when YARN service is disabled. Contributed by Eric Yang 2018-02-02 11:10:47 -08:00
Arun Suresh 6e5ba9366f YARN-7839. Modify PlacementAlgorithm to Check node capacity before placing request on node. (Panagiotis Garefalakis via asuresh) 2018-02-02 10:28:22 -08:00