Commit Graph

4513 Commits

Author SHA1 Message Date
Weiwei Yang 815a00580a YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang. 2018-03-16 19:33:52 +08:00
Rohith Sharma K S c662e688d1 YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi.
(cherry picked from commit e6de10d0a6)
2018-03-14 09:48:04 +05:30
Billie Rinaldi 8f27c35da8 YARN-7523. Introduce description and version field in Service record. Contributed by Chandni Singh
(cherry picked from commit e1f5251f3c)
2018-03-10 07:53:20 -08:00
Wangda Tan 4b9eb2188b Updated timeline reader to use AuthenticationFilter
Change-Id: I961771589180c1eb377d36c37a79aa23754effbf
(cherry picked from commit 837338788eb903d0e8bbb1230694782a707891be)
2018-03-09 23:01:11 -08:00
Owen O'Malley 26540a64d4 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
This reverts commit 172b23af33.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
2018-03-09 23:01:11 -08:00
Sunil G f313e59494 YARN-7944. [UI2] Remove master node link from headers of application pages. Contributed by Yesha Vora.
(cherry picked from commit 113f401f41)
2018-03-08 23:54:15 +05:30
Jason Lowe c0986b1b7e YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan
(cherry picked from commit d69b31f7f7)
2018-03-07 09:21:54 -06:00
Sen Zhao 429e9d6c19
YARN-7736. Fix itemization in YARN federation document
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc)
2018-03-05 11:54:49 -08:00
Jason Lowe 9e5ac217ac YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang
(cherry picked from commit 83798f15f8)
2018-03-02 10:00:59 -06:00
Sunil G 37b8b24dfb YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen.
(cherry picked from commit 22928c0c60)
2018-03-01 22:40:11 +05:30
Billie Rinaldi 5621254bd0 YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh
(cherry picked from commit 5ed689e33a)
2018-03-01 08:01:38 -08:00
Wangda Tan 164ad48fa7 YARN-7959. Add .vm extension to PlacementConstraints.md to ensure proper filtering. (Weiwei Yang via wangda)
Change-Id: I34ec516994a5de7accaa5ef7044e443b340bd294
(cherry picked from commit 0d516b30769471d9114214b3a518e2146ff2f25e)
2018-02-27 13:20:05 -08:00
Wangda Tan 6798adb12d YARN-7893. Document the FPGA isolation feature. (Zhankun Tang via wangda)
Change-Id: I8723320377a4bd0a7db168670d183ef5543caa67
(cherry picked from commit c2af2f16718bd1d38ceb05e354f34d7bef89127d)
2018-02-27 13:19:57 -08:00
Eric Yang 9b37d18693 YARN-7963. Updated MockServiceAM unit test to prevent test hang.
Contributed by Chandni Singh
2018-02-26 18:53:14 -05:00
Konstantinos Karanasos eb8765bbe9 YARN-7921. Transform a PlacementConstraint to a string expression. Contributed by Weiwei Yang.
(cherry picked from commit e85188101c)
2018-02-26 12:17:08 -08:00
Arpit Agarwal 9f3be797be HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:42:48 -08:00
Jason Lowe de7a079554 YARN-5714. ContainerExecutor does not order environment map. Contributed by Remi Catherinot and Jim Brennan
(cherry picked from commit 8e728f39c9)
2018-02-23 16:06:08 -06:00
Sunil G 40feeeeec7 YARN-7949. [UI2] ArtifactsId should not be a compulsory field for new service. Contributed by Yesha Vora.
(cherry picked from commit d1cd573687)
2018-02-23 16:50:59 +05:30
Sunil G c152187275 YARN-7675. [UI2] Support loading pre-2.8 version /scheduler REST response for queue page. Contributed by Gergely Novák.
(cherry picked from commit cc683952d2)
2018-02-23 16:11:20 +05:30
Gabor Bota b8942cb3bf
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31c)
2018-02-23 13:56:26 +09:00
Eric Yang 7fac69ea48 YARN-7942. Add check for JAAS configuration for Yarn Service.
Contributed by Billie Rinaldi
(Cherry-picked from commit 95904f6b3c)
2018-02-22 16:19:26 -05:00
Eric Yang 13922cc32d YARN-7836. Added error check for updating service components.
(Contributed by Gour Saha)
(Cherry-picked from commit 190969006d)
2018-02-22 16:11:22 -05:00
Jason Lowe bfbd43f2f7 YARN-7916. Remove call to docker logs on failure in container-executor. Contributed by Shane Kumpf
(cherry picked from commit 3132709b46)
2018-02-21 16:55:06 -06:00
Sunil G e53da3914a YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
(cherry picked from commit bdd2a184d7)
2018-02-21 14:57:43 +05:30
Sunil G 21af27995d YARN-7223. Document GPU isolation feature. Contributed by Wangda Tan.
(cherry picked from commit 86b227a1fb)
2018-02-21 14:17:18 +05:30
Eric Yang 7506e100fc YARN-7940. Fixed a bug in ServiceAM ZooKeeper initialization.
(Contributed by Billie Rinaldi)

(cherry-picked from commit 7280c5af82)
2018-02-20 14:16:46 -05:00
Jason Lowe 94def88889 YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
(cherry picked from commit 9497215084)
2018-02-19 14:22:52 -06:00
Jason Lowe 1481adbabe Revert "YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan"
This reverts commit 6f64530fc3.
2018-02-19 08:23:29 -06:00
fang zhenyi 55669df4f9
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 4d4dde5112)
2018-02-18 22:22:06 +09:00
Rohith Sharma K S 7ee3713f73 YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri.
(cherry picked from commit 87bdde6943)
2018-02-18 14:05:59 +05:30
Arun Suresh 950566230c YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh)
(cherry picked from commit a1e56a6286)
2018-02-17 03:26:13 -08:00
Wangda Tan f878ddb067 YARN-7328. ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores. (lovekesh bansal via wangda)
Change-Id: Ibb1faf0beefec079dae2208986976b2f64650672
(cherry picked from commit ca1043ab90)
2018-02-17 13:03:58 +08:00
Sunil G d6eb001da9 YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
(cherry picked from commit aae629913c)
2018-02-16 13:56:44 +05:30
Jason Lowe 6f64530fc3 YARN-7677. Docker image cannot set HADOOP_CONF_DIR. Contributed by Jim Brennan 2018-02-15 17:14:39 -06:00
Konstantinos Karanasos 41708402a1 YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
(cherry picked from commit 0b489e564c)
2018-02-15 14:25:34 -08:00
Eric Payne c81415dd2a Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit 1fcc3eac88.
2018-02-14 14:34:07 -06:00
Wangda Tan 4eb98f70ee YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda)
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
(cherry picked from commit 042ef2fa7b)
2018-02-14 23:21:22 +08:00
Eric Payne 1fcc3eac88 YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
(cherry picked from commit c5e6e3de1c)
2018-02-13 10:20:35 -06:00
Jason Lowe 5f7ef73b7a YARN-7914. Fix exit code handling for short lived Docker containers. Contributed by Shane Kumpf
(cherry picked from commit 5a1db60ab1)
2018-02-12 15:51:32 -06:00
Jason Lowe aad3958e50 YARN-7917. Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens. Contributed by Shane Kumpf
(cherry picked from commit 3414fd1243)
2018-02-12 09:30:06 -06:00
Wangda Tan 101cf2599e YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda)
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
(cherry picked from commit d02e42cee4)
2018-02-12 10:39:42 +08:00
Wangda Tan 3b20413acf YARN-7697. NM goes down with OOM due to leak in log-aggregation. (Xuan Gong via wangda)
Change-Id: Ie4fc7979d834e25f37a033c314f3efceeb8f4a9e
(cherry picked from commit d4c98579e3)
2018-02-12 10:39:34 +08:00
Wangda Tan 1e6d2972b8 YARN-5848. Remove unnecessary public/crossdomain.xml from YARN UIv2 sub project. (Sunil G via wangda)
Change-Id: Ie295f88232192e6b520c335b0332383cc6a232c0
(cherry picked from commit 789a185c16)
2018-02-12 10:39:27 +08:00
Wangda Tan 47a2e18670 YARN-7906. Fix mvn site fails with error: Multiple sources of package comments found for package o.a.h.y.client.api.impl. (Akira Ajisaka via wangda)
Change-Id: I20221d97446e97f208d587eacbc60448c11ffd48
(cherry picked from commit e795833d8c)
2018-02-12 10:39:21 +08:00
Weiwei Yang 388f4d11d7 YARN-7838. Support AND/OR constraints in Distributed Shell. Contributed by Weiwei Yang. 2018-02-11 14:21:55 +08:00
Eric Yang c97d5bceb2 YARN-7909. Add charset to YARN Service REST API. (Contributed by Eric Yang) 2018-02-09 20:01:25 -05:00
Jian He ddec08d7cc YARN-7827. Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404. Contributed by Sunil G 2018-02-08 21:32:40 -08:00
Yufei Gu 1bc03ddf97 YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand. 2018-02-08 12:32:43 -08:00
Jian He eb2449d539 YARN-5428. Allow for specifying the docker client configuration directory. Contributed by Shane Kumpf 2018-02-08 11:35:30 -08:00
Jason Lowe 456705a07c YARN-7815. Make the YARN mounts added to Docker containers more restrictive. Contributed by Shane Kumpf 2018-02-07 13:09:08 -06:00