Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,463 Commits 326 Branches 371 Tags
Commit Graph

3705 Commits

Author SHA1 Message Date
Rohith Sharma K S
3cb9888d56 YARN-8253. HTTPS Ats v2 api call fails with 'bad HTTP parsed'. Contributed by Charan Hebri. 
(cherry picked from commit 7450583721757b8af2945ebd9be1a9efed11444c)
 2018-05-08 12:33:23 +05:30
Robert Kanter
312462532e HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
(cherry picked from commit 74e5b4b437a0005676d51e770f7dd5110893e356)
 2018-05-07 12:39:57 -07:00
Rohith Sharma K S
250ea47985 YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G. 
(cherry picked from commit ef3ecc308dbea41c6a88bd4d16739c7bbc10cdda)
 2018-04-27 23:00:19 +05:30
Sunil G
a91d5c7e2c YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7fc09c4f7255645025ddf902dff70a17092ea039)
 2018-04-27 11:19:12 +05:30
Sunil G
ab2b4290a0 YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S. 
(cherry picked from commit 1634de0fc1430d86b7688d16259a81462fba482f)
 2018-04-27 11:08:27 +05:30
Junping Du
af70c69fb2 YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong. 
(cherry picked from commit 56788d759f47b4b158617701f543a9dcb4df69cd)
 2018-04-24 18:31:29 +08:00
Jason Lowe
06f3f453c2 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie 2018-04-20 13:31:19 -05:00
Sunil G
733248cec7 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7d06806dfdeb3252ac0defe23e8c468eabfa8b5e)
 2018-04-20 12:12:26 +05:30
Jason Lowe
5ec195edbc YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 
(cherry picked from commit 391ac5cdd2f31db2341bb731daee094b9ca309ec)
 2018-04-17 09:53:19 -05:00
Inigo Goiri
93fc813329 YARN-8164. Fix a potential NPE in AbstractSchedulerPlanFollower. Contributed by lujie. 
(cherry picked from commit f1461b2487d6c7a0b87e3799a8fdb5ade40ad898)
 2018-04-16 17:32:50 -07:00
Inigo Goiri
f37f680a4e YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan. 
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
 2018-04-16 17:07:38 -07:00
Eric Yang
0731756293 YARN-7810. Update TestDockerContainerRuntime to test with current user credential. 
(contributed by Shane Kumpf)
 2018-04-16 13:39:21 -04:00
Rohith Sharma K S
900e6b435a YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri. 
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
 2018-04-14 11:15:30 +05:30
Wei-Chiu Chuang
cc2a2a8e06 Revert "YARN-7810. Update TestDockerContainerRuntime to test with current user credential." 
This reverts commit 724bffdb89cd62cc90a1f49c7c5e40998dc1cc0f.
 2018-04-13 10:13:59 -07:00
Eric E Payne
7393020cb3 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe 
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
 2018-04-12 18:19:12 +00:00
Eric E Payne
b0dfb18daa YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe. 
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
 2018-04-12 16:38:50 +00:00
Weiwei Yang
a48deb1552 YARN-7527. Over-allocate node resource in async-scheduling mode of CapacityScheduler. Contributed by Tao Yang. 2018-04-12 10:12:46 +08:00
Eric Yang
724bffdb89 YARN-7810. Update TestDockerContainerRuntime to test with current user credential. 
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be1978ec942dda38774a1d9f741efa96f71
 2018-04-11 20:06:33 -04:00
Weiwei Yang
2b2e2ac5f4 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. Contributed by Tao Yang. 2018-04-11 20:21:05 +08:00
Vrushali C
fe4c7ee94c YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S 
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
 2018-04-11 09:51:42 +05:30
Subru Krishnan
05246b7585 YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru). 
(cherry picked from commit 00905efab22edd9857e0a3828c201bf70f03cb96)
 2018-04-06 16:38:28 -07:00
Haibo Chen
b19267259b YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 024d7c08704e6a5fcc1f53a8f56a44c84c8d5fa0)
(cherry picked from commit b232dcab33c4f3e131b9699119167af8916879c4)
(cherry picked from commit ca105d1c8eb7563fcf7465ed48b8e7ec89eeee59)
 2018-04-06 09:47:25 -07:00
Haibo Chen
a7d8b4d775 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
(cherry picked from commit 6658018410defe3d7e4ea2a465e68d1cfdde6ada)
(cherry picked from commit 9cb378f5c762f3b26598d3ade448219e5801fa2f)
 2018-04-05 11:45:01 -07:00
Subru Krishnan
304ce18714 YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 09999d7e014fde717e8b122773b68664f4594106)
 2018-03-28 11:51:59 -07:00
Subru Krishnan
b36b438043 Revert "YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru)." 
This reverts commit 0ab1d2f25ba39391bf7bc5e486bf75c828a0e856.
 2018-03-28 11:51:59 -07:00
Zhe Zhang
c93ab3e623 YARN-7623. Fix the CapacityScheduler Queue configuration documentation. Contributed by Jonathan Hung. 
(cherry picked from commit 0b1c2b5fe1b5c225d208936ecb1d3e307a535ee6)
(cherry picked from commit 0db6b8c93cd964291707c3ba03bfc63bb65b710a)
(cherry picked from commit f3b41bb1ad3e5cd23b2c6b75b3d89358213aa0d4)
 2018-03-28 11:44:44 -07:00
Subru Krishnan
0ab1d2f25b YARN-8010. Add config in FederationRMFailoverProxy to not bypass facade cache when failing over. (Botong Huang via Subru). 
(cherry picked from commit 2a2ef15caf791f30c471526c1b74e68803f0c405)
 2018-03-27 17:47:37 -07:00
Rohith Sharma K S
c2f26facd1 YARN-7986. ATSv2 REST API queries do not return results for uppercase application tags. Contributed by Charan Hebri. 
(cherry picked from commit 75fc05f369929db768b767d79351bca8c13ad9ba)
 2018-03-23 12:25:03 +05:30
Rohith Sharma K S
5fba8c67de YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 2018-03-23 12:05:11 +05:30
Sunil G
b39245d2a5 YARN-8063. DistributedShellTimelinePlugin wrongly check for entityId instead of entityType. Contributed by Rohith Sharma K S. 
(cherry picked from commit 22c5ddb7c4fb48d5bf5a7456d0b1b27d48c2a485)
 2018-03-23 10:58:13 +05:30
Jason Lowe
13f74a3601 YARN-8054. Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread. Contributed by Jonathan Eagles 
(cherry picked from commit 5aa7052e319c3273243dda9993fb6c2d776eb7cc)
 2018-03-21 17:40:05 -05:00
Jason Lowe
a253925862 Revert "YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen." 
This reverts commit a01091e90c18575e75eb1ecc3e1e2feea5146d20.
 2018-03-21 17:36:24 -05:00
Rohith Sharma K S
a01091e90c YARN-7581. HBase filters are not constructed correctly in ATSv2. Contributed by Habio Chen. 
(cherry picked from commit 29acea5000337a7f529bb1810a2af2b0af4d5f1d)
 2018-03-21 08:30:03 +05:30
Yufei Gu
204674f414 YARN-8039. Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer. Contributed by Miklos Szegedi. 
(cherry picked from commit 49c747ab187d0650143205ba57ca19607ec4c6bd)
 2018-03-16 16:34:14 -07:00
Rohith Sharma K S
207daabbcc YARN-8003. Backport the code structure changes in YARN-7346 to branch-2. Contributed by Haibo Chen. 2018-03-07 13:25:28 +05:30
Sen Zhao
bda2a9c2a0
YARN-7736. Fix itemization in YARN federation document 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 245751ffdc4229715a0c031f57f20748ed16d8a6)
 2018-03-05 11:55:16 -08:00
Jason Lowe
0a3a878428 YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 
(cherry picked from commit 83798f15f8602ef580a7885876de114b2425da89)
 2018-03-02 10:08:32 -06:00
Haibo Chen
45d012f208 YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit d1274c3b71549cb000868500c293cafd880b3713)
 2018-02-28 21:24:17 -08:00
Gabor Bota
696e8e0299
HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c36b4aa31ce25fbe5fa173bce36da2950d74a475)
(cherry picked from commit b8942cb3bf4a458c78654bc166447806523409b5)
 2018-02-23 13:58:08 +09:00
Jason Lowe
7a6aa7bf99 YARN-7945. Java Doc error in UnmanagedAMPoolManager for branch-2. Contributed by Botong Huang 2018-02-22 10:45:16 -06:00
Sunil G
f7e5e45b72 YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne. 
(cherry picked from commit bdd2a184d78379d99c802a43ebec7d2cef0bbaf7)
 2018-02-21 15:26:20 +05:30
Jason Lowe
51ad923f51 YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne 
(cherry picked from commit 85c611ad7dfa87846f708ba0131b4895a054752e)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/CapacitySchedulerPage.java
 2018-02-19 15:44:56 -06:00
Rohith Sharma K S
e35dfc85de YARN-7937. Fix http method name in Cluster Application Timeout Update API example request. Contributed by Charan Hebri. 
(cherry picked from commit 87bdde69431c19a22d79a767071f6ea47e1ceb3d)
 2018-02-18 14:08:50 +05:30
Rohith Sharma K S
da0660ec84 YARN-7919. Refactor timelineservice-hbase module into submodules. Contributed by Haibo Chen. 2018-02-18 13:26:10 +05:30
Billie Rinaldi
aa64a50746 Revert "YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi." 
This reverts commit a72dcb9cad7df7f7236092f5b86446c2ef4ea874.
 2018-02-07 08:58:28 -08:00
Billie Rinaldi
93128c1904 YARN-7890. NPE during container relaunch. Contributed by Jason Lowe 
(cherry picked from commit a196ee9362a1b35e5de20ee519f7c544ab1588e1)
 2018-02-06 12:04:52 -08:00
Jason Lowe
260f30f063 YARN-7849. TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error. Contributed by Botong Huang 
(cherry picked from commit 60656bcecadd80e28c81bc943b44abf13d20abae)
 2018-02-05 17:22:42 -06:00
Haibo Chen
c25c082961 YARN-6868. Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml. (Ray Chiang via Haibo Chen) 
(cherry picked from commit a20e7105ea9d4e38d7f8f9fd48035e342bb22f1c)
 2018-02-05 10:51:03 -08:00
Jinjiang Ling
987a8972ac
YARN-7698. A misleading variable's name in ApplicationAttemptEventDispatcher 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 3400d0c535aeb151c3f283cc41111b15d66990e5)
 2018-01-30 00:13:04 +09:00
Jian He
0497e09339 YARN-7765. Fixed an issue that kerberos tgt not found when NM posting timeline events. Contributed by Rohith Sharma K S 2018-01-28 13:24:49 -08:00