Commit Graph

3813 Commits

Author SHA1 Message Date
Subru Krishnan 850bd0ed7c YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru).
(cherry picked from commit 670e8d4ec7)
2017-12-08 15:44:45 -08:00
Weiwei Yang 029714e3ec YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang. 2017-12-08 13:53:33 +08:00
Robert Kanter 54b5da83ec YARN-5594. Handle old RMDelegationToken format when recovering RM (rkanter)
(cherry picked from commit d8863fc16f)
2017-12-04 13:18:04 -08:00
Jason Lowe 3fb83cbeb2 YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan
(cherry picked from commit 60f95fb719)
2017-12-01 15:51:49 -06:00
Robert Kanter edf9fd51fb YARN-4813. TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently (grepas via rkanter)
(cherry picked from commit c83fe44917)
2017-12-01 12:21:18 -08:00
Junping Du 14f251fcd5 YARN-7558. yarn logs command fails to get logs for running containers if UI authentication is enabled. Contributed by Xuan Gong.
(cherry picked from commit a409425986)
2017-11-30 13:49:45 -08:00
Jason Lowe ee9ce1d75a YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles
(cherry picked from commit 5cfaee2e6d)
2017-11-30 12:44:00 -06:00
Wei Yan 5bb6329215 YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
(cherry picked from commit 333ef303ff)
2017-11-29 14:46:47 -08:00
Yufei Gu de144175a4 YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
(cherry picked from commit d8923cdbf1)
(cherry picked from commit c0ab3c8407)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
2017-11-27 14:54:27 -08:00
Wangda Tan 94f7b0f99f YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda)
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
(cherry picked from commit 834e91ee91)
2017-11-23 20:06:16 -08:00
Haibo Chen db2651cc9d YARN-7390. All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. 2017-11-21 11:08:27 -08:00
Subru Krishnan ed31091361 YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru). 2017-11-20 14:21:58 -08:00
bibinchundatt ea8a121423 YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang. 2017-11-21 00:31:15 +05:30
bibinchundatt 5c2986e58d YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang. 2017-11-20 21:31:50 +05:30
Varun Vasudev 9cf9627e20 YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang.
(cherry picked from commit 5f0b238a11)
2017-11-17 12:05:35 +05:30
Sunil G a081d91480 YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne.
(cherry picked from commit 61ace174cd)
2017-11-16 22:42:52 +05:30
Jason Lowe ec4159c4df YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf
(cherry picked from commit fac72eef23)
2017-11-15 12:33:48 -06:00
Junping Du a72dcb9cad YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi. 2017-11-13 18:22:30 -08:00
Arun Suresh c153bed6e3 YARN-5049. Addendum patch for branch-2. (asuresh) 2017-11-12 10:16:00 -08:00
Eric Yang 90ac8cd5a1 YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger)
(cherry picked from commit 7a49ddfdde)
2017-11-12 09:59:39 -08:00
Subru Krishnan 0282efab14 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 2017-11-12 09:19:30 -08:00
Subru Krishnan 3c5b46c2ed YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 2017-11-12 09:18:08 -08:00
Arun Suresh 5cd92ed555 YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 2017-11-11 09:10:17 -08:00
Arun Suresh 0411c710d2 YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 2017-11-10 13:44:03 -08:00
Haibo Chen 3fbe67d3e1 YARN-7388. TestAMRestart should be scheduler agnostic.
(cherry picked from commit a1382a18df)
(cherry picked from commit 91a7f8d246)
2017-11-09 10:57:50 -08:00
Arun Suresh 5486542074 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
(cherry picked from commit a9c70b0e84)
2017-11-08 08:02:23 -08:00
bibinchundatt fd4868bdb4 Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
(cherry picked from commit dcd99c4b9a)
2017-11-06 23:09:41 +05:30
Subru Krishnan 656ab06873 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
(cherry picked from commit 0542e6f86e)
2017-11-03 11:11:25 -07:00
Inigo Goiri 2d8d420f26 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
2017-11-02 21:34:34 -07:00
Subru Krishnan 931987f470 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
(cherry picked from commit ad0fff2b41)
2017-11-02 17:40:26 -07:00
Eric Payne 1516a9ef61 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
(cherry picked from commit e6ec02001f)
2017-11-02 12:56:41 -05:00
Wangda Tan 752f000e0f YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
2017-11-02 09:50:00 -07:00
Jason Lowe 6ad6882343 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
(cherry picked from commit b7dee1f060)
2017-11-02 09:50:55 -05:00
Rohith Sharma K S e53fcd52ee addendum patch for YARN-7289.
(cherry picked from commit 940ffe3f9c)
2017-11-02 14:07:28 +05:30
Junping Du d1f8854a1b YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
(cherry picked from commit d57dba9942)
2017-11-01 14:50:44 -07:00
Haibo Chen 32a712a740 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b)
2017-11-01 14:19:59 -07:00
Daniel Templeton 956d814034 YARN-7146. Many RM unit tests failing with FairScheduler
(Contributed by Robert Kanter via Daniel Templeton)
2017-11-01 14:11:26 -07:00
Inigo Goiri 8180ab436a YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-11-01 13:21:15 -07:00
Arun Suresh 71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Subru Krishnan ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd7)
2017-10-31 12:11:40 -07:00
Junping Du 76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f)
2017-10-30 15:17:30 -07:00
Vrushali C 3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Yufei Gu 243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfa)
2017-10-29 16:47:22 -07:00
Varun Saxena e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh 2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745e)
2017-10-27 23:11:34 -07:00
Arun Suresh 519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3)
2017-10-27 22:57:46 -07:00
Jason Lowe 9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
(cherry picked from commit 665bb147aa)
2017-10-27 17:09:29 -05:00
Rohith Sharma K S 548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
(cherry picked from commit 5c799ecf09)
2017-10-27 22:51:41 +05:30
Sunil G 88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
(cherry picked from commit 792388e1c0)
2017-10-27 21:11:48 +05:30
Junping Du 1f2a2ba2be Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:20:24 -07:00