3817 Commits

Author SHA1 Message Date
Subru Krishnan
8d3d7fa1c5 YARN-7630. Fix AMRMToken rollover handling in AMRMProxy. Contributed by Botong Huang.
(cherry picked from commit 17ba74be29193ac15474f73baaaf4e647a95078b)
2017-12-14 14:07:44 -08:00
Weiwei Yang
d69b7358b6 YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang.
(cherry picked from commit 7efc4f76885348730728c0201dd0d1a89b213e9c)
2017-12-13 13:28:48 +08:00
Weiwei Yang
7b3c64aece YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák. 2017-12-11 13:06:13 +08:00
Wangda Tan
c27a5ba65c YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I67e086d6d35c3166ec0f6305490ea6527bd6d799
(cherry picked from commit 41796ea60ab9dbd6a41dd8fd3c6ff50990bba2f5)
2017-12-08 21:50:41 -08:00
Subru Krishnan
850bd0ed7c YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru).
(cherry picked from commit 670e8d4ec7e71fc3b054cd3b2826f869b649a788)
2017-12-08 15:44:45 -08:00
Weiwei Yang
029714e3ec YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang. 2017-12-08 13:53:33 +08:00
Robert Kanter
54b5da83ec YARN-5594. Handle old RMDelegationToken format when recovering RM (rkanter)
(cherry picked from commit d8863fc16fa3cbcdda5b99f79386c43e4fae5917)
2017-12-04 13:18:04 -08:00
Jason Lowe
3fb83cbeb2 YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan
(cherry picked from commit 60f95fb719f00a718b484c36a823ec5aa8b099f4)
2017-12-01 15:51:49 -06:00
Robert Kanter
edf9fd51fb YARN-4813. TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently (grepas via rkanter)
(cherry picked from commit c83fe4491731c994a4867759d80db31d9c1cab60)
2017-12-01 12:21:18 -08:00
Junping Du
14f251fcd5 YARN-7558. yarn logs command fails to get logs for running containers if UI authentication is enabled. Contributed by Xuan Gong.
(cherry picked from commit a409425986fc128bb54f656b05373201545f7213)
2017-11-30 13:49:45 -08:00
Jason Lowe
ee9ce1d75a YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles
(cherry picked from commit 5cfaee2e6db8b2ac55708de0968ff5539ee3bd76)
2017-11-30 12:44:00 -06:00
Wei Yan
5bb6329215 YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
(cherry picked from commit 333ef303ff0caf9adfd378652a8f966377901768)
2017-11-29 14:46:47 -08:00
Yufei Gu
de144175a4 YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu)
(cherry picked from commit d8923cdbf1567aee10a54f144fef734d1465ebed)
(cherry picked from commit c0ab3c8407b110dd9083d775e5ea823cbf73e7d4)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
2017-11-27 14:54:27 -08:00
Wangda Tan
94f7b0f99f YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda)
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
(cherry picked from commit 834e91ee91d22d74866afbf6252107e969bf8370)
2017-11-23 20:06:16 -08:00
Haibo Chen
db2651cc9d YARN-7390. All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. 2017-11-21 11:08:27 -08:00
Subru Krishnan
ed31091361 YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru). 2017-11-20 14:21:58 -08:00
bibinchundatt
ea8a121423 YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang. 2017-11-21 00:31:15 +05:30
bibinchundatt
5c2986e58d YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang. 2017-11-20 21:31:50 +05:30
Varun Vasudev
9cf9627e20 YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang.
(cherry picked from commit 5f0b238a118f3992bd149d8c02e6a1376dee96d7)
2017-11-17 12:05:35 +05:30
Sunil G
a081d91480 YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne.
(cherry picked from commit 61ace174cdcbca9d22abce7aa0aa71148f37ad55)
2017-11-16 22:42:52 +05:30
Jason Lowe
ec4159c4df YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf
(cherry picked from commit fac72eef23bb0a74a34f289dd6ef50ffa4303aa4)
2017-11-15 12:33:48 -06:00
Junping Du
a72dcb9cad YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi. 2017-11-13 18:22:30 -08:00
Arun Suresh
c153bed6e3 YARN-5049. Addendum patch for branch-2. (asuresh) 2017-11-12 10:16:00 -08:00
Eric Yang
90ac8cd5a1 YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger)
(cherry picked from commit 7a49ddfdde2e2a7b407f4a62a42d97bfe456075a)
2017-11-12 09:59:39 -08:00
Subru Krishnan
0282efab14 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 2017-11-12 09:19:30 -08:00
Subru Krishnan
3c5b46c2ed YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 2017-11-12 09:18:08 -08:00
Arun Suresh
5cd92ed555 YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 2017-11-11 09:10:17 -08:00
Arun Suresh
0411c710d2 YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 2017-11-10 13:44:03 -08:00
Haibo Chen
3fbe67d3e1 YARN-7388. TestAMRestart should be scheduler agnostic.
(cherry picked from commit a1382a18dff8a70aa25240d6fbba6e22832a7679)
(cherry picked from commit 91a7f8d2463de0a94ded0884143e4661c29868a4)
2017-11-09 10:57:50 -08:00
Arun Suresh
5486542074 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
(cherry picked from commit a9c70b0e84dab0c41e480a0dc0cb1a22efdc64ee)
2017-11-08 08:02:23 -08:00
bibinchundatt
fd4868bdb4 Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
(cherry picked from commit dcd99c4b9a7a15649dc9823ac060ce23c6a31056)
2017-11-06 23:09:41 +05:30
Subru Krishnan
656ab06873 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
(cherry picked from commit 0542e6f86e6734f8ceea00960bebe719827136db)
2017-11-03 11:11:25 -07:00
Inigo Goiri
2d8d420f26 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
2017-11-02 21:34:34 -07:00
Subru Krishnan
931987f470 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
(cherry picked from commit ad0fff2b419e8fe8bb5c9a7e19b79dec16cbd96f)
2017-11-02 17:40:26 -07:00
Eric Payne
1516a9ef61 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
(cherry picked from commit e6ec02001fc4eed9eb51c8653d8f931135e49eda)
2017-11-02 12:56:41 -05:00
Wangda Tan
752f000e0f YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
2017-11-02 09:50:00 -07:00
Jason Lowe
6ad6882343 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
(cherry picked from commit b7dee1f0608006e776624a9e4de39811d8aebc97)
2017-11-02 09:50:55 -05:00
Rohith Sharma K S
e53fcd52ee addendum patch for YARN-7289.
(cherry picked from commit 940ffe3f9ce74286a8863e3743faf88a33c817a3)
2017-11-02 14:07:28 +05:30
Junping Du
d1f8854a1b YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
(cherry picked from commit d57dba99428cbe3f3dfcec834d79f709e7529ef9)
2017-11-01 14:50:44 -07:00
Haibo Chen
32a712a740 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
2017-11-01 14:19:59 -07:00
Daniel Templeton
956d814034 YARN-7146. Many RM unit tests failing with FairScheduler
(Contributed by Robert Kanter via Daniel Templeton)
2017-11-01 14:11:26 -07:00
Inigo Goiri
8180ab436a YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-11-01 13:21:15 -07:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Subru Krishnan
ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
2017-10-31 12:11:40 -07:00
Junping Du
76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
2017-10-30 15:17:30 -07:00
Vrushali C
3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Yufei Gu
243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
2017-10-29 16:47:22 -07:00
Varun Saxena
e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh
2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
2017-10-27 23:11:34 -07:00
Arun Suresh
519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
2017-10-27 22:57:46 -07:00