3602 Commits

Author SHA1 Message Date
Arun Suresh
c153bed6e3 YARN-5049. Addendum patch for branch-2. (asuresh) 2017-11-12 10:16:00 -08:00
Eric Yang
90ac8cd5a1 YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger)
(cherry picked from commit 7a49ddfdde2e2a7b407f4a62a42d97bfe456075a)
2017-11-12 09:59:39 -08:00
Subru Krishnan
0282efab14 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru). 2017-11-12 09:19:30 -08:00
Subru Krishnan
3c5b46c2ed YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru). 2017-11-12 09:18:08 -08:00
Arun Suresh
5cd92ed555 YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh) 2017-11-11 09:10:17 -08:00
Arun Suresh
0411c710d2 YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh) 2017-11-10 13:44:03 -08:00
Haibo Chen
3fbe67d3e1 YARN-7388. TestAMRestart should be scheduler agnostic.
(cherry picked from commit a1382a18dff8a70aa25240d6fbba6e22832a7679)
(cherry picked from commit 91a7f8d2463de0a94ded0884143e4661c29868a4)
2017-11-09 10:57:50 -08:00
Arun Suresh
5486542074 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
(cherry picked from commit a9c70b0e84dab0c41e480a0dc0cb1a22efdc64ee)
2017-11-08 08:02:23 -08:00
bibinchundatt
fd4868bdb4 Add containerId to Localizer failed logs. Contributed by Prabhu Joseph
(cherry picked from commit dcd99c4b9a7a15649dc9823ac060ce23c6a31056)
2017-11-06 23:09:41 +05:30
Subru Krishnan
656ab06873 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
(cherry picked from commit 0542e6f86e6734f8ceea00960bebe719827136db)
2017-11-03 11:11:25 -07:00
Inigo Goiri
2d8d420f26 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
2017-11-02 21:34:34 -07:00
Subru Krishnan
931987f470 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
(cherry picked from commit ad0fff2b419e8fe8bb5c9a7e19b79dec16cbd96f)
2017-11-02 17:40:26 -07:00
Eric Payne
1516a9ef61 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
(cherry picked from commit e6ec02001fc4eed9eb51c8653d8f931135e49eda)
2017-11-02 12:56:41 -05:00
Wangda Tan
752f000e0f YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
2017-11-02 09:50:00 -07:00
Jason Lowe
6ad6882343 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
(cherry picked from commit b7dee1f0608006e776624a9e4de39811d8aebc97)
2017-11-02 09:50:55 -05:00
Rohith Sharma K S
e53fcd52ee addendum patch for YARN-7289.
(cherry picked from commit 940ffe3f9ce74286a8863e3743faf88a33c817a3)
2017-11-02 14:07:28 +05:30
Junping Du
d1f8854a1b YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
(cherry picked from commit d57dba99428cbe3f3dfcec834d79f709e7529ef9)
2017-11-01 14:50:44 -07:00
Haibo Chen
32a712a740 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b3236fbf8c25fdd4656251ed63a2be9)
2017-11-01 14:19:59 -07:00
Daniel Templeton
956d814034 YARN-7146. Many RM unit tests failing with FairScheduler
(Contributed by Robert Kanter via Daniel Templeton)
2017-11-01 14:11:26 -07:00
Inigo Goiri
8180ab436a YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-11-01 13:21:15 -07:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Subru Krishnan
ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd73c137b44235e525112056ace6d3843)
2017-10-31 12:11:40 -07:00
Junping Du
76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f4bcc7287f2b65018a946a840123c50)
2017-10-30 15:17:30 -07:00
Vrushali C
3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Yufei Gu
243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfae02f42a7aae1f775e87b6726caa3c9)
2017-10-29 16:47:22 -07:00
Varun Saxena
e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh
2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745ed18883ce8bdbdca379025b23f17f60)
2017-10-27 23:11:34 -07:00
Arun Suresh
519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3adb88e5af84b3e48c4c447ac91e6d3)
2017-10-27 22:57:46 -07:00
Jason Lowe
9093ad6168 YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
(cherry picked from commit 665bb147aa3fc198e53335931562dd69f9f0e345)
2017-10-27 17:09:29 -05:00
Rohith Sharma K S
548116c3f5 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
(cherry picked from commit 5c799ecf09617f634c41bba26d341b2ad45ee852)
2017-10-27 22:51:41 +05:30
Sunil G
88c3b444bd YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
(cherry picked from commit 792388e1c0ebaeb01db194412e30c08c0144b77c)
2017-10-27 21:11:48 +05:30
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
2017-10-26 23:20:24 -07:00
Subru Krishnan
a0dceec586 YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
(cherry picked from commit 25932da6d1ee56299c8f9911576a42792c435407)
2017-10-26 20:16:01 -07:00
Arun Suresh
f6fde85c5c YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)
(cherry picked from commit 00bebb7e58ba6899904e1619d151aa1b2f5b6acd)
2017-10-26 20:04:33 -07:00
Arun Suresh
098a6b8f19 YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)
(cherry picked from commit d82e797b652f248e238bdf1818e6b4a5b91cea7a)
2017-10-26 20:04:19 -07:00
Robert Kanter
7c26ae506a YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
(cherry picked from commit b1de78619f3e5e25d6f9d5eaf41925f22d212fb9)
2017-10-26 17:51:05 -07:00
Robert Kanter
46783158f8 YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter)
(cherry picked from commit 2da654e34a436aae266c1fbdec5c1067da8d854e)
2017-10-26 10:49:57 -07:00
Subru Krishnan
74aee8673f YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru).
(cherry picked from commit 3fae675383489129b3ca3c66683a1215d0c6edf0)
2017-10-25 15:32:03 -07:00
Arun Suresh
774a575363 YARN-4687. Document Reservation ACLs (Contributed by Sean Po)
(cherry picked from commit 2e1d0ff4e901b8313c8d71869735b94ed8bc40a0)
2017-10-25 15:29:32 -07:00
Carlo Curino
fa86fdc3cc YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino)
Edited cherry-pick from 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9
2017-10-25 13:56:35 -07:00
Eric Yang
f6d3c101a6 YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger. 2017-10-24 17:01:08 -04:00
Inigo Goiri
89ad6adab3 YARN-3661. Basic Federation UI. Contributed by Inigo Goiri. 2017-10-24 13:55:13 -07:00
Robert Kanter
85eadec67b YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter)
(cherry picked from commit 03af442e7608db2f8e6eb85a15aa0ba42781edab)
2017-10-24 13:43:27 -07:00
Robert Kanter
1d34a4805e YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter)
(cherry picked from commit 025c6565725c1819566377632753e8b9055617a6)
2017-10-24 10:29:36 -07:00
Daniel Templeton
08cfd010a3 YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations
(Contributed by Sen Zhao via Daniel Templeton)

(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371d0d6c9a1f507c04fc6b88e6c587005)
2017-10-23 13:52:15 -07:00
Eric Payne
ef0d6ff2e6 YARN-4163: Audit getQueueInfo and getApplications calls
(cherry picked from commit 921338cd86e7215b0c4b1efdf2daf9449fb12c7b)
2017-10-23 11:58:04 -05:00
Subru Krishnan
9bd77a6d9d YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru). 2017-10-20 17:19:29 -07:00
Yufei Gu
93d71d97d4 YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo)
(cherry picked from commit 6b7c87c94592606966a4229313b3d0da48f16158)
2017-10-20 11:49:34 -07:00
Yufei Gu
378fa3ac7d YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu)
(cherry picked from commit 0799fde35e7f3b9e8a85284ac0b30f6bdcbffad1)
2017-10-20 11:49:34 -07:00
Yufei Gu
4c4f28c9e7 YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin)
(cherry picked from commit 1f4cdf10681b6903207a63fb5c306c9665ed9464)
(cherry picked from commit 96106b8f5fe50e2d5c0c4df5dbddea4f89f278d9)
2017-10-20 11:49:33 -07:00