Commit Graph

3817 Commits

Author SHA1 Message Date
Weiwei Yang dff710632e YARN-7647. NM print inappropriate error log when node-labels is enabled. Contributed by Yang Wang. 2017-12-13 13:13:12 +08:00
Weiwei Yang 98eb4b2c6b YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák. 2017-12-11 10:37:22 +08:00
Wangda Tan 524ecb19ef YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I67e086d6d35c3166ec0f6305490ea6527bd6d799
(cherry picked from commit 41796ea60a)
(cherry picked from commit c27a5ba65c)
2017-12-08 21:57:26 -08:00
Subru Krishnan 39d0fdf1b2 YARN-6704. Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService. (Botong Huang via Subru).
(cherry picked from commit 670e8d4ec7)
(cherry picked from commit 850bd0ed7c)
2017-12-08 15:46:13 -08:00
Weiwei Yang 1a8f6bad34 YARN-7607. Remove the trailing duplicated timestamp in container diagnostics message. Contributed by Weiwei Yang. 2017-12-07 17:30:35 +08:00
Weiwei Yang 42deb54049 YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang.
Previous commit 218d622529 introduces a compile error,
  so it was reverted by commit db74ada80f.
  This commit fixed the issue.

(cherry picked from commit 05c347fe51)
2017-12-06 20:22:52 +08:00
Weiwei Yang db74ada80f Revert "YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang."
This reverts commit 218d622529.
2017-12-06 19:58:51 +08:00
Weiwei Yang 218d622529 YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang.
(cherry picked from commit 05c347fe51)
2017-12-06 12:57:22 +08:00
Arun Suresh cc0c966a4e YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh)
(cherry picked from commit 37ca416950)
2017-12-03 22:25:06 -08:00
Jason Lowe 487c920bb0 YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan
(cherry picked from commit 60f95fb719)
2017-12-01 15:54:03 -06:00
Jason Lowe 5a8a1e66c6 YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles
(cherry picked from commit 5cfaee2e6d)
2017-11-30 12:47:43 -06:00
Wangda Tan a6d7fa91d9 YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda)
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
(cherry picked from commit 834e91ee91)
(cherry picked from commit 94f7b0f99f)
2017-11-29 15:48:51 -08:00
Wei Yan 17289ca677 YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
(cherry picked from commit 333ef303ff)
2017-11-29 14:48:19 -08:00
Haibo Chen c08a0bcad8 YARN-7390. All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.
(cherry picked from commit db2651cc9d)
2017-11-21 13:29:00 -08:00
Subru Krishnan a6db6c9855 YARN-6128. Add support for AMRMProxy HA. (Botong Huang via Subru).
(cherry picked from commit ed31091361)
2017-11-20 14:22:59 -08:00
bibinchundatt 49ba091f71 YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang.
(cherry picked from commit ea8a121423)
2017-11-21 00:32:49 +05:30
bibinchundatt dc4132395e YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang.
(cherry picked from commit 5c2986e58d)
2017-11-20 23:29:14 +05:30
Sunil G 9eab9a25c6 YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne.
(cherry picked from commit 61ace174cd)
2017-11-17 19:42:00 +05:30
Varun Vasudev f23f49d4ee YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang.
(cherry picked from commit 5f0b238a11)
(cherry picked from commit 9cf9627e20)
2017-11-17 12:05:55 +05:30
Jason Lowe e4344d45cb YARN-7361. Improve the docker container runtime documentation. Contributed by Shane Kumpf
(cherry picked from commit fac72eef23)
2017-11-15 12:34:22 -06:00
Junping Du 9229fb3523 YARN-6078. Containers stuck in Localizing state. Contributed by Billie Rinaldi.
(cherry picked from commit a72dcb9cad)
2017-11-14 12:50:21 -08:00
Arun Suresh 238a70c6c3 YARN-5049. Addendum patch for branch-2. (asuresh)
(cherry picked from commit c153bed6e3)
2017-11-12 10:17:01 -08:00
Eric Yang 45c5b7f71d YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger)
(cherry picked from commit 7a49ddfdde)
(cherry picked from commit 90ac8cd5a1)
2017-11-12 10:13:49 -08:00
Subru Krishnan 8bcd1d62c8 YARN-7476. Fix miscellaneous issues in ATSv2 after merge to branch-2. (Varun Saxena via Subru).
(cherry picked from commit 0282efab14)
2017-11-12 09:25:12 -08:00
Subru Krishnan 8251601003 YARN-7475. Fix Container log link in new YARN UI. (Sunil G via Subru).
(cherry picked from commit 3c5b46c2ed)
2017-11-12 09:25:12 -08:00
Arun Suresh 45aabb3c8d YARN-6627. Addendum patch for branch-2. (Sunil G via asuresh)
(cherry picked from commit 5cd92ed555)
2017-11-11 09:11:43 -08:00
Arun Suresh dc65df2a1a YARN-6102. Addendum patch for branch-2. (Rohith Sharma K S via asuresh)
(cherry picked from commit 0411c710d2)
2017-11-10 13:45:14 -08:00
Haibo Chen 288d9506f0 YARN-7388. TestAMRestart should be scheduler agnostic.
(cherry picked from commit a1382a18df)
(cherry picked from commit 91a7f8d246)
(cherry picked from commit 3fbe67d3e1)
2017-11-09 11:02:05 -08:00
Arun Suresh 1ddd0a7958 YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
(cherry picked from commit a9c70b0e84)
(cherry picked from commit 5486542074)
2017-11-08 08:08:26 -08:00
Subru Krishnan 8746a65e78 YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure.
(cherry picked from commit 0542e6f86e)
2017-11-03 11:15:48 -07:00
Arun Suresh bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Inigo Goiri 6f5a95ff98 YARN-7434. Router getApps REST invocation fails with multiple RMs. Contributed by Inigo Goiri.
(cherry picked from commit 6e2259264ad9525eeec2a14055d53236711659d7)
2017-11-02 21:35:45 -07:00
Subru Krishnan a60bb3b36f YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru).
(cherry picked from commit ad0fff2b41)
2017-11-02 17:42:38 -07:00
Eric Payne 9a61d12c03 YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
(cherry picked from commit e6ec02001f)
2017-11-02 13:09:27 -05:00
Wangda Tan 7a658363d9 YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f)
2017-11-02 09:53:20 -07:00
Jason Lowe cfef479b73 YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger
(cherry picked from commit b7dee1f060)
(cherry picked from commit 6ad6882343)
2017-11-02 11:02:37 -05:00
Arun Suresh da6ea5c144 Add missing 2.8.2 jdiff for YARN API 2017-11-02 07:09:54 -07:00
Rohith Sharma K S 6005f0a3ee addendum patch for YARN-7289.
(cherry picked from commit 940ffe3f9c)
2017-11-02 14:11:33 +05:30
Junping Du d1accde1cd YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong.
(cherry picked from commit d57dba9942)
(cherry picked from commit d1f8854a1b)
2017-11-01 15:01:55 -07:00
Haibo Chen 955f3c30e4 YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
(cherry picked from commit d7f3737f3b)
(cherry picked from commit 32a712a740)
2017-11-01 14:22:53 -07:00
Daniel Templeton 951d5a46f4 YARN-7146. Many RM unit tests failing with FairScheduler
(Contributed by Robert Kanter via Daniel Templeton)

(cherry picked from commit 956d814034)
2017-11-01 14:13:42 -07:00
Inigo Goiri d6a5f8a06d YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri.
(cherry picked from commit 8180ab436a)
2017-11-01 13:22:26 -07:00
Arun Suresh efa708f546 Updating jdiff version in anticipation of 2.9.0 release. 2017-10-31 12:56:11 -07:00
Subru Krishnan ac41107423 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru).
(cherry picked from commit ed24da3dd7)
2017-10-31 12:11:40 -07:00
Junping Du 76ec5eab12 HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release.
(cherry picked from commit a8083aaa6f)
2017-10-30 15:17:30 -07:00
Vrushali C 3454c02c96 YARN-7378 Documentation changes post branch-2 merge (Vrushali C with Varun Saxena) 2017-10-30 14:09:29 -07:00
Yufei Gu 243b70eca8 YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
(cherry picked from commit d4811c8cfa)
2017-10-29 16:47:22 -07:00
Varun Saxena e1b3bbde60 YARN-7380. Fix findbugs warning in timeline service on branch-2 (Vrushali C via Varun Saxena). 2017-10-29 16:38:20 +05:30
Arun Suresh 2654d9973e YARN-7299. Fix TestDistributedScheduler. (asuresh)
(cherry picked from commit 9c5c68745e)
2017-10-27 23:11:34 -07:00
Arun Suresh 519aa0e804 YARN-7178. Add documentation for Container Update API. (asuresh)
(cherry picked from commit 24f8c5cce3)
2017-10-27 22:57:46 -07:00