Akira Ajisaka
98c3544e94
YARN-5728. TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout.
...
(cherry picked from commit f8bed5e9a7
)
2017-07-31 11:10:10 +09:00
Arun Suresh
7e643130f2
YARN-6870. Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTracker. (Brook Zhou via asuresh)
...
(cherry picked from commit 890e14c02a
)
2017-07-28 16:33:42 -07:00
Yufei Gu
e29d1c75ea
YARN-6864. FSPreemptionThread cleanup for readability. (Daniel Templeton via Yufei Gu)
...
(cherry picked from commit 9902be72cb
)
2017-07-27 23:21:30 -07:00
Varun Saxena
05bbbcbdbe
Addendum for YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
...
(cherry picked from commit 11ece0bda1
)
2017-07-28 00:33:41 +05:30
Varun Saxena
0b342a644a
YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
...
(cherry picked from commit f66fd11e51
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMRestart.java
2017-07-28 00:33:37 +05:30
Sunil G
08d5f3acf6
Addendum patch for YARN-6102.
2017-07-26 18:40:52 +05:30
Daniel Templeton
00f4a80e8f
YARN-6307. Refactor FairShareComparator#compare (Contributed by Yufei Gu via Daniel Templeton)
...
(cherry picked from commit f81a4efb8c
)
2017-07-25 13:02:00 -07:00
Akira Ajisaka
22f237c5d9
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
...
(cherry picked from commit cca51e916b
)
2017-07-25 15:25:36 +09:00
Akira Ajisaka
09241feb13
YARN-6150. TestContainerManagerSecurity tests for Yarn Server are flakey. Contributed by Daniel Sturman and Ray Chiang.
...
(cherry picked from commit 218b1b33ff
)
2017-07-25 15:12:47 +09:00
Daniel Templeton
9b6e787230
YARN-6845. Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.
...
(Contributed by Yufei Gu via Daniel Templeton)
(cherry picked from commit 10583625c1
)
2017-07-24 13:45:09 -07:00
Daniel Templeton
eb1751670a
YARN-6779. DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting
...
(Contributed by Yeliang Cang via Daniel Templeton)
(cherry picked from commit bb30bd3771
)
2017-07-24 12:15:35 -07:00
Sunil G
a657472b42
YARN-6102. RMActiveService context to be updated with new RMContext on failover. Contributed by Rohith Sharma K S.
2017-07-24 20:57:56 +05:30
Jason Lowe
e76e7b9f0b
YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling
...
(cherry picked from commit c8df3668ec
)
2017-07-20 11:06:39 -05:00
Wangda Tan
5070c9ba39
YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda)
...
Change-Id: Iaf9bb7e5ed3aa1300abdccf87ae6fcbddbd25e3e
2017-07-19 15:25:21 -07:00
Rohith Sharma K S
f806e8627b
YARN-6819. Application report fails if app rejected due to nodesize. Contributed by Bibin A Chundatt.
...
(cherry picked from commit 845c4e52bd
)
2017-07-19 11:16:17 +05:30
Yufei Gu
d04bb465d2
YARN-6778. In ResourceWeights, weights and setWeights() should be final. (Daniel Templeton via Yufei Gu)
...
(cherry picked from commit daaf530fce
)
2017-07-18 16:40:13 -07:00
Sunil G
487b0a3d7f
Addendum patch for YARN-5731
...
(cherry picked from commit 0b7afc060c
)
2017-07-18 13:46:43 +05:30
Sunil G
9b1abb448d
YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang.
2017-07-17 13:22:04 +05:30
Sunil G
d462e48336
YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin.
2017-07-17 12:25:41 +05:30
Arun Suresh
0101973dbf
YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)
2017-07-14 13:57:22 -07:00
Jason Lowe
9eb93c6f3f
YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt
...
(cherry picked from commit a5ae5ac50e
)
2017-07-14 15:03:48 -05:00
bibinchundatt
af80d10e54
YARN-6759. Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure. Contributed by Naganarasimha G R
...
(cherry picked from commit 75c0220b44
)
2017-07-14 14:05:38 +05:30
Yufei Gu
b2a34fe8d6
YARN-6769. Make schedulables without demand less needy in FairSharePolicy#compare. (Yunfan Zhou via Yufei Gu)
...
(cherry picked from commit 4a574e9a84
)
2017-07-13 23:11:27 -07:00
Sunil G
fd6935709f
YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan.
2017-07-14 08:45:17 +05:30
Sunil G
f5cdee6bfd
YARN-6792. Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo. Contributed by Giovanni Matteo Fumarola.
...
(cherry picked from commit 228ddaa31d
)
2017-07-14 08:08:32 +05:30
Jason Lowe
a77fb561ef
YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe
...
(cherry picked from commit ebc048cc05
)
2017-07-13 17:49:55 -05:00
Jason Lowe
6ce2b0e4d4
YARN-6654. RollingLevelDBTimelineStore backwards incompatible after fst upgrade. Contributed by Jonathan Eagles
...
(cherry picked from commit 5f1ee72b0e
)
2017-07-13 17:28:49 -05:00
Sunil G
d83e8712f6
YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.
...
(cherry picked from commit ca13b224b2
)
2017-07-13 14:50:28 -05:00
Wangda Tan
cbb5f601f1
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
...
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
(cherry picked from commit c583ab02c7
)
2017-07-13 10:44:07 -05:00
Xuan
edc0aa95f1
YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong)
2017-07-12 15:45:51 -07:00
Wangda Tan
f2d440b3b3
YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda)
...
(cherry picked from commit 5fb723bb77
)
2017-07-12 10:06:02 -05:00
Eric Payne
e6cdf770ca
Revert "YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G)"
...
This reverts commit eda4ac07c1
.
Commit eda4ac07c1
was a separate patch from trunk rather than a cherry-pick. I will cherryp-ick dependencies and then cherry-pick the trunk commit for YARN-2113.
2017-07-12 08:56:40 -05:00
Yufei Gu
20a2770d72
YARN-6764. Simplify the logic in FairScheduler#attemptScheduling. Contributed by Yufei Gu.
...
(cherry picked from commit 3de47ab5ea
)
2017-07-09 16:11:26 -07:00
Naganarasimha
b08ef44d9e
YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.
...
(cherry picked from commit 626d730bfc
)
2017-07-09 17:27:50 +05:30
Daniel Templeton
fcef28e53b
YARN-6410. FSContext.scheduler should be final (Contributed by Yeliang Cang via Daniel Templeton)
...
(cherry picked from commit 9d27880442
)
2017-07-09 19:38:37 +09:00
Daniel Templeton
a6d194d720
YARN-6746. SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code
...
(Contributed by Deepti Sawhney via Daniel Templeton)
(cherry picked from commit c5a0c38d8e
)
2017-07-09 19:31:20 +09:00
Daniel Templeton
edcfae8258
YARN-6752. Display reserved resources in web UI per application
...
(Contributed by Abdullah Yousufi via Daniel Templeton)
(cherry picked from commit 0615985886
)
2017-07-09 19:19:07 +09:00
Eric Payne
eda4ac07c1
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G)
2017-07-06 10:43:00 -05:00
Jason Lowe
53c2441c10
YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt
...
(cherry picked from commit 7576a688ea
)
2017-07-06 09:44:02 -05:00
Naganarasimha
87c81cfad3
YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp.
...
(cherry picked from commit fa1aaee87b
)
2017-07-01 12:32:01 +05:30
Daniel Templeton
93c5421a43
YARN-6751. Display reserved resources in web UI per queue
...
(Contributed by Abdullah Yousufi via Daniel Templeton)
(cherry picked from commit ec97519779
)
2017-06-29 16:57:23 -07:00
Naganarasimha
a5ae7c0cae
YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R.
2017-06-29 00:09:30 +05:30
Jason Lowe
44b3c6ffaa
YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich
...
(cherry picked from commit 63ce1593c5
)
2017-06-27 17:13:49 -05:00
Naganarasimha
92e266c2b6
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.
2017-06-24 23:14:51 +05:30
Yufei Gu
4c59b446e2
YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)
...
(cherry picked from commit 0b77262890
)
2017-06-23 13:30:20 -07:00
Arun Suresh
66f780e6ab
YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh).
2017-06-22 15:07:38 -07:00
Akira Ajisaka
35f6c7c9c7
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.
...
(cherry picked from commit 099dfe92a9
)
2017-06-20 17:23:06 +09:00
Naganarasimha
578318473c
YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp
...
(cherry picked from commit ee89ac84e6
)
2017-06-19 22:45:21 +05:30
bibinchundatt
3f9acf65fb
YARN-6703. RM startup failure with old state store due to version mismatch. Contributed by Varun Saxena
...
(cherry picked from commit d64c842743
)
2017-06-12 18:32:23 +05:30
Eric Payne
33605e0896
YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
...
(cherry picked from commit 5578af8603
)
2017-06-09 16:18:16 -05:00