Akira Ajisaka
|
daad077121
|
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
|
2018-11-10 14:37:35 +09:00 |
Weiwei Yang
|
a3b61baf94
|
YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji.
(cherry picked from commit c96cbe8659 )
|
2018-11-07 22:50:05 +08:00 |
Akira Ajisaka
|
52af95fdce
|
Revert "YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang."
This reverts commit dd8479e80d .
|
2018-11-07 11:33:31 +09:00 |
Akira Ajisaka
|
dd8479e80d
|
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang.
(cherry picked from commit 951c98f890 )
|
2018-11-07 11:19:11 +09:00 |
Jason Lowe
|
7335d940de
|
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
(cherry picked from commit ab6aa4c726 )
|
2018-11-06 08:52:29 -06:00 |
Weiwei Yang
|
631b31110c
|
YARN-8970. Improve the debug message in CS#allocateContainerOnSingleNode. Contributed by Zhankun Tang.
(cherry picked from commit 5d6554c722 )
|
2018-11-06 14:53:28 +08:00 |
Weiwei Yang
|
71999f4464
|
YARN-8969. AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting. Contributed by Wanqiang Ji.
(cherry picked from commit c7fcca0d7e )
|
2018-11-06 13:23:42 +08:00 |
Jonathan Hung
|
221494a75c
|
YARN-7225. Add queue and partition info to RM audit log. Contributed by Eric Payne
(cherry picked from commit 2ab611d48b )
|
2018-11-01 14:31:22 -07:00 |
Weiwei Yang
|
70efe253f3
|
YARN-8944. TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit 1d90a0dd23 )
|
2018-10-29 11:56:31 +08:00 |
Jason Lowe
|
3be72b7aa2
|
YARN-8904. TestRMDelegationTokens can fail in testRMDTMasterKeyStateOnRollingMasterKey. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 93fb3b4b9c )
|
2018-10-23 12:55:48 -05:00 |
Weiwei Yang
|
beca90ece8
|
YARN-8907. Fix incorrect logging message in TestCapacityScheduler. Contributed by Zhankun Tang.
(cherry picked from commit 13cc0f50ea )
|
2018-10-19 10:02:46 +08:00 |
Wangda Tan
|
46baafedf1
|
YARN-8896. Limit the maximum number of container assignments per heartbeat. (Zhankun Tang via wangda)
Change-Id: I6e72f8362bd7f5c2a844cb9e3c4732492314e9f1
(cherry picked from commit 780be14f07 )
|
2018-10-18 12:29:19 -07:00 |
Weiwei Yang
|
a0060cf8ee
|
Revert "YARN-8468. Enable the use of queue based maximum container allocation limit and implement it in FairScheduler. Contributed by Antal Bálint Steinbach."
This reverts commit ce4a0898df .
|
2018-10-10 21:41:00 +08:00 |
Weiwei Yang
|
3968ce1073
|
YARN-8858. CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Contributed by Wangda Tan.
(cherry picked from commit edce866489 )
|
2018-10-10 09:48:56 +08:00 |
Weiwei Yang
|
ce4a0898df
|
YARN-8468. Enable the use of queue based maximum container allocation limit and implement it in FairScheduler. Contributed by Antal Bálint Steinbach.
|
2018-10-09 22:30:42 +08:00 |
Eric E Payne
|
c306da08ec
|
YARN-8774. Memory leak when CapacityScheduler allocates from reserved container with non-default label. Contributed by Tao Yang.
(cherry picked from commit 8598b498bc )
|
2018-09-28 15:34:23 +00:00 |
Jason Lowe
|
a56a345e07
|
YARN-8804. resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues. Contributed by Tao Yang
(cherry picked from commit 6b988d821e )
|
2018-09-26 16:15:48 -07:00 |
Rohith Sharma K S
|
d473152e6a
|
YARN-8824. App Nodelabel missed after RM restart for finished apps. Contributed by Bibin A Chundatt.
|
2018-09-26 20:36:34 +05:30 |
Rohith Sharma K S
|
47306cc2db
|
YARN-8815. RM fails to recover finished unmanaged AM. Contributed by Bibin A Chundatt.
(cherry picked from commit 50bc7746d7 )
|
2018-09-25 11:40:09 +05:30 |
Weiwei Yang
|
aaf0b119e5
|
YARN-8771. CapacityScheduler fails to unreserve when cluster resource contains empty resource type. Contributed by Tao Yang.
(cherry picked from commit 0712537e79 )
|
2018-09-19 19:38:09 +08:00 |
Weiwei Yang
|
00a469138d
|
YARN-8720. CapacityScheduler does not enforce max resource allocation check at queue level. Contributed by Tarun Parimi.
(cherry picked from commit f1a893fdbc )
|
2018-09-14 16:40:35 +08:00 |
Eric E Payne
|
b6bc0f409a
|
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.
(cherry picked from commit 987d8191ad )
|
2018-09-10 20:02:39 +00:00 |
Weiwei Yang
|
f164568b47
|
YARN-8723. Fix a typo in CS init error message when resource calculator is not correctly set. Contributed by Abhishek Modi.
(cherry picked from commit 3fa4639421 )
|
2018-08-29 11:15:02 +08:00 |
Haibo Chen
|
e4282c077b
|
YARN-8051. TestRMEmbeddedElector#testCallbackSynchronization is flaky. (Robert Kanter via Haibo Chen)
(cherry picked from commit 93d47a0ed5 )
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMEmbeddedElector.java
|
2018-08-24 13:24:08 -05:00 |
Wei-Chiu Chuang
|
0d155de159
|
HADOOP-14212. Addendum patch: Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-20 14:49:28 -07:00 |
Wei-Chiu Chuang
|
78fb14ba49
|
HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
|
2018-08-20 14:49:24 -07:00 |
Rohith Sharma K S
|
a3d4a25bbf
|
YARN-8679. [ATSv2] If HBase cluster is down for long time, high chances that NM ContainerManager dispatcher get blocked. Contributed by Wangda Tan.
(cherry picked from commit 4aacbfff60 )
|
2018-08-18 11:04:09 +05:30 |
Weiwei Yang
|
734bc42289
|
YARN-8575. Avoid committing allocation proposal to unavailable nodes in async scheduling. Contributed by Tao Yang.
(cherry picked from commit 0a71bf1452 )
|
2018-08-10 15:10:27 +08:00 |
Weiwei Yang
|
991514f7c3
|
YARN-8521. NPE in AllocationTagsManager when a container is removed more than once. Contributed by Weiwei Yang.
(cherry picked from commit 08d5060605 )
|
2018-08-10 08:44:53 +08:00 |
Wangda Tan
|
68279fcd65
|
YARN-8588. Logging improvements for better debuggability. (Suma Shivaprasad via wangda)
Change-Id: I66aa4b0ec031ae5ce0fae558e2f8cbcbbfebc442
(cherry picked from commit 344c335a92 )
|
2018-08-09 12:04:25 -07:00 |
Weiwei Yang
|
0ee7e80047
|
YARN-8559. Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
(cherry picked from commit d352f167eb )
|
2018-08-10 00:43:53 +08:00 |
Sunil G
|
1f77b20f08
|
YARN-8593. Add RM web service endpoint to get user information. Contributed by Akhil PB.
(cherry picked from commit 735b492556 )
|
2018-08-02 08:35:54 +05:30 |
Sunil G
|
ff35f0c308
|
YARN-8606. Opportunistic scheduling does not work post RM failover. Contributed by Bibin A Chundatt.
(cherry picked from commit a48a0cc7fd )
|
2018-08-01 12:17:53 +05:30 |
Sunil G
|
cbfd7358d2
|
YARN-8397. Potential thread leak in ActivitiesManager. Contributed by Rohith Sharma K S.
(cherry picked from commit 6310c0d17d )
|
2018-08-01 08:34:09 +05:30 |
Eric Yang
|
7640d62716
|
YARN-8579. Recover NMToken of previous attempted component data.
Contributed by Gour Saha
|
2018-07-31 18:35:31 -04:00 |
Wangda Tan
|
5583711419
|
Preparing for 3.1.2 release
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
|
2018-07-31 13:08:55 -07:00 |
Jonathan Hung
|
b91cf90e1c
|
YARN-7974. Allow updating application tracking url after registration. Contributed by Jonathan Hung
|
2018-07-30 17:57:25 -07:00 |
Eric Yang
|
8e3807afe0
|
YARN-8330. Improved publishing ALLOCATED events to ATS.
Contributed by Suma Shivaprasad
(cherry picked from commit f93ecf5c1e )
|
2018-07-25 18:51:42 -04:00 |
Eric E Payne
|
830ef12af8
|
YARN-4606. CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps. Contributed by Manikandan R
(cherry picked from commit 9485c9aee6 )
|
2018-07-25 16:30:30 +00:00 |
bibinchundatt
|
8e65057eb1
|
YARN-8541. RM startup failure on recovery after user deletion. Contributed by Bibin A Chundatt.
|
2018-07-25 15:54:32 +05:30 |
Weiwei Yang
|
b89624a943
|
YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang.
(Cherry-picked from commit 5be9f4a5d0 )
|
2018-07-25 17:53:40 +08:00 |
Sunil G
|
4488fd8295
|
YARN-7748. TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted fails due to multiple container fail events. Contributed by Weiwei Yang.
(cherry picked from commit 35ce6eb1f5 )
|
2018-07-24 22:21:15 +05:30 |
bibinchundatt
|
a684a2efb8
|
YARN-8548. AllocationRespose proto setNMToken initBuilder not done. Contributed by Bilwa S T.
(cherry picked from commit ff7c2eda34 )
|
2018-07-24 16:30:31 +05:30 |
bibinchundatt
|
0710107f8d
|
YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
(cherry picked from commit 8461278833 )
|
2018-07-24 13:11:31 +05:30 |
Weiwei Yang
|
004e1f248e
|
YARN-8528. Final states in ContainerAllocation might be modified externally causing unexpected allocation results. Contributed by Xintong Song.
|
2018-07-20 22:43:47 +08:00 |
Eric Yang
|
76b8beb289
|
YARN-8501. Reduce complexity of RMWebServices getApps method.
Contributed by Szilard Nemeth
(cherry picked from commit 5836e0a46b )
|
2018-07-19 12:32:55 -04:00 |
Wangda Tan
|
44beab0b63
|
YARN-8511. When AM releases a container, RM removes allocation tags before it is released by NM. (Weiwei Yang via wangda)
Change-Id: I6f9f409f2ef685b405cbff547dea9623bf3322d9
(cherry picked from commit 752dcce5f4 )
|
2018-07-16 11:04:08 -07:00 |
Eric E Payne
|
9a79e893f7
|
YARN-8421: when moving app, activeUsers is increased, even though app does not have outstanding request. Contributed by Kyungwan Nam
(cherry picked from commit 937ef39b3f )
|
2018-07-16 16:32:05 +00:00 |
Sunil G
|
844538d669
|
YARN-8459. Improve Capacity Scheduler logs to debug invalid states. Contributed by Wangda Tan.
(cherry picked from commit 51654a3962 )
|
2018-07-03 10:00:05 -07:00 |
Junping Du
|
3d6ba2dd4e
|
yarn.resourcemanager.fail-fast is used inconsistently. Contributed by Yuanbo Liu.
(cherry picked from commit d9ba6f3656 )
|
2018-07-03 22:36:24 +08:00 |
Sunil G
|
122cb81b65
|
YARN-8379. Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption. Contributed by Zian Chen.
(cherry picked from commit 291194302c )
|
2018-06-28 10:24:03 -07:00 |
Eric Yang
|
3ce3571a34
|
YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
Contributed by Chandni Singh
|
2018-06-28 13:11:56 -04:00 |
Wangda Tan
|
ec37e02bc9
|
YARN-8464. Async scheduling thread could be interrupted when there are no NodeManagers in cluster. (Sunil G via wangda)
Change-Id: I4f5f856373378685713e77752ba6cf0988a66065
(cherry picked from commit bedc4fe079 )
|
2018-06-26 19:34:15 -07:00 |
Eric Yang
|
f6aa6a6981
|
YARN-8108. Added option to disable loading existing filters to prevent
security filter from initialize twice.
Contributed by Sunil Govindan
(cherry picked from commit b69ba0f330 )
|
2018-06-26 17:45:13 -04:00 |
Weiwei Yang
|
bfdbc9dea2
|
YARN-8443. Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers. Contributed by Tao Yang.
(Cherry picked from commit 440140cea6 )
|
2018-06-25 09:28:57 +08:00 |
Rohith Sharma K S
|
1aa6c9407c
|
YARN-8155. Improve ATSv2 client logging in RM and NM publisher. Contributed by Abhishek Modi.
(cherry picked from commit 9119b3cf8f )
|
2018-06-14 13:51:13 +05:30 |
Sunil G
|
ed20c59d36
|
YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S
(cherry picked from commit 6307962b93 )
|
2018-06-13 16:09:52 +05:30 |
Weiwei Yang
|
4488ad5297
|
YARN-8394. Improve data locality documentation for Capacity Scheduler. Contributed by Weiwei Yang.
|
2018-06-13 13:54:09 +08:00 |
Rohith Sharma K S
|
af0309d793
|
YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
(cherry picked from commit 2df73dace0 )
|
2018-06-12 17:23:22 +05:30 |
Robert Kanter
|
93d6ed859e
|
YARN-4677. RMNodeResourceUpdateEvent update from scheduler can lead to race condition (wilfreds and gphillips via rkanter)
(cherry picked from commit 0cd145a443 )
|
2018-06-04 15:32:47 -07:00 |
Wangda Tan
|
0be93a7973
|
YARN-8349. Remove YARN registry entries when a service is killed by the RM. (Billie Rinaldi via wangda)
Change-Id: Ia58db3637789a8921482f564aa9bdf99c45cc36c
(cherry picked from commit ff583d3fa3 )
|
2018-06-01 15:53:26 -07:00 |
Wangda Tan
|
1cee85d8c4
|
YARN-7962. Race Condition When Stopping DelegationTokenRenewer causes RM crash during failover. (BELUGA BEHR via wangda)
Change-Id: I617e2645f60a57080058ad5f06af860fb3f682c8
(cherry picked from commit 931f78718f )
|
2018-06-01 15:47:51 -07:00 |
Weiwei Yang
|
ec4240a7fa
|
YARN-8367. Fix NPE in SingleConstraintAppPlacementAllocator when placement constraint in SchedulingRequest is null. Contributed by Weiwei Yang.
(Cherry picked from commit 6468071f13 )
|
2018-05-31 21:04:41 +08:00 |
Wangda Tan
|
3eb1cb18c7
|
YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda)
Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4
(cherry picked from commit 17aa40f669 )
|
2018-05-29 09:28:34 -07:00 |
Sunil G
|
7f9caf8986
|
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.
(cherry picked from commit 7c343669ba )
|
2018-05-28 16:33:48 +05:30 |
Wangda Tan
|
4d41cb1696
|
YARN-8213. Add Capacity Scheduler performance metrics. (Weiwei Yang via wangda)
Change-Id: Ieea6f3eeb83c90cd74233fea896f0fcd0f325d5f
(cherry picked from commit f24c842d52 )
|
2018-05-25 22:04:54 -07:00 |
Eric E Payne
|
053937f436
|
YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan.
(cherry picked from commit 8d5509c681 )
|
2018-05-25 16:27:09 +00:00 |
Rohith Sharma K S
|
923c833da4
|
YARN-8319. More YARN pages need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
(cherry picked from commit c05b5d424b )
|
2018-05-24 14:22:43 +05:30 |
Wangda Tan
|
6aaf33e50c
|
YARN-8290. SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception. (Eric Yang via wangda)
Change-Id: I0ac6ddd19740d1aa7dd07111cd11af71ddc2fcaf
(cherry picked from commit bd15d2396e )
|
2018-05-22 13:39:15 -07:00 |
Eric E Payne
|
5b2bbff141
|
YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam.
(cherry picked from commit 0b4c44bdee )
|
2018-05-21 20:19:44 +00:00 |
Weiwei Yang
|
b4213bfd90
|
YARN-7003. DRAINING state of queues is not recovered after RM restart. Contributed by Tao Yang.
(Cherry picked from commit 9db9cd95bd )
|
2018-05-11 10:55:05 +08:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
4c0a6b67f3
|
YARN-8249. Fixed few REST APIs in RMWebServices to have static-user check. Contributed by Sunil Govindan.
(cherry picked from commit d76fbbc9b8 )
|
2018-05-10 19:07:23 -07:00 |
Robert Kanter
|
0506c762b2
|
YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
(cherry picked from commit c8b53c4364 )
|
2018-05-10 09:52:11 -07:00 |
bibinchundatt
|
b29479c93a
|
YARN-8201. Skip stacktrace of few exception from ClientRMService. Contributed by Bilwa S T.
(cherry picked from commit cc0310a526 )
|
2018-05-10 09:29:43 +05:30 |
Rohith Sharma K S
|
e3a7dbc4ec
|
YARN-8239. [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI. Contributed by Sunil G.
(cherry picked from commit eb7b256cc2 )
|
2018-05-09 12:33:49 +05:30 |
Wangda Tan
|
0873cfcb56
|
YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian via wangda)
Change-Id: Ia21e1da6871570c993bbedde76ce32929e95970f
(cherry picked from commit 6b96a73bb0 )
|
2018-05-08 11:35:11 -07:00 |
Weiwei Yang
|
68dd01efc1
|
YARN-8025. UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty. Contributed by Tao Yang.
(Cherry picked from commit 67f239c42f )
|
2018-05-07 11:41:01 +08:00 |
Rohith Sharma K S
|
4c93cd228c
|
YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad.
(cherry picked from commit ee2ce923a9 )
|
2018-05-03 18:20:21 +05:30 |
Weiwei Yang
|
6fce88765a
|
YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang.
|
2018-05-02 18:02:24 +08:00 |
Weiwei Yang
|
f34f4e9c11
|
YARN-8212. Pending backlog for async allocation threads should be configurable. Contributed by Tao Yang.
(cherry picked from commit 2d319e3793 )
|
2018-05-01 09:57:15 +08:00 |
Konstantinos Karanasos
|
9d2967098d
|
YARN-8195. Fix constraint cardinality check in the presence of multiple target allocation tags. Contributed by Weiwei Yang.
(cherry picked from commit 9b09555451 )
|
2018-04-30 11:55:26 -07:00 |
Wangda Tan
|
090a8a274e
|
YARN-8005. Add unit tests for queue priority with dominant resource calculator. (Zian Chen via wangda)
Change-Id: I17a645f20869a1e5d86fa7a325c93fec908b91dc
(cherry picked from commit 92c5331423 )
|
2018-04-27 13:13:52 -07:00 |
Rohith Sharma K S
|
b3fd464e55
|
YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
(cherry picked from commit ef3ecc308d )
|
2018-04-27 22:59:16 +05:30 |
Sunil G
|
28e63f3d88
|
YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen.
(cherry picked from commit 71220d218d )
|
2018-04-27 10:42:59 +05:30 |
Sunil G
|
e2901d97ba
|
YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S.
(cherry picked from commit 1634de0fc1 )
|
2018-04-27 10:28:18 +05:30 |
Wangda Tan
|
af286319fd
|
YARN-8193. YARN RM hangs abruptly (stops allocating resources) when running successive applications. (Zian Chen via wangda)
Change-Id: Ia83dd2499ee9000b9e09ae5a932f21a13c0ddee6
(cherry picked from commit af986b442b7be0f2fad1241ca9e267a15c20bf43)
|
2018-04-25 22:16:07 -07:00 |
Sunil G
|
44d28692a8
|
YARN-8188. RM Nodes UI data table index for sorting column need to be corrected post Application tags display. Contributed by Weiwei Yang.
(cherry picked from commit 626690612cd0957316628376744a8be62f891665)
|
2018-04-25 14:58:07 +05:30 |
Wangda Tan
|
3043a93d46
|
YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda)
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
(cherry picked from commit bb3c504764f807fccba7f28298a12e2296f284cb)
|
2018-04-24 17:44:58 -07:00 |
Robert Kanter
|
ea7ad50499
|
HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
(cherry picked from commit 7ab08a9c37 )
|
2018-04-23 16:25:41 -07:00 |
Konstantinos Karanasos
|
18c86a3fb6
|
YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang.
(cherry picked from commit 28e2244390 )
|
2018-04-20 12:25:08 -07:00 |
Jason Lowe
|
71b0d52987
|
YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
(cherry picked from commit 766544c0b0 )
|
2018-04-20 13:23:46 -05:00 |
Sunil G
|
162db6e826
|
YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
(cherry picked from commit 7d06806dfd )
|
2018-04-20 00:06:44 +05:30 |
Shashikant Banerjee
|
a13b3edfd8
|
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247 )
|
2018-04-19 08:36:32 +09:00 |
Rohith Sharma K S
|
fa007d986b
|
YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G.
(cherry picked from commit 241d985467 )
|
2018-04-18 13:40:32 +05:30 |
Inigo Goiri
|
8f300c9ce1
|
YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4ae )
|
2018-04-17 15:28:13 +05:30 |
Wangda Tan
|
6ee62e6b1c
|
YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda)
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
|
2018-04-14 11:04:49 -07:00 |
Wangda Tan
|
994c7d66e0
|
YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda)
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
|
2018-04-13 10:19:10 -07:00 |
Wangda Tan
|
7031a853f4
|
YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda)
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
|
2018-04-13 10:18:48 -07:00 |
Sunil G
|
21717db6a0
|
YARN-8028. Support authorizeUserAccessToQueue in RMWebServices. Contributed by Wangda Tan.
|
2018-04-13 10:18:12 -07:00 |
Eric E Payne
|
9693d8b99d
|
YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599ae )
|
2018-04-12 17:58:41 +00:00 |
Eric E Payne
|
f955d52f39
|
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb8 )
|
2018-04-12 16:11:57 +00:00 |
Weiwei Yang
|
c2036af196
|
YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang.
(cherry picked from commit 7eb783e263 )
|
2018-04-11 17:21:47 +08:00 |
Vrushali C
|
67cd7acf99
|
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d5 )
|
2018-04-11 09:41:04 +05:30 |
Wangda Tan
|
25bf1d3ac6
|
Updated branch-3.1 to track 3.1.1
Change-Id: Idd55c79921b8acacc8a8a3258450e476f3abb706
|
2018-04-09 10:58:50 -07:00 |
Sunil G
|
8311fcc75b
|
YARN-7574. Add support for Node Labels on Auto Created Leaf Queue Template. Contributed by Suma Shivaprasad.
(cherry picked from commit 821b0de4c5 )
|
2018-04-09 21:17:56 +05:30 |
Konstantinos Karanasos
|
fa464c12ad
|
YARN-8013. Support application tags when defining application namespaces for placement constraints. Contributed by Weiwei Yang.
(cherry picked from commit 7853ec8d2f )
|
2018-04-04 10:53:33 -07:00 |
Wangda Tan
|
78832eca8a
|
YARN-8002. Support NOT_SELF and ALL namespace types for allocation tag. (Weiwei Yang via wangda)
Change-Id: I63b4e4192a95bf7ded98c54e46a2871c72869700
|
2018-04-04 09:42:49 +08:00 |
Sunil G
|
73cd67d7e3
|
YARN-8085. ResourceProfilesManager should be set in RMActiveServiceContext. Contributed by Tao Yang.
(cherry picked from commit 7a59d60e0c )
|
2018-03-29 21:41:52 +05:30 |
Wangda Tan
|
a2b4daab55
|
YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. (Tao Yang via wangda)
Change-Id: I805880f90b3f6798ec96ed8e8e75755f390a9ad5
(cherry picked from commit 47f711eebc )
|
2018-03-28 11:22:26 -07:00 |
Wangda Tan
|
dc99611878
|
YARN-8072. RM log is getting flooded with MemoryPlacementConstraintManager info logs. (Zian Chen via wangda)
Change-Id: I2567f4669ad868e13c4301fe44c4bde85bb92c37
(cherry picked from commit 24bc5e0e4d )
|
2018-03-26 11:27:40 -07:00 |
Wangda Tan
|
62b9537332
|
YARN-8068. Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ (Sunil G via wangda)
Change-Id: I7910bd1064a1b4dbbe2084080c060822ea6f3b48
(cherry picked from commit 9eef19b2ad )
|
2018-03-26 11:27:32 -07:00 |
Wangda Tan
|
54da6a0d78
|
YARN-8062. yarn rmadmin -getGroups returns group from which the user has been removed. (Sunil G via wangda)
Change-Id: I80ed63846502bf7751b890b6c6c6a7c0679e2b4a
(cherry picked from commit 5d381570f8 )
|
2018-03-26 11:27:21 -07:00 |
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
0bd99621c5
|
Preparing for 3.1.0 development
|
2018-03-19 15:16:54 -07:00 |
Weiwei Yang
|
154cfb2b62
|
YARN-7636. Re-reservation count may overflow when cluster resource exhausted for a long time. contributed by Tao Yang.
|
2018-03-16 18:57:31 +08:00 |
Wangda Tan
|
4bf622043f
|
YARN-7952. RM should be able to recover log aggregation status after restart/fail-over. (Xuan Gong via wangda)
Change-Id: I725c9afe64831eda0aa6b0bebdbc79d2dd165707
|
2018-03-15 13:26:45 -07:00 |
Wangda Tan
|
b167d60763
|
YARN-7657. Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue. (Suma Shivaprasad via wangda)
Change-Id: I32d566e8727840e43c0d66e39a77edef017e3a83
|
2018-03-13 17:55:51 -07:00 |
Yufei Gu
|
ff31d8aefa
|
YARN-8024. LOG in class MaxRunningAppsEnforcer is initialized with a faulty class. Contributed by Sen Zhao.
|
2018-03-12 16:35:26 -07:00 |
Weiwei Yang
|
b451889e8e
|
YARN-8011. TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails intermittently. Contributed by Tao Yang.
|
2018-03-08 18:13:36 +08:00 |
Wangda Tan
|
e718ac597f
|
Revert "YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)"
This reverts commit 4d53ef7eef .
|
2018-03-07 15:46:47 -08:00 |
Wangda Tan
|
4d53ef7eef
|
YARN-7891. LogAggregationIndexedFileController should support read from HAR file. (Xuan Gong via wangda)
Change-Id: Ie16e34039d57df50128c73b37516ad0bc7c9590e
|
2018-03-07 11:30:06 -08:00 |
Arun Suresh
|
1054b48c27
|
YARN-7972. Support inter-app placement constraints for allocation tags by application ID. (Weiwei Yang via asuresh)
|
2018-03-05 11:24:17 -08:00 |
Yufei Gu
|
6ca4e3017b
|
YARN-5028. RMStateStore should trim down app state for completed applications(addendum). Contributed by Rohith Sharma K S.
|
2018-03-01 08:38:53 -08:00 |
Arpit Agarwal
|
2fa7963c3d
|
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
|
2018-02-24 14:41:55 -08:00 |
Carlo Curino
|
514794e1a5
|
YARN-7934. [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos. (Contributed by curino)
|
2018-02-22 18:12:12 -08:00 |
Yufei Gu
|
92cbbfe79e
|
YARN-5028. RMStateStore should trim down app state for completed applications. Contributed by Gergo Repas.
|
2018-02-21 11:42:51 -08:00 |
Sunil G
|
bdd2a184d7
|
YARN-7947. Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps. Contributed by Eric Payne.
|
2018-02-21 14:35:57 +05:30 |
Jason Lowe
|
9497215084
|
YARN-7813. Capacity Scheduler Intra-queue Preemption should be configurable for each queue. Contributed by Eric Payne
|
2018-02-19 14:06:28 -06:00 |
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
Arun Suresh
|
a1e56a6286
|
YARN-7918. Fix TestAMRMClientPlacementConstraints. (Gergely Novák via asuresh)
|
2018-02-17 03:24:55 -08:00 |
Sunil G
|
aae629913c
|
YARN-7292. Retrospect Resource Profile Behavior for overriding capability. Contributed by Wangda Tan.
|
2018-02-16 12:37:40 +05:30 |
Konstantinos Karanasos
|
0b489e564c
|
YARN-7920. Simplify configuration for PlacementConstraints. Contributed by Wangda Tan.
|
2018-02-15 14:23:38 -08:00 |
Eric Payne
|
bddfe42e2c
|
Revert "YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue"
This reverts commit c5e6e3de1c .
|
2018-02-14 14:29:20 -06:00 |
Wangda Tan
|
042ef2fa7b
|
YARN-7789. Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator. (Zian Chen via wangda)
Change-Id: I1f6a451fe16758def6f47c046a9b8a67ad7255af
|
2018-02-14 23:11:10 +08:00 |
Eric Payne
|
c5e6e3de1c
|
YARN-7813: Capacity Scheduler Intra-queue Preemption should be configurable for each queue
|
2018-02-13 10:11:02 -06:00 |
Wangda Tan
|
d02e42cee4
|
YARN-7739. DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation. (wangda)
Change-Id: I10cc9341237d9a2fc0f8c855efb98a36b91389e2
|
2018-02-12 10:29:37 +08:00 |
Wangda Tan
|
60f9e60b3b
|
Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
|
2018-02-11 11:17:38 +08:00 |
Yufei Gu
|
1bc03ddf97
|
YARN-7655. Avoid AM preemption caused by RRs for specific nodes or racks. Contributed by Steven Rand.
|
2018-02-08 12:32:43 -08:00 |
Robert Kanter
|
814d701d46
|
YARN-7841. Cleanup AllocationFileLoaderService's reloadAllocations method (snemeth via rkanter)
|
2018-02-06 14:36:49 -08:00 |
Weiwei Yang
|
bff858e910
|
YARN-7860. Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning. Contributed by Sunil G.
|
2018-02-06 19:33:04 +08:00 |
Konstantinos Karanasos
|
50723889cc
|
YARN-7778. Merging of placement constraints defined at different levels. Contributed by Weiwei Yang.
|
2018-02-02 14:46:20 -08:00 |
Arun Suresh
|
6e5ba9366f
|
YARN-7839. Modify PlacementAlgorithm to Check node capacity before placing request on node. (Panagiotis Garefalakis via asuresh)
|
2018-02-02 10:28:22 -08:00 |
Arun Suresh
|
d481344783
|
YARN-7822. Constraint satisfaction checker support for composite OR and AND constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:51:08 -08:00 |
Arun Suresh
|
add993e26a
|
YARN-6597. Add RMContainer recovery test to verify tag population in the AllocationTagsManager. (Panagiotis Garefalakis via asuresh)
|
2018-01-31 01:30:17 -08:00 |
Arun Suresh
|
f8c5f5b237
|
YARN-7784. Fix Cluster metrics when placement processor is enabled. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
Arun Suresh
|
c23980c4f2
|
YARN-7795. Fix jenkins issues of YARN-6592 branch. (Sunil G via asuresh)
|
2018-01-31 01:30:17 -08:00 |
Arun Suresh
|
644afe5fd8
|
YARN-7807. Assume intra-app anti-affinity as default for scheduling request inside AppPlacementAllocator. (Wangda Tan via asuresh)
|
2018-01-31 01:30:17 -08:00 |
Arun Suresh
|
a4c539fcdb
|
YARN-7783. Add validation step to ensure constraints are not violated due to order in which a request is processed. (asuresh)
|
2018-01-31 01:30:17 -08:00 |
Sunil G
|
9b81cb0537
|
YARN-7779. Display allocation tags in RM web UI and expose same through REST API. Contributed by Weiwei Yang.
|
2018-01-31 01:30:17 -08:00 |
Konstantinos Karanasos
|
adbe87abf8
|
YARN-7788. Factor out management of temp tags from AllocationTagsManager. (Arun Suresh via kkaranasos)
|
2018-01-31 01:30:17 -08:00 |
Arun Suresh
|
8bf7c44436
|
YARN-7763. Allow Constraints specified in the SchedulingRequest to override application level constraints. (Weiwei Yang via asuresh)
|
2018-01-31 01:30:17 -08:00 |