Varun Saxena
|
19b89c4c7b
|
YARN-6420. RM startup failure due to wrong order in nodelabel editlog (Bibin A Chundatt via Varun Saxena)
|
2017-04-05 09:38:35 +05:30 |
Karthik Kambatla
|
9cc04b4708
|
YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha)
|
2017-04-04 17:08:33 -07:00 |
Wangda Tan
|
3fdae0a2b6
|
YARN-6109. Add an ability to convert ChildQueue to ParentQueue. (Xuan Gong via wangda)
|
2017-04-04 14:39:01 -07:00 |
Chris Douglas
|
6eba79232f
|
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
|
2017-04-03 20:13:14 -07:00 |
Eric Payne
|
318bfb01bc
|
YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe
|
2017-03-31 12:30:35 -05:00 |
Jason Lowe
|
4d1fac5df2
|
YARN-6411. Clean up the overwrite of createDispatcher() in subclass of MockRM. Contributed by Yufei Gu
|
2017-03-31 10:05:34 -05:00 |
Daniel Templeton
|
640ba1d23f
|
YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled
|
2017-03-29 12:38:11 -07:00 |
|
Jason Lowe
|
fdf8f8ebca
|
YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter
|
2017-03-28 09:33:26 -05:00 |
Robert Kanter
|
9bae6720cb
|
YARN-6050. AMs can't be scheduled on racks or nodes (rkanter)
|
2017-03-27 17:23:13 -07:00 |
|
Wangda Tan
|
cd014d57aa
|
YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda)
|
2017-03-27 13:29:09 -07:00 |
Akira Ajisaka
|
b63ae854f9
|
YARN-6379. Remove unused argument in ClientRMService. Contributed by Kai Sasaki.
|
2017-03-27 11:23:41 +09:00 |
Sunil G
|
cffea251be
|
YARN-5956. Refactor ClientRMService for unify error handling across apis. Contributed by Kai Sasaki.
|
2017-03-25 22:26:19 +05:30 |
Tsuyoshi Ozawa
|
84ddedc0b2
|
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
|
2017-03-25 10:06:52 +09:00 |
Ravi Prakash
|
d4f73e7e27
|
HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong.
|
2017-03-24 09:38:17 -07:00 |
|
Daniel Templeton
|
0a05c5c598
|
YARN-6284. hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable
(Contributed by Laura Adams via Daniel Templeton)
|
2017-03-21 14:15:40 -07:00 |
|
Varun Saxena
|
35034653d0
|
YARN-6353. Clean up OrderingPolicy javadoc (Daniel Templeton via Varun Saxena)
|
2017-03-20 23:29:09 +05:30 |
|
Sunil G
|
2d0e24eb01
|
YARN-6328. Fix a spelling mistake in CapacityScheduler. Contributed by Jin Yibo. This closes #202
|
2017-03-15 14:48:05 +05:30 |
Ray Chiang
|
4c66a8d19b
|
YARN-6331. Fix flakiness in TestFairScheduler#testDumpState. (Yufei Gu via rchiang)
|
2017-03-14 15:09:47 -07:00 |
Naganarasimha
|
0a3aa40fe7
|
YARN-6327. Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator. Contributed by Jonathan Hung.
|
2017-03-15 01:22:25 +05:30 |
|
Ray Chiang
|
4db9cc70d0
|
YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)
|
2017-03-10 16:13:31 -08:00 |
|
Jason Lowe
|
9649c27864
|
YARN-6321. TestResources test timeouts are too aggressive. Contributed by Eric Badger
|
2017-03-10 13:06:54 -06:00 |
|
Karthik Kambatla
|
a96afae125
|
YARN-6264. AM not launched when a single vcore is available on the cluster. (Yufei Gu via kasha)
|
2017-03-09 23:11:54 -08:00 |
|
Daniel Templeton
|
846a0cd678
|
YARN-1047. Expose # of pre-emptions as a queue counter (Contributed by Karthik Kambatla via Daniel Templeton)
|
2017-03-09 17:51:47 -08:00 |
|
Daniel Templeton
|
822a74f2ae
|
YARN-6300. NULL_UPDATE_REQUESTS is redundant in TestFairScheduler (Contributed by Yuanbo Liu via Daniel Templeton)
|
2017-03-09 12:14:33 -08:00 |
|
Jason Lowe
|
d7762a5511
|
YARN-6165. Intra-queue preemption occurs even when preemption is turned off for a specific queue. Contributed by Eric Payne
|
2017-03-08 16:46:09 -06:00 |
|
Sunil G
|
1eb8186703
|
YARN-6207. Move application across queues should handle delayed event processing. Contributed by Bibin A Chundatt.
|
2017-03-08 12:04:30 +05:30 |
|
Daniel Templeton
|
e0c239cdbd
|
YARN-6287. RMCriticalThreadUncaughtExceptionHandler.rmContext should be final (Contributed by Corey Barker via Daniel Templeton)
|
2017-03-07 11:58:48 -08:00 |
|
Sunil G
|
c1386a90d7
|
YARN-6248. user is not removed from UsersManager’s when app is killed with pending container requests. Contributed by Eric Payne.
|
2017-03-04 13:46:35 +05:30 |
Junping Du
|
8db7a8c3ae
|
YARN-6271. yarn rmadin -getGroups returns information from standby RM. Contributed by Jian He.
|
2017-03-03 14:39:31 -08:00 |
|
Ray Chiang
|
2148b83993
|
YARN-6218. Fix TestAMRMClient when using FairScheduler. (Miklos Szegedi via rchiang)
|
2017-03-03 13:04:51 -08:00 |
|
Jason Lowe
|
e58fc76030
|
YARN-6263. NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe. Contributed by Haibo Chen
|
2017-03-03 08:23:08 -06:00 |
Jian He
|
235203dffd
|
YARN-6153. KeepContainer does not work when AM retry window is set. Contributed by kyungwan nam
|
2017-02-28 13:23:36 -08:00 |
Xuan
|
e0bb867c3f
|
YARN-6189: Improve application status log message when RM restarted when
app is in NEW state. Contributed by Junping Du
|
2017-02-28 11:04:56 -08:00 |
|
Wangda Tan
|
eac6b4c35c
|
YARN-6216. Unify Container Resizing code paths with Container Updates making it scheduler agnostic. (Arun Suresh via wangda)
|
2017-02-28 10:35:50 -08:00 |
|
Karthik Kambatla
|
f187d63816
|
YARN-6231. FairSchedulerTestBase helper methods should call scheduler.update to avoid flakiness. (kasha)
|
2017-02-27 22:10:57 -08:00 |
|
Naganarasimha
|
5f5b031d1f
|
YARN-5703. ReservationAgents are not correctly configured. Contributed by Manikandan R.
|
2017-02-27 20:38:29 +05:30 |
Karthik Kambatla
|
fbfe86deea
|
YARN-6172. FSLeafQueue demand update needs to be atomic. (Miklos Szegedi via kasha)
|
2017-02-26 20:36:33 -08:00 |
|
Karthik Kambatla
|
815d53506f
|
YARN-6215. FairScheduler preemption and update should not run concurrently. (Tao Jie via kasha)
|
2017-02-26 20:16:36 -08:00 |
|
Karthik Kambatla
|
694e680d20
|
YARN-6222. TestFairScheduler.testReservationMetrics is flaky. (Yufei Gu via kasha)
|
2017-02-23 15:21:52 -08:00 |
|
Sunil G
|
a207aa9930
|
YARN-6211. Synchronization improvement for moveApplicationAcrossQueues and updateApplicationPriority. Contributed by Bibin A Chundatt.
|
2017-02-23 14:19:07 +05:30 |
|
Karthik Kambatla
|
b10e962224
|
YARN-6194. Cluster capacity in SchedulingPolicy is updated only on allocation file reload. (Yufei Gu via kasha)
|
2017-02-22 15:58:49 -08:00 |
|
Karthik Kambatla
|
718ad9f6ee
|
YARN-6210. FairScheduler: Node reservations can interfere with preemption. (kasha)
|
2017-02-22 15:46:07 -08:00 |
|
Wangda Tan
|
1a6ca75f38
|
YARN-6143. Fix incompatible issue caused by YARN-3583. (Sunil G via wangda)
|
2017-02-22 11:17:09 -08:00 |
|
Karthik Kambatla
|
dbbfcf74ab
|
YARN-6193. FairScheduler might not trigger preemption when using DRF. (kasha)
|
2017-02-17 14:07:31 -08:00 |
|
Daniel Templeton
|
c7a36e6130
|
YARN-6125. The application attempt's diagnostic message should have a maximum size
(Contributed by Andras Piros via Daniel Templeton)
|
2017-02-17 13:40:58 -08:00 |
|
Daniel Templeton
|
9a92837786
|
YARN-6188. Fix OOM issue with decommissioningNodesWatcher in the case of clusters with
large number of nodes (Contributed by Ajay Jadhav via Daniel Templeton)
|
2017-02-17 13:13:46 -08:00 |
|
Karthik Kambatla
|
a77f432449
|
YARN-6171. ConcurrentModificationException on FSAppAttempt.containersToPreempt. (Miklos Szegedi via kasha)
|
2017-02-16 14:54:58 -08:00 |
Rohith Sharma K S
|
e63a7814d2
|
YARN-6200. addendum to fix compilation error caused by reverting YARN-5068.
|
2017-02-16 18:19:57 +05:30 |
|
Rohith Sharma K S
|
a393e84c6f
|
YARN-6200. Reverting since the same functionality achieved by YARN-1623.
Revert "YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)"
This reverts commit b7ac85259c.
|
2017-02-16 18:00:25 +05:30 |
|
Karthik Kambatla
|
74dd142250
|
YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei Gu via kasha)
|
2017-02-16 00:03:09 -08:00 |
|
Karthik Kambatla
|
11be3f70e0
|
YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue. (Yufei Gu via kasha)
|
2017-02-15 23:51:22 -08:00 |
|
Karthik Kambatla
|
6c25dbcdc0
|
YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha)
|
2017-02-15 23:16:12 -08:00 |
|
Varun Saxena
|
b7613e0f40
|
YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt via Varun Saxena)
|
2017-02-15 14:48:17 +05:30 |
|
Karthik Kambatla
|
353a9b2d91
|
YARN-6061. Addendum. Remove extraneous change.
|
2017-02-14 15:19:52 -08:00 |
|
Karthik Kambatla
|
652679aa8a
|
YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei Gu via kasha)
|
2017-02-14 13:39:41 -08:00 |
Arun Suresh
|
aaf106fde3
|
YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh)
|
2017-02-14 06:09:10 -08:00 |
|
Karthik Kambatla
|
646c6d6509
|
YARN-3933. FairScheduler: Multiple calls to completedContainer are not safe. (Shiwei Guo and Miklos Szegedi via kasha)
|
2017-02-13 11:26:30 -08:00 |
|
Karthik Kambatla
|
08f93978f3
|
YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha)
|
2017-02-09 14:45:04 -08:00 |
|
Karthik Kambatla
|
9b85053583
|
YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha)
|
2017-02-09 13:09:32 -08:00 |
|
Wangda Tan
|
5fb723bb77
|
YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda)
|
2017-02-09 10:23:50 -08:00 |
|
Daniel Templeton
|
3e06475307
|
YARN-4658. Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment (Contributed by Udai Potluri via Daniel Templeton)
|
2017-01-31 16:25:33 -08:00 |
|
Daniel Templeton
|
87852b6ef4
|
YARN-6103. Log updates for ZKRMStateStore (Contributed by Daniel Sturman via Daniel Templeton)
|
2017-01-30 21:44:48 -08:00 |
|
Karthik Kambatla
|
11e44bdda7
|
YARN-6131. FairScheduler: Lower update interval for faster tests. (kasha)
|
2017-01-30 13:35:23 -08:00 |
|
Sunil G
|
165f07f51a
|
YARN-6123. [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. Contributed by Wangda Tan.
|
2017-01-27 18:37:51 +05:30 |
|
Daniel Templeton
|
f85b74ccf9
|
YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-01-26 10:31:09 -08:00 |
|
Karthik Kambatla
|
abedb8a9d8
|
YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha)
|
2017-01-25 12:17:28 -08:00 |
|
Rohith Sharma K S
|
0101267d9d
|
YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G.
|
2017-01-24 10:59:55 +05:30 |
|
Wangda Tan
|
ce832059db
|
YARN-5864. Capacity Scheduler - Queue Priorities. (wangda)
|
2017-01-23 10:52:14 -08:00 |
Jason Lowe
|
69fa81679f
|
YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He
|
2017-01-23 17:12:51 +00:00 |
|
Sunil G
|
3fa0d540df
|
YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang.
|
2017-01-23 12:19:35 +05:30 |
Sangjin Lee
|
b01514f65b
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-01-19 20:52:55 -08:00 |
Andrew Wang
|
5d8b80ea9b
|
Preparing for 3.0.0-alpha3 development
|
2017-01-19 15:50:07 -08:00 |
|
Wangda Tan
|
72054a817d
|
YARN-5556. CapacityScheduler: Support deleting queues without requiring a RM restart. (Naganarasimha G R via wangda)
|
2017-01-18 13:31:33 -08:00 |
|
Karthik Kambatla
|
e224c96234
|
YARN-5831. FairScheduler: Propagate allowPreemptionFrom flag all the way down to the app. (Yufei Gu via kasha)
|
2017-01-17 17:01:31 -08:00 |
|
Daniel Templeton
|
695f110f93
|
YARN-6071. Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)
(Contributed by Wangda Tan via Daniel Templeton)
|
2017-01-17 12:55:47 -08:00 |
|
Sunil G
|
d3170f9eba
|
YARN-6081. LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container. Contributed by Wangda Tan.
|
2017-01-13 18:22:29 +05:30 |
|
Naganarasimha
|
a6b06f7179
|
YARN-6072. RM unable to start in secure mode. Contributed by Ajith S.
|
2017-01-12 06:40:41 +05:30 |
|
Daniel Templeton
|
7979939428
|
YARN-5554. MoveApplicationAcrossQueues does not check user permission on the target queue
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
|
2017-01-11 14:34:10 -08:00 |
|
Jason Lowe
|
357eab9566
|
YARN-5416. TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped. Contributed by Junping Du
|
2017-01-11 17:13:37 +00:00 |
|
Junping Du
|
4db119b7b5
|
YARN-6079. Fix simple spelling errors in yarn test code. Contributed by vijay.
|
2017-01-10 18:20:27 -08:00 |
|
Sunil G
|
9594c35dcb
|
YARN-5899. Debug log in AbstractCSQueue#canAssignToThisQueue needs improvement. Contributed by Ying Zhang.
|
2017-01-10 14:08:01 +05:30 |
|
Junping Du
|
945db55f2e
|
YARN-4148. When killing app, RM releases app's resource before they are released by NM. Contributed by Jason Lowe.
|
2017-01-09 18:14:46 -08:00 |
|
Wangda Tan
|
287d3d6804
|
YARN-3955. Support for application priority ACLs in queues of CapacityScheduler. (Sunil G via wangda)
|
2017-01-09 08:40:39 -08:00 |
|
Daniel Templeton
|
ac16400e1f
|
YARN-6022. Revert changes of AbstractResourceRequest (Contributed by Wangda Tan via Daniel Templeton)
|
2017-01-07 08:24:30 -08:00 |
|
Naganarasimha
|
a59df15757
|
YARN-6015. AsyncDispatcher thread name can be set to improved debugging. Contributed by Ajith S.
|
2017-01-07 08:11:58 +05:30 |
|
Jian He
|
020316458d
|
YARN-6009. Skip validating app timeout value on recovery. Contributed by Rohith Sharma K S
|
2017-01-06 18:19:09 -08:00 |
|
Arun Suresh
|
2977bc6a14
|
YARN-6040. Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes. (Wangda Tan via asuresh)
|
2017-01-06 09:59:57 -08:00 |
|
Wangda Tan
|
0a55bd841e
|
YARN-5959. RM changes to support change of container ExecutionType. (Arun Suresh via wangda)
|
2017-01-05 10:31:05 -08:00 |
|
Rohith Sharma K S
|
e49e0a6e37
|
YARN-5988. RM unable to start in secure setup. Contributed by Ajith S.
|
2017-01-04 12:09:29 +05:30 |
|
Wangda Tan
|
f69a107aec
|
YARN-6025. Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
(cherry picked from commit e0f2379312)
|
2017-01-03 14:53:36 -08:00 |
|
Wangda Tan
|
ab1faa4ba8
|
Revert "Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)" to add correct JIRA number
This reverts commit e0f2379312.
|
2017-01-03 14:53:13 -08:00 |
|
Wangda Tan
|
e0f2379312
|
Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
|
2017-01-03 14:46:41 -08:00 |
|
Daniel Templeton
|
165d01a73e
|
YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)
|
2016-12-30 08:41:52 -08:00 |
|
Robert Kanter
|
f216276d21
|
YARN-4882. Change the log level to DEBUG for recovering completed applications (templedf via rkanter)
|
2016-12-28 15:21:52 -08:00 |
|
Sunil G
|
9ca54f4810
|
YARN-5906. Update AppSchedulingInfo to use SchedulingPlacementSet. Contributed by Wangda Tan.
|
2016-12-28 22:48:19 +05:30 |
|
Sunil G
|
f6715b26b6
|
YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.
|
2016-12-28 12:33:02 +05:30 |
|
Wangda Tan
|
0840b4329b
|
YARN-5756. Add state-machine implementation for scheduler queues. (Xuan Gong via wangda)
|
2016-12-27 21:18:33 -08:00 |
|
Robert Kanter
|
1bbd023275
|
YARN-5962. Spelling errors in logging and exceptions for resource manager code (gsohn via rkanter)
|
2016-12-27 13:35:34 -08:00 |
|
Daniel Templeton
|
e216e8e233
|
HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)
|
2016-12-27 13:03:16 -08:00 |
|
Arun Suresh
|
ac1e5d4f77
|
YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes (asuresh)
|
2016-12-27 12:40:44 -08:00 |