Wangda Tan
|
e0cfb0a31a
|
YARN-7817. Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages. (Sunil G via wangda)
Change-Id: Ia7ceeabd82046645ddeaf487c763288f36cfbdee
|
2018-01-26 15:43:27 +08:00 |
Jason Lowe
|
ff8378eb1b
|
YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
|
2018-01-25 17:47:19 -06:00 |
Sunil G
|
82cc6f6968
|
YARN-7728. Expose container preemptions related information in Capacity Scheduler queue metrics. Contributed by Eric Payne.
|
2018-01-25 14:32:54 +05:30 |
Billie Rinaldi
|
e307edcb47
|
YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He
|
2018-01-23 17:54:39 -08:00 |
Yufei Gu
|
22ee6f77e5
|
YARN-7755. Clean up deprecation messages for allocation increments in FS config. Contributed by Wilfred Spiegelenburg.
|
2018-01-22 10:30:01 -08:00 |
Miklos Szegedi
|
bc93ac229e
|
YARN-7139. FairScheduler: finished applications are always restored to default queue. Contributed by Wilfred Spiegelenburg.
|
2018-01-18 17:43:47 -08:00 |
Sunil G
|
06cceba1cb
|
YARN-7738. CapacityScheduler: Support refresh maximum allocation for multiple resource types. Contributed by Wangda Tan.
|
2018-01-18 19:05:26 +05:30 |
Yufei Gu
|
370f1c6283
|
YARN-6486. FairScheduler: Deprecate continuous scheduling. (Contributed by Wilfred Spiegelenburg)
|
2018-01-16 14:46:55 -08:00 |
Rohith Sharma K S
|
d09058b2fd
|
YARN-6736. Consider writing to both ats v1 & v2 from RM for smoother upgrades. Contributed by Aaron Gresch.
|
2018-01-16 07:58:29 +05:30 |
Sunil G
|
128d773a23
|
YARN-7727. Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector. Contributed by Prabhu Joseph.
|
2018-01-12 15:41:19 +05:30 |
Sunil G
|
afd8caba27
|
YARN-7722. Rename variables in MockNM, MockRM for better clarity. Contributed by Lovekesh bansal
|
2018-01-10 20:51:34 +05:30 |
Miklos Szegedi
|
55066cc53d
|
YARN-7689. TestRMContainerAllocator fails after YARN-6124. Contributed by Wilfred Spiegelenburg.
|
2018-01-09 16:59:39 -08:00 |
Haibo Chen
|
8ee7080e5d
|
YARN-7665. Allow FS scheduler state dump to be turned on/off separately from FS debug log. (Wilfred Spiegelenburg via Haibo Chen)
|
2018-01-09 16:45:35 -08:00 |
Jason Lowe
|
90c86d6e09
|
YARN-6948. Invalid event: ATTEMPT_ADDED at FINAL_SAVING. Contributed by lujie
|
2018-01-09 10:51:15 -06:00 |
Jason Lowe
|
ebff4decfe
|
YARN-7663. RMAppImpl:Invalid event: START at KILLED. Contributed by lujie
|
2018-01-09 09:52:59 -06:00 |
bibinchundatt
|
b26e30ab16
|
YARN-7508. NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode. Contributed by Tao Yang.
|
2018-01-09 17:57:01 +05:30 |
Ray Chiang
|
59ab5da0a0
|
YARN-4227. Ignore expired containers from removed nodes in FairScheduler. (Wilfred Spiegelenburg via rchiang)
|
2018-01-08 16:19:02 -08:00 |
Rohith Sharma K S
|
c2d6fa3656
|
YARN-7699. queueUsagePercentage is coming as INF for getApp REST api call. Contributed by Sunil G.
|
2018-01-08 10:39:31 +05:30 |
Wangda Tan
|
a81144daa0
|
YARN-7666. Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations. (Sunil G via wangda)
Change-Id: I0fd826490f5160d47d42af2a9ac0bd8ec4e959dc
|
2018-01-05 15:12:04 -08:00 |
Robert Kanter
|
2aa4f0a559
|
YARN-7645. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers is flakey with FairScheduler (rkanter)
|
2018-01-05 13:55:09 -08:00 |
Robert Kanter
|
f8e7dd9b10
|
YARN-7557. It should be possible to specify resource types in the fair scheduler increment value (grepas via rkanter)
|
2018-01-05 11:15:06 -08:00 |
Sunil G
|
0c75d0634b
|
YARN-7619. Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user. Contributed by Eric Payne.
|
2018-01-05 14:42:17 +05:30 |
Robert Kanter
|
7a55044803
|
YARN-7622. Allow fair-scheduler configuration on HDFS (gphillips via rkanter)
|
2018-01-03 15:31:50 -08:00 |
Rohith Sharma K S
|
c9bf813c9a
|
YARN-7692. Skip validating priority acls while recovering applications. Contributed by Sunil G.
|
2018-01-03 18:20:04 +05:30 |
Robert Kanter
|
382215c72b
|
YARN-7577. Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart (miklos.szegedi@cloudera.com via rkanter)
|
2017-12-20 13:39:00 -08:00 |
Eric Yang
|
94a2ac6b71
|
YARN-7466. addendum patch for failing unit test. (Contributed by Chandni Singh)
|
2017-12-19 18:42:27 -05:00 |
Akira Ajisaka
|
001008958d
|
YARN-7664. Several javadoc errors. Contributed by Sean Mackrory.
|
2017-12-18 22:24:51 +09:00 |
Rohith Sharma K S
|
09d996fdd4
|
YARN-7190. Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath. Contributed by Varun Saxena.
|
2017-12-15 21:50:28 +05:30 |
Sunil G
|
890d3d0645
|
YARN-7638. Unit tests related to preemption for auto created leaf queues feature.Contributed by Suma Shivaprasad.
|
2017-12-15 13:00:57 +05:30 |
Sunil G
|
cb87e4dc92
|
YARN-7643. Handle recovery of applications in case of auto-created leaf queue mapping. Contributed by Suma Shivaprasad.
|
2017-12-13 22:49:58 +05:30 |
Sunil G
|
8bb83a8f62
|
Queue ACL validations should validate parent queue ACLs before auto-creating leaf queues. Contributed by Suma Shivaprasad.
|
2017-12-12 15:20:59 +05:30 |
Sunil G
|
5c87fb2f62
|
YARN-7635. TestRMWebServicesSchedulerActivities fails in trunk. Contributed by Sunil G.
|
2017-12-12 15:08:18 +05:30 |
Sunil G
|
312ceebde8
|
YARN-7632. Effective min and max resource need to be set for auto created leaf queues upon creation and capacity management. Contributed by Suma Shivaprasad.
|
2017-12-11 19:20:02 +05:30 |
Wangda Tan
|
adca1a72e4
|
YARN-7591. NPE in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I46689e530550ee0a6ac7a29786aab2cc1bdf314f
|
2017-12-08 15:17:02 -08:00 |
Wangda Tan
|
a8316df8c0
|
YARN-7520. Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues. (Suma Shivaprasad via wangda)
Change-Id: I482f086945bd448d512cb5b3879d7371e37ee134
|
2017-12-08 15:11:28 -08:00 |
Wangda Tan
|
f548bfffbd
|
YARN-7420. YARN UI changes to depict auto created queues. (Suma Shivaprasad via wangda)
Change-Id: I8039d3772a191ddede132cd1f8b08a8ca2e275b7
|
2017-12-08 15:10:47 -08:00 |
Wangda Tan
|
b38643c9a8
|
YARN-7473. Implement Framework and policy for capacity management of auto created queues. (Suma Shivaprasad via wangda)
Change-Id: Icca7805fe12f6f7fb335effff4b121b6f7f6337b
|
2017-12-08 15:10:16 -08:00 |
Wangda Tan
|
74665e3a7d
|
YARN-7274. Ability to disable elasticity at leaf queue level. (Zian Chen via wangda)
Change-Id: Ic8d43e297f0f5de788b562f7eff8106c5c35e8d2
|
2017-12-08 15:07:56 -08:00 |
Sunil G
|
4db4a4a165
|
YARN-7575. NPE in scheduler UI when max-capacity is not configured. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
Sunil G
|
daa1cdd062
|
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
1012b901c8
|
YARN-7544. Use queue-path.capacity/maximum-capacity to specify absolute min/max resources. (Sunil G via wangda)
Change-Id: I685341be213eee500f51e02f01c91def89391c17
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
b7b8cd5324
|
YARN-7538. Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring. (Sunil G via wangda)
Change-Id: Ic9bd7e599c56970fe01cb0e1bba6df7d1f77eb29
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
7462c38277
|
YARN-7483. CapacityScheduler test cases cleanup post YARN-5881. (Sunil G via wangda)
Change-Id: I9741a6baf5cb7352d05636efb6c0b24790e7589a
|
2017-12-07 18:56:54 -08:00 |
Rohith Sharma K S
|
e65ca92fb6
|
YARN-7482. Max applications calculation per queue has to be retrospected with absolute resource support. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
034b312d9f
|
YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)
Change-Id: I41b1d7558c20fc4eb2050d40134175a2ef6330cb
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
aa3f62740f
|
YARN-7332. Compute effectiveCapacity per each resource vector. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
d52627a7cb
|
YARN-7254. UI and metrics changes related to absolute resource configuration. (Sunil G via wangda)
|
2017-12-07 18:56:54 -08:00 |
Wangda Tan
|
5e798b1a0d
|
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
|
2017-12-07 18:56:54 -08:00 |
Sunil G
|
a957f1c60e
|
YARN-7438. Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm. Contributed by Wangda Tan
|
2017-12-05 22:50:07 +05:30 |
Sunil G
|
f9f317b702
|
YARN-7586. Application Placement should be done before ACL checks in ResourceManager. Contributed by Suma Shivaprasad.
|
2017-12-05 18:28:31 +05:30 |
Robert Kanter
|
d8863fc16f
|
YARN-5594. Handle old RMDelegationToken format when recovering RM (rkanter)
|
2017-12-04 13:14:55 -08:00 |
Arun Suresh
|
37ca416950
|
YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh)
|
2017-12-03 22:22:01 -08:00 |
Robert Kanter
|
c83fe44917
|
YARN-4813. TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently (grepas via rkanter)
|
2017-12-01 12:18:13 -08:00 |
Wangda Tan
|
a63d19d365
|
YARN-6124. Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues. (Zian Chen via wangda)
Change-Id: Id93656f3af7dcd78cafa94e33663c78d410d43c2
|
2017-11-30 15:57:22 -08:00 |
Daniel Templeton
|
8498d287cd
|
YARN-7541. Node updates don't update the maximum cluster capability for resources other than CPU and memory
|
2017-11-29 11:11:36 -08:00 |
Jason Lowe
|
a2c7a73e33
|
YARN-6647. RM can crash during transitionToStandby due to InterruptedException. Contributed by Bibin A Chundatt
|
2017-11-28 11:15:44 -06:00 |
Jian He
|
fedabcad42
|
YARN-6168. Restarted RM may not inform AM about all existing containers. Contributed by Chandni Singh
|
2017-11-27 10:19:58 -08:00 |
Yufei Gu
|
2bde3aedf1
|
YARN-7290. Method canContainerBePreempted can return true when it shouldn't. (Contributed by Steven Rand)
|
2017-11-24 23:32:46 -08:00 |
Wangda Tan
|
834e91ee91
|
YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda)
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
|
2017-11-23 19:59:03 -08:00 |
Arun Suresh
|
b46ca7e73b
|
YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh)
|
2017-11-22 19:18:30 -08:00 |
Yufei Gu
|
4cc9479dae
|
YARN-7524. Remove unused FairSchedulerEventLog. (Contributed by Wilfred Spiegelenburg)
|
2017-11-22 14:18:36 -08:00 |
yufei
|
03c311eae3
|
YARN-7513. Remove the scheduler lock in FSAppAttempt.getWeight() (Contributed by Wilfred Spiegelenburg)
|
2017-11-21 10:33:34 -08:00 |
Wangda Tan
|
0d781dd03b
|
YARN-7527. Over-allocate node resource in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda)
Change-Id: I51ae6c2ab7a3d1febdd7d8d0519b63a13295ac7d
|
2017-11-20 11:48:15 -08:00 |
bibinchundatt
|
b5b81a4f08
|
YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang.
|
2017-11-18 19:25:29 +05:30 |
Eric Yang
|
0940e4f692
|
YARN-7218. Decouple YARN Services REST API namespace from RM. (Contributed by Eric Yang)
|
2017-11-17 12:28:12 -05:00 |
Wangda Tan
|
0987a7b8cb
|
YARN-7419. CapacityScheduler: Allow auto leaf queue creation after queue mapping. (Suma Shivaprasad via wangda)
Change-Id: Ia1704bb8cb5070e5b180b5a85787d7b9ca57ebc6
|
2017-11-16 11:25:52 -08:00 |
Sunil G
|
61ace174cd
|
YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne.
|
2017-11-16 22:34:23 +05:30 |
Daniel Templeton
|
b246c54749
|
YARN-7414. FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()
(Contributed by Soumabrata Chakraborty via Daniel Templeton)
|
2017-11-15 10:03:29 -08:00 |
Wangda Tan
|
dd07038ffa
|
YARN-6909. Use LightWeightedResource when number of resource types more than two. (Sunil G via wangda)
Change-Id: I90e021c5dea7abd9ec6bd73b2287c8adebe14595
|
2017-11-09 14:51:15 -08:00 |
Konstantinos Karanasos
|
ac4d2b1081
|
YARN-7437. Rename PlacementSet and SchedulingPlacementSet. (Wangda Tan via kkaranasos)
|
2017-11-09 13:01:24 -08:00 |
Robert Kanter
|
a2c150a736
|
YARN-7386. Duplicate Strings in various places in Yarn memory (misha@cloudera.com via rkanter)
|
2017-11-09 12:12:52 -08:00 |
Haibo Chen
|
a1382a18df
|
YARN-7388. TestAMRestart should be scheduler agnostic.
|
2017-11-09 10:49:50 -08:00 |
bibinchundatt
|
0a72c2f56c
|
YARN-7454. RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup. Contributed by Jason Lowe.
|
2017-11-09 21:01:19 +05:30 |
Arun Suresh
|
a9c70b0e84
|
YARN-7453. Fix issue where RM fails to switch to active after first successful start. (Rohith Sharma K S via asuresh)
|
2017-11-08 08:00:53 -08:00 |
Daniel Templeton
|
8db9d61ac2
|
YARN-7401. Reduce lock contention in ClusterNodeTracker#getClusterCapacity()
|
2017-11-07 14:53:48 -08:00 |
Wangda Tan
|
13fa2d4e3e
|
YARN-7394. Merge code paths for Reservation/Plan queues and Auto Created queues. (Suma Shivaprasad via wangda)
|
2017-11-06 21:38:24 -08:00 |
Haibo Chen
|
8f214dc4f8
|
YARN-7360. TestRM.testNMTokenSentForNormalContainer() should be scheduler agnostic.
|
2017-11-06 15:45:37 -08:00 |
Jian He
|
a55d0738f1
|
YARN-7371. Added allocateRequestId in NMContainerStatus for recovery. Contributed by Chandni Singh
|
2017-11-06 13:30:20 -08:00 |
Jian He
|
c723021579
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
Jian He
|
673c0db43c
|
Revert "YARN-6626. Embed REST API service into RM. Contributed by Eric Yang"
This reverts commit 63d1084e9781e0fee876916190b69f6242dd00e4.
|
2017-11-06 13:30:17 -08:00 |
Jian He
|
9e677fa05c
|
YARN-6626. Embed REST API service into RM. Contributed by Eric Yang
|
2017-11-06 13:30:17 -08:00 |
Jian He
|
bd96c4c235
|
Rebase onto latest trunk. minor conflicts
|
2017-11-06 13:30:13 -08:00 |
Billie Rinaldi
|
1888318c89
|
YARN-6903. Yarn-native-service framework core rewrite. Contributed by Jian He
|
2017-11-06 13:30:11 -08:00 |
Eric Payne
|
e6ec02001f
|
YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák.
|
2017-11-02 12:37:33 -05:00 |
Rohith Sharma K S
|
940ffe3f9c
|
addendum patch for YARN-7289.
|
2017-11-02 13:55:19 +05:30 |
Daniel Templeton
|
9711b78998
|
YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler
|
2017-10-29 18:54:33 -07:00 |
Yufei Gu
|
d4811c8cfa
|
YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi)
|
2017-10-29 16:44:16 -07:00 |
Daniel Templeton
|
e62bbbca7a
|
YARN-7397. Reduce lock contention in FairScheduler#getAppWeight()
|
2017-10-28 09:13:13 -07:00 |
Rohith Sharma K S
|
5c799ecf09
|
YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
|
2017-10-27 22:46:38 +05:30 |
Sunil G
|
792388e1c0
|
YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
|
2017-10-27 20:53:57 +05:30 |
Wangda Tan
|
36e158ae98
|
YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda)
Change-Id: I14c5ea7252b7c17e86ab38f692b5f9d43196dbe0
|
2017-10-26 20:15:19 -07:00 |
Robert Kanter
|
b1de78619f
|
YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
|
2017-10-26 17:47:32 -07:00 |
Subru Krishnan
|
25932da6d1
|
YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
|
2017-10-26 12:10:14 -07:00 |
Robert Kanter
|
2da654e34a
|
YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter)
|
2017-10-26 10:25:10 -07:00 |
Subru Krishnan
|
3fae675383
|
YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru).
|
2017-10-25 15:07:50 -07:00 |
Haibo Chen
|
d7f3737f3b
|
YARN-7389. Make TestResourceManager Scheduler agnostic. (Robert Kanter via Haibo Chen)
|
2017-10-24 22:17:56 -07:00 |
Robert Kanter
|
03af442e76
|
YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter)
|
2017-10-24 13:36:50 -07:00 |
Robert Kanter
|
025c656572
|
YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter)
|
2017-10-24 10:21:44 -07:00 |
Daniel Templeton
|
9e77dc2bd1
|
YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations
(Contributed by Sen Zhao via Daniel Templeton)
|
2017-10-23 13:51:19 -07:00 |
Eric Payne
|
921338cd86
|
YARN-4163: Audit getQueueInfo and getApplications calls
|
2017-10-23 11:43:41 -05:00 |
Yufei Gu
|
1f4cdf1068
|
YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin)
|
2017-10-20 01:32:20 -07:00 |
Yufei Gu
|
7b4b018780
|
YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen)
|
2017-10-19 16:51:47 -07:00 |
Yufei Gu
|
cbd2b73ef8
|
YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi)
|
2017-10-19 16:39:25 -07:00 |
Subru Krishnan
|
75323394fb
|
YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru).
|
2017-10-17 12:38:06 -07:00 |
Robert Kanter
|
8a61525928
|
YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter)
|
2017-10-16 15:34:32 -07:00 |
Rohith Sharma K S
|
f4fb6695a3
|
YARN-7180. Remove class ResourceType. Contributed by Sunil G.
|
2017-10-13 15:17:05 +05:30 |
Robert Kanter
|
ec8bf9e48a
|
YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter)
|
2017-10-10 10:18:42 -07:00 |
Wangda Tan
|
5cfbad68c0
|
YARN-7237. Cleanup usages of ResourceProfiles. (Wangda Tan)
Change-Id: I959c8531bd48231956068cb7d2312f3235549f9c
(cherry picked from commit 8536db5a7549fa44d9f9e444b41bd5978b5c6ae1)
|
2017-10-09 20:36:57 -07:00 |
Jonathan Hung
|
1d36b53ab6
|
YARN-7252. Removing queue then failing over results in exception
|
2017-10-09 11:11:23 -07:00 |
Jonathan Hung
|
09c5dfe937
|
YARN-7251. Misc changes to YARN-5734
|
2017-10-09 11:11:23 -07:00 |
Jonathan Hung
|
d6622daaa3
|
YARN-7046. Add closing logic to configuration store
|
2017-10-09 11:11:23 -07:00 |
Wangda Tan
|
ff39c0de20
|
YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda)
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
4d8abd84f4
|
YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
4c8b208adb
|
YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
74ba6ffa0b
|
YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
04f9e80bb2
|
YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
916bdbd6be
|
YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong)
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
e566fd8b58
|
YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong)
|
2017-10-09 11:11:23 -07:00 |
Wangda Tan
|
a4e6253046
|
YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda)
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
|
2017-10-09 11:11:23 -07:00 |
Wangda Tan
|
d8a5136b1f
|
YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda)
|
2017-10-09 11:11:23 -07:00 |
Jonathan Hung
|
ef686635c1
|
YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
e3579a8c3b
|
YARN-5946: Create YarnConfigurationStore interface and
InMemoryConfigurationStore class. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
Jonathan Hung
|
ef59cbe08a
|
YARN-5951. Changes to allow CapacityScheduler to use configuration store
|
2017-10-09 11:11:22 -07:00 |
Daniel Templeton
|
6d6ca4c923
|
YARN-2612 addendum: fixed javadoc error.
|
2017-10-09 14:12:13 +02:00 |
Sunil G
|
8137254a1f
|
YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne.
|
2017-10-09 14:39:41 +05:30 |
Rohith Sharma K S
|
6fe6a72352
|
Revert "YARN-7180. Remove class ResourceType. Contributed by Sunil G."
This reverts commit 6bd81ab054 .
|
2017-10-09 13:21:13 +05:30 |
Rohith Sharma K S
|
6bd81ab054
|
YARN-7180. Remove class ResourceType. Contributed by Sunil G.
|
2017-10-09 10:20:40 +05:30 |
Yufei Gu
|
72d22b753a
|
YARN-7207. Cache the RM proxy server address. (Yufei Gu)
|
2017-10-06 09:49:11 -07:00 |
Yufei Gu
|
49ae538164
|
YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage(addendum). (Yufei Gu)
|
2017-10-06 00:08:25 -07:00 |
Yufei Gu
|
99292adcef
|
YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu)
|
2017-10-05 23:51:58 -07:00 |
Arun Suresh
|
b733348dde
|
YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh).
|
2017-10-05 09:58:04 -07:00 |
Subru Krishnan
|
e6e614e380
|
YARN-5329. Placement Agent enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru).
|
2017-10-04 19:28:27 -07:00 |
Akira Ajisaka
|
2df1b2ac05
|
YARN-7044. TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails.
|
2017-10-05 06:07:32 +09:00 |
Akira Ajisaka
|
c9b525bd94
|
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
|
2017-10-04 07:01:54 +09:00 |
Subru Krishnan
|
d4d2fd1acd
|
YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru).
|
2017-10-02 18:14:44 -07:00 |
Eric Payne
|
7f6118f918
|
YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe.
|
2017-09-29 10:33:57 -05:00 |
Jason Lowe
|
85d81ae58e
|
YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh
|
2017-09-28 14:10:15 -05:00 |
Sunil G
|
8facf1f976
|
YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak.
|
2017-09-27 14:37:32 +05:30 |
Rohith Sharma K S
|
06e5a7b5cf
|
YARN-65. Reduce RM app memory footprint once app has completed. Contributed by Manikandan R.
|
2017-09-26 14:34:09 +05:30 |
Daniel Templeton
|
164a063e74
|
YARN-6878. TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order
(Contributed by Sen Zhao via Daniel Templeton)
|
2017-09-22 23:53:32 +02:00 |
Yufei Gu
|
a92ef030a2
|
YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu)
|
2017-09-21 12:31:07 -07:00 |
Yufei Gu
|
a9019e1fb7
|
YARN-6499. Remove the doc about Schedulable#redistributeShare(). (Contributed by Chetna Chaudhari via Yufei Gu)
|
2017-09-19 18:28:31 -07:00 |
Arun Suresh
|
56ef5279c1
|
YARN-7203. Add container ExecutionType into ContainerReport. (Botong Huang via asuresh)
|
2017-09-18 15:49:31 -07:00 |
Wangda Tan
|
e81596d06d
|
YARN-7172. ResourceCalculator.fitsIn() should not take a cluster resource parameter. (Sen Zhao via wangda)
Change-Id: Icc3670c9381ce7591ca69ec12da5aa52d3612d34
|
2017-09-17 21:20:43 -07:00 |
Wangda Tan
|
38c14ef8d8
|
YARN-7149. Cross-queue preemption sometimes starves an underserved queue. (Eric Payne via wangda)
Change-Id: Ib269991dbebce160378e8372ee6d24849c4a5ed6
(cherry picked from commit 3dfa937a1fadfc62947755872515f549b3b15e6a)
|
2017-09-15 21:29:39 -07:00 |
Wangda Tan
|
958e8c0e25
|
YARN-6977. Node information is not provided for non am containers in RM logs. (Suma Shivaprasad via wangda)
Change-Id: I0c44d09a560446dee2ba68c2b9ae69fce0ec1d3e
(cherry picked from commit 8a42e922fad613f3cf1cc6cb0f3fa72546a9cc56)
|
2017-09-15 21:29:31 -07:00 |
Yufei Gu
|
09b476e6da
|
YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu)
|
2017-09-14 11:23:37 -07:00 |
Robert Kanter
|
bb34ae9554
|
YARN-7146. Many RM unit tests failing with FairScheduler (rkanter)
|
2017-09-13 15:44:54 -07:00 |
Rohith Sharma K S
|
5324388cf2
|
YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G.
|
2017-09-13 23:36:47 +05:30 |
Yufei Gu
|
82c5dd1d50
|
YARN-7057. FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption. (Contributed by Karthik via Yufei Gu)
|
2017-09-12 16:13:39 -07:00 |
Sunil G
|
da0b6a354b
|
YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
Daniel Templeton
|
bf2b687412
|
YARN-7136. Additional Performance Improvement for Resource Profile Feature
(Contributed by Wangda Tan via Daniel Templeton)
|
2017-09-12 09:19:12 -07:00 |
Wangda Tan
|
e490602e9b
|
YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda)
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
|
2017-09-12 09:19:12 -07:00 |
Sunil G
|
a333ba54e3
|
YARN-7067. [YARN-3926] Optimize ResourceType information display in UI. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
Wangda Tan
|
39240b61a1
|
YARN-7043. Cleanup ResourceProfileManager. (wangda)
Change-Id: I463356f37bf1f6a3f1fc3c594c79916e8c0ab913
|
2017-09-12 09:19:12 -07:00 |
Wangda Tan
|
df3855541a
|
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
|
2017-09-12 09:19:12 -07:00 |
Daniel Templeton
|
6746f8cadb
|
YARN-6908. ResourceProfilesManagerImpl is missing @Overrides on methods
(Contributed by Sunil G. via Daniel Templeton)
|
2017-09-12 09:19:12 -07:00 |
Daniel Templeton
|
5c4ab4c291
|
YARN-6935. [YARN-3926] ResourceProfilesManagerImpl.parseResource() has no need of the key parameter
(Contributed by Manikandan R via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
Daniel Templeton
|
3aeaafecb8
|
YARN-6788. [YARN-3926] Improve performance of resource profile branch
(Contributed by Sunil Govindan via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
Sunil G
|
58da54640e
|
YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
Sunil G
|
dae65f3bef
|
YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
Sunil G
|
7805deed48
|
YARN-5588. [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
Arun Suresh
|
6708ac3301
|
YARN-5587. Add support for resource profiles. (vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
Varun Vasudev
|
c2032e251e
|
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
Varun Vasudev
|
a9b4426302
|
YARN-5707. Add manager class for resource profiles. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
Rohith Sharma K S
|
239c1824a0
|
YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
Varun Vasudev
|
759114b006
|
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
Wangda Tan
|
e74d1be04b
|
YARN-7173. Container update RM-NM communication fix for backward compatibility. (Arun Suresh via wangda)
Change-Id: I1c39ed5c59dee739ba5044b61b3ef5ed203b79c1
|
2017-09-11 20:52:08 -07:00 |
Haibo Chen
|
fa531788fd
|
YARN-7132. FairScheduler.initScheduler() contains a surprising unary plus. (Yeliang Cang via Haibo Chen)
|
2017-09-11 20:42:49 -07:00 |
Sunil G
|
722ee84194
|
YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S.
|
2017-09-11 10:28:10 +05:30 |
Arun Suresh
|
1f53ae7972
|
YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-09-08 09:24:05 -07:00 |
Subru Krishnan
|
fa6137501c
|
YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru).
|
2017-09-07 19:07:17 -07:00 |
Sunil G
|
56d93d2e39
|
YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
|
2017-09-08 07:15:17 +05:30 |
Subru Krishnan
|
b6e7d13696
|
YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-06 16:46:01 -07:00 |
Subru Krishnan
|
e3345e985b
|
Revert "Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem."
This reverts commit 7996eca7dc .
|
2017-09-06 16:39:23 -07:00 |
Subru Krishnan
|
7996eca7dc
|
Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-01 15:16:40 -07:00 |
Andrew Wang
|
0d419c984f
|
Preparing for 3.1.0 development
|
2017-09-01 11:53:48 -07:00 |
Jason Lowe
|
99a7f5d451
|
YARN-7120. CapacitySchedulerPage NPE in "Aggregate scheduler counts" section. Contributed by Eric Payne
|
2017-09-01 11:09:14 -05:00 |
bibinchundatt
|
dcd0bedcc8
|
YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena
|
2017-09-01 11:29:16 +05:30 |
Subru Krishnan
|
bac4e8cca8
|
YARN-7095. Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
|
2017-08-31 15:05:41 -07:00 |
Daniel Templeton
|
d4417dae4f
|
YARN-6780. ResourceWeights.toString() cleanup (Contributed by weiyuan via Daniel Templeton)
|
2017-08-31 09:35:01 -07:00 |
Sunil G
|
f9e0cc8cdc
|
YARN-7116. CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage. Contributed by Wangda Tan.
|
2017-08-31 18:42:01 +05:30 |
Daniel Templeton
|
cc23514aba
|
YARN-7115. Move BoundedAppender to org.hadoop.yarn.util pacakge
(Contributed by Jian He via Daniel Templeton)
|
2017-08-30 17:26:13 -07:00 |
Haibo Chen
|
a20e7105ea
|
YARN-6868. Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml. (Ray Chiang via Haibo Chen)
|
2017-08-30 09:14:59 -07:00 |
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
Rohith Sharma K S
|
660413165a
|
YARN-6801. NPE in RM while setting collectors map in NodeHeartbeatResponse. Contributed by Vrushali C.
|
2017-08-30 11:29:53 +05:30 |
Sangjin Lee
|
ccb38c1991
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-08-30 11:29:52 +05:30 |
Sangjin Lee
|
092fead5d9
|
YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena.
|
2017-08-30 11:29:51 +05:30 |
Varun Saxena
|
91d3443806
|
YARN-3359. Recover collector list when RM fails over (Li Lu via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
Sangjin Lee
|
78b7e070d8
|
YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu.
|
2017-08-30 11:29:50 +05:30 |
Rohith Sharma K S
|
4cae120c61
|
YARN-6982. Potential issue on setting AMContainerSpec#tokenConf to null before app is completed. Contributed by Manikandan R.
|
2017-08-30 10:45:11 +05:30 |
Carlo Curino
|
cc8893edc0
|
YARN-7010. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps). (Contributed by Giovanni Matteo Fumarola via curino)
|
2017-08-29 14:53:09 -07:00 |
Jason Lowe
|
1f6dc4ee9a
|
YARN-5816. TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey. Contributed by Robert Kanter
|
2017-08-29 09:52:24 -05:00 |
Junping Du
|
312b1fd9da
|
YARN-7076. yarn application -list -appTypes is not working. Contributed by Jian He.
|
2017-08-28 18:26:51 -07:00 |
Sunil G
|
02599bda04
|
YARN-7051. Avoid concurrent modification exception in FifoIntraQueuePreemptionPlugin. Contributed by Eric Payne.
|
2017-08-28 12:22:56 +05:30 |
Jason Lowe
|
39a9dc8e4a
|
YARN-7052. RM SchedulingMonitor gives no indication why the spawned thread crashed. Contributed by Eric Payne
|
2017-08-25 15:31:29 -05:00 |
Jason Lowe
|
3a4e861169
|
YARN-6640. AM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang
|
2017-08-25 09:16:17 -05:00 |
Yufei Gu
|
9e2699ac2c
|
YARN-7049. FSAppAttempt preemption related fields have confusing names. (Contributed by Karthik Kambatla via Yufei Gu)
|
2017-08-24 17:52:41 -07:00 |
Junping Du
|
652dd434d9
|
YARN-7090. testRMRestartAfterNodeLabelDisabled get failed when CapacityScheduler is configured. Contributed by Wangda Tan.
|
2017-08-23 18:06:29 -07:00 |
Wangda Tan
|
f49843a988
|
YARN-6251. Do async container release to prevent deadlock during container updates. (Arun Suresh via wangda)
Change-Id: I6c67d20c5dd4d22752830ebf0ed2340824976ecb
|
2017-08-23 09:56:20 -07:00 |
Subru Krishnan
|
4249172e14
|
YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).
|
2017-08-22 19:20:57 -07:00 |
Jason Lowe
|
657dd59cc8
|
YARN-7048. Fix tests faking kerberos to explicitly set ugi auth type. Contributed by Daryn Sharp
|
2017-08-22 13:16:24 -05:00 |
Jason Lowe
|
3efcd51c3b
|
YARN-2416. InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time. Contributed by Jonathan Eagles
|
2017-08-22 12:56:09 -05:00 |
Arun Suresh
|
8410d862d3
|
YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh)
|
2017-08-20 07:54:09 -07:00 |
Yufei Gu
|
8991f0baec
|
YARN-6969. Clean up unused code in class FairSchedulerQueueInfo. (Larry Lo via Yufei Gu)
|
2017-08-18 14:38:44 -07:00 |
bibinchundatt
|
e05fa3451d
|
YARN-7007. NPE in RM while using YarnClient.getApplications(). Contributed by Lingfeng Su.
|
2017-08-18 20:28:50 +05:30 |
Akira Ajisaka
|
588c190afd
|
YARN-6965. Duplicate instantiation in FairSchedulerQueueInfo. Contributed by Masahiro Tanaka.
|
2017-08-16 14:06:22 +09:00 |
Subru Krishnan
|
75dd866bfb
|
HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).
|
2017-08-15 16:53:59 -07:00 |
Arun Suresh
|
4d7be1d857
|
YARN-5978. ContainerScheduler and ContainerManager changes to support ExecType update. (Kartheek Muthyala via asuresh)
|
2017-08-14 19:46:17 -07:00 |
Jason Lowe
|
5558792894
|
YARN-6917. Queue path is recomputed from scratch on every allocation. Contributed by Eric Payne
|
2017-08-14 15:31:34 -05:00 |
Jason Lowe
|
3325ef653d
|
YARN-6987. Log app attempt during InvalidStateTransition. Contributed by Jonathan Eagles
|
2017-08-14 14:40:08 -05:00 |
Daniel Templeton
|
6b09c32705
|
YARN-6881. LOG is unused in AllocationConfiguration (Contributed by weiyuan via Daniel Templeton)
|
2017-08-14 11:55:33 -07:00 |
Jian He
|
e2f6299f6f
|
YARN-6959. RM may allocate wrong AM Container for new attempt. Contributed by Yuqi Wang
|
2017-08-14 10:51:30 -07:00 |
bibinchundatt
|
d8f74c3964
|
YARN-6741. Deleting all children of a Parent Queue on refresh throws exception. Contributed by Naganarasimha G R.
|
2017-08-14 09:39:00 +05:30 |
Carlo Curino
|
28d97b79b6
|
YARN-6687. Validate that the duration of the periodic reservation is less than the periodicity. (subru via curino)
|
2017-08-11 16:58:04 -07:00 |
Daniel Templeton
|
0996acde6c
|
YARN-6882. AllocationFileLoaderService.reloadAllocations() should use the diamond operator
(Contributed by Larry Lo via Daniel Templeton)
|
2017-08-11 14:50:46 -07:00 |
Daniel Templeton
|
65364defb4
|
YARN-6967. Limit application attempt's diagnostic message size thoroughly
(Contributed by Chengbing Liu via Daniel Templeton)
|
2017-08-11 14:28:55 -07:00 |
Daniel Templeton
|
c7680d4cc4
|
YARN-6884. AllocationFileLoaderService.loadQueue() has an if without braces
(Contributed by weiyuan via Daniel Templeton)
|
2017-08-11 14:22:02 -07:00 |
Daniel Templeton
|
218588be77
|
YARN-6952. Enable scheduling monitor in FS (Contributed by Yufei Gu via Daniel Templeton)
|
2017-08-11 14:04:19 -07:00 |
Subru Krishnan
|
bbbf0e2a41
|
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
|
2017-08-11 13:58:45 -07:00 |
Daniel Templeton
|
e0c24145d2
|
YARN-6879. TestLeafQueue.testDRFUserLimits() has commented out code
(Contributed by Angela Wang via Daniel Templeton)
|
2017-08-08 13:35:22 -07:00 |
Wangda Tan
|
adb84f34db
|
YARN-4161. Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration. (Wei Yan via wangda)
Change-Id: Ic441ae4e0bf72e7232411eb54243ec143d5fd0d3
|
2017-08-07 11:32:21 -07:00 |
Arun Suresh
|
35dc782923
|
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-08-03 21:15:40 -07:00 |
Yufei Gu
|
c617fe02b3
|
YARN-6832. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
|
2017-08-03 11:33:37 -07:00 |
Sunil G
|
f64cfeaf61
|
YARN-6678. Handle IllegalStateException in Async Scheduling mode of CapacityScheduler. Contributed by Tao Yang.
|
2017-08-03 19:27:10 +05:30 |
Eric Payne
|
8ce8672b6b
|
YARN-5349. TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently. Contributed by Jason Lowe.
|
2017-08-02 12:53:22 -05:00 |
Yufei Gu
|
45535f8afa
|
YARN-6895. [FairScheduler] Preemption reservation may cause regular reservation leaks. (Miklos Szegedi via Yufei Gu)
|
2017-08-02 09:25:19 -07:00 |
Jian He
|
f9139ac8f6
|
YARN-6872. [Addendum patch] Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-02 00:03:25 -07:00 |
Carlo Curino
|
acda6b96a4
|
YARN-5412. Create a proxy chain for ResourceManager REST API in the Router. (Contributed by Giovanni Matteo Fumarola via curino)
(cherry picked from commit b6240b92ab )
|
2017-08-01 17:28:28 -07:00 |
Subru Krishnan
|
712e97d4cf
|
Bumping up yarn-server-router (new) module pom to beta1 and fixing imports post rebase.
(cherry picked from commit f1eff212c5 )
|
2017-08-01 17:28:27 -07:00 |
Subru Krishnan
|
859aa1f9d6
|
YARN-5531. UnmanagedAM pool manager for federating application across clusters. (Botong Huang via Subru).
(cherry picked from commit 73bb2102ce )
|
2017-08-01 17:28:24 -07:00 |
Subru Krishnan
|
78032e51d9
|
YARN-5905. Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP.
(cherry picked from commit e0f0e7afed )
|
2017-08-01 17:28:22 -07:00 |
Jian He
|
2797507d51
|
YARN-5601. Make the RM epoch base value configurable. Contributed by Subru Krishnan
(cherry picked from commit 9ca2aba9cc )
|
2017-08-01 17:28:20 -07:00 |
Jian He
|
94a24567d6
|
YARN-3671. Integrate Federation services with ResourceManager. Contributed by Subru Krishnan
(cherry picked from commit 8573c286e2 )
|
2017-08-01 17:28:20 -07:00 |
Jian He
|
91f120f743
|
YARN-6872. Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G
|
2017-08-01 09:56:33 -07:00 |
Subru Krishnan
|
bcde66bed1
|
YARN-6897. Refactoring RMWebServices by moving some util methods to RMWebAppUtil. (Giovanni Matteo Fumarola via Subru).
|
2017-07-28 15:44:36 -07:00 |
Yufei Gu
|
9ea01fd956
|
YARN-6802. Add max AM resource and AM resource usage to leaf queue view in FairScheduler WebUI. (YunFan Zhou via Yufei Gu)
|
2017-07-28 09:52:53 -07:00 |
Yufei Gu
|
9902be72cb
|
YARN-6864. FSPreemptionThread cleanup for readability. (Daniel Templeton via Yufei Gu)
|
2017-07-27 23:19:39 -07:00 |
Akira Ajisaka
|
38c6fa5c7a
|
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.
|
2017-07-28 09:10:52 +09:00 |
Varun Saxena
|
11ece0bda1
|
Addendum for YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
|
2017-07-28 00:10:45 +05:30 |
Varun Saxena
|
f66fd11e51
|
YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
|
2017-07-27 23:14:50 +05:30 |
Daniel Templeton
|
f81a4efb8c
|
YARN-6307. Refactor FairShareComparator#compare (Contributed by Yufei Gu via Daniel Templeton)
|
2017-07-25 13:00:31 -07:00 |
Akira Ajisaka
|
cca51e916b
|
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
|
2017-07-25 15:24:56 +09:00 |
Daniel Templeton
|
10583625c1
|
YARN-6845. Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue.
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-07-24 13:44:00 -07:00 |
Daniel Templeton
|
bb30bd3771
|
YARN-6779. DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting
(Contributed by Yeliang Cang via Daniel Templeton)
|
2017-07-24 12:13:50 -07:00 |
Sunil G
|
e315328428
|
YARN-6102. RMActiveService context to be updated with new RMContext on failover. Contributed by Rohith Sharma K S.
|
2017-07-24 11:39:03 +05:30 |
Arun Suresh
|
077fcf6a96
|
YARN-6777. Support for ApplicationMasterService processing chain of interceptors. (asuresh)
|
2017-07-19 12:26:40 -07:00 |
Rohith Sharma K S
|
845c4e52bd
|
YARN-6819. Application report fails if app rejected due to nodesize. Contributed by Bibin A Chundatt.
|
2017-07-19 11:10:52 +05:30 |
Yufei Gu
|
daaf530fce
|
YARN-6778. In ResourceWeights, weights and setWeights() should be final. (Daniel Templeton via Yufei Gu)
|
2017-07-18 16:38:07 -07:00 |
Sunil G
|
0b7afc060c
|
Addendum patch for YARN-5731
|
2017-07-18 11:49:09 +05:30 |
Jason Lowe
|
a5ae5ac50e
|
YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt
|
2017-07-14 14:56:00 -05:00 |
bibinchundatt
|
75c0220b44
|
YARN-6759. Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure. Contributed by Naganarasimha G R
|
2017-07-14 13:53:39 +05:30 |
Yufei Gu
|
4a574e9a84
|
YARN-6769. Make schedulables without demand less needy in FairSharePolicy#compare. (Yunfan Zhou via Yufei Gu)
|
2017-07-13 23:10:10 -07:00 |
Sunil G
|
228ddaa31d
|
YARN-6792. Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo. Contributed by Giovanni Matteo Fumarola.
|
2017-07-14 08:07:05 +05:30 |
Wangda Tan
|
945c0958bb
|
YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda)
Change-Id: I84ccd54200ccbaae23018ef320028e42b4c3509a
|
2017-07-13 10:30:15 -07:00 |
Sunil G
|
cf0d0844d6
|
YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan.
|
2017-07-13 16:48:29 +05:30 |
Xuan
|
9845bea59c
|
YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong)
|
2017-07-12 15:40:45 -07:00 |
Sunil G
|
34f113df5c
|
YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang.
|
2017-07-11 14:52:44 +05:30 |
Arun Suresh
|
5496a34c0c
|
YARN-6776. Refactor ApplicaitonMasterService to move actual processing logic to a separate class. (asuresh)
|
2017-07-10 14:34:58 -07:00 |
Yufei Gu
|
3de47ab5ea
|
YARN-6764. Simplify the logic in FairScheduler#attemptScheduling. Contributed by Yufei Gu.
|
2017-07-09 16:09:12 -07:00 |
Naganarasimha
|
626d730bfc
|
YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.
|
2017-07-09 17:26:09 +05:30 |
Daniel Templeton
|
9d27880442
|
YARN-6410. FSContext.scheduler should be final (Contributed by Yeliang Cang via Daniel Templeton)
|
2017-07-09 19:34:35 +09:00 |
Daniel Templeton
|
c5a0c38d8e
|
YARN-6746. SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code
(Contributed by Deepti Sawhney via Daniel Templeton)
|
2017-07-09 19:27:32 +09:00 |
Daniel Templeton
|
0615985886
|
YARN-6752. Display reserved resources in web UI per application
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-07-09 19:02:31 +09:00 |
Naganarasimha
|
fa1aaee87b
|
YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp.
|
2017-07-01 12:29:39 +05:30 |
Andrew Wang
|
af2773f609
|
Updating version for 3.0.0-beta1 development
|
2017-06-29 17:57:40 -07:00 |
Daniel Templeton
|
ec97519779
|
YARN-6751. Display reserved resources in web UI per queue
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-06-29 16:53:50 -07:00 |
Sunil G
|
c1edca101c
|
YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin.
|
2017-06-28 15:40:58 -07:00 |
Yufei Gu
|
0b77262890
|
YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)
|
2017-06-23 13:26:03 -07:00 |
Sunil G
|
ca13b224b2
|
YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.
|
2017-06-22 23:50:57 -07:00 |
Naganarasimha
|
740204b292
|
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.
|
2017-06-23 07:52:41 +05:30 |
Akira Ajisaka
|
099dfe92a9
|
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.
|
2017-06-20 17:20:27 +09:00 |
Naganarasimha
|
ee89ac84e6
|
YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp
|
2017-06-19 22:42:45 +05:30 |
Naganarasimha
|
e9c2aa1bc3
|
YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R.
|
2017-06-19 21:31:40 +05:30 |
bibinchundatt
|
d64c842743
|
YARN-6703. RM startup failure with old state store due to version mismatch. Contributed by Varun Saxena
|
2017-06-12 18:07:43 +05:30 |
Eric Payne
|
5578af8603
|
YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
|
2017-06-09 16:16:34 -05:00 |
Naganarasimha
|
99634d10ed
|
YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp.
|
2017-06-09 11:10:13 +05:30 |
Carlo Curino
|
547cb53e8a
|
YARN-6634. [API] Refactor ResourceManager WebServices to make API explicit. (Giovanni Matteo Fumarola via curino)
|
2017-06-07 13:41:06 -07:00 |
Jian He
|
7311015ace
|
YARN-6683. Invalid event: COLLECTOR_UPDATE at KILLED. Contributed by Rohith Sharma K S
|
2017-06-05 13:16:57 -07:00 |
Daniel Templeton
|
d5b71e4175
|
YARN-6246. Identifying starved apps does not need the scheduler writelock
(Contributed by Karthik Kambatla via Daniel Templeton)
|
2017-05-31 15:48:04 -07:00 |
Jonathan Eagles
|
cbfed0e82f
|
YARN-6497. Method length of ResourceManager#serviceInit() is too long (Gergely Novák via jeagles)
|
2017-05-31 10:18:42 -05:00 |
Andrew Wang
|
16ad896d5c
|
Update maven version for 3.0.0-alpha4 development
|
2017-05-26 14:09:44 -07:00 |
Daniel Templeton
|
d81372dfad
|
YARN-6646. Modifier 'static' is redundant for inner enums
(Contributed by ZhangBing Lin via Daniel Templeton)
|
2017-05-26 12:05:48 -07:00 |
Yufei Gu
|
87590090c8
|
YARN-6582. FSAppAttempt demand can be updated atomically in updateDemand(). (Karthik Kambatla via Yufei Gu)
|
2017-05-25 14:22:13 -07:00 |
Jason Lowe
|
3fd6a2da4e
|
YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter
|
2017-05-25 16:07:52 -05:00 |
Wangda Tan
|
8e0f83e49a
|
YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
|
2017-05-22 14:28:55 -07:00 |
Wangda Tan
|
c583ab02c7
|
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
|
2017-05-22 14:26:13 -07:00 |
Jian He
|
e135c0b207
|
YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G
|
2017-05-19 20:14:03 -07:00 |
Yufei Gu
|
66bba8c024
|
YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu)
|
2017-05-19 14:53:27 -07:00 |
Rohith Sharma K S
|
d87a63a901
|
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
|
2017-05-17 08:27:45 +05:30 |
Jason Lowe
|
489f85933c
|
YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe
|
2017-05-16 09:26:44 -05:00 |
Carlo Curino
|
6600abbb5c
|
YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino).
|
2017-05-12 17:48:55 -07:00 |
Haibo Chen
|
6c35001b9f
|
YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen)
|
2017-05-12 13:05:40 -07:00 |
Daniel Templeton
|
90cb5b4635
|
YARN-6380. FSAppAttempt keeps redundant copy of the queue
|
2017-05-11 13:47:02 -07:00 |
Min Shen
|
2ada100da7
|
YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
|
2017-05-11 13:25:31 -07:00 |
Brahma Reddy Battula
|
4aae2d40a3
|
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
|
2017-05-11 23:33:45 +05:30 |
Carlo Curino
|
5cb6e3e082
|
YARN-6473. Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations.
|
2017-05-10 14:49:25 -07:00 |
Daniel Templeton
|
e7654c4a1f
|
YARN-6571. Fix JavaDoc issues in SchedulingPolicy
(Contributed by Weiwei Yang via Daniel Templeton)
|
2017-05-10 14:34:13 -07:00 |
Jason Lowe
|
6099deebcb
|
YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
|
2017-05-10 08:47:48 -05:00 |
Karthik Kambatla
|
166be0ee95
|
YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha)
|
2017-05-09 14:44:16 -07:00 |
Andrew Wang
|
543aac9f28
|
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
|
2017-05-09 09:22:53 -07:00 |
Chris Douglas
|
e4f34ecb04
|
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
|
2017-05-05 12:10:50 -07:00 |
Daniel Templeton
|
9f0aea0ee2
|
YARN-6481. Yarn top shows negative container number in FS
(Contributed by Tao Jie via Daniel Templeton)
|
2017-05-02 13:06:47 -07:00 |
Subru Krishnan
|
6bf42e48ef
|
YARN-5331. Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
|
2017-05-01 18:48:36 -07:00 |
Subru Krishnan
|
e514fc432a
|
YARN-6542. Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent.
|
2017-05-01 18:10:07 -07:00 |
Subru Krishnan
|
a3a615eeab
|
YARN-4359. Update LowCost agents logic to take advantage of YARN-4358. (Jonathan Yaniv and Ishai Menache via Subru).
|
2017-05-01 16:01:07 -07:00 |
Naganarasimha
|
30fc580196
|
YARN-6519. Fix warnings from Spotbugs in hadoop-yarn-server-resourcemanager. Contributed by Weiwei Yang.
|
2017-05-01 20:15:27 +05:30 |
Daniel Templeton
|
2e52789edf
|
YARN-2962. ZKRMStateStore: Limit the number of znodes under a znode (Contributed by Varun Sexena via Daniel Templeton)
|
2017-04-28 13:30:28 -07:00 |
Wangda Tan
|
2ba21d6376
|
YARN-6392. Add submit time to Application Summary log. (Zhihai Xu via wangda)
|
2017-04-24 13:17:35 -07:00 |
Eric Payne
|
52adf71914
|
YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe.
|
2017-04-24 12:03:28 -05:00 |
Daniel Templeton
|
dd43b895c2
|
YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-04-19 11:44:55 -07:00 |
Sunil G
|
9ff25408bc
|
YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu.
|
2017-04-19 20:39:09 +05:30 |
Chris Douglas
|
af8e9842d2
|
YARN-6451. Add RM monitor validating metrics invariants. Contributed by Carlo Curino
|
2017-04-18 10:29:44 -07:00 |
Junping Du
|
6ed9d36224
|
YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S.
|
2017-04-17 15:51:10 -07:00 |
Jason Lowe
|
4168805502
|
YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger
|
2017-04-14 17:15:48 -05:00 |
Eric Payne
|
a41f8dd58e
|
YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger
|
2017-04-14 10:53:09 -05:00 |
Karthik Kambatla
|
c3375175d6
|
YARN-6432. FairScheduler: Reserve preempted resources for corresponding applications. (Miklos Szegedi via kasha)
|
2017-04-12 14:21:20 -07:00 |
Wangda Tan
|
4d4ad0ebb7
|
YARN-6439. Fix ReservationSystem creation of default ReservationQueue. (Carlo Curino via wangda)
|
2017-04-11 14:56:18 -07:00 |
Naganarasimha
|
7d873c465b
|
YARN-6463. Correct spelling mistake in FileSystemRMStateStore. Contributed by Yeliang Cang.
|
2017-04-11 22:42:08 +05:30 |
Jason Lowe
|
0e065f2ede
|
YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu
|
2017-04-11 08:44:18 -05:00 |
Konstantinos Karanasos
|
7999318af1
|
YARN-6344. Add parameter for rack locality delay in CapacityScheduler. (kkaranasos)
|
2017-04-10 15:34:44 -07:00 |
Karthik Kambatla
|
2aa8967809
|
YARN-6298. Metric preemptCall is not used in new preemption. (Yufei Gu via kasha)
|
2017-04-07 17:31:59 -07:00 |
Rohith Sharma K S
|
1a9439e299
|
YARN-6424. TimelineCollector is not stopped when an app finishes in RM. Contributed by Varun Saxena.
|
2017-04-06 10:15:22 +05:30 |
Daniel Templeton
|
a2c57bb70d
|
YARN-6381. FSAppAttempt has several variables that should be final
(Contributed by Ameet Zaveri via Daniel Templeton)
|
2017-04-05 16:07:24 -07:00 |
Andrew Wang
|
539ef5aa2e
|
HFDS-11596. hadoop-hdfs-client jar is in the wrong directory in release tarball. Contributed by Yuanbo Liu.
|
2017-04-05 16:04:09 -07:00 |
Karthik Kambatla
|
b4c4f36594
|
YARN-6448. Continuous scheduling thread crashes while sorting nodes. (Yufei Gu via kasha)
|
2017-04-05 15:43:14 -07:00 |
Varun Saxena
|
7d963c477a
|
YARN-6437. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently (Jason Lowe via Varun Saxena)
|
2017-04-06 01:20:41 +05:30 |
Wangda Tan
|
87e2ef8c98
|
YARN-6406. Remove SchedulerRequestKeys when no more pending ResourceRequest. (Arun Suresh via wangda)
|
2017-04-05 11:28:30 -07:00 |
Varun Saxena
|
19b89c4c7b
|
YARN-6420. RM startup failure due to wrong order in nodelabel editlog (Bibin A Chundatt via Varun Saxena)
|
2017-04-05 09:38:35 +05:30 |
Karthik Kambatla
|
9cc04b4708
|
YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha)
|
2017-04-04 17:08:33 -07:00 |
Wangda Tan
|
3fdae0a2b6
|
YARN-6109. Add an ability to convert ChildQueue to ParentQueue. (Xuan Gong via wangda)
|
2017-04-04 14:39:01 -07:00 |
Chris Douglas
|
6eba79232f
|
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
|
2017-04-03 20:13:14 -07:00 |
Eric Payne
|
318bfb01bc
|
YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe
|
2017-03-31 12:30:35 -05:00 |
Jason Lowe
|
4d1fac5df2
|
YARN-6411. Clean up the overwrite of createDispatcher() in subclass of MockRM. Contributed by Yufei Gu
|
2017-03-31 10:05:34 -05:00 |
Daniel Templeton
|
640ba1d23f
|
YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled
|
2017-03-29 12:38:11 -07:00 |
Jason Lowe
|
fdf8f8ebca
|
YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter
|
2017-03-28 09:33:26 -05:00 |
Robert Kanter
|
9bae6720cb
|
YARN-6050. AMs can't be scheduled on racks or nodes (rkanter)
|
2017-03-27 17:23:13 -07:00 |
Wangda Tan
|
cd014d57aa
|
YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda)
|
2017-03-27 13:29:09 -07:00 |
Akira Ajisaka
|
b63ae854f9
|
YARN-6379. Remove unused argument in ClientRMService. Contributed by Kai Sasaki.
|
2017-03-27 11:23:41 +09:00 |
Sunil G
|
cffea251be
|
YARN-5956. Refactor ClientRMService for unify error handling across apis. Contributed by Kai Sasaki.
|
2017-03-25 22:26:19 +05:30 |
Tsuyoshi Ozawa
|
84ddedc0b2
|
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
|
2017-03-25 10:06:52 +09:00 |
Ravi Prakash
|
d4f73e7e27
|
HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong.
|
2017-03-24 09:38:17 -07:00 |
Daniel Templeton
|
0a05c5c598
|
YARN-6284. hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable
(Contributed by Laura Adams via Daniel Templeton)
|
2017-03-21 14:15:40 -07:00 |
Varun Saxena
|
35034653d0
|
YARN-6353. Clean up OrderingPolicy javadoc (Daniel Templeton via Varun Saxena)
|
2017-03-20 23:29:09 +05:30 |
Sunil G
|
2d0e24eb01
|
YARN-6328. Fix a spelling mistake in CapacityScheduler. Contributed by Jin Yibo. This closes #202
|
2017-03-15 14:48:05 +05:30 |
Ray Chiang
|
4c66a8d19b
|
YARN-6331. Fix flakiness in TestFairScheduler#testDumpState. (Yufei Gu via rchiang)
|
2017-03-14 15:09:47 -07:00 |
Naganarasimha
|
0a3aa40fe7
|
YARN-6327. Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator. Contributed by Jonathan Hung.
|
2017-03-15 01:22:25 +05:30 |
Ray Chiang
|
4db9cc70d0
|
YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)
|
2017-03-10 16:13:31 -08:00 |
Jason Lowe
|
9649c27864
|
YARN-6321. TestResources test timeouts are too aggressive. Contributed by Eric Badger
|
2017-03-10 13:06:54 -06:00 |
Karthik Kambatla
|
a96afae125
|
YARN-6264. AM not launched when a single vcore is available on the cluster. (Yufei Gu via kasha)
|
2017-03-09 23:11:54 -08:00 |
Daniel Templeton
|
846a0cd678
|
YARN-1047. Expose # of pre-emptions as a queue counter (Contributed by Karthik Kambatla via Daniel Templeton)
|
2017-03-09 17:51:47 -08:00 |
Daniel Templeton
|
822a74f2ae
|
YARN-6300. NULL_UPDATE_REQUESTS is redundant in TestFairScheduler (Contributed by Yuanbo Liu via Daniel Templeton)
|
2017-03-09 12:14:33 -08:00 |
Jason Lowe
|
d7762a5511
|
YARN-6165. Intra-queue preemption occurs even when preemption is turned off for a specific queue. Contributed by Eric Payne
|
2017-03-08 16:46:09 -06:00 |
Sunil G
|
1eb8186703
|
YARN-6207. Move application across queues should handle delayed event processing. Contributed by Bibin A Chundatt.
|
2017-03-08 12:04:30 +05:30 |
Daniel Templeton
|
e0c239cdbd
|
YARN-6287. RMCriticalThreadUncaughtExceptionHandler.rmContext should be final (Contributed by Corey Barker via Daniel Templeton)
|
2017-03-07 11:58:48 -08:00 |
Sunil G
|
c1386a90d7
|
YARN-6248. user is not removed from UsersManager’s when app is killed with pending container requests. Contributed by Eric Payne.
|
2017-03-04 13:46:35 +05:30 |
Junping Du
|
8db7a8c3ae
|
YARN-6271. yarn rmadin -getGroups returns information from standby RM. Contributed by Jian He.
|
2017-03-03 14:39:31 -08:00 |
Ray Chiang
|
2148b83993
|
YARN-6218. Fix TestAMRMClient when using FairScheduler. (Miklos Szegedi via rchiang)
|
2017-03-03 13:04:51 -08:00 |
Jason Lowe
|
e58fc76030
|
YARN-6263. NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe. Contributed by Haibo Chen
|
2017-03-03 08:23:08 -06:00 |
Jian He
|
235203dffd
|
YARN-6153. KeepContainer does not work when AM retry window is set. Contributed by kyungwan nam
|
2017-02-28 13:23:36 -08:00 |
Xuan
|
e0bb867c3f
|
YARN-6189: Improve application status log message when RM restarted when
app is in NEW state. Contributed by Junping Du
|
2017-02-28 11:04:56 -08:00 |
Wangda Tan
|
eac6b4c35c
|
YARN-6216. Unify Container Resizing code paths with Container Updates making it scheduler agnostic. (Arun Suresh via wangda)
|
2017-02-28 10:35:50 -08:00 |
Karthik Kambatla
|
f187d63816
|
YARN-6231. FairSchedulerTestBase helper methods should call scheduler.update to avoid flakiness. (kasha)
|
2017-02-27 22:10:57 -08:00 |
Naganarasimha
|
5f5b031d1f
|
YARN-5703. ReservationAgents are not correctly configured. Contributed by Manikandan R.
|
2017-02-27 20:38:29 +05:30 |
Karthik Kambatla
|
fbfe86deea
|
YARN-6172. FSLeafQueue demand update needs to be atomic. (Miklos Szegedi via kasha)
|
2017-02-26 20:36:33 -08:00 |
Karthik Kambatla
|
815d53506f
|
YARN-6215. FairScheduler preemption and update should not run concurrently. (Tao Jie via kasha)
|
2017-02-26 20:16:36 -08:00 |
Karthik Kambatla
|
694e680d20
|
YARN-6222. TestFairScheduler.testReservationMetrics is flaky. (Yufei Gu via kasha)
|
2017-02-23 15:21:52 -08:00 |
Sunil G
|
a207aa9930
|
YARN-6211. Synchronization improvement for moveApplicationAcrossQueues and updateApplicationPriority. Contributed by Bibin A Chundatt.
|
2017-02-23 14:19:07 +05:30 |
Karthik Kambatla
|
b10e962224
|
YARN-6194. Cluster capacity in SchedulingPolicy is updated only on allocation file reload. (Yufei Gu via kasha)
|
2017-02-22 15:58:49 -08:00 |
Karthik Kambatla
|
718ad9f6ee
|
YARN-6210. FairScheduler: Node reservations can interfere with preemption. (kasha)
|
2017-02-22 15:46:07 -08:00 |
Wangda Tan
|
1a6ca75f38
|
YARN-6143. Fix incompatible issue caused by YARN-3583. (Sunil G via wangda)
|
2017-02-22 11:17:09 -08:00 |
Karthik Kambatla
|
dbbfcf74ab
|
YARN-6193. FairScheduler might not trigger preemption when using DRF. (kasha)
|
2017-02-17 14:07:31 -08:00 |
Daniel Templeton
|
c7a36e6130
|
YARN-6125. The application attempt's diagnostic message should have a maximum size
(Contributed by Andras Piros via Daniel Templeton)
|
2017-02-17 13:40:58 -08:00 |
Daniel Templeton
|
9a92837786
|
YARN-6188. Fix OOM issue with decommissioningNodesWatcher in the case of clusters with
large number of nodes (Contributed by Ajay Jadhav via Daniel Templeton)
|
2017-02-17 13:13:46 -08:00 |
Karthik Kambatla
|
a77f432449
|
YARN-6171. ConcurrentModificationException on FSAppAttempt.containersToPreempt. (Miklos Szegedi via kasha)
|
2017-02-16 14:54:58 -08:00 |
Rohith Sharma K S
|
e63a7814d2
|
YARN-6200. addendum to fix compilation error caused by reverting YARN-5068.
|
2017-02-16 18:19:57 +05:30 |
Rohith Sharma K S
|
a393e84c6f
|
YARN-6200. Reverting since the same functionality achieved by YARN-1623.
Revert "YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)"
This reverts commit b7ac85259c .
|
2017-02-16 18:00:25 +05:30 |
Karthik Kambatla
|
74dd142250
|
YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei Gu via kasha)
|
2017-02-16 00:03:09 -08:00 |
Karthik Kambatla
|
11be3f70e0
|
YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue. (Yufei Gu via kasha)
|
2017-02-15 23:51:22 -08:00 |
Karthik Kambatla
|
6c25dbcdc0
|
YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha)
|
2017-02-15 23:16:12 -08:00 |
Varun Saxena
|
b7613e0f40
|
YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt via Varun Saxena)
|
2017-02-15 14:48:17 +05:30 |
Karthik Kambatla
|
353a9b2d91
|
YARN-6061. Addendum. Remove extraneous change.
|
2017-02-14 15:19:52 -08:00 |
Karthik Kambatla
|
652679aa8a
|
YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei Gu via kasha)
|
2017-02-14 13:39:41 -08:00 |
Arun Suresh
|
aaf106fde3
|
YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh)
|
2017-02-14 06:09:10 -08:00 |
Karthik Kambatla
|
646c6d6509
|
YARN-3933. FairScheduler: Multiple calls to completedContainer are not safe. (Shiwei Guo and Miklos Szegedi via kasha)
|
2017-02-13 11:26:30 -08:00 |
Karthik Kambatla
|
08f93978f3
|
YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha)
|
2017-02-09 14:45:04 -08:00 |
Karthik Kambatla
|
9b85053583
|
YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha)
|
2017-02-09 13:09:32 -08:00 |
Wangda Tan
|
5fb723bb77
|
YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda)
|
2017-02-09 10:23:50 -08:00 |
Daniel Templeton
|
3e06475307
|
YARN-4658. Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment (Contributed by Udai Potluri via Daniel Templeton)
|
2017-01-31 16:25:33 -08:00 |
Daniel Templeton
|
87852b6ef4
|
YARN-6103. Log updates for ZKRMStateStore (Contributed by Daniel Sturman via Daniel Templeton)
|
2017-01-30 21:44:48 -08:00 |
Karthik Kambatla
|
11e44bdda7
|
YARN-6131. FairScheduler: Lower update interval for faster tests. (kasha)
|
2017-01-30 13:35:23 -08:00 |
Sunil G
|
165f07f51a
|
YARN-6123. [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. Contributed by Wangda Tan.
|
2017-01-27 18:37:51 +05:30 |
Daniel Templeton
|
f85b74ccf9
|
YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-01-26 10:31:09 -08:00 |
Karthik Kambatla
|
abedb8a9d8
|
YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha)
|
2017-01-25 12:17:28 -08:00 |
Rohith Sharma K S
|
0101267d9d
|
YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G.
|
2017-01-24 10:59:55 +05:30 |
Wangda Tan
|
ce832059db
|
YARN-5864. Capacity Scheduler - Queue Priorities. (wangda)
|
2017-01-23 10:52:14 -08:00 |
Jason Lowe
|
69fa81679f
|
YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He
|
2017-01-23 17:12:51 +00:00 |
Sunil G
|
3fa0d540df
|
YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang.
|
2017-01-23 12:19:35 +05:30 |
Sangjin Lee
|
b01514f65b
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-01-19 20:52:55 -08:00 |
Andrew Wang
|
5d8b80ea9b
|
Preparing for 3.0.0-alpha3 development
|
2017-01-19 15:50:07 -08:00 |