Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

YARN-10860. Make max container per heartbeat configs refreshable. Contributed by Eric Badger.

This commit is contained in:
zhuqi-lucas 2021-07-21 15:35:45 +08:00
parent 99b952fcb4
commit 34acf9d4c8
2 changed files with 11 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
View File

@ -368,7 +368,10 @@ public class CapacityScheduler extends
+ getMinimumResourceCapability() + ">, " + "maximumAllocation=<" + getMinimumResourceCapability() + ">, " + "maximumAllocation=<"
+ getMaximumResourceCapability() + ">, " + "asynchronousScheduling=" + getMaximumResourceCapability() + ">, " + "asynchronousScheduling="
+ scheduleAsynchronously + ", " + "asyncScheduleInterval=" + scheduleAsynchronously + ", " + "asyncScheduleInterval="
+ asyncScheduleInterval + "ms"); + asyncScheduleInterval + "ms" + ", " + "assignMultipleEnabled="
+ assignMultipleEnabled + ", " + "maxAssignPerHeartbeat="
+ maxAssignPerHeartbeat + ", " + "offswitchPerHeartbeatLimit="
+ offswitchPerHeartbeatLimit);
} finally { } finally {
writeLock.unlock(); writeLock.unlock();
} }
@ -453,7 +456,13 @@ public class CapacityScheduler extends
this.isLazyPreemptionEnabled = this.conf.getLazyPreemptionEnabled(); this.isLazyPreemptionEnabled = this.conf.getLazyPreemptionEnabled();
// Setup how many containers we can allocate for each round // Setup how many containers we can allocate for each round
assignMultipleEnabled = this.conf.getAssignMultipleEnabled();
maxAssignPerHeartbeat = this.conf.getMaxAssignPerHeartbeat();
offswitchPerHeartbeatLimit = this.conf.getOffSwitchPerHeartbeatLimit(); offswitchPerHeartbeatLimit = this.conf.getOffSwitchPerHeartbeatLimit();
LOG.info("assignMultipleEnabled = " + assignMultipleEnabled + "\n" +
"maxAssignPerHeartbeat = " + maxAssignPerHeartbeat + "\n" +
"offswitchPerHeartbeatLimit = " + offswitchPerHeartbeatLimit);
} finally { } finally {
writeLock.unlock(); writeLock.unlock();
} }

2
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md
View File

@ -285,7 +285,7 @@ The `ReservationSystem` is integrated with the `CapacityScheduler` queue hierach
* Container Allocation per NodeManager Heartbeat * Container Allocation per NodeManager Heartbeat
The `CapacityScheduler` supports the following parameters to control how many containers can be allocated in each NodeManager heartbeat. The `CapacityScheduler` supports the following parameters to control how many containers can be allocated in each NodeManager heartbeat. These parameters are refreshable via *yarn rmadmin -refreshQueues*.
| Property | Description | | Property | Description |
|:---- |:---- | |:---- |:---- |