2013-01-14 09:34:51 -05:00
|
|
|
<!--
|
|
|
|
Licensed under the Apache License, Version 2.0 (the "License");
|
|
|
|
you may not use this file except in compliance with the License.
|
|
|
|
You may obtain a copy of the License at
|
|
|
|
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
|
|
|
|
Unless required by applicable law or agreed to in writing, software
|
|
|
|
distributed under the License is distributed on an "AS IS" BASIS,
|
|
|
|
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
|
|
See the License for the specific language governing permissions and
|
|
|
|
limitations under the License. See accompanying LICENSE file.
|
|
|
|
-->
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<configuration>
|
|
|
|
|
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.maximum-applications</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>10000</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
Maximum number of applications that can be pending and running.
|
2011-09-08 21:44:58 -04:00
|
|
|
</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
2011-09-05 15:49:47 -04:00
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
|
2011-09-05 15:49:47 -04:00
|
|
|
<value>0.1</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
Maximum percent of resources in the cluster which can be used to run
|
|
|
|
application masters i.e. controls number of concurrent running
|
|
|
|
applications.
|
|
|
|
</description>
|
2011-09-05 15:49:47 -04:00
|
|
|
</property>
|
|
|
|
|
2013-01-09 00:08:23 -05:00
|
|
|
<property>
|
|
|
|
<name>yarn.scheduler.capacity.resource-calculator</name>
|
2013-06-21 14:28:57 -04:00
|
|
|
<value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value>
|
2013-01-09 00:08:23 -05:00
|
|
|
<description>
|
|
|
|
The ResourceCalculator implementation to be used to compare
|
|
|
|
Resources in the scheduler.
|
|
|
|
The default i.e. DefaultResourceCalculator only uses Memory while
|
|
|
|
DominantResourceCalculator uses dominant-resource to compare
|
|
|
|
multi-dimensional resources such as Memory, CPU etc.
|
|
|
|
</description>
|
|
|
|
</property>
|
|
|
|
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.queues</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>default</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
The queues at the this level (root is the root queue).
|
2011-09-08 21:44:58 -04:00
|
|
|
</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.default.capacity</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>100</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>Default queue target capacity.</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.default.user-limit-factor</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>1</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
Default queue user limit a percentage from 0.0 to 1.0.
|
2011-09-08 21:44:58 -04:00
|
|
|
</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.default.maximum-capacity</name>
|
2012-02-01 02:57:35 -05:00
|
|
|
<value>100</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
2012-02-01 02:57:35 -05:00
|
|
|
The maximum capacity of the default queue.
|
2011-09-08 21:44:58 -04:00
|
|
|
</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
2011-09-08 21:44:58 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.default.state</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>RUNNING</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
The state of the default queue. State can be one of RUNNING or STOPPED.
|
2011-09-08 21:44:58 -04:00
|
|
|
</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
2012-10-02 22:56:20 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.default.acl_submit_applications</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>*</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
The ACL of who can submit jobs to the default queue.
|
2011-09-08 21:44:58 -04:00
|
|
|
</description>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
2012-10-02 22:56:20 -04:00
|
|
|
<name>yarn.scheduler.capacity.root.default.acl_administer_queue</name>
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
<value>*</value>
|
2011-10-03 15:35:41 -04:00
|
|
|
<description>
|
|
|
|
The ACL of who can administer jobs on the default queue.
|
|
|
|
</description>
|
|
|
|
</property>
|
|
|
|
|
2012-09-07 01:10:51 -04:00
|
|
|
<property>
|
|
|
|
<name>yarn.scheduler.capacity.node-locality-delay</name>
|
2013-12-11 15:14:30 -05:00
|
|
|
<value>40</value>
|
2012-09-07 01:10:51 -04:00
|
|
|
<description>
|
|
|
|
Number of missed scheduling opportunities after which the CapacityScheduler
|
|
|
|
attempts to schedule rack-local containers.
|
2013-12-11 15:14:30 -05:00
|
|
|
Typically this should be set to number of nodes in the cluster, By default is setting
|
|
|
|
approximately number of nodes in one rack which is 40.
|
2012-09-07 01:10:51 -04:00
|
|
|
</description>
|
|
|
|
</property>
|
|
|
|
|
2014-08-18 02:08:45 -04:00
|
|
|
<property>
|
|
|
|
<name>yarn.scheduler.capacity.queue-mappings</name>
|
|
|
|
<value></value>
|
|
|
|
<description>
|
|
|
|
A list of mappings that will be used to assign jobs to queues
|
|
|
|
The syntax for this list is [u|g]:[name]:[queue_name][,next mapping]*
|
|
|
|
Typically this list will be used to map users to queues,
|
|
|
|
for example, u:%user:%user maps all users to queues with the same name
|
|
|
|
as the user.
|
|
|
|
</description>
|
|
|
|
</property>
|
|
|
|
|
|
|
|
<property>
|
|
|
|
<name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
|
|
|
|
<value>false</value>
|
|
|
|
<description>
|
|
|
|
If a queue mapping is present, will it override the value specified
|
|
|
|
by the user? This can be used by administrators to place jobs in queues
|
|
|
|
that are different than the one specified by the user.
|
|
|
|
The default is false.
|
|
|
|
</description>
|
|
|
|
</property>
|
|
|
|
|
2016-10-28 13:30:15 -04:00
|
|
|
<property>
|
|
|
|
<name>yarn.scheduler.capacity.per-node-heartbeat.maximum-offswitch-assignments</name>
|
|
|
|
<value>1</value>
|
|
|
|
<description>
|
|
|
|
Controls the number of OFF_SWITCH assignments allowed
|
|
|
|
during a node's heartbeat. Increasing this value can improve
|
|
|
|
scheduling rate for OFF_SWITCH containers. Lower values reduce
|
|
|
|
"clumping" of applications on particular nodes. The default is 1.
|
|
|
|
Legal values are 1-MAX_INT. This config is refreshable.
|
|
|
|
</description>
|
|
|
|
</property>
|
|
|
|
|
MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 07:07:10 -04:00
|
|
|
</configuration>
|