MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev) - Merging r1202002 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1202004 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
parent
c799c3b2e7
commit
7934940eb8
|
@ -35,6 +35,9 @@ Release 0.23.1 - Unreleased
|
|||
MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles
|
||||
via mahadev)
|
||||
|
||||
MAPREDUCE-3331. Improvement to single node cluster setup documentation for
|
||||
0.23 (Anupam Seth via mahadev)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
BUG FIXES
|
||||
|
|
|
@ -41,7 +41,7 @@ $ mvn clean install assembly:assembly -Pnative
|
|||
* Setting up the environment.
|
||||
|
||||
Assuming you have installed hadoop-common/hadoop-hdfs and exported
|
||||
<<$HADOOP_COMMON_HOME>>/<<$HADOOP_COMMON_HOME>>, untar hadoop mapreduce
|
||||
<<$HADOOP_COMMON_HOME>>/<<$HADOOP_HDFS_HOME>>, untar hadoop mapreduce
|
||||
tarball and set environment variable <<$HADOOP_MAPRED_HOME>> to the
|
||||
untarred directory. Set <<$YARN_HOME>> the same as <<$HADOOP_MAPRED_HOME>>.
|
||||
|
||||
|
@ -79,15 +79,15 @@ $ mvn clean install assembly:assembly -Pnative
|
|||
Add the following configs to your <<<yarn-site.xml>>>
|
||||
|
||||
+---+
|
||||
<property>
|
||||
<property>
|
||||
<name>yarn.resourcemanager.resource-tracker.address</name>
|
||||
<value>host:port</value>
|
||||
<description>host is the hostname of the resource manager and
|
||||
port is the port on which the NodeManagers contact the Resource Manager.
|
||||
</description>
|
||||
</property>
|
||||
</property>
|
||||
|
||||
<property>
|
||||
<property>
|
||||
<name>yarn.resourcemanager.scheduler.address</name>
|
||||
<value>host:port</value>
|
||||
<description>host is the hostname of the resourcemanager and port is the port
|
||||
|
@ -145,6 +145,32 @@ Add the following configs to your <<<yarn-site.xml>>>
|
|||
</property>
|
||||
+---+
|
||||
|
||||
** Setting up <<<capacity-scheduler.xml>>>
|
||||
|
||||
Make sure you populate the root queues in <<<capacity-scheduler.xml>>>.
|
||||
|
||||
+---+
|
||||
<property>
|
||||
<name>yarn.scheduler.capacity.root.queues</name>
|
||||
<value>unfunded,default</value>
|
||||
</property>
|
||||
|
||||
<property>
|
||||
<name>yarn.scheduler.capacity.root.capacity</name>
|
||||
<value>100</value>
|
||||
</property>
|
||||
|
||||
<property>
|
||||
<name>yarn.scheduler.capacity.root.unfunded.capacity</name>
|
||||
<value>50</value>
|
||||
</property>
|
||||
|
||||
<property>
|
||||
<name>yarn.scheduler.capacity.root.default.capacity</name>
|
||||
<value>50</value>
|
||||
</property>
|
||||
+---+
|
||||
|
||||
* Create Symlinks.
|
||||
|
||||
You will have to create the following symlinks:
|
||||
|
|
Loading…
Reference in New Issue