Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Merge -c 1528626 from trunk to branch-2 to fix MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN. Contributed by Zhijie Shen. 

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1528627 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Arun Murthy 2013-10-02 21:09:59 +00:00
parent f2e97aad31
commit ce990cd911
2 changed files with 21 additions and 9 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
hadoop-mapreduce-project/CHANGES.txt
View File

@ -128,6 +128,9 @@ Release 2.1.2 - UNRELEASED
isSplittable(FileSystem, Path) api and ensuring semantic compatibility. isSplittable(FileSystem, Path) api and ensuring semantic compatibility.
(Robert Kanter via acmurthy) (Robert Kanter via acmurthy)
MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN.
(Zhijie Shen via acmurthy)
Release 2.1.1-beta - 2013-09-23 Release 2.1.1-beta - 2013-09-23
INCOMPATIBLE CHANGES INCOMPATIBLE CHANGES

27
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
View File

@ -96,12 +96,21 @@ Apache Hadoop MapReduce - Migrating from Apache Hadoop 1.x to Apache Hadoop 2.x
* {Malicious} * {Malicious}
For the users who are going to try <<<hadoop-examples-1.x.x.jar>>> on YARN, For the users who are going to try <<<hadoop-examples-1.x.x.jar>>> on YARN,
please note that <<<hadoop -jar hadoop-examples-1.x.x.jar>>> will still use please note that <<<hadoop -jar hadoop-examples-1.x.x.jar>>> will still use
<<<hadoop-mapreduce-examples-2.x.x.jar>>>, which is installed together with <<<hadoop-mapreduce-examples-2.x.x.jar>>>, which is installed together with
other MRv2 jars. By default Hadoop framework jars appear before the users' other MRv2 jars. By default Hadoop framework jars appear before the users'
jars in the classpath, such that the classes from the 2.x.x jar will still be jars in the classpath, such that the classes from the 2.x.x jar will still be
picked. Users should either remove <<<hadoop-mapreduce-examples-2.x.x.jar>>> picked. Users should remove <<<hadoop-mapreduce-examples-2.x.x.jar>>>
from the classpath or set <<<HADOOP_USER_CLASSPATH_FIRST=true>>> and from the classpath of all the nodes in a cluster. Otherwise, users need to
<<<HADOOP_CLASSPATH=...:hadoop-examples-1.x.x.jar>>> to run their target set <<<HADOOP_USER_CLASSPATH_FIRST=true>>> and
examples jar. <<<HADOOP_CLASSPATH=...:hadoop-examples-1.x.x.jar>>> to run their target
examples jar, and add the following configuration in <<<mapred-site.xml>>> to
make the processes in YARN containers pick this jar as well.
+---+
<property>
<name>mapreduce.job.user.classpath.first</name>
<value>true</value>
</property>
+---+