Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. 

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1340629 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Todd Lipcon 2012-05-20 07:41:37 +00:00
parent d4ae893a27
commit 58f72f035f
2 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
hadoop-mapreduce-project/CHANGES.txt
View File

@ -18,6 +18,9 @@ Release 2.0.1-alpha - UNRELEASED
MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn
jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu) jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not
from default file system. (Bhallamudi Venkata Siva Kamesh via todd)
Release 2.0.0-alpha - UNRELEASED Release 2.0.0-alpha - UNRELEASED
INCOMPATIBLE CHANGES INCOMPATIBLE CHANGES

2
hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/MultiFileWordCount.java
View File

@ -130,8 +130,8 @@ public class MultiFileWordCount extends Configured implements Tool {
public CombineFileLineRecordReader(CombineFileSplit split, public CombineFileLineRecordReader(CombineFileSplit split,
TaskAttemptContext context, Integer index) throws IOException { TaskAttemptContext context, Integer index) throws IOException {
fs = FileSystem.get(context.getConfiguration());
this.path = split.getPath(index); this.path = split.getPath(index);
fs = this.path.getFileSystem(context.getConfiguration());
this.startOffset = split.getOffset(index); this.startOffset = split.getOffset(index);
this.end = startOffset + split.getLength(index); this.end = startOffset + split.getLength(index);
boolean skipFirstLine = false; boolean skipFirstLine = false;