Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

MAPREDUCE-4990. Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu) 

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457914 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Alejandro Abdelnur 2013-03-18 18:45:55 +00:00
parent 64741f4635
commit 5ac6abe107
2 changed files with 10 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
hadoop-mapreduce-project/CHANGES.txt
View File

@ -194,6 +194,9 @@ Release 2.0.5-beta - UNRELEASED
MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits' MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits'
allocation on small clusters. (Bikas Saha via vinodkv) allocation on small clusters. (Bikas Saha via vinodkv)
MAPREDUCE-4990. Construct debug strings conditionally in
ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu)
OPTIMIZATIONS OPTIMIZATIONS
BUG FIXES BUG FIXES

8
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java
View File

@ -549,15 +549,19 @@ public class ShuffleHandler extends AbstractService
ContainerLocalizer.USERCACHE + "/" + user + "/" ContainerLocalizer.USERCACHE + "/" + user + "/"
+ ContainerLocalizer.APPCACHE + "/" + ContainerLocalizer.APPCACHE + "/"
+ ConverterUtils.toString(appID) + "/output" + "/" + mapId; + ConverterUtils.toString(appID) + "/output" + "/" + mapId;
if (LOG.isDebugEnabled()) {
LOG.debug("DEBUG0 " + base); LOG.debug("DEBUG0 " + base);
}
// Index file // Index file
Path indexFileName = lDirAlloc.getLocalPathToRead( Path indexFileName = lDirAlloc.getLocalPathToRead(
base + "/file.out.index", conf); base + "/file.out.index", conf);
// Map-output file // Map-output file
Path mapOutputFileName = lDirAlloc.getLocalPathToRead( Path mapOutputFileName = lDirAlloc.getLocalPathToRead(
base + "/file.out", conf); base + "/file.out", conf);
LOG.debug("DEBUG1 " + base + " : " + mapOutputFileName + " : " + if (LOG.isDebugEnabled()) {
indexFileName); LOG.debug("DEBUG1 " + base + " : " + mapOutputFileName + " : "
+ indexFileName);
}
final IndexRecord info = final IndexRecord info =
indexCache.getIndexInformation(mapId, reduce, indexFileName, user); indexCache.getIndexInformation(mapId, reduce, indexFileName, user);
final ShuffleHeader header = final ShuffleHeader header =