Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags.

Browse Source
This commit is contained in:
Tsz-Wo Nicholas Sze 2015-11-24 14:34:51 -08:00
parent 83fcbd49a7
commit d2518fd562
2 changed files with 8 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
View File

@ -23,6 +23,9 @@ Release 2.6.3 - UNRELEASED
HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in
commitBlock. (Chang Li via zhz) commitBlock. (Chang Li via zhz)
HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30
seconds for printing info log messags. (szetszwo)
Release 2.6.2 - 2015-10-28 Release 2.6.2 - 2015-10-28
INCOMPATIBLE CHANGES INCOMPATIBLE CHANGES

10
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
View File

@ -2853,11 +2853,11 @@ private void processOverReplicatedBlock(final Block block,
for(DatanodeStorageInfo storage : blocksMap.getStorages(block, State.NORMAL)) { for(DatanodeStorageInfo storage : blocksMap.getStorages(block, State.NORMAL)) {
final DatanodeDescriptor cur = storage.getDatanodeDescriptor(); final DatanodeDescriptor cur = storage.getDatanodeDescriptor();
if (storage.areBlockContentsStale()) { if (storage.areBlockContentsStale()) {
LOG.info("BLOCK* processOverReplicatedBlock: " + if (LOG.isTraceEnabled()) {
"Postponing processing of over-replicated " + LOG.trace("BLOCK* processOverReplicatedBlock: Postponing " + block
block + " since storage + " + storage + " since storage " + storage
+ "datanode " + cur + " does not yet have up-to-date " + + " does not yet have up-to-date information.");
"block information."); }
postponeBlock(block); postponeBlock(block);
return; return;
} }