diff --git a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html b/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
index 3557e06334c..8ac55c1ce62 100644
--- a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
+++ b/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html
@@ -1 +1,10726 @@
-THIS IS A PLACEHOLDER. REAL RELEASE NOTES WILL BE ADDED TO THIS FILE IN RELEASE BRANCHES.
+
+Hadoop 2.0.2-alpha Release Notes
+
+
+
+Hadoop 2.0.2-alpha Release Notes
+These release notes include new developer and user-facing incompatibilities, features, and major improvements.
+
+Changes since Hadoop 2.0.1-alpha
+
+- YARN-137.
+ Major improvement reported by Siddharth Seth and fixed by Siddharth Seth (scheduler)
+ Change the default scheduler to the CapacityScheduler
+ There's some bugs in the FifoScheduler atm - doesn't distribute tasks across nodes and some headroom (available resource) issues.
+That's not the best experience for users trying out the 2.0 branch. The CS with the default configuration of a single queue behaves the same as the FifoScheduler and doesn't have these issues.
+
+- YARN-108.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
+ FSDownload can create cache directories with the wrong permissions
+ When the cluster is configured with a restrictive umask, e.g.: {{fs.permissions.umask-mode=0077}}, the nodemanager can end up creating directory entries in the public cache with the wrong permissions. The permissions can end up where only the nodemanager user can access files in the public cache, preventing jobs from running properly.
+- YARN-106.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
+ Nodemanager needs to set permissions of local directories
+ If the nodemanager process is running with a restrictive default umask (e.g.: 0077) then it will create its local directories with permissions that are too restrictive to allow containers from other users to run.
+- YARN-88.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
+ DefaultContainerExecutor can fail to set proper permissions
+ {{DefaultContainerExecutor}} can fail to set the proper permissions on its local directories if the cluster has been configured with a restrictive umask, e.g.: fs.permissions.umask-mode=0077. The configured umask ends up defeating the permissions requested by {{DefaultContainerExecutor}} when it creates directories.
+- YARN-87.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
+ NM ResourceLocalizationService does not set permissions of local cache directories
+ {{ResourceLocalizationService}} creates a file cache and user cache directory when it starts up but doesn't specify the permissions for them when they are created. If the cluster configs are set to limit the default permissions (e.g.: fs.permissions.umask-mode=0077 instead of the default 0022), then the cache directories are created with too-restrictive permissions and no jobs are able to run.
+- YARN-83.
+ Major bug reported by Bikas Saha and fixed by Bikas Saha (client)
+ Change package of YarnClient to include apache
+ Currently its org.hadoop.* instead of org.apache.hadoop.*
+- YARN-80.
+ Major improvement reported by Todd Lipcon and fixed by Arun C Murthy (capacityscheduler)
+ Support delay scheduling for node locality in MR2's capacity scheduler
+ The capacity scheduler in MR2 doesn't support delay scheduling for achieving node-level locality. So, jobs exhibit poor data locality even if they have good rack locality. Especially on clusters where disk throughput is much better than network capacity, this hurts overall job performance. We should optionally support node-level delay scheduling heuristics similar to what the fair scheduler implements in MR1.
+- YARN-79.
+ Major bug reported by Bikas Saha and fixed by Vinod Kumar Vavilapalli (client)
+ Calling YarnClientImpl.close throws Exception
+ The following exception is thrown
+===========
+*org.apache.hadoop.HadoopIllegalArgumentException: Cannot close proxy - is not Closeable or does not provide closeable invocation handler class org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl*
+ *at org.apache.hadoop.ipc.RPC.stopProxy(RPC.java:624)*
+ *at org.hadoop.yarn.client.YarnClientImpl.stop(YarnClientImpl.java:102)*
+ at org.apache.hadoop.yarn.applications.unmanagedamlauncher.UnmanagedAMLauncher.run(UnmanagedAMLauncher.java:336)
+ at org.apache.hadoop.yarn.applications.unmanagedamlauncher.TestUnmanagedAMLauncher.testDSShell(TestUnmanagedAMLauncher.java:156)
+ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
+ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
+ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
+ at java.lang.reflect.Method.invoke(Method.java:597)
+ at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
+ at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
+ at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
+ at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
+ at org.junit.runners.BlockJUnit4ClassRunner.runNotIgnored(BlockJUnit4ClassRunner.java:79)
+ at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:71)
+ at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:49)
+ at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
+ at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
+ at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
+ at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
+ at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
+ at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
+ at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
+ at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
+ at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:236)
+ at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:134)
+ at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:113)
+ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
+ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
+ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
+ at java.lang.reflect.Method.invoke(Method.java:597)
+ at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
+ at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
+ at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
+ at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:103)
+ at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:74)
+===========
+- YARN-75.
+ Major bug reported by Siddharth Seth and fixed by Siddharth Seth
+ RMContainer should handle a RELEASE event while RUNNING
+ An AppMaster can send a container release at any point. Currently this results in an exception, if this is done while the RM considers the container to be RUNNING.
+The event not being processed correctly also implies that these containers do not show up in the Completed Container List seen by the AM (AMRMProtocol). MR-3902 depends on this set being complete.
+- YARN-68.
+ Major bug reported by patrick white and fixed by Daryn Sharp (nodemanager)
+ NodeManager will refuse to shutdown indefinitely due to container log aggregation
+ The nodemanager is able to get into a state where containermanager.logaggregation.AppLogAggregatorImpl will apparently wait
+indefinitely for log aggregation to complete for an application, even if that application has abnormally terminated and is no longer present.
+
+Observed behavior is that an attempt to stop the nodemanager daemon will return but have no effect, the nm log continually displays messages similar to this:
+
+[Thread-1]2012-08-21 17:44:07,581 INFO
+org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl:
+Waiting for aggregation to complete for application_1345221477405_2733
+
+The only recovery we found to work was to 'kill -9' the nm process.
+
+What exactly causes the NM to enter this state is unclear but we do see this behavior reliably when the NM has run a task which failed, for example when debugging oozie distcp actions and having a distcp map task fail, the NM that was running the container will now enter this state where a shutdown on said NM will never complete, 'never' in this case was waiting for 2 hours before killing the nodemanager process.
+
+- YARN-66.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves (nodemanager)
+ aggregated logs permissions not set properly
+ If the default file permissions are set to something restrictive - like 700, application logs get aggregated and created with those restrictive file permissions which doesn't allow the history server to serve them up.
+
+
+They need to be created with group readable similar to how log aggregation sets up the directory permissions.
+
+- YARN-63.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (resourcemanager)
+ RMNodeImpl is missing valid transitions from the UNHEALTHY state
+ The ResourceManager isn't properly handling nodes that have been marked UNHEALTHY when they are lost or are decommissioned.
+- YARN-60.
+ Blocker sub-task reported by Daryn Sharp and fixed by Vinod Kumar Vavilapalli (nodemanager)
+ NMs rejects all container tokens after secret key rolls
+ The NM's token secret manager will reject all container tokens after the secret key is activated which means the NM will not launch _any_ containers including AMs. The whole yarn cluster becomes inoperable in 1d.
+- YARN-58.
+ Critical bug reported by Daryn Sharp and fixed by Jason Lowe (nodemanager)
+ NM leaks filesystems
+ The NM is exhausting its fds because it's not closing fs instances when the app is finished.
+- YARN-42.
+ Major bug reported by Devaraj K and fixed by Devaraj K (nodemanager)
+ Node Manager throws NPE on startup
+ NM throws NPE on startup if it doesn't have persmission's on nm local dir's
+
+
+{code:xml}
+2012-05-14 16:32:13,468 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager
+org.apache.hadoop.yarn.YarnException: Failed to initialize LocalizationService
+ at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.init(ResourceLocalizationService.java:202)
+ at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
+ at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.init(ContainerManagerImpl.java:183)
+ at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
+ at org.apache.hadoop.yarn.server.nodemanager.NodeManager.init(NodeManager.java:166)
+ at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:268)
+ at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:284)
+Caused by: java.io.IOException: mkdir of /mrv2/tmp/nm-local-dir/usercache failed
+ at org.apache.hadoop.fs.FileSystem.primitiveMkdir(FileSystem.java:907)
+ at org.apache.hadoop.fs.DelegateToFileSystem.mkdir(DelegateToFileSystem.java:143)
+ at org.apache.hadoop.fs.FilterFs.mkdir(FilterFs.java:189)
+ at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:706)
+ at org.apache.hadoop.fs.FileContext$4.next(FileContext.java:703)
+ at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2325)
+ at org.apache.hadoop.fs.FileContext.mkdir(FileContext.java:703)
+ at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.init(ResourceLocalizationService.java:188)
+ ... 6 more
+2012-05-14 16:32:13,472 INFO org.apache.hadoop.yarn.service.CompositeService: Error stopping org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
+java.lang.NullPointerException
+ at org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler.stop(NonAggregatingLogHandler.java:82)
+ at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
+ at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
+ at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.stop(ContainerManagerImpl.java:266)
+ at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:99)
+ at org.apache.hadoop.yarn.service.CompositeService.stop(CompositeService.java:89)
+ at org.apache.hadoop.yarn.server.nodemanager.NodeManager.stop(NodeManager.java:182)
+ at org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:122)
+ at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
+{code}
+
+- YARN-39.
+ Critical sub-task reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli
+ RM-NM secret-keys should be randomly generated and rolled every so often
+ - RM should generate the master-key randomly
+ - The master-key should roll every so often
+ - NM should remember old expired keys so that already doled out container-requests can be satisfied.
+- YARN-37.
+ Minor bug reported by Jason Lowe and fixed by Mayank Bansal (resourcemanager)
+ TestRMAppTransitions.testAppSubmittedKilled passes for the wrong reason
+ TestRMAppTransitions#testAppSubmittedKilled causes an invalid event exception but the test doesn't catch the error since the final app state is still killed. Killed for the wrong reason, but the final state is the same.
+- YARN-36.
+ Blocker bug reported by Eli Collins and fixed by Radim Kolar
+ branch-2.1.0-alpha doesn't build
+ branch-2.1.0-alpha doesn't build due to the following. Per YARN-1 I updated the mvn version to be 2.1.0-SNAPSHOT, before I hit this issue it didn't compile due to the bogus version.
+
+{noformat}
+hadoop-branch-2.1.0-alpha $ mvn compile
+[INFO] Scanning for projects...
+[ERROR] The build could not read 1 project -> [Help 1]
+[ERROR]
+[ERROR] The project org.apache.hadoop:hadoop-yarn-project:2.1.0-SNAPSHOT (/home/eli/src/hadoop-branch-2.1.0-alpha/hadoop-yarn-project/pom.xml) has 1 error
+[ERROR] 'dependencies.dependency.version' for org.hsqldb:hsqldb:jar is missing. @ line 160, column 17
+{noformat}
+- YARN-31.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves
+ TestDelegationTokenRenewer fails on jdk7
+ TestDelegationTokenRenewer fails when run with jdk7.
+
+With JDK7, test methods run in an undefined order. Here it is expecting that testDTRenewal runs first but it no longer is.
+- YARN-29.
+ Major bug reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli (client)
+ Add a yarn-client module
+ I see that we are duplicating (some) code for talking to RM via client API. In this light, a yarn-client module will be useful so that clients of all frameworks can use/extend it.
+
+And that same module can be the destination for all the YARN's command line tools.
+- YARN-27.
+ Major bug reported by Ramya Sunil and fixed by Arun C Murthy
+ Failed refreshQueues due to misconfiguration prevents further refreshing of queues
+ Stumbled upon this problem while refreshing queues with incorrect configuration. The exact scenario was:
+1. Added a new queue "newQueue" without defining its capacity.
+2. "bin/mapred queue -refreshQueues" fails correctly with "Illegal capacity of -1 for queue root.newQueue"
+3. However, after defining the capacity of "newQueue" followed by a second "bin/mapred queue -refreshQueues" throws "org.apache.hadoop.metrics2.MetricsException: Metrics source QueueMetrics,q0=root,q1=newQueue already exists!" Also see Hadoop:name=QueueMetrics,q0=root,q1=newQueue,service=ResourceManager metrics being available even though the queue was not added.
+
+The expected behavior would be to refresh the queues correctly and allow addition of "newQueue".
+- YARN-25.
+ Major bug reported by Thomas Graves and fixed by Robert Joseph Evans
+ remove old aggregated logs
+ Currently the aggregated user logs under NM_REMOTE_APP_LOG_DIR are never removed. We should have mechanism to remove them after certain period.
+
+It might make sense for job history server to remove them.
+- YARN-22.
+ Minor bug reported by Eli Collins and fixed by Mayank Bansal
+ Using URI for yarn.nodemanager log dirs fails
+ If I use URIs (eg file:///home/eli/hadoop/dirs) for yarn.nodemanager.log-dirs or yarn.nodemanager.remote-app-log-dir the container log servlet fails with an NPE (works if I remove the "file" scheme). Using a URI for yarn.nodemanager.local-dirs works.
+- YARN-15.
+ Critical bug reported by Alejandro Abdelnur and fixed by Arun C Murthy (nodemanager)
+ YarnConfiguration DEFAULT_YARN_APPLICATION_CLASSPATH should be updated
+
+{code}
+ /**
+ * Default CLASSPATH for YARN applications. A comma-separated list of
+ * CLASSPATH entries
+ */
+ public static final String[] DEFAULT_YARN_APPLICATION_CLASSPATH = {
+ "$HADOOP_CONF_DIR", "$HADOOP_COMMON_HOME/share/hadoop/common/*",
+ "$HADOOP_COMMON_HOME/share/hadoop/common/lib/*",
+ "$HADOOP_HDFS_HOME/share/hadoop/hdfs/*",
+ "$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*",
+ "$YARN_HOME/share/hadoop/mapreduce/*",
+ "$YARN_HOME/share/hadoop/mapreduce/lib/*"};
+{code}
+
+It should have {{share/yarn/}} and MR should add the {{share/mapreduce/}} (another JIRA?)
+- YARN-14.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
+ Symlinks to peer distributed cache files no longer work
+ Trying to create a symlink to another file that is specified for the distributed cache will fail to create the link. For example:
+
+hadoop jar ... -files "x,y,x#z"
+
+will localize the files x and y as x and y, but the z symlink for x will not be created. This is a regression from 1.x behavior.
+- YARN-13.
+ Critical bug reported by Todd Lipcon and fixed by
+ Merge of yarn reorg into branch-2 copied trunk tree
+ When the move of yarn from inside MR to the project root was merged into branch-2, it seems like the trunk code base was actually copied into the branch-2 branch, instead of a parallel move occurring. So, the poms in branch-2 show the version as 3.0.0-SNAPSHOT instead of a 2.x snapshot version. This is breaking the branch-2 build.
+- YARN-12.
+ Major bug reported by Junping Du and fixed by Junping Du (scheduler)
+ Several Findbugs issues with new FairScheduler in YARN
+ The good feature of FairScheduler is added recently to YARN. As recently PreCommit test from MAPREDUCE-4309, there are several bugs found by Findbugs related to FairScheduler:
+org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairSchedulerEventLog.shutdown() might ignore java.lang.Exception
+Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairSchedulerEventLog.logDisabled; locked 50% of time
+Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueueManager.queueMaxAppsDefault; locked 50% of time
+Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.QueueManager.userMaxAppsDefault; locked 50% of time
+The details are in:https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2612//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html#DE_MIGHT_IGNORE
+
+
+- YARN-10.
+ Major improvement reported by Arun C Murthy and fixed by Hitesh Shah
+ dist-shell shouldn't have a (test) dependency on hadoop-mapreduce-client-core
+ dist-shell shouldn't have a (test) dependency on hadoop-mapreduce-client-core, this should be removed.
+- YARN-9.
+ Major improvement reported by Arun C Murthy and fixed by Vinod Kumar Vavilapalli
+ Rename YARN_HOME to HADOOP_YARN_HOME
+ We should rename YARN_HOME to HADOOP_YARN_HOME to be consistent with rest of Hadoop sub-projects.
+- YARN-1.
+ Major task reported by Arun C Murthy and fixed by Arun C Murthy
+ Move YARN out of hadoop-mapreduce
+ Move YARN out of hadoop-mapreduce-project into hadoop-yarn-project in hadoop trunk
+- MAPREDUCE-4691.
+ Critical bug reported by Jason Lowe and fixed by Robert Joseph Evans (jobhistoryserver , mrv2)
+ Historyserver can report "Unknown job" after RM says job has completed
+
+- MAPREDUCE-4689.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (client)
+ JobClient.getMapTaskReports on failed job results in NPE
+
+- MAPREDUCE-4649.
+ Major bug reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli (jobhistoryserver)
+ mr-jobhistory-daemon.sh needs to be updated post YARN-1
+
+- MAPREDUCE-4647.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ We should only unjar jobjar if there is a lib directory in it.
+
+- MAPREDUCE-4646.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ client does not receive job diagnostics for failed jobs
+
+- MAPREDUCE-4642.
+ Major bug reported by Robert Kanter and fixed by Robert Kanter (test)
+ MiniMRClientClusterFactory should not use job.setJar()
+
+- MAPREDUCE-4641.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ Exception in commitJob marks job as successful in job history
+
+- MAPREDUCE-4638.
+ Major improvement reported by Arun C Murthy and fixed by Arun C Murthy
+ MR AppMaster shouldn't rely on YARN_APPLICATION_CLASSPATH providing MR jars
+
+- MAPREDUCE-4635.
+ Major bug reported by Bikas Saha and fixed by Bikas Saha
+ MR side of YARN-83. Changing package of YarnClient
+
+- MAPREDUCE-4633.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves (jobhistoryserver)
+ history server doesn't set permissions on all subdirs
+
+- MAPREDUCE-4629.
+ Major bug reported by Karthik Kambatla and fixed by Karthik Kambatla
+ Remove JobHistory.DEBUG_MODE
+
+- MAPREDUCE-4614.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (client , task)
+ Simplify debugging a job's tokens
+
+- MAPREDUCE-4612.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves
+ job summary file permissions not set when its created
+
+- MAPREDUCE-4611.
+ Critical bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ MR AM dies badly when Node is decomissioned
+
+- MAPREDUCE-4610.
+ Major bug reported by Tom White and fixed by Tom White (mrv2)
+ Support deprecated mapreduce.job.counters.limit property in MR2
+
+- MAPREDUCE-4608.
+ Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
+ hadoop-mapreduce-client is missing some dependencies
+
+- MAPREDUCE-4604.
+ Critical bug reported by Ravi Prakash and fixed by Ravi Prakash (mrv2)
+ In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker.
+
+- MAPREDUCE-4600.
+ Critical bug reported by Robert Joseph Evans and fixed by Daryn Sharp
+ TestTokenCache.java from MRV1 no longer compiles
+
+- MAPREDUCE-4580.
+ Major bug reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli
+ Change MapReduce to use the yarn-client module
+
+- MAPREDUCE-4579.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves
+ TestTaskAttempt fails jdk7
+
+- MAPREDUCE-4577.
+ Minor bug reported by Alejandro Abdelnur and fixed by Aaron T. Myers (test)
+ HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test
+
+- MAPREDUCE-4572.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (tasktracker , webapps)
+ Can not access user logs - Jetty is not configured by default to serve aliases/symlinks
+
+- MAPREDUCE-4570.
+ Minor bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found.
+
+- MAPREDUCE-4569.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves
+ TestHsWebServicesJobsQuery fails on jdk7
+
+- MAPREDUCE-4562.
+ Major bug reported by Jarek Jarcec Cecho and fixed by Jarek Jarcec Cecho
+ Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name
+
+- MAPREDUCE-4511.
+ Major improvement reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv1 , mrv2 , performance)
+ Add IFile readahead
+
+- MAPREDUCE-4504.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ SortValidator writes to wrong directory
+
+- MAPREDUCE-4503.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles
+
+- MAPREDUCE-4498.
+ Critical bug reported by Robert Kanter and fixed by Robert Kanter (build , examples)
+ Remove hsqldb jar from Hadoop runtime classpath
+
+- MAPREDUCE-4496.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (applicationmaster , mrv2)
+ AM logs link is missing user name
+
+- MAPREDUCE-4494.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2 , test)
+ TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists!
+
+- MAPREDUCE-4493.
+ Critical bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ Distibuted Cache Compatability Issues
+
+- MAPREDUCE-4492.
+ Minor bug reported by Nishan Shetty and fixed by Mayank Bansal (mrv2)
+ Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull
+
+- MAPREDUCE-4484.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration
+
+- MAPREDUCE-4483.
+ Major bug reported by John George and fixed by John George
+ 2.0 build does not work
+
+- MAPREDUCE-4470.
+ Major bug reported by Kihwal Lee and fixed by Ilya Katsov (test)
+ Fix TestCombineFileInputFormat.testForEmptyFile
+
+- MAPREDUCE-4467.
+ Critical bug reported by Andrey Klochkov and fixed by Kihwal Lee (nodemanager)
+ IndexCache failures due to missing synchronization
+
+- MAPREDUCE-4465.
+ Trivial bug reported by Bo Wang and fixed by Bo Wang
+ Update description of yarn.nodemanager.address property
+
+- MAPREDUCE-4457.
+ Critical bug reported by Thomas Graves and fixed by Robert Joseph Evans (mrv2)
+ mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED
+
+- MAPREDUCE-4456.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks
+
+- MAPREDUCE-4449.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig
+
+- MAPREDUCE-4448.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (mrv2 , nodemanager)
+ Nodemanager crashes upon application cleanup if aggregation failed to start
+
+- MAPREDUCE-4447.
+ Major bug reported by Eli Collins and fixed by Eli Collins (build)
+ Remove aop from cruft from the ant build
+
+- MAPREDUCE-4444.
+ Blocker bug reported by Nathan Roberts and fixed by Jason Lowe (nodemanager)
+ nodemanager fails to start when one of the local-dirs is bad
+
+- MAPREDUCE-4441.
+ Blocker bug reported by Karthik Kambatla and fixed by Karthik Kambatla
+ Fix build issue caused by MR-3451
+
+- MAPREDUCE-4440.
+ Major bug reported by Arun C Murthy and fixed by Arun C Murthy
+ Change SchedulerApp & SchedulerNode to be a minimal interface
+
+- MAPREDUCE-4437.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (applicationmaster , mrv2)
+ Race in MR ApplicationMaster can cause reducers to never be scheduled
+
+- MAPREDUCE-4432.
+ Trivial bug reported by Gabriel Reid and fixed by
+ Confusing warning message when GenericOptionsParser is not used
+
+- MAPREDUCE-4427.
+ Major improvement reported by Bikas Saha and fixed by Bikas Saha
+ Enable the RM to work with AM's that are not managed by it
+
+- MAPREDUCE-4423.
+ Critical bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ Potential infinite fetching of map output
+
+- MAPREDUCE-4422.
+ Major improvement reported by Arun C Murthy and fixed by Ahmed Radwan (nodemanager)
+ YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration
+
+- MAPREDUCE-4419.
+ Major bug reported by Nishan Shetty and fixed by Devaraj K (mrv2)
+ ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename>
+
+- MAPREDUCE-4417.
+ Major new feature reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (mrv2 , security)
+ add support for encrypted shuffle
+
+- MAPREDUCE-4416.
+ Critical bug reported by Kihwal Lee and fixed by Kihwal Lee (client , mrv2)
+ Some tests fail if Clover is enabled
+
+- MAPREDUCE-4408.
+ Major improvement reported by Alejandro Abdelnur and fixed by Robert Kanter (mrv1 , mrv2)
+ allow jobs to set a JAR that is in the distributed cached
+
+- MAPREDUCE-4407.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (build , mrv2)
+ Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package
+
+- MAPREDUCE-4406.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2 , test)
+ Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports
+
+- MAPREDUCE-4402.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (test)
+ TestFileInputFormat fails intermittently
+
+- MAPREDUCE-4395.
+ Critical bug reported by Bhallamudi Venkata Siva Kamesh and fixed by Bhallamudi Venkata Siva Kamesh (distributed-cache , job submission , mrv2)
+ Possible NPE at ClientDistributedCacheManager#determineTimestamps
+
+- MAPREDUCE-4392.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ Counters.makeCompactString() changed behavior from 0.20
+
+- MAPREDUCE-4387.
+ Major bug reported by Kihwal Lee and fixed by Kihwal Lee (resourcemanager)
+ RM gets fatal error and exits during TestRM
+
+- MAPREDUCE-4384.
+ Major bug reported by Kihwal Lee and fixed by Kihwal Lee (nodemanager)
+ Race conditions in IndexCache
+
+- MAPREDUCE-4383.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson (pipes)
+ HadoopPipes.cc needs to include unistd.h
+
+- MAPREDUCE-4380.
+ Minor bug reported by Devaraj K and fixed by Devaraj K (mrv2 , nodemanager)
+ Empty Userlogs directory is getting created under logs directory
+
+- MAPREDUCE-4379.
+ Blocker bug reported by Devaraj K and fixed by Devaraj K (mrv2 , nodemanager)
+ Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts
+
+- MAPREDUCE-4376.
+ Major bug reported by Jason Lowe and fixed by Kihwal Lee (mrv2 , test)
+ TestClusterMRNotification times out
+
+- MAPREDUCE-4375.
+ Major improvement reported by Robert Joseph Evans and fixed by Robert Joseph Evans (applicationmaster)
+ Show Configuration Tracability in MR UI
+
+- MAPREDUCE-4372.
+ Major bug reported by Devaraj K and fixed by Devaraj K (mrv2 , resourcemanager)
+ Deadlock in Resource Manager between SchedulerEventDispatcher.EventProcessor and Shutdown hook manager
+
+- MAPREDUCE-4361.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ Fix detailed metrics for protobuf-based RPC on 0.23
+
+- MAPREDUCE-4355.
+ Major new feature reported by Karthik Kambatla and fixed by Karthik Kambatla (mrv1 , mrv2)
+ Add RunningJob.getJobStatus()
+
+- MAPREDUCE-4341.
+ Major bug reported by Thomas Graves and fixed by Karthik Kambatla (capacity-sched , mrv2)
+ add types to capacity scheduler properties documentation
+
+- MAPREDUCE-4336.
+ Major bug reported by Siddharth Seth and fixed by Ahmed Radwan (mrv2)
+ Distributed Shell fails when used with the CapacityScheduler
+
+- MAPREDUCE-4320.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves (contrib/gridmix)
+ gridmix mainClass wrong in pom.xml
+
+- MAPREDUCE-4313.
+ Blocker bug reported by Eli Collins and fixed by Robert Joseph Evans (build , test)
+ TestTokenCache doesn't compile due TokenCache.getDelegationToken compilation error
+
+- MAPREDUCE-4311.
+ Major bug reported by Thomas Graves and fixed by Karthik Kambatla (capacity-sched , mrv2)
+ Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings
+
+- MAPREDUCE-4307.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem
+
+- MAPREDUCE-4306.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ Problem running Distributed Shell applications as a user other than the one started the daemons
+
+- MAPREDUCE-4302.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (nodemanager)
+ NM goes down if error encountered during log aggregation
+
+- MAPREDUCE-4301.
+ Major improvement reported by Robert Joseph Evans and fixed by Robert Joseph Evans (applicationmaster)
+ Dedupe some strings in MRAM for memory savings
+
+- MAPREDUCE-4300.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (applicationmaster)
+ OOM in AM can turn it into a zombie.
+
+- MAPREDUCE-4299.
+ Major bug reported by Tom White and fixed by Tom White (mrv2)
+ Terasort hangs with MR2 FifoScheduler
+
+- MAPREDUCE-4297.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash (contrib/gridmix)
+ Usersmap file in gridmix should not fail on empty lines
+
+- MAPREDUCE-4295.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves (mrv2 , resourcemanager)
+ RM crashes due to DNS issue
+
+- MAPREDUCE-4290.
+ Major bug reported by Nishan Shetty and fixed by Devaraj K (mrv2)
+ JobStatus.getState() API is giving ambiguous values
+
+- MAPREDUCE-4283.
+ Major improvement reported by Jason Lowe and fixed by Jason Lowe (jobhistoryserver , mrv2)
+ Display tail of aggregated logs by default
+
+- MAPREDUCE-4276.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ Allow setting yarn.nodemanager.delete.debug-delay-sec property to "-1" for easier container debugging.
+
+- MAPREDUCE-4270.
+ Major bug reported by Brock Noland and fixed by Thomas Graves (mrv2)
+ data_join test classes are in the wrong packge
+
+- MAPREDUCE-4269.
+ Major bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ documentation: Gridmix has javadoc warnings in StressJobFactory
+
+- MAPREDUCE-4267.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ mavenize pipes
+
+- MAPREDUCE-4264.
+ Blocker bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
+
+- MAPREDUCE-4262.
+ Minor bug reported by Devaraj K and fixed by Devaraj K (mrv2 , nodemanager)
+ NM gives wrong log message saying "Connected to ResourceManager" before trying to connect
+
+- MAPREDUCE-4252.
+ Major bug reported by Tom White and fixed by Tom White (mrv2)
+ MR2 job never completes with 1 pending task
+
+- MAPREDUCE-4250.
+ Major bug reported by Patrick Hunt and fixed by Patrick Hunt (nodemanager)
+ hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster
+
+- MAPREDUCE-4238.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ mavenize data_join
+
+- MAPREDUCE-4237.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ TestNodeStatusUpdater can fail if localhost has a domain associated with it
+
+- MAPREDUCE-4233.
+ Critical bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ NPE can happen in RMNMNodeInfo.
+
+- MAPREDUCE-4228.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (applicationmaster , mrv2)
+ mapreduce.job.reduce.slowstart.completedmaps is not working properly to delay the scheduling of the reduce tasks
+
+- MAPREDUCE-4226.
+ Major bug reported by Tom White and fixed by Tom White (mrv2)
+ ConcurrentModificationException in FileSystemCounterGroup
+
+- MAPREDUCE-4224.
+ Major bug reported by Devaraj K and fixed by Devaraj K (mrv2 , scheduler , test)
+ TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException
+
+- MAPREDUCE-4220.
+ Minor bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ RM apps page starttime/endtime sorts are incorrect
+
+- MAPREDUCE-4215.
+ Major bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ RM app page shows 500 error on appid parse error
+
+- MAPREDUCE-4212.
+ Major test reported by Daryn Sharp and fixed by Daryn Sharp (test)
+ TestJobClientGetJob sometimes fails
+
+- MAPREDUCE-4211.
+ Minor bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ Error conditions (missing appid, appid not found) are masked in the RM app page
+
+- MAPREDUCE-4210.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (webapps)
+ Expose listener address for WebApp
+
+- MAPREDUCE-4209.
+ Major bug reported by Radim Kolar and fixed by (build)
+ junit dependency in hadoop-mapreduce-client is missing scope test
+
+- MAPREDUCE-4206.
+ Minor bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ Sorting by Last Health-Update on the RM nodes page sorts does not work correctly
+
+- MAPREDUCE-4205.
+ Major improvement reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (mrv2)
+ retrofit all JVM shutdown hooks to use ShutdownHookManager
+
+- MAPREDUCE-4197.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash
+ Include the hsqldb jar in the hadoop-mapreduce tar file
+
+- MAPREDUCE-4194.
+ Major bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ ConcurrentModificationError in DirectoryCollection
+
+- MAPREDUCE-4190.
+ Major improvement reported by Thomas Graves and fixed by Thomas Graves (mrv2 , webapps)
+ Improve web UI for task attempts userlog link
+
+- MAPREDUCE-4189.
+ Critical bug reported by Devaraj K and fixed by Devaraj K (mrv2)
+ TestContainerManagerSecurity is failing
+
+- MAPREDUCE-4169.
+ Minor bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ Container Logs appear in unsorted order
+
+- MAPREDUCE-4165.
+ Trivial bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ Committing is misspelled as commiting in task logs
+
+- MAPREDUCE-4163.
+ Major sub-task reported by Daryn Sharp and fixed by Daryn Sharp (mrv2)
+ consistently set the bind address
+
+- MAPREDUCE-4162.
+ Major sub-task reported by Daryn Sharp and fixed by Daryn Sharp (client , mrv2)
+ Correctly set token service
+
+- MAPREDUCE-4161.
+ Major sub-task reported by Daryn Sharp and fixed by Daryn Sharp (client , mrv2)
+ create sockets consistently
+
+- MAPREDUCE-4160.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves (test)
+ some mrv1 ant tests fail with timeout - due to 4156
+
+- MAPREDUCE-4159.
+ Major bug reported by Nishan Shetty and fixed by Devaraj K (mrv2)
+ Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero
+
+- MAPREDUCE-4157.
+ Major improvement reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ ResourceManager should not kill apps that are well behaved
+
+- MAPREDUCE-4156.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves (build)
+ ant build fails compiling JobInProgress
+
+- MAPREDUCE-4152.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ map task left hanging after AM dies trying to connect to RM
+
+- MAPREDUCE-4151.
+ Major improvement reported by Jason Lowe and fixed by Jason Lowe (mrv2 , webapps)
+ RM scheduler web page should filter apps to those that are relevant to scheduling
+
+- MAPREDUCE-4148.
+ Major bug reported by Tom White and fixed by Tom White (mrv2)
+ MapReduce should not have a compile-time dependency on HDFS
+
+- MAPREDUCE-4146.
+ Major improvement reported by Tom White and fixed by Ahmed Radwan
+ Support limits on task status string length and number of block locations in branch-2
+
+- MAPREDUCE-4144.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ ResourceManager NPE while handling NODE_UPDATE
+
+- MAPREDUCE-4140.
+ Major bug reported by Patrick Hunt and fixed by Patrick Hunt (client , mrv2)
+ mapreduce classes incorrectly importing "clover.org.apache.*" classes
+
+- MAPREDUCE-4139.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ Potential ResourceManager deadlock when SchedulerEventDispatcher is stopped
+
+- MAPREDUCE-4134.
+ Major task reported by Ravi Prakash and fixed by Ravi Prakash (mrv2)
+ Remove references of mapred.child.ulimit etc. since they are not being used any more
+
+- MAPREDUCE-4133.
+ Major bug reported by John George and fixed by John George
+ MR over viewfs is broken
+
+- MAPREDUCE-4129.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (mrv2)
+ Lots of unneeded counters log messages
+
+- MAPREDUCE-4128.
+ Major bug reported by Bikas Saha and fixed by Bikas Saha (mrv2)
+ AM Recovery expects all attempts of a completed task to also be completed.
+
+- MAPREDUCE-4117.
+ Critical bug reported by Devaraj K and fixed by Devaraj K (client , mrv2)
+ mapred job -status throws NullPointerException
+
+- MAPREDUCE-4102.
+ Major bug reported by Thomas Graves and fixed by Bhallamudi Venkata Siva Kamesh (webapps)
+ job counters not available in Jobhistory webui for killed jobs
+
+- MAPREDUCE-4099.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (mrv2)
+ ApplicationMaster may fail to remove staging directory
+
+- MAPREDUCE-4097.
+ Major bug reported by Alejandro Abdelnur and fixed by Roman Shaposhnik (build)
+ tools testcases fail because missing mrapp-generated-classpath file in classpath
+
+- MAPREDUCE-4092.
+ Blocker bug reported by Jonathan Eagles and fixed by Jonathan Eagles (mrv2)
+ commitJob Exception does not fail job (regression in 0.23 vs 0.20)
+
+- MAPREDUCE-4091.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build , test)
+ tools testcases failing because of MAPREDUCE-4082
+
+- MAPREDUCE-4089.
+ Blocker bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ Hung Tasks never time out.
+
+- MAPREDUCE-4082.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
+ hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR
+
+- MAPREDUCE-4079.
+ Blocker improvement reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mr-am , mrv2)
+ Allow MR AppMaster to limit ephemeral port range.
+
+- MAPREDUCE-4074.
+ Major bug reported by Devaraj K and fixed by xieguiming
+ Client continuously retries to RM When RM goes down before launching Application Master
+
+- MAPREDUCE-4073.
+ Critical bug reported by Siddharth Seth and fixed by Siddharth Seth (mrv2 , scheduler)
+ CS assigns multiple off-switch containers when using multi-level-queues
+
+- MAPREDUCE-4072.
+ Major bug reported by Anupam Seth and fixed by Anupam Seth (mrv2)
+ User set java.library.path seems to overwrite default creating problems native lib loading
+ -Djava.library.path in mapred.child.java.opts can cause issues with native libraries. LD_LIBRARY_PATH through mapred.child.env should be used instead.
+- MAPREDUCE-4068.
+ Blocker bug reported by Ahmed Radwan and fixed by Robert Kanter (mrv2)
+ Jars in lib subdirectory of the submittable JAR are not added to the classpath
+
+- MAPREDUCE-4062.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ AM Launcher thread can hang forever
+
+- MAPREDUCE-4060.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (build)
+ Multiple SLF4J binding warning
+
+- MAPREDUCE-4059.
+ Major improvement reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ The history server should have a separate pluggable storage/query interface
+
+- MAPREDUCE-4053.
+ Major bug reported by Alejandro Abdelnur and fixed by Robert Joseph Evans (mrv2)
+ Counters group names deprecation is wrong, iterating over group names deprecated names don't show up
+
+- MAPREDUCE-4051.
+ Major task reported by Ravi Prakash and fixed by Ravi Prakash
+ Remove the empty hadoop-mapreduce-project/assembly/all.xml file
+
+- MAPREDUCE-4050.
+ Major bug reported by Bhallamudi Venkata Siva Kamesh and fixed by Bhallamudi Venkata Siva Kamesh (mrv2)
+ Invalid node link
+
+- MAPREDUCE-4048.
+ Major bug reported by Devaraj K and fixed by Devaraj K (mrv2)
+ NullPointerException exception while accessing the Application Master UI
+
+- MAPREDUCE-4040.
+ Minor bug reported by Bhallamudi Venkata Siva Kamesh and fixed by Bhallamudi Venkata Siva Kamesh (jobhistoryserver , mrv2)
+ History links should use hostname rather than IP address.
+
+- MAPREDUCE-4031.
+ Critical bug reported by Devaraj K and fixed by Devaraj K (mrv2 , nodemanager)
+ Node Manager hangs on shut down
+
+- MAPREDUCE-4024.
+ Major bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ RM webservices can't query on finalStatus
+
+- MAPREDUCE-4020.
+ Major bug reported by Jason Lowe and fixed by Anupam Seth (mrv2 , webapps)
+ Web services returns incorrect JSON for deep queue tree
+
+- MAPREDUCE-4017.
+ Trivial improvement reported by Koji Noguchi and fixed by Thomas Graves (jobhistoryserver , jobtracker)
+ Add jobname to jobsummary log
+ The Job Summary log may contain commas in values that are escaped by a '\' character. This was true before, but is more likely to be exposed now.
+- MAPREDUCE-4012.
+ Minor bug reported by Koji Noguchi and fixed by Thomas Graves
+ Hadoop Job setup error leaves no useful info to users (when LinuxTaskController is used)
+
+- MAPREDUCE-4010.
+ Critical bug reported by Jason Lowe and fixed by Alejandro Abdelnur (mrv2)
+ TestWritableJobConf fails on trunk
+
+- MAPREDUCE-4002.
+ Major bug reported by Bhallamudi Venkata Siva Kamesh and fixed by Bhallamudi Venkata Siva Kamesh (examples)
+ MultiFileWordCount job fails if the input path is not from default file system
+
+- MAPREDUCE-3999.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash (mrv2 , webapps)
+ Tracking link gives an error if the AppMaster hasn't started yet
+
+- MAPREDUCE-3993.
+ Major bug reported by Todd Lipcon and fixed by Karthik Kambatla (mrv1 , mrv2)
+ Graceful handling of codec errors during decompression
+
+- MAPREDUCE-3992.
+ Major bug reported by Todd Lipcon and fixed by Todd Lipcon (mrv1)
+ Reduce fetcher doesn't verify HTTP status code of response
+
+- MAPREDUCE-3988.
+ Major bug reported by Vinod Kumar Vavilapalli and fixed by Eric Payne (mrv2)
+ mapreduce.job.local.dir doesn't point to a single directory on a node.
+
+- MAPREDUCE-3983.
+ Major test reported by Robert Joseph Evans and fixed by Ravi Prakash (mrv1)
+ TestTTResourceReporting can fail, and should just be deleted
+
+- MAPREDUCE-3972.
+ Major sub-task reported by Robert Joseph Evans and fixed by Robert Joseph Evans (mrv2)
+ Locking and exception issues in JobHistory Server.
+
+- MAPREDUCE-3947.
+ Minor bug reported by Todd Lipcon and fixed by Devaraj K
+ yarn.app.mapreduce.am.resource.mb not documented
+
+- MAPREDUCE-3942.
+ Major sub-task reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli (mrv2 , security)
+ Randomize master key generation for ApplicationTokenSecretManager and roll it every so often
+
+- MAPREDUCE-3940.
+ Major sub-task reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli (mrv2 , security)
+ ContainerTokens should have an expiry interval
+ ContainerTokens now have an expiry interval so that stale tokens cannot be used for launching containers.
+- MAPREDUCE-3932.
+ Critical bug reported by Vinod Kumar Vavilapalli and fixed by Robert Joseph Evans (mr-am , mrv2)
+ MR tasks failing and crashing the AM when available-resources/headRoom becomes zero
+
+- MAPREDUCE-3927.
+ Critical bug reported by MengWang and fixed by Bhallamudi Venkata Siva Kamesh (mrv2)
+ Shuffle hang when set map.failures.percent
+
+- MAPREDUCE-3907.
+ Minor improvement reported by Eugene Koontz and fixed by Eugene Koontz (documentation)
+ Document entries mapred-default.xml for the jobhistory server.
+
+- MAPREDUCE-3906.
+ Trivial improvement reported by Eugene Koontz and fixed by Eugene Koontz (documentation)
+ Fix inconsistency in documentation regarding mapreduce.jobhistory.principal
+
+- MAPREDUCE-3893.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ allow capacity scheduler configs maximum-applications and maximum-am-resource-percent configurable on a per queue basis
+
+- MAPREDUCE-3889.
+ Critical bug reported by Thomas Graves and fixed by Devaraj K (mrv2)
+ job client tries to use /tasklog interface, but that doesn't exist anymore
+
+- MAPREDUCE-3873.
+ Minor bug reported by Nishan Shetty and fixed by xieguiming (mrv2 , nodemanager)
+ Nodemanager is not getting decommisioned if the absolute ip is given in exclude file.
+ Fixed NodeManagers' decommissioning at RM to accept IP addresses also.
+- MAPREDUCE-3871.
+ Major improvement reported by Tom White and fixed by Tom White (distributed-cache)
+ Allow symlinking in LocalJobRunner DistributedCache
+
+- MAPREDUCE-3870.
+ Major bug reported by Bhallamudi Venkata Siva Kamesh and fixed by Bhallamudi Venkata Siva Kamesh (mrv2)
+ Invalid App Metrics
+
+- MAPREDUCE-3850.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (security)
+ Avoid redundant calls for tokens in TokenCache
+
+- MAPREDUCE-3842.
+ Critical improvement reported by Alejandro Abdelnur and fixed by Thomas Graves (mrv2 , webapps)
+ stop webpages from automatic refreshing
+
+- MAPREDUCE-3812.
+ Major sub-task reported by Vinod Kumar Vavilapalli and fixed by Harsh J (mrv2 , performance)
+ Lower default allocation sizes, fix allocation configurations and document them
+ Removes two sets of previously available config properties:
+
+1. ( yarn.scheduler.fifo.minimum-allocation-mb and yarn.scheduler.fifo.maximum-allocation-mb ) and,
+2. ( yarn.scheduler.capacity.minimum-allocation-mb and yarn.scheduler.capacity.maximum-allocation-mb )
+
+In favor of two new, generically named properties:
+
+1. yarn.scheduler.minimum-allocation-mb - This acts as the floor value of memory resource requests for containers.
+2. yarn.scheduler.maximum-allocation-mb - This acts as the ceiling value of memory resource requests for containers.
+
+Both these properties need to be set at the ResourceManager (RM) to take effect, as the RM is where the scheduler resides.
+
+Also changes the default minimum and maximums to 128 MB and 10 GB respectively.
+- MAPREDUCE-3782.
+ Critical bug reported by Arpit Gupta and fixed by Jason Lowe (mrv2)
+ teragen terasort jobs fail when using webhdfs://
+
+- MAPREDUCE-3773.
+ Major new feature reported by Owen O'Malley and fixed by Owen O'Malley (jobtracker)
+ Add queue metrics with buckets for job run times
+
+- MAPREDUCE-3728.
+ Critical bug reported by Roman Shaposhnik and fixed by Giridharan Kesavan (mrv2 , nodemanager)
+ ShuffleHandler can't access results when configured in a secure mode
+
+- MAPREDUCE-3682.
+ Major bug reported by David Capwell and fixed by Ravi Prakash (mrv2)
+ Tracker URL says AM tasks run on localhost
+
+- MAPREDUCE-3672.
+ Major bug reported by Vinod Kumar Vavilapalli and fixed by Anupam Seth (mr-am , mrv2)
+ Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS
+
+- MAPREDUCE-3659.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (security)
+ Host-based token support
+
+- MAPREDUCE-3650.
+ Blocker bug reported by Thomas Graves and fixed by Ravi Prakash (mrv2)
+ testGetTokensForHftpFS() fails
+
+- MAPREDUCE-3621.
+ Major bug reported by Thomas Graves and fixed by Ravi Prakash (mrv2)
+ TestDBJob and TestDataDrivenDBInputFormat ant tests fail
+
+- MAPREDUCE-3613.
+ Critical sub-task reported by Thomas Graves and fixed by Thomas Graves (mrv2)
+ web service calls header contains 2 content types
+
+- MAPREDUCE-3543.
+ Critical bug reported by Mahadev konar and fixed by Thomas Graves (mrv2)
+ Mavenize Gridmix.
+ Note that to apply this you should first run the script - ./MAPREDUCE-3543v3.sh svn, then apply the patch.
+
+If this is merged to more then trunk, the version inside of hadoop-tools/hadoop-gridmix/pom.xml will need to be udpated accordingly.
+- MAPREDUCE-3506.
+ Minor bug reported by Ratandeep Ratti and fixed by Jason Lowe (client , mrv2)
+ Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException
+
+- MAPREDUCE-3493.
+ Minor bug reported by Ahmed Radwan and fixed by (mrv2)
+ Add the default mapreduce.shuffle.port property to mapred-default.xml
+
+- MAPREDUCE-3451.
+ Major new feature reported by Patrick Wendell and fixed by Patrick Wendell (mrv2 , scheduler)
+ Port Fair Scheduler to MR2
+
+- MAPREDUCE-3350.
+ Critical bug reported by Vinod Kumar Vavilapalli and fixed by Jonathan Eagles (mrv2 , webapps)
+ Per-app RM page should have the list of application-attempts like on the app JHS page
+
+- MAPREDUCE-3348.
+ Major bug reported by Devaraj K and fixed by Devaraj K (mrv2)
+ mapred job -status fails to give info even if the job is present in History
+ Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
+- MAPREDUCE-3289.
+ Major improvement reported by Todd Lipcon and fixed by Todd Lipcon (mrv2 , nodemanager , performance)
+ Make use of fadvise in the NM's shuffle handler
+
+- MAPREDUCE-3082.
+ Major bug reported by Rajit Saha and fixed by John George (harchive)
+ archive command take wrong path for input file with current directory
+
+- MAPREDUCE-2786.
+ Minor improvement reported by Plamen Jeliazkov and fixed by Plamen Jeliazkov (benchmarks)
+ TestDFSIO should also test compression reading/writing from command-line.
+
+- MAPREDUCE-2739.
+ Minor bug reported by Ahmed Radwan and fixed by Bo Wang (mrv2)
+ MR-279: Update installation docs (remove YarnClientFactory)
+
+- MAPREDUCE-2374.
+ Major bug reported by Todd Lipcon and fixed by Andy Isaacson
+ "Text File Busy" errors launching MR tasks
+
+- MAPREDUCE-2289.
+ Major bug reported by Todd Lipcon and fixed by Ahmed Radwan (job submission)
+ Permissions race can make getStagingDir fail on local filesystem
+
+- MAPREDUCE-2220.
+ Minor bug reported by Rui KUBO and fixed by Rui KUBO (documentation)
+ Fix new API FileOutputFormat-related typos in mapred-default.xml
+
+- MAPREDUCE-987.
+ Minor new feature reported by Philip Zeyliger and fixed by Ahmed Radwan (build , test)
+ Exposing MiniDFS and MiniMR clusters as a single process command-line
+
+- HDFS-3972.
+ Critical bug reported by Todd Lipcon and fixed by Todd Lipcon (name-node)
+ Trash emptier fails in secure HA cluster
+
+- HDFS-3928.
+ Major bug reported by Eli Collins and fixed by Eli Collins (test)
+ MiniDFSCluster should reset the first ExitException on shutdown
+
+- HDFS-3902.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson
+ TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken
+
+- HDFS-3895.
+ Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
+ hadoop-client must include commons-cli
+
+- HDFS-3890.
+ Critical bug reported by Thomas Graves and fixed by Thomas Graves
+ filecontext mkdirs doesn't apply umask as expected
+
+- HDFS-3888.
+ Minor bug reported by Jing Zhao and fixed by Jing Zhao
+ BlockPlacementPolicyDefault code cleanup
+
+- HDFS-3887.
+ Trivial improvement reported by Jing Zhao and fixed by Jing Zhao (name-node)
+ Remove redundant chooseTarget methods in BlockPlacementPolicy.java
+
+- HDFS-3879.
+ Minor bug reported by Eli Collins and fixed by Eli Collins (name-node)
+ Fix findbugs warning in TransferFsImage on branch-2
+
+- HDFS-3873.
+ Major bug reported by Daryn Sharp and fixed by Daryn Sharp (hdfs client)
+ Hftp assumes security is disabled if token fetch fails
+
+- HDFS-3871.
+ Minor improvement reported by Arun C Murthy and fixed by Arun C Murthy (hdfs client)
+ Change NameNodeProxies to use HADOOP-8748
+
+- HDFS-3866.
+ Minor improvement reported by Ryan Hennig and fixed by Plamen Jeliazkov (build)
+ HttpFS POM should have property where to download tomcat from
+
+- HDFS-3864.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (name-node)
+ NN does not update internal file mtime for OP_CLOSE when reading from the edit log
+
+- HDFS-3861.
+ Blocker bug reported by Kihwal Lee and fixed by Kihwal Lee (hdfs client)
+ Deadlock in DFSClient
+
+- HDFS-3860.
+ Major bug reported by Jing Zhao and fixed by Jing Zhao
+ HeartbeatManager#Monitor may wrongly hold the writelock of namesystem
+
+- HDFS-3856.
+ Blocker bug reported by Thomas Graves and fixed by Eli Collins (test)
+ TestHDFSServerPorts failure is causing surefire fork failure
+
+- HDFS-3853.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (name-node)
+ Port MiniDFSCluster enableManagedDfsDirsRedundancy option to branch-2
+
+- HDFS-3852.
+ Major bug reported by Aaron T. Myers and fixed by Daryn Sharp (hdfs client , security)
+ TestHftpDelegationToken is broken after HADOOP-8225
+
+- HDFS-3849.
+ Critical bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (name-node)
+ When re-loading the FSImage, we should clear the existing genStamp and leases.
+
+- HDFS-3844.
+ Trivial improvement reported by Jing Zhao and fixed by Jing Zhao
+ Add @Override where necessary and remove unnecessary {@inheritdoc} and imports
+
+- HDFS-3841.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ Port HDFS-3835 to branch-0.23
+
+- HDFS-3837.
+ Major bug reported by Eli Collins and fixed by Eli Collins (data-node)
+ Fix DataNode.recoverBlock findbugs warning
+
+- HDFS-3835.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (name-node , security)
+ Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens
+
+- HDFS-3833.
+ Major bug reported by Brandon Li and fixed by Brandon Li (test)
+ TestDFSShell fails on Windows due to file concurrent read write
+
+- HDFS-3832.
+ Major bug reported by Suresh Srinivas and fixed by Suresh Srinivas (data-node , name-node)
+ Remove protocol methods related to DistributedUpgrade
+
+- HDFS-3830.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ test_libhdfs_threaded: use forceNewInstance
+
+- HDFS-3819.
+ Minor improvement reported by Jing Zhao and fixed by Jing Zhao
+ Should check whether invalidate work percentage default value is not greater than 1.0f
+
+- HDFS-3816.
+ Major bug reported by Jing Zhao and fixed by Jing Zhao (name-node)
+ Invalidate work percentage default value should be 0.32f instead of 32
+
+- HDFS-3808.
+ Critical bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (fuse-dfs)
+ fuse_dfs: postpone libhdfs intialization until after fork
+
+- HDFS-3803.
+ Minor bug reported by Andrew Purtell and fixed by (data-node)
+ BlockPoolSliceScanner new work period notice is very chatty at INFO level
+
+- HDFS-3802.
+ Trivial improvement reported by Jing Zhao and fixed by Jing Zhao
+ StartupOption.name in HdfsServerConstants should be final
+
+- HDFS-3796.
+ Minor improvement reported by Todd Lipcon and fixed by Todd Lipcon (test)
+ Speed up edit log tests by avoiding fsync()
+
+- HDFS-3794.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash (webhdfs)
+ WebHDFS Open used with Offset returns the original (and incorrect) Content Length in the HTTP Header.
+
+- HDFS-3790.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (fuse-dfs)
+ test_fuse_dfs.c doesn't compile on centos 5
+
+- HDFS-3788.
+ Critical bug reported by Eli Collins and fixed by Tsz Wo (Nicholas), SZE (webhdfs)
+ distcp can't copy large files using webhdfs due to missing Content-Length header
+
+- HDFS-3765.
+ Major improvement reported by Vinay and fixed by Vinay (ha)
+ Namenode INITIALIZESHAREDEDITS should be able to initialize all shared storages
+
+- HDFS-3760.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson (hdfs client)
+ primitiveCreate is a write, not a read
+
+- HDFS-3758.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (fuse-dfs)
+ TestFuseDFS test failing
+
+- HDFS-3756.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured
+
+- HDFS-3755.
+ Major bug reported by Todd Lipcon and fixed by Todd Lipcon (name-node)
+ Creating an already-open-for-write file with overwrite=true fails
+
+- HDFS-3754.
+ Major bug reported by Eli Collins and fixed by Eli Collins (data-node)
+ BlockSender doesn't shutdown ReadaheadPool threads
+
+- HDFS-3738.
+ Minor bug reported by Aaron T. Myers and fixed by Aaron T. Myers (test)
+ TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config
+
+- HDFS-3733.
+ Major bug reported by Andy Isaacson and fixed by Andy Isaacson (webhdfs)
+ Audit logs should include WebHDFS access
+
+- HDFS-3732.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (fuse-dfs)
+ fuse_dfs: incorrect configuration value checked for connection expiry timer period
+
+- HDFS-3731.
+ Blocker bug reported by Suresh Srinivas and fixed by Kihwal Lee (data-node)
+ 2.0 release upgrade must handle blocks being written from 1.0
+
+- HDFS-3724.
+ Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
+ add InterfaceAudience annotations to HttpFS classes and making inner enum static
+
+- HDFS-3723.
+ Major improvement reported by E. Sammer and fixed by Jing Zhao (scripts , tools)
+ All commands should support meaningful --help
+
+- HDFS-3721.
+ Critical bug reported by Todd Lipcon and fixed by Aaron T. Myers (data-node , hdfs client)
+ hsync support broke wire compatibility
+
+- HDFS-3720.
+ Major bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ hdfs.h must get packaged
+
+- HDFS-3718.
+ Critical bug reported by Kihwal Lee and fixed by Kihwal Lee (data-node)
+ Datanode won't shutdown because of runaway DataBlockScanner thread
+
+- HDFS-3715.
+ Major bug reported by Eli Collins and fixed by Andrew Wang (test)
+ Fix TestFileCreation#testFileCreationNamenodeRestart
+
+- HDFS-3711.
+ Major improvement reported by Andrew Wang and fixed by Andrew Wang
+ Manually convert remaining tests to JUnit4
+
+- HDFS-3710.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson (libhdfs)
+ libhdfs misuses O_RDONLY/WRONLY/RDWR
+
+- HDFS-3709.
+ Major test reported by Eli Collins and fixed by Eli Collins (test)
+ TestStartup tests still binding to the ephemeral port
+
+- HDFS-3707.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ TestFSInputChecker: improper use of skip
+
+- HDFS-3697.
+ Minor improvement reported by Todd Lipcon and fixed by Todd Lipcon (data-node , performance)
+ Enable fadvise readahead by default
+ The datanode now performs 4MB readahead by default when reading data from its disks, if the native libraries are present. This has been shown to improve performance in many workloads. The feature may be disabled by setting dfs.datanode.readahead.bytes to "0".
+- HDFS-3696.
+ Critical bug reported by Kihwal Lee and fixed by Tsz Wo (Nicholas), SZE
+ Create files with WebHdfsFileSystem goes OOM when file size is big
+
+- HDFS-3690.
+ Major bug reported by Eli Collins and fixed by Eli Collins
+ BlockPlacementPolicyDefault incorrectly casts LOG
+
+- HDFS-3688.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (data-node)
+ Namenode loses datanode hostname if datanode re-registers
+
+- HDFS-3683.
+ Minor bug reported by Todd Lipcon and fixed by Plamen Jeliazkov (name-node)
+ Edit log replay progress indicator shows >100% complete
+
+- HDFS-3679.
+ Minor bug reported by Conrad Meyer and fixed by Conrad Meyer (fuse-dfs)
+ fuse_dfs notrash option sets usetrash
+
+- HDFS-3675.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ libhdfs: follow documented return codes
+
+- HDFS-3673.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ libhdfs: fix some compiler warnings
+
+- HDFS-3672.
+ Major improvement reported by Andrew Wang and fixed by Andrew Wang
+ Expose disk-location information for blocks to enable better scheduling
+
+- HDFS-3666.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins
+ Plumb more exception messages to terminate
+
+- HDFS-3665.
+ Major test reported by Eli Collins and fixed by Eli Collins (test)
+ Add a test for renaming across file systems via a symlink
+
+- HDFS-3664.
+ Major bug reported by Eli Collins and fixed by Colin Patrick McCabe (test)
+ BlockManager race when stopping active services
+
+- HDFS-3663.
+ Major improvement reported by Eli Collins and fixed by Eli Collins (test)
+ MiniDFSCluster should capture the code path that led to the first ExitException
+
+- HDFS-3658.
+ Major bug reported by Eli Collins and fixed by Tsz Wo (Nicholas), SZE
+ TestDFSClientRetries#testNamenodeRestart failed
+
+- HDFS-3650.
+ Major improvement reported by Andrew Wang and fixed by Andrew Wang
+ Use MutableQuantiles to provide latency histograms for various operations
+
+- HDFS-3646.
+ Critical bug reported by Kihwal Lee and fixed by Kihwal Lee (hdfs client)
+ LeaseRenewer can hold reference to inactive DFSClient instances forever
+
+- HDFS-3641.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins
+ Move server Util time methods to common and use now instead of System#currentTimeMillis
+
+- HDFS-3637.
+ Major new feature reported by Aaron T. Myers and fixed by Aaron T. Myers (data-node , hdfs client , security)
+ Add support for encrypting the DataTransferProtocol
+
+- HDFS-3634.
+ Minor test reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (fuse-dfs)
+ Add self-contained, mavenized fuse_dfs test
+
+- HDFS-3633.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE
+
+- HDFS-3629.
+ Trivial bug reported by Brandon Li and fixed by Brandon Li (name-node)
+ fix the typo in the error message about inconsistent storage layout version
+
+- HDFS-3622.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ Backport HDFS-3541 to branch-0.23
+
+- HDFS-3615.
+ Major bug reported by Eli Collins and fixed by Aaron T. Myers (security)
+ Two BlockTokenSecretManager findbugs warnings
+
+- HDFS-3613.
+ Trivial improvement reported by Harsh J and fixed by Andrew Wang (name-node)
+ GSet prints some INFO level values, which aren't really very useful to all
+
+- HDFS-3612.
+ Trivial improvement reported by Harsh J and fixed by Andy Isaacson (name-node)
+ Single namenode image directory config warning can be improved
+
+- HDFS-3611.
+ Trivial bug reported by Harsh J and fixed by Colin Patrick McCabe (name-node)
+ NameNode prints unnecessary WARNs about edit log normally skipping a few bytes
+
+- HDFS-3610.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ fuse_dfs: Provide a way to use the default (configured) NN URI
+
+- HDFS-3609.
+ Major bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ libhdfs: don't force the URI to look like hdfs://hostname:port
+
+- HDFS-3608.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ fuse_dfs: detect changes in UID ticket cache
+
+- HDFS-3606.
+ Minor test reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ libhdfs: create self-contained unit test
+
+- HDFS-3605.
+ Major bug reported by Brahma Reddy Battula and fixed by Todd Lipcon (ha , name-node)
+ Block mistakenly marked corrupt during edit log catchup phase of failover
+
+- HDFS-3604.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins
+ Add dfs.webhdfs.enabled to hdfs-default.xml
+
+- HDFS-3603.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (test)
+ Decouple TestHDFSTrash from TestTrash
+
+- HDFS-3597.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson
+ SNN can fail to start on upgrade
+
+- HDFS-3591.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ Backport HDFS-3357 to branch-0.23
+
+- HDFS-3583.
+ Major improvement reported by Eli Collins and fixed by Andrew Wang (test)
+ Convert remaining tests to Junit4
+
+- HDFS-3582.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins (test)
+ Hook daemon process exit for testing
+
+- HDFS-3581.
+ Major bug reported by Eli Collins and fixed by Eli Collins (name-node)
+ FSPermissionChecker#checkPermission sticky bit check missing range check
+
+- HDFS-3580.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson
+ incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK
+
+- HDFS-3579.
+ Major bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (libhdfs)
+ libhdfs: fix exception handling
+
+- HDFS-3577.
+ Blocker bug reported by Alejandro Abdelnur and fixed by Tsz Wo (Nicholas), SZE (hdfs client)
+ WebHdfsFileSystem can not read files larger than 24KB
+
+- HDFS-3575.
+ Minor bug reported by Brock Noland and fixed by Brock Noland
+ HttpFS does not log Exception Stacktraces
+
+- HDFS-3574.
+ Minor bug reported by Todd Lipcon and fixed by Todd Lipcon (name-node)
+ Fix small race and do some cleanup in GetImageServlet
+
+- HDFS-3572.
+ Minor bug reported by Todd Lipcon and fixed by Todd Lipcon (name-node , security)
+ Cleanup code which inits SPNEGO in HttpServer
+
+- HDFS-3568.
+ Major improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ fuse_dfs: add support for security
+
+- HDFS-3559.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ DFSTestUtil: use Builder class to construct DFSTestUtil instances
+
+- HDFS-3555.
+ Major bug reported by Jeff Lord and fixed by Andy Isaacson (data-node , hdfs client)
+ idle client socket triggers DN ERROR log (should be INFO or DEBUG)
+
+- HDFS-3551.
+ Major bug reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (webhdfs)
+ WebHDFS CREATE does not use client location for redirection
+
+- HDFS-3548.
+ Critical bug reported by Todd Lipcon and fixed by Colin Patrick McCabe (name-node)
+ NamenodeFsck.copyBlock fails to create a Block Reader
+
+- HDFS-3541.
+ Major bug reported by suja s and fixed by Vinay (data-node)
+ Deadlock between recovery, xceiver and packet responder
+
+- HDFS-3539.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ libhdfs code cleanups
+
+- HDFS-3537.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (fuse-dfs , libhdfs)
+ Move libhdfs and fuse-dfs source to native subdirectories
+
+- HDFS-3535.
+ Major new feature reported by Andy Isaacson and fixed by Andy Isaacson (name-node)
+ Audit logging should log denied accesses
+
+- HDFS-3531.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (name-node)
+ EditLogFileOutputStream#preallocate should check for incomplete writes
+
+- HDFS-3524.
+ Major bug reported by Eli Collins and fixed by Brandon Li (test)
+ TestFileLengthOnClusterRestart failed due to error message change
+
+- HDFS-3522.
+ Major bug reported by Brandon Li and fixed by Brandon Li (name-node)
+ If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations
+ getBlockLocations(), and hence open() for read, will now throw SafeModeException if the NameNode is still in safe mode and there are no replicas reported yet for one of the blocks in the file.
+- HDFS-3520.
+ Major improvement reported by Eli Collins and fixed by Eli Collins (name-node)
+ Add transfer rate logging to TransferFsImage
+
+- HDFS-3518.
+ Major bug reported by Bikas Saha and fixed by Tsz Wo (Nicholas), SZE (hdfs client)
+ Provide API to check HDFS operational state
+ Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
+- HDFS-3517.
+ Minor bug reported by Eli Collins and fixed by Eli Collins (test)
+ TestStartup should bind ephemeral ports
+
+- HDFS-3516.
+ Major improvement reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (hdfs client)
+ Check content-type in WebHdfsFileSystem
+
+- HDFS-3514.
+ Major improvement reported by Henry Robinson and fixed by Henry Robinson (test)
+ Add missing TestParallelLocalRead
+
+- HDFS-3513.
+ Major improvement reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
+ HttpFS should cache filesystems
+
+- HDFS-3505.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ DirectoryScanner does not join all threads in shutdown
+
+- HDFS-3504.
+ Major improvement reported by Siddharth Seth and fixed by Tsz Wo (Nicholas), SZE
+ Configurable retry in DFSClient
+
+- HDFS-3502.
+ Major sub-task reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (name-node)
+ Change INodeFile and INodeFileUnderConstruction to package private
+
+- HDFS-3501.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (ha , name-node)
+ Checkpointing with security enabled will stop working after ticket lifetime expires
+
+- HDFS-3491.
+ Major bug reported by Romain Rigaux and fixed by Alejandro Abdelnur
+ HttpFs does not set permissions correctly
+
+- HDFS-3490.
+ Minor bug reported by Todd Lipcon and fixed by Tsz Wo (Nicholas), SZE (webhdfs)
+ DN WebHDFS methods throw NPE if Namenode RPC address param not specified
+
+- HDFS-3487.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (tools)
+ offlineimageviewer should give byte offset information when it encounters an exception
+
+- HDFS-3486.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (security , tools)
+ offlineimageviewer can't read fsimage files that contain persistent delegation tokens
+
+- HDFS-3485.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson
+ DataTransferThrottler will over-throttle when currentTimeMillis jumps
+
+- HDFS-3484.
+ Minor bug reported by Aaron T. Myers and fixed by Aaron T. Myers (hdfs client)
+ hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured
+
+- HDFS-3481.
+ Major improvement reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
+ Refactor HttpFS handling of JAX-RS query string parameters
+
+- HDFS-3480.
+ Major bug reported by Eli Collins and fixed by Vinay (build)
+ Multiple SLF4J binding warning
+
+- HDFS-3475.
+ Trivial improvement reported by Harsh J and fixed by Harsh J
+ Make the replication and invalidation rates configurable
+ This change adds two new configuration parameters.
+# {{dfs.namenode.invalidate.work.pct.per.iteration}} for controlling deletion rate of blocks.
+# {{dfs.namenode.replication.work.multiplier.per.iteration}} for controlling replication rate. This in turn allows controlling the time it takes for decommissioning.
+
+Please see hdfs-default.xml for detailed description.
+- HDFS-3474.
+ Major sub-task reported by Ivan Kelly and fixed by Ivan Kelly
+ Cleanup Exception handling in BookKeeper journal manager
+
+- HDFS-3469.
+ Minor bug reported by Vinay and fixed by Vinay (auto-failover)
+ start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly.
+
+- HDFS-3468.
+ Major sub-task reported by Uma Maheswara Rao G and fixed by Uma Maheswara Rao G
+ Make BKJM-ZK session timeout configurable.
+
+- HDFS-3466.
+ Major bug reported by Owen O'Malley and fixed by Owen O'Malley (name-node , security)
+ The SPNEGO filter for the NameNode should come out of the web keytab file
+
+- HDFS-3460.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
+ HttpFS proxyuser validation with Kerberos ON uses full principal name
+
+- HDFS-3454.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins (balancer)
+ Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled
+
+- HDFS-3452.
+ Blocker sub-task reported by suja s and fixed by Uma Maheswara Rao G
+ BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock
+
+- HDFS-3446.
+ Major bug reported by Matthew Jacobs and fixed by Matthew Jacobs (name-node)
+ HostsFileReader silently ignores bad includes/excludes
+ HDFS no longer silently ignores missing or unreadable host files specified by dfs.hosts or dfs.hosts.exclude. In order to specify that no hosts should be included or excluded, administrators should either refrain from setting the relevant config properties, or create an empty file in order to represent an empty list.
+- HDFS-3444.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (hdfs client)
+ hdfs groups command doesn't work with security enabled
+
+- HDFS-3442.
+ Minor bug reported by suja s and fixed by Andrew Wang
+ Incorrect count for Missing Replicas in FSCK report
+
+- HDFS-3441.
+ Major sub-task reported by suja s and fixed by Rakesh R
+ Race condition between rolling logs at active NN and purging at standby
+
+- HDFS-3440.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ should more effectively limit stream memory consumption when reading corrupt edit logs
+
+- HDFS-3438.
+ Major improvement reported by Todd Lipcon and fixed by Todd Lipcon (ha)
+ BootstrapStandby should not require a rollEdits on active node
+
+- HDFS-3436.
+ Major bug reported by Brahma Reddy Battula and fixed by Vinay (data-node)
+ adding new datanode to existing pipeline fails in case of Append/Recovery
+
+- HDFS-3433.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (name-node)
+ GetImageServlet should allow administrative requestors when security is enabled
+
+- HDFS-3428.
+ Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ move DelegationTokenRenewer to common
+
+- HDFS-3423.
+ Major sub-task reported by Rakesh R and fixed by Ivan Kelly
+ BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes
+
+- HDFS-3422.
+ Minor bug reported by Todd Lipcon and fixed by Todd Lipcon (test)
+ TestStandbyIsHot timeouts too aggressive
+
+- HDFS-3419.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins
+ Cleanup LocatedBlock
+
+- HDFS-3417.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins (data-node)
+ Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode
+
+- HDFS-3416.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins (data-node)
+ Cleanup DatanodeID and DatanodeRegistration constructors used by testing
+
+- HDFS-3415.
+ Major bug reported by Brahma Reddy Battula and fixed by Brandon Li (name-node)
+ During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are different
+
+- HDFS-3414.
+ Minor bug reported by Aaron T. Myers and fixed by Aaron T. Myers (balancer)
+ Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs
+
+- HDFS-3413.
+ Critical bug reported by Todd Lipcon and fixed by Aaron T. Myers (ha , test)
+ TestFailureToReadEdits timing out
+
+- HDFS-3408.
+ Minor sub-task reported by Rakesh R and fixed by Rakesh R (name-node)
+ BKJM : Namenode format fails, if there is no BK root
+
+- HDFS-3404.
+ Major improvement reported by Aaron T. Myers and fixed by Aaron T. Myers
+ Make putImage in GetImageServlet infer remote address to fetch from request
+
+- HDFS-3401.
+ Major improvement reported by Eli Collins and fixed by Eli Collins (data-node , test)
+ Cleanup DatanodeDescriptor creation in the tests
+
+- HDFS-3400.
+ Major improvement reported by Aaron T. Myers and fixed by Aaron T. Myers (data-node , scripts)
+ DNs should be able start with jsvc even if security is disabled
+
+- HDFS-3398.
+ Minor bug reported by Brahma Reddy Battula and fixed by amith (hdfs client)
+ Client will not retry when primaryDN is down once it's just got pipeline
+
+- HDFS-3394.
+ Minor improvement reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (name-node)
+ Do not use generic in INodeFile.getLastBlock()
+
+- HDFS-3391.
+ Critical bug reported by Arun C Murthy and fixed by Todd Lipcon
+ TestPipelinesFailover#testLeaseRecoveryAfterFailover is failing
+
+- HDFS-3390.
+ Minor improvement reported by Aaron T. Myers and fixed by Aaron T. Myers (hdfs client)
+ DFSAdmin should print full stack traces of errors when DEBUG logging is enabled
+
+- HDFS-3389.
+ Major sub-task reported by Uma Maheswara Rao G and fixed by Uma Maheswara Rao G (name-node)
+ Document the BKJM usage in Namenode HA.
+
+- HDFS-3385.
+ Major bug reported by Brahma Reddy Battula and fixed by Tsz Wo (Nicholas), SZE (name-node)
+ ClassCastException when trying to append a file
+
+- HDFS-3372.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (tools)
+ offlineEditsViewer should be able to read a binary edits file with recovery mode
+
+- HDFS-3369.
+ Minor sub-task reported by John George and fixed by John George (name-node)
+ change variable names referring to inode in blockmanagement to more appropriate
+
+- HDFS-3368.
+ Major bug reported by Konstantin Shvachko and fixed by Konstantin Shvachko (name-node)
+ Missing blocks due to bad DataNodes coming up and down.
+
+- HDFS-3359.
+ Critical bug reported by Todd Lipcon and fixed by Todd Lipcon (hdfs client)
+ DFSClient.close should close cached sockets
+
+- HDFS-3341.
+ Minor improvement reported by Todd Lipcon and fixed by Todd Lipcon
+ Change minimum RPC versions to 2.0.0-SNAPSHOT instead of 2.0.0
+
+- HDFS-3335.
+ Major improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ check for edit log corruption at the end of the log
+
+- HDFS-3334.
+ Major bug reported by Daryn Sharp and fixed by Daryn Sharp (hdfs client)
+ ByteRangeInputStream leaks streams
+
+- HDFS-3331.
+ Major bug reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (name-node)
+ setBalancerBandwidth do not checkSuperuserPrivilege
+
+- HDFS-3321.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash
+ Error message for insufficient data nodes to come out of safemode is wrong.
+
+- HDFS-3318.
+ Blocker bug reported by Daryn Sharp and fixed by Daryn Sharp (hdfs client)
+ Hftp hangs on transfers >2GB
+
+- HDFS-3312.
+ Blocker bug reported by Daryn Sharp and fixed by Daryn Sharp (hdfs client)
+ Hftp selects wrong token service
+
+- HDFS-3308.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (webhdfs)
+ hftp/webhdfs can't get tokens if authority has no port
+
+- HDFS-3306.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ fuse_dfs: don't lock release operations
+
+- HDFS-3291.
+ Major test reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
+ add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem
+
+- HDFS-3276.
+ Minor improvement reported by Vinithra Varadharajan and fixed by Todd Lipcon (ha , name-node)
+ initializeSharedEdits should have a -nonInteractive flag
+
+- HDFS-3266.
+ Minor bug reported by Aaron T. Myers and fixed by madhukara phatak
+ DFSTestUtil#waitCorruptReplicas doesn't sleep between checks
+
+- HDFS-3258.
+ Major test reported by Eli Collins and fixed by Junping Du (test)
+ Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node)
+
+- HDFS-3243.
+ Major bug reported by Todd Lipcon and fixed by Henry Robinson (hdfs client , test)
+ TestParallelRead timing out on jenkins
+
+- HDFS-3235.
+ Minor bug reported by Henry Robinson and fixed by Henry Robinson
+ MiniDFSClusterManager doesn't correctly support -format option
+
+- HDFS-3230.
+ Minor improvement reported by Eli Collins and fixed by Eli Collins (test)
+ Cleanup DatanodeID creation in the tests
+
+- HDFS-3194.
+ Major bug reported by suja s and fixed by Andy Isaacson (data-node)
+ DataNode block scanner is running too frequently
+
+- HDFS-3190.
+ Minor sub-task reported by Todd Lipcon and fixed by Todd Lipcon (name-node)
+ Simple refactors in existing NN code to assist QuorumJournalManager extension
+
+- HDFS-3177.
+ Major bug reported by Kihwal Lee and fixed by Kihwal Lee (data-node , hdfs client)
+ Allow DFSClient to find out and use the CRC type being used for a file.
+
+- HDFS-3176.
+ Major bug reported by Kihwal Lee and fixed by Kihwal Lee (hdfs client)
+ JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own.
+
+- HDFS-3170.
+ Major improvement reported by Todd Lipcon and fixed by Matthew Jacobs (data-node)
+ Add more useful metrics for write latency
+
+- HDFS-3168.
+ Major sub-task reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (name-node)
+ Clean up FSNamesystem and BlockManager
+
+- HDFS-3166.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (hdfs client)
+ Hftp connections do not have a timeout
+
+- HDFS-3157.
+ Major bug reported by J.Andreina and fixed by Ashish Singhi (name-node)
+ Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened
+
+- HDFS-3150.
+ Major new feature reported by Eli Collins and fixed by Eli Collins (data-node , hdfs client)
+ Add option for clients to contact DNs via hostname
+
+- HDFS-3136.
+ Major bug reported by Jason Lowe and fixed by Jason Lowe (build)
+ Multiple SLF4J binding warning
+
+- HDFS-3134.
+ Major improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (name-node)
+ Harden edit log loader against malformed or malicious input
+
+- HDFS-3113.
+ Major new feature reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur
+ httpfs does not support delegation tokens
+
+- HDFS-3110.
+ Major improvement reported by Henry Robinson and fixed by Henry Robinson (libhdfs , performance)
+ libhdfs implementation of direct read API
+ libhdfs is enhanced to read directly into user-supplied buffers when possible, reducing the number of memory copies.
+- HDFS-3067.
+ Major bug reported by Henry Robinson and fixed by Henry Robinson (hdfs client)
+ NPE in DFSInputStream.readBuffer if read is repeated on corrupted block
+
+- HDFS-3058.
+ Major sub-task reported by Ivan Kelly and fixed by Ivan Kelly
+ HA: Bring BookKeeperJournalManager up to date with HA changes
+
+- HDFS-3054.
+ Major bug reported by patrick white and fixed by Colin Patrick McCabe (tools)
+ distcp -skipcrccheck has no effect
+
+- HDFS-3048.
+ Major bug reported by Eli Collins and fixed by Andy Isaacson (name-node)
+ Small race in BlockManager#close
+
+- HDFS-3042.
+ Major new feature reported by Todd Lipcon and fixed by Todd Lipcon (auto-failover , ha)
+ Automatic failover support for NN HA
+
+- HDFS-3040.
+ Trivial improvement reported by Aaron T. Myers and fixed by madhukara phatak (test)
+ TestMulitipleNNDataBlockScanner is misspelled
+
+- HDFS-3037.
+ Minor bug reported by Aaron T. Myers and fixed by Aaron T. Myers (test)
+ TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy
+
+- HDFS-3031.
+ Major bug reported by Stephen Chu and fixed by Todd Lipcon (ha)
+ HA: Error (failed to close file) when uploading large file + kill active NN + manual failover
+
+- HDFS-3002.
+ Trivial improvement reported by Suresh Srinivas and fixed by Suresh Srinivas (test)
+ TestNameNodeMetrics need not wait for metrics update with new metrics framework
+
+- HDFS-2988.
+ Minor improvement reported by Todd Lipcon and fixed by Miomir Boljanovic (name-node)
+ Improve error message when storage directory lock fails
+
+- HDFS-2982.
+ Critical bug reported by Todd Lipcon and fixed by Colin Patrick McCabe (name-node)
+ Startup performance suffers when there are many edit log segments
+
+- HDFS-2978.
+ Major new feature reported by Aaron T. Myers and fixed by Aaron T. Myers (name-node)
+ The NameNode should expose name dir statuses via JMX
+
+- HDFS-2966.
+ Minor bug reported by Steve Loughran and fixed by Steve Loughran (test)
+ TestNameNodeMetrics tests can fail under load
+
+- HDFS-2963.
+ Minor bug reported by J.Andreina and fixed by Andrew Wang
+ Console Output is confusing while executing metasave (dfsadmin command)
+
+- HDFS-2914.
+ Major bug reported by Hari Mankude and fixed by Vinay (ha , name-node)
+ HA: Standby should not enter safemode when resources are low
+
+- HDFS-2885.
+ Major improvement reported by Eli Collins and fixed by Tsz Wo (Nicholas), SZE (name-node)
+ Remove "federation" from the nameservice config options
+
+- HDFS-2834.
+ Major improvement reported by Henry Robinson and fixed by Henry Robinson (hdfs client , performance)
+ ByteBuffer-based read API for DFSInputStream
+
+- HDFS-2800.
+ Major bug reported by Aaron T. Myers and fixed by Todd Lipcon (ha , test)
+ HA: TestStandbyCheckpoints.testCheckpointCancellation is racy
+
+- HDFS-2797.
+ Major bug reported by Aaron T. Myers and fixed by Colin Patrick McCabe (ha , name-node)
+ Fix misuses of InputStream#skip in the edit log code
+
+- HDFS-2793.
+ Major new feature reported by Aaron T. Myers and fixed by Todd Lipcon (name-node)
+ Add an admin command to trigger an edit log roll
+ Introduced a new command, "hdfs dfsadmin -rollEdits" which requests that the active NameNode roll its edit log. This can be useful for administrators manually backing up log segments.
+- HDFS-2759.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (ha , name-node)
+ Pre-allocate HDFS edit log files after writing version number
+
+- HDFS-2757.
+ Major bug reported by Jean-Daniel Cryans and fixed by Jean-Daniel Cryans
+ Cannot read a local block that's being written to when using the local read short circuit
+
+- HDFS-2727.
+ Minor improvement reported by Sho Shimauchi and fixed by Colin Patrick McCabe (libhdfs)
+ libhdfs should get the default block size from the server
+ libhdfs now uses the server block size configuration rather than the deprecated dfs.block.size client configuration.
+- HDFS-2717.
+ Major sub-task reported by Ivan Kelly and fixed by Ivan Kelly
+ BookKeeper Journal output stream doesn't check addComplete rc
+
+- HDFS-2686.
+ Major improvement reported by Todd Lipcon and fixed by Suresh Srinivas (data-node , name-node)
+ Remove DistributedUpgrade related code
+ This jira removes functionality that has not been used/applicable since release 0.17. The incompatibility introduced by this change will not affect any HDFS users.
+- HDFS-2652.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp
+ Port token service changes from 205
+
+- HDFS-2619.
+ Major bug reported by Owen O'Malley and fixed by Owen O'Malley (build)
+ Remove my personal email address from the libhdfs build file.
+
+- HDFS-2617.
+ Major improvement reported by Jakob Homan and fixed by Jakob Homan (security)
+ Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution
+ Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true".
+- HDFS-2421.
+ Major improvement reported by Hairong Kuang and fixed by Jing Zhao (name-node)
+ Improve the concurrency of SerialNumberMap in NameNode
+
+- HDFS-2391.
+ Major improvement reported by Rajit Saha and fixed by Harsh J (balancer)
+ Newly set BalancerBandwidth value is not displayed anywhere
+
+- HDFS-2330.
+ Major sub-task reported by Uma Maheswara Rao G and fixed by Uma Maheswara Rao G (name-node)
+ In NNStorage.java, IOExceptions of stream closures can mask root exceptions.
+
+- HDFS-2285.
+ Major bug reported by Konstantin Shvachko and fixed by Konstantin Shvachko (name-node)
+ BackupNode should reject requests trying to modify namespace
+
+- HDFS-2025.
+ Minor bug reported by sravankorumilli and fixed by Ashish Singhi (data-node)
+ Go Back to File View link is not working in tail.jsp
+
+- HDFS-1490.
+ Minor bug reported by Dmytro Molkov and fixed by Vinay (name-node)
+ TransferFSImage should timeout
+
+- HDFS-1249.
+ Minor bug reported by matsusaka kentaro and fixed by Colin Patrick McCabe (fuse-dfs)
+ with fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error.
+
+- HDFS-1153.
+ Minor bug reported by Ravi Phulari and fixed by Ravi Phulari (data-node)
+ dfsnodelist.jsp should handle invalid input parameters
+
+- HDFS-1013.
+ Minor improvement reported by Todd Lipcon and fixed by Eugene Koontz
+ Miscellaneous improvements to HTML markup for web UIs
+
+- HDFS-799.
+ Major improvement reported by Christian Kunz and fixed by Colin Patrick McCabe
+ libhdfs must call DetachCurrentThread when a thread is destroyed
+
+- HDFS-766.
+ Minor bug reported by Ravi Phulari and fixed by Jon Zuanich
+ Error message not clear for set space quota out of boundary values.
+
+- HDFS-744.
+ Major new feature reported by Hairong Kuang and fixed by Lars Hofhansl (data-node , hdfs client)
+ Support hsync in HDFS
+
+- HDFS-711.
+ Major bug reported by freestyler and fixed by Colin Patrick McCabe (documentation)
+ hdfsUtime does not handle atime = 0 or mtime = 0 correctly
+
+- HDFS-470.
+ Minor bug reported by Pete Wyckoff and fixed by Colin Patrick McCabe
+ libhdfs should handle 0-length reads from FSInputStream correctly
+
+- HADOOP-8801.
+ Major bug reported by Eli Collins and fixed by Eli Collins
+ ExitUtil#terminate should capture the exception stack trace
+
+- HADOOP-8794.
+ Major bug reported by Vinod Kumar Vavilapalli and fixed by Vinod Kumar Vavilapalli
+ Modifiy bin/hadoop to point to HADOOP_YARN_HOME
+
+- HADOOP-8781.
+ Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (scripts)
+ hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH
+
+- HADOOP-8775.
+ Major bug reported by Sandy Ryza and fixed by Sandy Ryza
+ MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete
+
+- HADOOP-8770.
+ Blocker bug reported by Todd Lipcon and fixed by Eli Collins (trash)
+ NN should not RPC to self to find trash defaults (causes deadlock)
+
+- HADOOP-8766.
+ Major bug reported by Eli Collins and fixed by Colin Patrick McCabe (test)
+ FileContextMainOperationsBaseTest should randomize the root dir
+
+- HADOOP-8764.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (build)
+ CMake: HADOOP-8737 broke ARM build
+
+- HADOOP-8754.
+ Minor improvement reported by Brandon Li and fixed by Brandon Li (ipc)
+ Deprecate all the RPC.getServer() variants
+
+- HADOOP-8749.
+ Major bug reported by Ahmed Radwan and fixed by Ahmed Radwan (conf)
+ HADOOP-8031 changed the way in which relative xincludes are handled in Configuration.
+
+- HADOOP-8748.
+ Minor improvement reported by Arun C Murthy and fixed by Arun C Murthy (io)
+ Move dfsclient retry to a util class
+
+- HADOOP-8747.
+ Major bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (native)
+ Syntax error on cmake version 2.6 patch 2 in JNIFlags.cmake
+
+- HADOOP-8738.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
+ junit JAR is showing up in the distro
+
+- HADOOP-8737.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (native)
+ cmake: always use JAVA_HOME to find libjvm.so, jni.h, jni_md.h
+
+- HADOOP-8727.
+ Major bug reported by Harsh J and fixed by Harsh J (conf)
+ Gracefully deprecate dfs.umaskmode in 2.x onwards
+
+- HADOOP-8726.
+ Major bug reported by Benoy Antony and fixed by Daryn Sharp (security)
+ The Secrets in Credentials are not available to MR tasks
+
+- HADOOP-8725.
+ Blocker bug reported by Daryn Sharp and fixed by Daryn Sharp (security)
+ MR is broken when security is off
+
+- HADOOP-8722.
+ Minor bug reported by Eli Collins and fixed by Colin Patrick McCabe (documentation)
+ Update BUILDING.txt with latest snappy info
+
+- HADOOP-8721.
+ Critical bug reported by suja s and fixed by Vinay (auto-failover , ha)
+ ZKFC should not retry 45 times when attempting a graceful fence during a failover
+
+- HADOOP-8720.
+ Trivial bug reported by Vlad Rozov and fixed by Vlad Rozov (test)
+ TestLocalFileSystem should use test root subdirectory
+
+- HADOOP-8710.
+ Major improvement reported by Eli Collins and fixed by Eli Collins (fs)
+ Remove ability for users to easily run the trash emptier
+ The trash emptier may no longer be run using "hadoop org.apache.hadoop.fs.Trash". The trash emptier runs on the NameNode (if configured). Old trash checkpoints may be deleted using "hadoop fs -expunge".
+- HADOOP-8709.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (fs)
+ globStatus changed behavior from 0.20/1.x
+
+- HADOOP-8703.
+ Major bug reported by Dave Thompson and fixed by Dave Thompson
+ distcpV2: turn CRC checking off for 0 byte size
+ distcp skips CRC on 0 byte files.
+- HADOOP-8700.
+ Minor improvement reported by Tsz Wo (Nicholas), SZE and fixed by Tsz Wo (Nicholas), SZE (util)
+ Move the checksum type constants to an enum
+
+- HADOOP-8699.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (test)
+ some common testcases create core-site.xml in test-classes making other testcases to fail
+
+- HADOOP-8697.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (test)
+ TestWritableName fails intermittently with JDK7
+
+- HADOOP-8695.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (test)
+ TestPathData fails intermittently with JDK7
+
+- HADOOP-8693.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (test)
+ TestSecurityUtil fails intermittently with JDK7
+
+- HADOOP-8692.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (test)
+ TestLocalDirAllocator fails intermittently with JDK7
+
+- HADOOP-8689.
+ Major improvement reported by Eli Collins and fixed by Eli Collins (fs)
+ Make trash a server side configuration option
+ If fs.trash.interval is configured on the server then the client's value for this configuration is ignored.
+- HADOOP-8686.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (native)
+ Fix warnings in native code
+
+- HADOOP-8660.
+ Major bug reported by Eli Collins and fixed by Alejandro Abdelnur
+ TestPseudoAuthenticator failing with NPE
+
+- HADOOP-8659.
+ Major bug reported by Trevor Robinson and fixed by Colin Patrick McCabe (native)
+ Native libraries must build with soft-float ABI for Oracle JVM on ARM
+
+- HADOOP-8655.
+ Major bug reported by Arun A K and fixed by (util)
+ In TextInputFormat, while specifying textinputformat.record.delimiter the character/character sequences in data file similar to starting character/starting character sequence in delimiter were found missing in certain cases in the Map Output
+
+- HADOOP-8654.
+ Major bug reported by Gelesh and fixed by (util)
+ TextInputFormat delimiter bug:- Input Text portion ends with & Delimiter starts with same char/char sequence
+
+- HADOOP-8648.
+ Major bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1
+
+- HADOOP-8644.
+ Critical new feature reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ AuthenticatedURL should be able to use SSLFactory
+
+- HADOOP-8637.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (fs)
+ FilterFileSystem#setWriteChecksum is broken
+
+- HADOOP-8635.
+ Critical improvement reported by Daryn Sharp and fixed by Daryn Sharp (fs)
+ Cannot cancel paths registered deleteOnExit
+
+- HADOOP-8634.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (fs)
+ Ensure FileSystem#close doesn't squawk for deleteOnExit paths
+
+- HADOOP-8633.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (fs)
+ Interrupted FsShell copies may leave tmp files
+
+- HADOOP-8632.
+ Major bug reported by Costin Leau and fixed by Costin Leau (conf)
+ Configuration leaking class-loaders
+
+- HADOOP-8627.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (fs)
+ FS deleteOnExit may delete the wrong path
+
+- HADOOP-8626.
+ Major bug reported by Jonathan Natkins and fixed by Jonathan Natkins (security)
+ Typo in default setting for hadoop.security.group.mapping.ldap.search.filter.user
+
+- HADOOP-8624.
+ Minor improvement reported by Todd Lipcon and fixed by Todd Lipcon (ipc)
+ ProtobufRpcEngine should log all RPCs if TRACE logging is enabled
+
+- HADOOP-8623.
+ Minor improvement reported by Steven Willis and fixed by Steven Willis (scripts)
+ hadoop jar command should respect HADOOP_OPTS
+
+- HADOOP-8620.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (build)
+ Add -Drequire.fuse and -Drequire.snappy
+
+- HADOOP-8614.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ IOUtils#skipFully hangs forever on EOF
+
+- HADOOP-8613.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp
+ AbstractDelegationTokenIdentifier#getUser() should set token auth type
+
+- HADOOP-8611.
+ Major bug reported by Kihwal Lee and fixed by Robert Parker (security)
+ Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails
+
+- HADOOP-8609.
+ Major improvement reported by Todd Lipcon and fixed by Jon Zuanich
+ IPC server logs a useless message when shutting down socket
+
+- HADOOP-8606.
+ Major bug reported by Daryn Sharp and fixed by Daryn Sharp (fs)
+ FileSystem.get may return the wrong filesystem
+
+- HADOOP-8599.
+ Major bug reported by Andrey Klochkov and fixed by Andrey Klochkov (fs)
+ Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file
+
+- HADOOP-8587.
+ Minor bug reported by Eli Collins and fixed by Eli Collins (fs)
+ HarFileSystem access of harMetaCache isn't threadsafe
+
+- HADOOP-8586.
+ Major bug reported by Eli Collins and fixed by Eli Collins
+ Fixup a bunch of SPNEGO misspellings
+
+- HADOOP-8585.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ Fix initialization circularity between UserGroupInformation and HadoopConfiguration
+
+- HADOOP-8581.
+ Major new feature reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ add support for HTTPS to the web UIs
+
+- HADOOP-8573.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (conf)
+ Configuration tries to read from an inputstream resource multiple times.
+
+- HADOOP-8566.
+ Major bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (io)
+ AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays)
+
+- HADOOP-8563.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (build)
+ don't package hadoop-pipes examples/bin
+
+- HADOOP-8551.
+ Major bug reported by Robert Joseph Evans and fixed by John George (fs)
+ fs -mkdir creates parent directories without the -p option
+ FsShell's "mkdir" no longer implicitly creates all non-existent parent directories. The command adopts the posix compliant behavior of requiring the "-p" flag to auto-create parent directories.
+- HADOOP-8550.
+ Major bug reported by Robert Joseph Evans and fixed by John George (fs)
+ hadoop fs -touchz automatically created parent directories
+
+- HADOOP-8547.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ Package hadoop-pipes examples/bin directory (again)
+
+- HADOOP-8543.
+ Major bug reported by Radim Kolar and fixed by Radim Kolar (build)
+ Invalid pom.xml files on 0.23 branch
+
+- HADOOP-8541.
+ Major improvement reported by Andrew Wang and fixed by Andrew Wang (metrics)
+ Better high-percentile latency metrics
+
+- HADOOP-8538.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (native)
+ CMake builds fail on ARM
+
+- HADOOP-8537.
+ Major bug reported by Todd Lipcon and fixed by Todd Lipcon (io)
+ Two TFile tests failing recently
+
+- HADOOP-8535.
+ Major improvement reported by Jonathan Eagles and fixed by Jonathan Eagles (build)
+ Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1)
+
+- HADOOP-8533.
+ Major improvement reported by Suresh Srinivas and fixed by Brandon Li (ipc)
+ Remove Parallel Call in IPC
+ Merged the change to branch-2
+- HADOOP-8531.
+ Trivial improvement reported by Harsh J and fixed by madhukara phatak (io)
+ SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available
+
+- HADOOP-8525.
+ Trivial improvement reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ Provide Improved Traceability for Configuration
+
+- HADOOP-8524.
+ Trivial improvement reported by Harsh J and fixed by Harsh J (conf)
+ Allow users to get source of a Configuration parameter
+
+- HADOOP-8512.
+ Minor bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ AuthenticatedURL should reset the Token when the server returns other than OK on authentication
+
+- HADOOP-8509.
+ Minor bug reported by Matteo Bertozzi and fixed by Alejandro Abdelnur (util)
+ JarFinder duplicate entry: META-INF/MANIFEST.MF exception
+
+- HADOOP-8507.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ Avoid OOM while deserializing DelegationTokenIdentifer
+
+- HADOOP-8501.
+ Major bug reported by Radim Kolar and fixed by Radim Kolar (benchmarks)
+ Gridmix fails to compile on OpenJDK7u4
+
+- HADOOP-8499.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ Lower min.user.id to 500 for the tests
+
+- HADOOP-8495.
+ Critical bug reported by Jason Lowe and fixed by Jason Lowe (build)
+ Update Netty to avoid leaking file descriptors during shuffle
+
+- HADOOP-8488.
+ Minor bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ test-patch.sh gives +1 even if the native build fails.
+
+- HADOOP-8485.
+ Minor bug reported by Eli Collins and fixed by Eli Collins (documentation)
+ Don't hardcode "Apache Hadoop 0.23" in the docs
+
+- HADOOP-8481.
+ Trivial bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe (documentation)
+ update BUILDING.txt to talk about cmake rather than autotools
+
+- HADOOP-8480.
+ Trivial bug reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ The native build should honor -DskipTests
+
+- HADOOP-8466.
+ Major bug reported by Bruno Mahé and fixed by Bruno Mahé (build)
+ hadoop-client POM incorrectly excludes avro
+
+- HADOOP-8465.
+ Major new feature reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ hadoop-auth should support ephemeral authentication
+
+- HADOOP-8463.
+ Major improvement reported by Eli Collins and fixed by madhukara phatak (security)
+ hadoop.security.auth_to_local needs a key definition and doc
+
+- HADOOP-8460.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans (documentation)
+ Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR
+
+- HADOOP-8458.
+ Major new feature reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (security)
+ Add management hook to AuthenticationHandler to enable delegation token operations support
+
+- HADOOP-8452.
+ Minor bug reported by Andy Isaacson and fixed by Andy Isaacson
+ DN logs backtrace when running under jsvc and /jmx is loaded
+
+- HADOOP-8450.
+ Trivial bug reported by Colin Patrick McCabe and fixed by Eli Collins (test)
+ Remove src/test/system
+
+- HADOOP-8449.
+ Minor bug reported by Joey Echeverria and fixed by Harsh J
+ hadoop fs -text fails with compressed sequence files with the codec file extension
+
+- HADOOP-8444.
+ Major bug reported by Mariappan Asokan and fixed by madhukara phatak (fs , test)
+ Fix the tests FSMainOperationsBaseTest.java and F ileContextMainOperationsBaseTest.java to avoid potential test failure
+
+- HADOOP-8438.
+ Major bug reported by Devaraj K and fixed by Devaraj K
+ hadoop-validate-setup.sh refers to examples jar file which doesn't exist
+
+- HADOOP-8433.
+ Major bug reported by Brahma Reddy Battula and fixed by Brahma Reddy Battula (scripts)
+ Don't set HADOOP_LOG_DIR in hadoop-env.sh
+
+- HADOOP-8431.
+ Major bug reported by Eli Collins and fixed by Sandy Ryza
+ Running distcp wo args throws IllegalArgumentException
+
+- HADOOP-8423.
+ Major bug reported by Jason B and fixed by Todd Lipcon (io)
+ MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data
+
+- HADOOP-8422.
+ Minor bug reported by Eli Collins and fixed by Eli Collins (fs)
+ Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument
+
+- HADOOP-8408.
+ Major bug reported by Aaron T. Myers and fixed by Aaron T. Myers (viewfs)
+ MR doesn't work with a non-default ViewFS mount table and security enabled
+
+- HADOOP-8406.
+ Major bug reported by Todd Lipcon and fixed by Todd Lipcon (io)
+ CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe
+
+- HADOOP-8403.
+ Major task reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (build)
+ bump up POMs version to 2.0.1-SNAPSHOT
+
+- HADOOP-8400.
+ Major bug reported by Eli Collins and fixed by Alejandro Abdelnur (security)
+ All commands warn "Kerberos krb5 configuration not found" when security is not enabled
+
+- HADOOP-8393.
+ Major bug reported by Patrick Hunt and fixed by Patrick Hunt (scripts)
+ hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster
+
+- HADOOP-8390.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (test)
+ TestFileSystemCanonicalization fails with JDK7
+
+- HADOOP-8373.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (ipc)
+ Port RPC.getServerAddress to 0.23
+
+- HADOOP-8372.
+ Major bug reported by Junping Du and fixed by Junping Du (io , util)
+ normalizeHostName() in NetUtils is not working properly in resolving a hostname start with numeric character
+
+- HADOOP-8370.
+ Major bug reported by Trevor Robinson and fixed by Trevor Robinson (native)
+ Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found
+
+- HADOOP-8368.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ Use CMake rather than autotools to build native code
+
+- HADOOP-8367.
+ Major improvement reported by Sanjay Radia and fixed by Sanjay Radia
+ Improve documentation of declaringClassProtocolName in rpc headers
+
+- HADOOP-8362.
+ Trivial improvement reported by Todd Lipcon and fixed by madhukara phatak (conf)
+ Improve exception message when Configuration.set() is called with a null key or value
+
+- HADOOP-8361.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ Avoid out-of-memory problems when deserializing strings
+
+- HADOOP-8358.
+ Trivial improvement reported by Harsh J and fixed by Harsh J (conf)
+ Config-related WARN for dfs.web.ugi can be avoided.
+
+- HADOOP-8342.
+ Major bug reported by Randy Clayton and fixed by Alejandro Abdelnur (fs)
+ HDFS command fails with exception following merge of HADOOP-8325
+
+- HADOOP-8341.
+ Major bug reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ Fix or filter findbugs issues in hadoop-tools
+
+- HADOOP-8340.
+ Minor improvement reported by Todd Lipcon and fixed by Todd Lipcon (util)
+ SNAPSHOT build versions should compare as less than their eventual final release
+
+- HADOOP-8335.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (util)
+ Improve Configuration's address handling
+
+- HADOOP-8334.
+ Major bug reported by Daryn Sharp and fixed by Daryn Sharp
+ HttpServer sometimes returns incorrect port
+
+- HADOOP-8330.
+ Minor bug reported by John George and fixed by John George (test)
+ TestSequenceFile.testCreateUsesFsArg() is broken
+
+- HADOOP-8329.
+ Major bug reported by Kumar Ravi and fixed by Eli Collins (build)
+ Build fails with Java 7
+
+- HADOOP-8328.
+ Major bug reported by Tom White and fixed by Tom White (fs)
+ Duplicate FileSystem Statistics object for 'file' scheme
+
+- HADOOP-8327.
+ Major bug reported by Dave Thompson and fixed by Dave Thompson
+ distcpv2 and distcpv1 jars should not coexist
+ Resolve sporadic distcp issue due to having two DistCp classes (v1 & v2) in the classpath.
+- HADOOP-8325.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (fs)
+ Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook
+
+- HADOOP-8323.
+ Critical improvement reported by Harsh J and fixed by Harsh J (io)
+ Revert HADOOP-7940 and improve javadocs and test for Text.clear()
+
+- HADOOP-8317.
+ Major bug reported by Radim Kolar and fixed by (build)
+ Update maven-assembly-plugin to 2.3 - fix build on FreeBSD
+
+- HADOOP-8316.
+ Major bug reported by Eli Collins and fixed by Eli Collins (conf)
+ Audit logging should be disabled by default
+
+- HADOOP-8305.
+ Major bug reported by John George and fixed by John George (viewfs)
+ distcp over viewfs is broken
+
+- HADOOP-8288.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash
+ Remove references of mapred.child.ulimit etc. since they are not being used any more
+
+- HADOOP-8287.
+ Major bug reported by Eli Collins and fixed by Eli Collins (conf)
+ etc/hadoop is missing hadoop-env.sh
+
+- HADOOP-8286.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (conf)
+ Simplify getting a socket address from conf
+
+- HADOOP-8283.
+ Major test reported by Daryn Sharp and fixed by Daryn Sharp (test)
+ Allow tests to control token service value
+
+- HADOOP-8278.
+ Major improvement reported by Tom White and fixed by Tom White (build)
+ Make sure components declare correct set of dependencies
+
+- HADOOP-8268.
+ Major bug reported by Radim Kolar and fixed by Radim Kolar (build)
+ A few pom.xml across Hadoop project may fail XML validation
+
+- HADOOP-8244.
+ Major improvement reported by Henry Robinson and fixed by Henry Robinson
+ Improve comments on ByteBufferReadable.read
+
+- HADOOP-8242.
+ Minor improvement reported by Colin Patrick McCabe and fixed by Colin Patrick McCabe
+ AbstractDelegationTokenIdentifier: add getter methods for owner and realuser
+
+- HADOOP-8240.
+ Major improvement reported by Kihwal Lee and fixed by Kihwal Lee (fs)
+ Allow users to specify a checksum type on create()
+
+- HADOOP-8239.
+ Major improvement reported by Kihwal Lee and fixed by Kihwal Lee (fs)
+ Extend MD5MD5CRC32FileChecksum to show the actual checksum type being used
+
+- HADOOP-8227.
+ Blocker improvement reported by Robert Joseph Evans and fixed by Robert Joseph Evans
+ Allow RPC to limit ephemeral port range.
+
+- HADOOP-8225.
+ Blocker bug reported by Mithun Radhakrishnan and fixed by Daryn Sharp (security)
+ DistCp fails when invoked by Oozie
+
+- HADOOP-8224.
+ Major improvement reported by Eli Collins and fixed by Tomohiko Kinebuchi (conf)
+ Don't hardcode hdfs.audit.logger in the scripts
+
+- HADOOP-8197.
+ Critical bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (conf)
+ Configuration logs WARNs on every use of a deprecated key
+
+- HADOOP-8180.
+ Major bug reported by Ravi Prakash and fixed by Ravi Prakash
+ Remove hsqldb since its not needed from pom.xml
+
+- HADOOP-8179.
+ Minor bug reported by Steve Loughran and fixed by Daryn Sharp (fs)
+ risk of NPE in CopyCommands processArguments()
+
+- HADOOP-8172.
+ Critical bug reported by Robert Joseph Evans and fixed by Anupam Seth (conf)
+ Configuration no longer sets all keys in a deprecated key list.
+
+- HADOOP-8168.
+ Major bug reported by Eugene Koontz and fixed by Eugene Koontz (fs)
+ empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath()
+
+- HADOOP-8167.
+ Blocker bug reported by Alejandro Abdelnur and fixed by Alejandro Abdelnur (conf)
+ Configuration deprecation logic breaks backwards compatibility
+
+- HADOOP-8144.
+ Minor bug reported by Junping Du and fixed by Junping Du (io)
+ pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node
+
+- HADOOP-8135.
+ Major new feature reported by Henry Robinson and fixed by Henry Robinson (fs)
+ Add ByteBufferReadable interface to FSDataInputStream
+
+- HADOOP-8129.
+ Major bug reported by Ravi Prakash and fixed by Ahmed Radwan (fs , test)
+ ViewFileSystemTestSetup setupForViewFileSystem is erring when the user's home directory is somewhere other than /home (eg. /User) etc.
+
+- HADOOP-8110.
+ Major bug reported by Tsz Wo (Nicholas), SZE and fixed by Jason Lowe (fs)
+ TestViewFsTrash occasionally fails
+
+- HADOOP-8104.
+ Major bug reported by Colin Patrick McCabe and fixed by Alejandro Abdelnur
+ Inconsistent Jackson versions
+
+- HADOOP-8088.
+ Major bug reported by Kihwal Lee and fixed by Kihwal Lee (security)
+ User-group mapping cache incorrectly does negative caching on transient failures
+
+- HADOOP-8075.
+ Major improvement reported by Eli Collins and fixed by Hızır Sefa İrken (native)
+ Lower native-hadoop library log from info to debug
+
+- HADOOP-8060.
+ Major bug reported by Kihwal Lee and fixed by Kihwal Lee (fs , util)
+ Add a capability to discover and set checksum types per file.
+
+- HADOOP-8031.
+ Major bug reported by Elias Ross and fixed by Elias Ross (conf)
+ Configuration class fails to find embedded .jar resources; should use URL.openStream()
+
+- HADOOP-8014.
+ Major bug reported by Daryn Sharp and fixed by John George (fs)
+ ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary
+
+- HADOOP-8005.
+ Major bug reported by Joe Crobak and fixed by Jason Lowe (scripts)
+ Multiple SLF4J binding message in .out file for all daemons
+
+- HADOOP-7967.
+ Critical bug reported by Daryn Sharp and fixed by Daryn Sharp (fs , security)
+ Need generalized multi-token filesystem support
+
+- HADOOP-7868.
+ Major bug reported by James Page and fixed by Trevor Robinson (native)
+ Hadoop native fails to compile when default linker option is -Wl,--as-needed
+
+- HADOOP-7818.
+ Minor bug reported by Eli Collins and fixed by madhukara phatak (util)
+ DiskChecker#checkDir should fail if the directory is not executable
+
+- HADOOP-7754.
+ Major sub-task reported by Todd Lipcon and fixed by Todd Lipcon (native , performance)
+ Expose file descriptors from Hadoop-wrapped local FileSystems
+
+- HADOOP-7703.
+ Major bug reported by Devaraj K and fixed by Devaraj K
+ WebAppContext should also be stopped and cleared
+ Improved excpetion handling of shutting down web server. (Devaraj K via Eric Yang)
+- HADOOP-7510.
+ Major improvement reported by Daryn Sharp and fixed by Daryn Sharp (security)
+ Tokens should use original hostname provided instead of ip
+
+- HADOOP-6963.
+ Critical bug reported by Owen O'Malley and fixed by Ravi Prakash (fs)
+ Fix FileUtil.getDU. It should not include the size of the directory or follow symbolic links
+
+- HADOOP-6802.
+ Major improvement reported by Erik Steffl and fixed by Sho Shimauchi (conf , fs)
+ Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated)
+
+- HADOOP-3886.
+ Minor bug reported by brien colwell and fixed by Jingguo Yao (documentation)
+ Error in javadoc of Reporter, Mapper and Progressable
+
+- HADOOP-3450.
+ Minor improvement reported by Ari Rabkin and fixed by Sho Shimauchi (fs)
+ Add tests to Local Directory Allocator for asserting their URI-returning capability
+
+
+