From 3e0bbcb6884b1d6b0a5aba6c1318476ee852290f Mon Sep 17 00:00:00 2001 From: Andrew Wang Date: Wed, 29 Jan 2014 23:08:45 +0000 Subject: [PATCH] Update HDFS and Common CHANGES.txt post branch-2.3 reswizzle. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562628 13f79535-47bb-0310-9956-ffa450edef68 --- .../hadoop-common/CHANGES.txt | 252 +++++----- hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt | 454 +++++++++--------- 2 files changed, 353 insertions(+), 353 deletions(-) diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt index 0e7b7930b8a..f96530c2fa1 100644 --- a/hadoop-common-project/hadoop-common/CHANGES.txt +++ b/hadoop-common-project/hadoop-common/CHANGES.txt @@ -2,6 +2,18 @@ Hadoop Change Log Release 2.4.0 - UNRELEASED + INCOMPATIBLE CHANGES + + NEW FEATURES + + IMPROVEMENTS + + OPTIMIZATIONS + + BUG FIXES + +Release 2.3.0 - UNRELEASED + INCOMPATIBLE CHANGES HADOOP-8545. Filesystem Implementation for OpenStack Swift @@ -11,6 +23,27 @@ Release 2.4.0 - UNRELEASED IMPROVEMENTS + HADOOP-10046. Print a log message when SSL is enabled. + (David S. Wang via wang) + + HADOOP-10079. log a warning message if group resolution takes too long. + (cmccabe) + + HADOOP-9623. Update jets3t dependency to 0.9.0 (Amandeep Khurana via Colin + Patrick McCabe) + + HADOOP-10132. RPC#stopProxy() should log the class of proxy when IllegalArgumentException + is encountered (Ted yu via umamahesh) + + HADOOP-10248. Property name should be included in the exception where property value + is null (Akira AJISAKA via umamahesh) + + HADOOP-10086. User document for authentication in secure cluster. + (Masatake Iwasaki via Arpit Agarwal) + + HADOOP-10274 Lower the logging level from ERROR to WARN for UGI.doAs method + (Takeshi Miao via stack) + HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu) HADOOP 9871. Fix intermittent findbugs warnings in DefaultMetricsSystem. @@ -126,6 +159,9 @@ Release 2.4.0 - UNRELEASED OPTIMIZATIONS + HADOOP-10142. Avoid groups lookup for unprivileged users such as "dr.who" + (vinay via cmccabe) + HADOOP-9748. Reduce blocking on UGI.ensureInitialized (daryn) HADOOP-10047. Add a direct-buffer based apis for compression. (Gopal V @@ -144,6 +180,96 @@ Release 2.4.0 - UNRELEASED BUG FIXES + HADOOP-10028. Malformed ssl-server.xml.example. (Haohui Mai via jing9) + + HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path. + (Chuan Liu via cnauroth) + + HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows + local path. (Chuan Liu via cnauroth) + + HADOOP-10039. Add Hive to the list of projects using + AbstractDelegationTokenSecretManager. (Haohui Mai via jing9) + + HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on + Windows. (cnauroth) + + HADOOP-10055. FileSystemShell.apt.vm doc has typo "numRepicas". + (Akira Ajisaka via cnauroth) + + HADOOP-10072. TestNfsExports#testMultiMatchers fails due to non-deterministic + timing around cache expiry check. (cnauroth) + + HADOOP-9898. Set SO_KEEPALIVE on all our sockets. (todd via wang) + + HADOOP-9478. Fix race conditions during the initialization of Configuration + related to deprecatedKeyMap (cmccabe) + + HADOOP-9660. [WINDOWS] Powershell / cmd parses -Dkey=value from command line + as [-Dkey, value] which breaks GenericsOptionParser. + (Enis Soztutar via cnauroth) + + HADOOP-10078. KerberosAuthenticator always does SPNEGO. (rkanter via tucu) + + HADOOP-10110. hadoop-auth has a build break due to missing dependency. + (Chuan Liu via arp) + + HADOOP-9114. After defined the dfs.checksum.type as the NULL, write file and hflush will + through java.lang.ArrayIndexOutOfBoundsException (Sathish via umamahesh) + + HADOOP-10130. RawLocalFS::LocalFSFileInputStream.pread does not track + FS::Statistics (Binglin Chang via Colin Patrick McCabe) + + HDFS-5560. Trash configuration log statements prints incorrect units. + (Josh Elser via Andrew Wang) + + HADOOP-10081. Client.setupIOStreams can leak socket resources on exception + or error (Tsuyoshi OZAWA via jlowe) + + HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary + group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe) + + HADOOP-10175. Har files system authority should preserve userinfo. + (Chuan Liu via cnauroth) + + HADOOP-10090. Jobtracker metrics not updated properly after execution + of a mapreduce job. (ivanmi) + + HADOOP-10193. hadoop-auth's PseudoAuthenticationHandler can consume getInputStream. + (gchanan via tucu) + + HADOOP-10178. Configuration deprecation always emit "deprecated" warnings + when a new key is used. (Shanyu Zhao via cnauroth) + + HADOOP-10234. "hadoop.cmd jar" does not propagate exit code. (cnauroth) + + HADOOP-10240. Windows build instructions incorrectly state requirement of + protoc 2.4.1 instead of 2.5.0. (cnauroth) + + HADOOP-10110. hadoop-auth has a build break due to missing dependency + (Chuan Liu via cos) + + HADOOP-10167. Mark hadoop-common source as UTF-8 in Maven pom files / refactoring + (Mikhail Antonov via cos) + + HADOOP-9982. Fix dead links in hadoop site docs. (Akira Ajisaka via Arpit + Agarwal) + + HADOOP-10212. Incorrect compile command in Native Library document. + (Akira Ajisaka via Arpit Agarwal) + + HADOOP-9830. Fix typo at http://hadoop.apache.org/docs/current/ + (Kousuke Saruta via Arpit Agarwal) + + HADOOP-10255. Rename HttpServer to HttpServer2 to retain older + HttpServer in branch-2 for compatibility. (Haohui Mai via suresh) + + HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2. + (Haohui Mai via suresh) + + HADOOP-10291. TestSecurityUtil#testSocketAddrWithIP fails due to test + order dependency. (Mit Desai via Arpit Agarwal) + HADOOP-9964. Fix deadlocks in TestHttpServer by synchronize ReflectionUtils.printThreadInfo. (Junping Du via llu) @@ -249,132 +375,6 @@ Release 2.4.0 - UNRELEASED HADOOP-10288. Explicit reference to Log4JLogger breaks non-log4j users (todd) -Release 2.3.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-10046. Print a log message when SSL is enabled. - (David S. Wang via wang) - - HADOOP-10079. log a warning message if group resolution takes too long. - (cmccabe) - - HADOOP-9623. Update jets3t dependency to 0.9.0 (Amandeep Khurana via Colin - Patrick McCabe) - - HADOOP-10132. RPC#stopProxy() should log the class of proxy when IllegalArgumentException - is encountered (Ted yu via umamahesh) - - HADOOP-10248. Property name should be included in the exception where property value - is null (Akira AJISAKA via umamahesh) - - HADOOP-10086. User document for authentication in secure cluster. - (Masatake Iwasaki via Arpit Agarwal) - - HADOOP-10274 Lower the logging level from ERROR to WARN for UGI.doAs method - (Takeshi Miao via stack) - - OPTIMIZATIONS - - HADOOP-10142. Avoid groups lookup for unprivileged users such as "dr.who" - (vinay via cmccabe) - - BUG FIXES - - HADOOP-10028. Malformed ssl-server.xml.example. (Haohui Mai via jing9) - - HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path. - (Chuan Liu via cnauroth) - - HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows - local path. (Chuan Liu via cnauroth) - - HADOOP-10039. Add Hive to the list of projects using - AbstractDelegationTokenSecretManager. (Haohui Mai via jing9) - - HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on - Windows. (cnauroth) - - HADOOP-10055. FileSystemShell.apt.vm doc has typo "numRepicas". - (Akira Ajisaka via cnauroth) - - HADOOP-10072. TestNfsExports#testMultiMatchers fails due to non-deterministic - timing around cache expiry check. (cnauroth) - - HADOOP-9898. Set SO_KEEPALIVE on all our sockets. (todd via wang) - - HADOOP-9478. Fix race conditions during the initialization of Configuration - related to deprecatedKeyMap (cmccabe) - - HADOOP-9660. [WINDOWS] Powershell / cmd parses -Dkey=value from command line - as [-Dkey, value] which breaks GenericsOptionParser. - (Enis Soztutar via cnauroth) - - HADOOP-10078. KerberosAuthenticator always does SPNEGO. (rkanter via tucu) - - HADOOP-10110. hadoop-auth has a build break due to missing dependency. - (Chuan Liu via arp) - - HADOOP-9114. After defined the dfs.checksum.type as the NULL, write file and hflush will - through java.lang.ArrayIndexOutOfBoundsException (Sathish via umamahesh) - - HADOOP-10130. RawLocalFS::LocalFSFileInputStream.pread does not track - FS::Statistics (Binglin Chang via Colin Patrick McCabe) - - HDFS-5560. Trash configuration log statements prints incorrect units. - (Josh Elser via Andrew Wang) - - HADOOP-10081. Client.setupIOStreams can leak socket resources on exception - or error (Tsuyoshi OZAWA via jlowe) - - HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary - group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe) - - HADOOP-10175. Har files system authority should preserve userinfo. - (Chuan Liu via cnauroth) - - HADOOP-10090. Jobtracker metrics not updated properly after execution - of a mapreduce job. (ivanmi) - - HADOOP-10193. hadoop-auth's PseudoAuthenticationHandler can consume getInputStream. - (gchanan via tucu) - - HADOOP-10178. Configuration deprecation always emit "deprecated" warnings - when a new key is used. (Shanyu Zhao via cnauroth) - - HADOOP-10234. "hadoop.cmd jar" does not propagate exit code. (cnauroth) - - HADOOP-10240. Windows build instructions incorrectly state requirement of - protoc 2.4.1 instead of 2.5.0. (cnauroth) - - HADOOP-10110. hadoop-auth has a build break due to missing dependency - (Chuan Liu via cos) - - HADOOP-10167. Mark hadoop-common source as UTF-8 in Maven pom files / refactoring - (Mikhail Antonov via cos) - - HADOOP-9982. Fix dead links in hadoop site docs. (Akira Ajisaka via Arpit - Agarwal) - - HADOOP-10212. Incorrect compile command in Native Library document. - (Akira Ajisaka via Arpit Agarwal) - - HADOOP-9830. Fix typo at http://hadoop.apache.org/docs/current/ - (Kousuke Saruta via Arpit Agarwal) - - HADOOP-10255. Rename HttpServer to HttpServer2 to retain older - HttpServer in branch-2 for compatibility. (Haohui Mai via suresh) - - HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2. - (Haohui Mai via suresh) - - HADOOP-10291. TestSecurityUtil#testSocketAddrWithIP fails due to test - order dependency. (Mit Desai via Arpit Agarwal) - Release 2.2.0 - 2013-10-13 INCOMPATIBLE CHANGES diff --git a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt index b626be8633e..ecc58863b02 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt +++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt @@ -4,6 +4,24 @@ Release 2.4.0 - UNRELEASED INCOMPATIBLE CHANGES + NEW FEATURES + + IMPROVEMENTS + + HDFS-5781. Use an array to record the mapping between FSEditLogOpCode and + the corresponding byte value. (jing9) + + OPTIMIZATIONS + + BUG FIXES + + HDFS-5842. Cannot create hftp filesystem when using a proxy user ugi and a doAs + on a secure cluster. (jing9) + +Release 2.3.0 - UNRELEASED + + INCOMPATIBLE CHANGES + NEW FEATURES HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA. @@ -38,8 +56,46 @@ Release 2.4.0 - UNRELEASED HDFS-4949. Centralized cache management in HDFS (wang and cmccabe) + IMPROVEMENTS + HDFS-5360. Improvement of usage message of renameSnapshot and + deleteSnapshot. (Shinichi Yamashita via wang) + + HDFS-5331. make SnapshotDiff.java to a o.a.h.util.Tool interface implementation. + (Vinayakumar B via umamahesh) + + HDFS-4657. Limit the number of blocks logged by the NN after a block + report to a configurable value. (Aaron T. Myers via Colin Patrick + McCabe) + + HDFS-5344. Make LsSnapshottableDir as Tool interface implementation. (Sathish via umamahesh) + + HDFS-5544. Adding Test case For Checking dfs.checksum type as NULL value. (Sathish via umamahesh) + + HDFS-5568. Support includeSnapshots option with Fsck command. (Vinayakumar B via umamahesh) + + HDFS-4983. Numeric usernames do not work with WebHDFS FS. (Yongjun Zhang via + jing9) + + HDFS-5592. statechangeLog of completeFile should be logged only in case of success. + (Vinayakumar via umamahesh) + + HDFS-5662. Can't decommission a DataNode due to file's replication factor + larger than the rest of the cluster size. (brandonli) + + HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options. + (shv) + + HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark. + (Plamen Jeliazkov via shv) + + HDFS-5677. Need error checking for HA cluster configuration. + (Vincent Sheffer via cos) + + HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile(). + (Haohui Mai via Arpit Agarwal) + HDFS-5267. Remove volatile from LightWeightHashSet. (Junping Du via llu) HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is @@ -215,9 +271,6 @@ Release 2.4.0 - UNRELEASED HDFS-5788. listLocatedStatus response can be very large. (Nathan Roberts via kihwal) - HDFS-5781. Use an array to record the mapping between FSEditLogOpCode and - the corresponding byte value. (jing9) - OPTIMIZATIONS HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn) @@ -232,6 +285,177 @@ Release 2.4.0 - UNRELEASED BUG FIXES + HDFS-5307. Support both HTTP and HTTPS in jsp pages (Haohui Mai via + brandonli) + + HDFS-5291. Standby namenode after transition to active goes into safemode. + (jing9) + + HDFS-5317. Go back to DFS Home link does not work on datanode webUI + (Haohui Mai via brandonli) + + HDFS-5316. Namenode ignores the default https port (Haohui Mai via + brandonli) + + HDFS-5281. COMMIT request should not block. (brandonli) + + HDFS-5337. should do hsync for a commit request even there is no pending + writes (brandonli) + + HDFS-5335. Hive query failed with possible race in dfs output stream. + (Haohui Mai via suresh) + + HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA + clusters. (jing9) + + HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter + token. (brandonli) + + HDFS-5330. fix readdir and readdirplus for large directories (brandonli) + + HDFS-5370. Typo in Error Message: different between range in condition + and range in error message. (Kousuke Saruta via suresh) + + HDFS-5365. Fix libhdfs compile error on FreeBSD9. (Radim Kolar via cnauroth) + + HDFS-5347. Add HDFS NFS user guide. (brandonli) + + HDFS-5403. WebHdfs client cannot communicate with older WebHdfs servers + post HDFS-5306. (atm) + + HDFS-5171. NFS should create input stream for a file and try to share it + with multiple read requests. (Haohui Mai via brandonli) + + HDFS-5413. hdfs.cmd does not support passthrough to any arbitrary class. + (cnauroth) + + HDFS-5433. When reloading fsimage during checkpointing, we should clear + existing snapshottable directories. (Aaron T. Myers via wang) + + HDFS-5432. TestDatanodeJsp fails on Windows due to assumption that loopback + address resolves to host name localhost. (cnauroth) + + HDFS-5065. TestSymlinkHdfsDisable fails on Windows. (ivanmi) + + HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes + cache expires too quickly (Chris Nauroth via Sanjay) + + HDFS-5037. Active NN should trigger its own edit log rolls. (wang) + + HDFS-5035. getFileLinkStatus and rename do not correctly check permissions + of symlinks. (Andrew Wang via Colin Patrick McCabe) + + HDFS-5456. NameNode startup progress creates new steps if caller attempts to + create a counter for a step that doesn't already exist. (cnauroth) + + HDFS-5458. Datanode failed volume threshold ignored if exception is thrown + in getDataDirsFromURIs. (Mike Mellenthin via wang) + + HDFS-5252. Stable write is not handled correctly in someplace. (brandonli) + + HDFS-5364. Add OpenFileCtx cache. (brandonli) + + HDFS-5469. Add configuration property for the sub-directroy export path + (brandonli) + + HDFS-5519. COMMIT handler should update the commit status after sync + (brandonli) + + HDFS-5372. In FSNamesystem, hasReadLock() returns false if the current + thread holds the write lock (Vinaykumar B via umamahesh) + + HDFS-4516. Client crash after block allocation and NN switch before lease recovery for + the same file can cause readers to fail forever (VinaayKumar B via umamahesh) + + HDFS-5014. Process register commands with out holding BPOfferService lock. + (Vinaykumar B via umamahesh) + + HDFS-5288. Close idle connections in portmap (Haohui Mai via brandonli) + + HDFS-5407. Fix typos in DFSClientCache (Haohui Mai via brandonli) + + HDFS-5548. Use ConcurrentHashMap in portmap (Haohui Mai via brandonli) + + HDFS-5577. NFS user guide update (brandonli) + + HDFS-5563. NFS gateway should commit the buffered data when read request comes + after write to the same file (brandonli) + + HDFS-4997. libhdfs doesn't return correct error codes in most cases (cmccabe) + + HDFS-5587. add debug information when NFS fails to start with duplicate user + or group names (brandonli) + + HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is + set to false. (jing9) + + HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is + enabled. (Colin Patrick McCabe via jing9) + + HDFS-5283. Under construction blocks only inside snapshots should not be + counted in safemode threshhold. (Vinay via szetszwo) + + HDFS-5257. addBlock() retry should return LocatedBlock with locations else client + will get AIOBE. (Vinay via jing9) + + HDFS-5427. Not able to read deleted files from snapshot directly under + snapshottable dir after checkpoint and NN restart. (Vinay via jing9) + + HDFS-5443. Delete 0-sized block when deleting an under-construction file that + is included in snapshot. (jing9) + + HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed + file/directory while deletion. (jing9) + + HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on + restart. (jing9 and Vinay) + + HDFS-5474. Deletesnapshot can make Namenode in safemode on NN restarts. + (Sathish via jing9) + + HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, + leads to NN safemode. (Vinay via jing9) + + HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart + leads nn safemode. (jing9) + + HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a + segment. (Todd Lipcon via atm) + + HDFS-4201. NPE in BPServiceActor#sendHeartBeat. (jxiang via cmccabe) + + HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe) + + HDFS-5657. race condition causes writeback state error in NFS gateway (brandonli) + + HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip + address. (Benoy Antony via jing9) + + HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (sathish + via cmccabe) + + HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. (JamesLi via umamahesh) + + HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. + (brandonli) + + HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. (umamahesh) + + HDFS-5343. When cat command is issued on snapshot files getting unexpected result. + (Sathish via umamahesh) + + HDFS-5297. Fix dead links in HDFS site documents. (Akira Ajisaka via + Arpit Agarwal) + + HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws + IllegalArgumentException when accessing another cluster. (Yongjun Zhang via + Colin Patrick McCabe) + + HDFS-5833. Fix SecondaryNameNode javadoc. (Bangtao Zhou via Arpit Agarwal) + + HDFS-5844. Fix broken link in WebHDFS.apt.vm. (Akira Ajisaka via + Arpit Agarwal) + HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe) @@ -316,9 +540,6 @@ Release 2.4.0 - UNRELEASED HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns (Ted Yu via todd) - HDFS-5842. Cannot create hftp filesystem when using a proxy user ugi and a doAs - on a secure cluster. (jing9) - BREAKDOWN OF HDFS-2832 SUBTASKS AND RELATED JIRAS HDFS-4985. Add storage type to the protocol and expose it in block report @@ -656,227 +877,6 @@ Release 2.4.0 - UNRELEASED HDFS-5724. modifyCacheDirective logging audit log command wrongly as addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe) - -Release 2.3.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HDFS-5360. Improvement of usage message of renameSnapshot and - deleteSnapshot. (Shinichi Yamashita via wang) - - HDFS-5331. make SnapshotDiff.java to a o.a.h.util.Tool interface implementation. - (Vinayakumar B via umamahesh) - - HDFS-4657. Limit the number of blocks logged by the NN after a block - report to a configurable value. (Aaron T. Myers via Colin Patrick - McCabe) - - HDFS-5344. Make LsSnapshottableDir as Tool interface implementation. (Sathish via umamahesh) - - HDFS-5544. Adding Test case For Checking dfs.checksum type as NULL value. (Sathish via umamahesh) - - HDFS-5568. Support includeSnapshots option with Fsck command. (Vinayakumar B via umamahesh) - - HDFS-4983. Numeric usernames do not work with WebHDFS FS. (Yongjun Zhang via - jing9) - - HDFS-5592. statechangeLog of completeFile should be logged only in case of success. - (Vinayakumar via umamahesh) - - HDFS-5662. Can't decommission a DataNode due to file's replication factor - larger than the rest of the cluster size. (brandonli) - - HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options. - (shv) - - HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark. - (Plamen Jeliazkov via shv) - - HDFS-5677. Need error checking for HA cluster configuration. - (Vincent Sheffer via cos) - - HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile(). - (Haohui Mai via Arpit Agarwal) - - OPTIMIZATIONS - - BUG FIXES - - HDFS-5307. Support both HTTP and HTTPS in jsp pages (Haohui Mai via - brandonli) - - HDFS-5291. Standby namenode after transition to active goes into safemode. - (jing9) - - HDFS-5317. Go back to DFS Home link does not work on datanode webUI - (Haohui Mai via brandonli) - - HDFS-5316. Namenode ignores the default https port (Haohui Mai via - brandonli) - - HDFS-5281. COMMIT request should not block. (brandonli) - - HDFS-5337. should do hsync for a commit request even there is no pending - writes (brandonli) - - HDFS-5335. Hive query failed with possible race in dfs output stream. - (Haohui Mai via suresh) - - HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA - clusters. (jing9) - - HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter - token. (brandonli) - - HDFS-5330. fix readdir and readdirplus for large directories (brandonli) - - HDFS-5370. Typo in Error Message: different between range in condition - and range in error message. (Kousuke Saruta via suresh) - - HDFS-5365. Fix libhdfs compile error on FreeBSD9. (Radim Kolar via cnauroth) - - HDFS-5347. Add HDFS NFS user guide. (brandonli) - - HDFS-5403. WebHdfs client cannot communicate with older WebHdfs servers - post HDFS-5306. (atm) - - HDFS-5171. NFS should create input stream for a file and try to share it - with multiple read requests. (Haohui Mai via brandonli) - - HDFS-5413. hdfs.cmd does not support passthrough to any arbitrary class. - (cnauroth) - - HDFS-5433. When reloading fsimage during checkpointing, we should clear - existing snapshottable directories. (Aaron T. Myers via wang) - - HDFS-5432. TestDatanodeJsp fails on Windows due to assumption that loopback - address resolves to host name localhost. (cnauroth) - - HDFS-5065. TestSymlinkHdfsDisable fails on Windows. (ivanmi) - - HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes - cache expires too quickly (Chris Nauroth via Sanjay) - - HDFS-5037. Active NN should trigger its own edit log rolls. (wang) - - HDFS-5035. getFileLinkStatus and rename do not correctly check permissions - of symlinks. (Andrew Wang via Colin Patrick McCabe) - - HDFS-5456. NameNode startup progress creates new steps if caller attempts to - create a counter for a step that doesn't already exist. (cnauroth) - - HDFS-5458. Datanode failed volume threshold ignored if exception is thrown - in getDataDirsFromURIs. (Mike Mellenthin via wang) - - HDFS-5252. Stable write is not handled correctly in someplace. (brandonli) - - HDFS-5364. Add OpenFileCtx cache. (brandonli) - - HDFS-5469. Add configuration property for the sub-directroy export path - (brandonli) - - HDFS-5519. COMMIT handler should update the commit status after sync - (brandonli) - - HDFS-5372. In FSNamesystem, hasReadLock() returns false if the current - thread holds the write lock (Vinaykumar B via umamahesh) - - HDFS-4516. Client crash after block allocation and NN switch before lease recovery for - the same file can cause readers to fail forever (VinaayKumar B via umamahesh) - - HDFS-5014. Process register commands with out holding BPOfferService lock. - (Vinaykumar B via umamahesh) - - HDFS-5288. Close idle connections in portmap (Haohui Mai via brandonli) - - HDFS-5407. Fix typos in DFSClientCache (Haohui Mai via brandonli) - - HDFS-5548. Use ConcurrentHashMap in portmap (Haohui Mai via brandonli) - - HDFS-5577. NFS user guide update (brandonli) - - HDFS-5563. NFS gateway should commit the buffered data when read request comes - after write to the same file (brandonli) - - HDFS-4997. libhdfs doesn't return correct error codes in most cases (cmccabe) - - HDFS-5587. add debug information when NFS fails to start with duplicate user - or group names (brandonli) - - HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is - set to false. (jing9) - - HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is - enabled. (Colin Patrick McCabe via jing9) - - HDFS-5283. Under construction blocks only inside snapshots should not be - counted in safemode threshhold. (Vinay via szetszwo) - - HDFS-5257. addBlock() retry should return LocatedBlock with locations else client - will get AIOBE. (Vinay via jing9) - - HDFS-5427. Not able to read deleted files from snapshot directly under - snapshottable dir after checkpoint and NN restart. (Vinay via jing9) - - HDFS-5443. Delete 0-sized block when deleting an under-construction file that - is included in snapshot. (jing9) - - HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed - file/directory while deletion. (jing9) - - HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on - restart. (jing9 and Vinay) - - HDFS-5474. Deletesnapshot can make Namenode in safemode on NN restarts. - (Sathish via jing9) - - HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, - leads to NN safemode. (Vinay via jing9) - - HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart - leads nn safemode. (jing9) - - HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a - segment. (Todd Lipcon via atm) - - HDFS-4201. NPE in BPServiceActor#sendHeartBeat. (jxiang via cmccabe) - - HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe) - - HDFS-5657. race condition causes writeback state error in NFS gateway (brandonli) - - HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip - address. (Benoy Antony via jing9) - - HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (sathish - via cmccabe) - - HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. (JamesLi via umamahesh) - - HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. - (brandonli) - - HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. (umamahesh) - - HDFS-5343. When cat command is issued on snapshot files getting unexpected result. - (Sathish via umamahesh) - - HDFS-5297. Fix dead links in HDFS site documents. (Akira Ajisaka via - Arpit Agarwal) - - HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws - IllegalArgumentException when accessing another cluster. (Yongjun Zhang via - Colin Patrick McCabe) - - HDFS-5833. Fix SecondaryNameNode javadoc. (Bangtao Zhou via Arpit Agarwal) - - HDFS-5844. Fix broken link in WebHDFS.apt.vm. (Akira Ajisaka via - Arpit Agarwal) - Release 2.2.0 - 2013-10-13 INCOMPATIBLE CHANGES