Update HDFS and Common CHANGES.txt post branch-2.3 reswizzle.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562628 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Andrew Wang
parent
698ed255fd
commit
3e0bbcb688
|
|
@ -2,6 +2,18 @@ Hadoop Change Log
|
||||||
|
|
||||||
Release 2.4.0 - UNRELEASED
|
Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
|
INCOMPATIBLE CHANGES
|
||||||
|
|
||||||
|
NEW FEATURES
|
||||||
|
|
||||||
|
IMPROVEMENTS
|
||||||
|
|
||||||
|
OPTIMIZATIONS
|
||||||
|
|
||||||
|
BUG FIXES
|
||||||
|
|
||||||
|
Release 2.3.0 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
|
||||||
HADOOP-8545. Filesystem Implementation for OpenStack Swift
|
HADOOP-8545. Filesystem Implementation for OpenStack Swift
|
||||||
|
|
@ -11,6 +23,27 @@ Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
IMPROVEMENTS
|
IMPROVEMENTS
|
||||||
|
|
||||||
|
HADOOP-10046. Print a log message when SSL is enabled.
|
||||||
|
(David S. Wang via wang)
|
||||||
|
|
||||||
|
HADOOP-10079. log a warning message if group resolution takes too long.
|
||||||
|
(cmccabe)
|
||||||
|
|
||||||
|
HADOOP-9623. Update jets3t dependency to 0.9.0 (Amandeep Khurana via Colin
|
||||||
|
Patrick McCabe)
|
||||||
|
|
||||||
|
HADOOP-10132. RPC#stopProxy() should log the class of proxy when IllegalArgumentException
|
||||||
|
is encountered (Ted yu via umamahesh)
|
||||||
|
|
||||||
|
HADOOP-10248. Property name should be included in the exception where property value
|
||||||
|
is null (Akira AJISAKA via umamahesh)
|
||||||
|
|
||||||
|
HADOOP-10086. User document for authentication in secure cluster.
|
||||||
|
(Masatake Iwasaki via Arpit Agarwal)
|
||||||
|
|
||||||
|
HADOOP-10274 Lower the logging level from ERROR to WARN for UGI.doAs method
|
||||||
|
(Takeshi Miao via stack)
|
||||||
|
|
||||||
HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu)
|
HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu)
|
||||||
|
|
||||||
HADOOP 9871. Fix intermittent findbugs warnings in DefaultMetricsSystem.
|
HADOOP 9871. Fix intermittent findbugs warnings in DefaultMetricsSystem.
|
||||||
|
|
@ -126,6 +159,9 @@ Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
OPTIMIZATIONS
|
OPTIMIZATIONS
|
||||||
|
|
||||||
|
HADOOP-10142. Avoid groups lookup for unprivileged users such as "dr.who"
|
||||||
|
(vinay via cmccabe)
|
||||||
|
|
||||||
HADOOP-9748. Reduce blocking on UGI.ensureInitialized (daryn)
|
HADOOP-9748. Reduce blocking on UGI.ensureInitialized (daryn)
|
||||||
|
|
||||||
HADOOP-10047. Add a direct-buffer based apis for compression. (Gopal V
|
HADOOP-10047. Add a direct-buffer based apis for compression. (Gopal V
|
||||||
|
|
@ -144,6 +180,96 @@ Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
BUG FIXES
|
BUG FIXES
|
||||||
|
|
||||||
|
HADOOP-10028. Malformed ssl-server.xml.example. (Haohui Mai via jing9)
|
||||||
|
|
||||||
|
HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path.
|
||||||
|
(Chuan Liu via cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows
|
||||||
|
local path. (Chuan Liu via cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10039. Add Hive to the list of projects using
|
||||||
|
AbstractDelegationTokenSecretManager. (Haohui Mai via jing9)
|
||||||
|
|
||||||
|
HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on
|
||||||
|
Windows. (cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10055. FileSystemShell.apt.vm doc has typo "numRepicas".
|
||||||
|
(Akira Ajisaka via cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10072. TestNfsExports#testMultiMatchers fails due to non-deterministic
|
||||||
|
timing around cache expiry check. (cnauroth)
|
||||||
|
|
||||||
|
HADOOP-9898. Set SO_KEEPALIVE on all our sockets. (todd via wang)
|
||||||
|
|
||||||
|
HADOOP-9478. Fix race conditions during the initialization of Configuration
|
||||||
|
related to deprecatedKeyMap (cmccabe)
|
||||||
|
|
||||||
|
HADOOP-9660. [WINDOWS] Powershell / cmd parses -Dkey=value from command line
|
||||||
|
as [-Dkey, value] which breaks GenericsOptionParser.
|
||||||
|
(Enis Soztutar via cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10078. KerberosAuthenticator always does SPNEGO. (rkanter via tucu)
|
||||||
|
|
||||||
|
HADOOP-10110. hadoop-auth has a build break due to missing dependency.
|
||||||
|
(Chuan Liu via arp)
|
||||||
|
|
||||||
|
HADOOP-9114. After defined the dfs.checksum.type as the NULL, write file and hflush will
|
||||||
|
through java.lang.ArrayIndexOutOfBoundsException (Sathish via umamahesh)
|
||||||
|
|
||||||
|
HADOOP-10130. RawLocalFS::LocalFSFileInputStream.pread does not track
|
||||||
|
FS::Statistics (Binglin Chang via Colin Patrick McCabe)
|
||||||
|
|
||||||
|
HDFS-5560. Trash configuration log statements prints incorrect units.
|
||||||
|
(Josh Elser via Andrew Wang)
|
||||||
|
|
||||||
|
HADOOP-10081. Client.setupIOStreams can leak socket resources on exception
|
||||||
|
or error (Tsuyoshi OZAWA via jlowe)
|
||||||
|
|
||||||
|
HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary
|
||||||
|
group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe)
|
||||||
|
|
||||||
|
HADOOP-10175. Har files system authority should preserve userinfo.
|
||||||
|
(Chuan Liu via cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10090. Jobtracker metrics not updated properly after execution
|
||||||
|
of a mapreduce job. (ivanmi)
|
||||||
|
|
||||||
|
HADOOP-10193. hadoop-auth's PseudoAuthenticationHandler can consume getInputStream.
|
||||||
|
(gchanan via tucu)
|
||||||
|
|
||||||
|
HADOOP-10178. Configuration deprecation always emit "deprecated" warnings
|
||||||
|
when a new key is used. (Shanyu Zhao via cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10234. "hadoop.cmd jar" does not propagate exit code. (cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10240. Windows build instructions incorrectly state requirement of
|
||||||
|
protoc 2.4.1 instead of 2.5.0. (cnauroth)
|
||||||
|
|
||||||
|
HADOOP-10110. hadoop-auth has a build break due to missing dependency
|
||||||
|
(Chuan Liu via cos)
|
||||||
|
|
||||||
|
HADOOP-10167. Mark hadoop-common source as UTF-8 in Maven pom files / refactoring
|
||||||
|
(Mikhail Antonov via cos)
|
||||||
|
|
||||||
|
HADOOP-9982. Fix dead links in hadoop site docs. (Akira Ajisaka via Arpit
|
||||||
|
Agarwal)
|
||||||
|
|
||||||
|
HADOOP-10212. Incorrect compile command in Native Library document.
|
||||||
|
(Akira Ajisaka via Arpit Agarwal)
|
||||||
|
|
||||||
|
HADOOP-9830. Fix typo at http://hadoop.apache.org/docs/current/
|
||||||
|
(Kousuke Saruta via Arpit Agarwal)
|
||||||
|
|
||||||
|
HADOOP-10255. Rename HttpServer to HttpServer2 to retain older
|
||||||
|
HttpServer in branch-2 for compatibility. (Haohui Mai via suresh)
|
||||||
|
|
||||||
|
HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
|
||||||
|
(Haohui Mai via suresh)
|
||||||
|
|
||||||
|
HADOOP-10291. TestSecurityUtil#testSocketAddrWithIP fails due to test
|
||||||
|
order dependency. (Mit Desai via Arpit Agarwal)
|
||||||
|
|
||||||
HADOOP-9964. Fix deadlocks in TestHttpServer by synchronize
|
HADOOP-9964. Fix deadlocks in TestHttpServer by synchronize
|
||||||
ReflectionUtils.printThreadInfo. (Junping Du via llu)
|
ReflectionUtils.printThreadInfo. (Junping Du via llu)
|
||||||
|
|
||||||
|
|
@ -249,132 +375,6 @@ Release 2.4.0 - UNRELEASED
|
||||||
HADOOP-10288. Explicit reference to Log4JLogger breaks non-log4j users
|
HADOOP-10288. Explicit reference to Log4JLogger breaks non-log4j users
|
||||||
(todd)
|
(todd)
|
||||||
|
|
||||||
Release 2.3.0 - UNRELEASED
|
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
|
||||||
|
|
||||||
NEW FEATURES
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
|
||||||
|
|
||||||
HADOOP-10046. Print a log message when SSL is enabled.
|
|
||||||
(David S. Wang via wang)
|
|
||||||
|
|
||||||
HADOOP-10079. log a warning message if group resolution takes too long.
|
|
||||||
(cmccabe)
|
|
||||||
|
|
||||||
HADOOP-9623. Update jets3t dependency to 0.9.0 (Amandeep Khurana via Colin
|
|
||||||
Patrick McCabe)
|
|
||||||
|
|
||||||
HADOOP-10132. RPC#stopProxy() should log the class of proxy when IllegalArgumentException
|
|
||||||
is encountered (Ted yu via umamahesh)
|
|
||||||
|
|
||||||
HADOOP-10248. Property name should be included in the exception where property value
|
|
||||||
is null (Akira AJISAKA via umamahesh)
|
|
||||||
|
|
||||||
HADOOP-10086. User document for authentication in secure cluster.
|
|
||||||
(Masatake Iwasaki via Arpit Agarwal)
|
|
||||||
|
|
||||||
HADOOP-10274 Lower the logging level from ERROR to WARN for UGI.doAs method
|
|
||||||
(Takeshi Miao via stack)
|
|
||||||
|
|
||||||
OPTIMIZATIONS
|
|
||||||
|
|
||||||
HADOOP-10142. Avoid groups lookup for unprivileged users such as "dr.who"
|
|
||||||
(vinay via cmccabe)
|
|
||||||
|
|
||||||
BUG FIXES
|
|
||||||
|
|
||||||
HADOOP-10028. Malformed ssl-server.xml.example. (Haohui Mai via jing9)
|
|
||||||
|
|
||||||
HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path.
|
|
||||||
(Chuan Liu via cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows
|
|
||||||
local path. (Chuan Liu via cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10039. Add Hive to the list of projects using
|
|
||||||
AbstractDelegationTokenSecretManager. (Haohui Mai via jing9)
|
|
||||||
|
|
||||||
HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on
|
|
||||||
Windows. (cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10055. FileSystemShell.apt.vm doc has typo "numRepicas".
|
|
||||||
(Akira Ajisaka via cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10072. TestNfsExports#testMultiMatchers fails due to non-deterministic
|
|
||||||
timing around cache expiry check. (cnauroth)
|
|
||||||
|
|
||||||
HADOOP-9898. Set SO_KEEPALIVE on all our sockets. (todd via wang)
|
|
||||||
|
|
||||||
HADOOP-9478. Fix race conditions during the initialization of Configuration
|
|
||||||
related to deprecatedKeyMap (cmccabe)
|
|
||||||
|
|
||||||
HADOOP-9660. [WINDOWS] Powershell / cmd parses -Dkey=value from command line
|
|
||||||
as [-Dkey, value] which breaks GenericsOptionParser.
|
|
||||||
(Enis Soztutar via cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10078. KerberosAuthenticator always does SPNEGO. (rkanter via tucu)
|
|
||||||
|
|
||||||
HADOOP-10110. hadoop-auth has a build break due to missing dependency.
|
|
||||||
(Chuan Liu via arp)
|
|
||||||
|
|
||||||
HADOOP-9114. After defined the dfs.checksum.type as the NULL, write file and hflush will
|
|
||||||
through java.lang.ArrayIndexOutOfBoundsException (Sathish via umamahesh)
|
|
||||||
|
|
||||||
HADOOP-10130. RawLocalFS::LocalFSFileInputStream.pread does not track
|
|
||||||
FS::Statistics (Binglin Chang via Colin Patrick McCabe)
|
|
||||||
|
|
||||||
HDFS-5560. Trash configuration log statements prints incorrect units.
|
|
||||||
(Josh Elser via Andrew Wang)
|
|
||||||
|
|
||||||
HADOOP-10081. Client.setupIOStreams can leak socket resources on exception
|
|
||||||
or error (Tsuyoshi OZAWA via jlowe)
|
|
||||||
|
|
||||||
HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary
|
|
||||||
group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe)
|
|
||||||
|
|
||||||
HADOOP-10175. Har files system authority should preserve userinfo.
|
|
||||||
(Chuan Liu via cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10090. Jobtracker metrics not updated properly after execution
|
|
||||||
of a mapreduce job. (ivanmi)
|
|
||||||
|
|
||||||
HADOOP-10193. hadoop-auth's PseudoAuthenticationHandler can consume getInputStream.
|
|
||||||
(gchanan via tucu)
|
|
||||||
|
|
||||||
HADOOP-10178. Configuration deprecation always emit "deprecated" warnings
|
|
||||||
when a new key is used. (Shanyu Zhao via cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10234. "hadoop.cmd jar" does not propagate exit code. (cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10240. Windows build instructions incorrectly state requirement of
|
|
||||||
protoc 2.4.1 instead of 2.5.0. (cnauroth)
|
|
||||||
|
|
||||||
HADOOP-10110. hadoop-auth has a build break due to missing dependency
|
|
||||||
(Chuan Liu via cos)
|
|
||||||
|
|
||||||
HADOOP-10167. Mark hadoop-common source as UTF-8 in Maven pom files / refactoring
|
|
||||||
(Mikhail Antonov via cos)
|
|
||||||
|
|
||||||
HADOOP-9982. Fix dead links in hadoop site docs. (Akira Ajisaka via Arpit
|
|
||||||
Agarwal)
|
|
||||||
|
|
||||||
HADOOP-10212. Incorrect compile command in Native Library document.
|
|
||||||
(Akira Ajisaka via Arpit Agarwal)
|
|
||||||
|
|
||||||
HADOOP-9830. Fix typo at http://hadoop.apache.org/docs/current/
|
|
||||||
(Kousuke Saruta via Arpit Agarwal)
|
|
||||||
|
|
||||||
HADOOP-10255. Rename HttpServer to HttpServer2 to retain older
|
|
||||||
HttpServer in branch-2 for compatibility. (Haohui Mai via suresh)
|
|
||||||
|
|
||||||
HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2.
|
|
||||||
(Haohui Mai via suresh)
|
|
||||||
|
|
||||||
HADOOP-10291. TestSecurityUtil#testSocketAddrWithIP fails due to test
|
|
||||||
order dependency. (Mit Desai via Arpit Agarwal)
|
|
||||||
|
|
||||||
Release 2.2.0 - 2013-10-13
|
Release 2.2.0 - 2013-10-13
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
|
|
||||||
|
|
@ -4,6 +4,24 @@ Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
|
||||||
|
NEW FEATURES
|
||||||
|
|
||||||
|
IMPROVEMENTS
|
||||||
|
|
||||||
|
HDFS-5781. Use an array to record the mapping between FSEditLogOpCode and
|
||||||
|
the corresponding byte value. (jing9)
|
||||||
|
|
||||||
|
OPTIMIZATIONS
|
||||||
|
|
||||||
|
BUG FIXES
|
||||||
|
|
||||||
|
HDFS-5842. Cannot create hftp filesystem when using a proxy user ugi and a doAs
|
||||||
|
on a secure cluster. (jing9)
|
||||||
|
|
||||||
|
Release 2.3.0 - UNRELEASED
|
||||||
|
|
||||||
|
INCOMPATIBLE CHANGES
|
||||||
|
|
||||||
NEW FEATURES
|
NEW FEATURES
|
||||||
|
|
||||||
HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA.
|
HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA.
|
||||||
|
|
@ -38,8 +56,46 @@ Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
HDFS-4949. Centralized cache management in HDFS (wang and cmccabe)
|
HDFS-4949. Centralized cache management in HDFS (wang and cmccabe)
|
||||||
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
IMPROVEMENTS
|
||||||
|
|
||||||
|
HDFS-5360. Improvement of usage message of renameSnapshot and
|
||||||
|
deleteSnapshot. (Shinichi Yamashita via wang)
|
||||||
|
|
||||||
|
HDFS-5331. make SnapshotDiff.java to a o.a.h.util.Tool interface implementation.
|
||||||
|
(Vinayakumar B via umamahesh)
|
||||||
|
|
||||||
|
HDFS-4657. Limit the number of blocks logged by the NN after a block
|
||||||
|
report to a configurable value. (Aaron T. Myers via Colin Patrick
|
||||||
|
McCabe)
|
||||||
|
|
||||||
|
HDFS-5344. Make LsSnapshottableDir as Tool interface implementation. (Sathish via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5544. Adding Test case For Checking dfs.checksum type as NULL value. (Sathish via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5568. Support includeSnapshots option with Fsck command. (Vinayakumar B via umamahesh)
|
||||||
|
|
||||||
|
HDFS-4983. Numeric usernames do not work with WebHDFS FS. (Yongjun Zhang via
|
||||||
|
jing9)
|
||||||
|
|
||||||
|
HDFS-5592. statechangeLog of completeFile should be logged only in case of success.
|
||||||
|
(Vinayakumar via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5662. Can't decommission a DataNode due to file's replication factor
|
||||||
|
larger than the rest of the cluster size. (brandonli)
|
||||||
|
|
||||||
|
HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options.
|
||||||
|
(shv)
|
||||||
|
|
||||||
|
HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark.
|
||||||
|
(Plamen Jeliazkov via shv)
|
||||||
|
|
||||||
|
HDFS-5677. Need error checking for HA cluster configuration.
|
||||||
|
(Vincent Sheffer via cos)
|
||||||
|
|
||||||
|
HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile().
|
||||||
|
(Haohui Mai via Arpit Agarwal)
|
||||||
|
|
||||||
HDFS-5267. Remove volatile from LightWeightHashSet. (Junping Du via llu)
|
HDFS-5267. Remove volatile from LightWeightHashSet. (Junping Du via llu)
|
||||||
|
|
||||||
HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is
|
HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is
|
||||||
|
|
@ -215,9 +271,6 @@ Release 2.4.0 - UNRELEASED
|
||||||
HDFS-5788. listLocatedStatus response can be very large. (Nathan Roberts
|
HDFS-5788. listLocatedStatus response can be very large. (Nathan Roberts
|
||||||
via kihwal)
|
via kihwal)
|
||||||
|
|
||||||
HDFS-5781. Use an array to record the mapping between FSEditLogOpCode and
|
|
||||||
the corresponding byte value. (jing9)
|
|
||||||
|
|
||||||
OPTIMIZATIONS
|
OPTIMIZATIONS
|
||||||
|
|
||||||
HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn)
|
HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn)
|
||||||
|
|
@ -232,6 +285,177 @@ Release 2.4.0 - UNRELEASED
|
||||||
|
|
||||||
BUG FIXES
|
BUG FIXES
|
||||||
|
|
||||||
|
HDFS-5307. Support both HTTP and HTTPS in jsp pages (Haohui Mai via
|
||||||
|
brandonli)
|
||||||
|
|
||||||
|
HDFS-5291. Standby namenode after transition to active goes into safemode.
|
||||||
|
(jing9)
|
||||||
|
|
||||||
|
HDFS-5317. Go back to DFS Home link does not work on datanode webUI
|
||||||
|
(Haohui Mai via brandonli)
|
||||||
|
|
||||||
|
HDFS-5316. Namenode ignores the default https port (Haohui Mai via
|
||||||
|
brandonli)
|
||||||
|
|
||||||
|
HDFS-5281. COMMIT request should not block. (brandonli)
|
||||||
|
|
||||||
|
HDFS-5337. should do hsync for a commit request even there is no pending
|
||||||
|
writes (brandonli)
|
||||||
|
|
||||||
|
HDFS-5335. Hive query failed with possible race in dfs output stream.
|
||||||
|
(Haohui Mai via suresh)
|
||||||
|
|
||||||
|
HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA
|
||||||
|
clusters. (jing9)
|
||||||
|
|
||||||
|
HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter
|
||||||
|
token. (brandonli)
|
||||||
|
|
||||||
|
HDFS-5330. fix readdir and readdirplus for large directories (brandonli)
|
||||||
|
|
||||||
|
HDFS-5370. Typo in Error Message: different between range in condition
|
||||||
|
and range in error message. (Kousuke Saruta via suresh)
|
||||||
|
|
||||||
|
HDFS-5365. Fix libhdfs compile error on FreeBSD9. (Radim Kolar via cnauroth)
|
||||||
|
|
||||||
|
HDFS-5347. Add HDFS NFS user guide. (brandonli)
|
||||||
|
|
||||||
|
HDFS-5403. WebHdfs client cannot communicate with older WebHdfs servers
|
||||||
|
post HDFS-5306. (atm)
|
||||||
|
|
||||||
|
HDFS-5171. NFS should create input stream for a file and try to share it
|
||||||
|
with multiple read requests. (Haohui Mai via brandonli)
|
||||||
|
|
||||||
|
HDFS-5413. hdfs.cmd does not support passthrough to any arbitrary class.
|
||||||
|
(cnauroth)
|
||||||
|
|
||||||
|
HDFS-5433. When reloading fsimage during checkpointing, we should clear
|
||||||
|
existing snapshottable directories. (Aaron T. Myers via wang)
|
||||||
|
|
||||||
|
HDFS-5432. TestDatanodeJsp fails on Windows due to assumption that loopback
|
||||||
|
address resolves to host name localhost. (cnauroth)
|
||||||
|
|
||||||
|
HDFS-5065. TestSymlinkHdfsDisable fails on Windows. (ivanmi)
|
||||||
|
|
||||||
|
HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes
|
||||||
|
cache expires too quickly (Chris Nauroth via Sanjay)
|
||||||
|
|
||||||
|
HDFS-5037. Active NN should trigger its own edit log rolls. (wang)
|
||||||
|
|
||||||
|
HDFS-5035. getFileLinkStatus and rename do not correctly check permissions
|
||||||
|
of symlinks. (Andrew Wang via Colin Patrick McCabe)
|
||||||
|
|
||||||
|
HDFS-5456. NameNode startup progress creates new steps if caller attempts to
|
||||||
|
create a counter for a step that doesn't already exist. (cnauroth)
|
||||||
|
|
||||||
|
HDFS-5458. Datanode failed volume threshold ignored if exception is thrown
|
||||||
|
in getDataDirsFromURIs. (Mike Mellenthin via wang)
|
||||||
|
|
||||||
|
HDFS-5252. Stable write is not handled correctly in someplace. (brandonli)
|
||||||
|
|
||||||
|
HDFS-5364. Add OpenFileCtx cache. (brandonli)
|
||||||
|
|
||||||
|
HDFS-5469. Add configuration property for the sub-directroy export path
|
||||||
|
(brandonli)
|
||||||
|
|
||||||
|
HDFS-5519. COMMIT handler should update the commit status after sync
|
||||||
|
(brandonli)
|
||||||
|
|
||||||
|
HDFS-5372. In FSNamesystem, hasReadLock() returns false if the current
|
||||||
|
thread holds the write lock (Vinaykumar B via umamahesh)
|
||||||
|
|
||||||
|
HDFS-4516. Client crash after block allocation and NN switch before lease recovery for
|
||||||
|
the same file can cause readers to fail forever (VinaayKumar B via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5014. Process register commands with out holding BPOfferService lock.
|
||||||
|
(Vinaykumar B via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5288. Close idle connections in portmap (Haohui Mai via brandonli)
|
||||||
|
|
||||||
|
HDFS-5407. Fix typos in DFSClientCache (Haohui Mai via brandonli)
|
||||||
|
|
||||||
|
HDFS-5548. Use ConcurrentHashMap in portmap (Haohui Mai via brandonli)
|
||||||
|
|
||||||
|
HDFS-5577. NFS user guide update (brandonli)
|
||||||
|
|
||||||
|
HDFS-5563. NFS gateway should commit the buffered data when read request comes
|
||||||
|
after write to the same file (brandonli)
|
||||||
|
|
||||||
|
HDFS-4997. libhdfs doesn't return correct error codes in most cases (cmccabe)
|
||||||
|
|
||||||
|
HDFS-5587. add debug information when NFS fails to start with duplicate user
|
||||||
|
or group names (brandonli)
|
||||||
|
|
||||||
|
HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is
|
||||||
|
set to false. (jing9)
|
||||||
|
|
||||||
|
HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is
|
||||||
|
enabled. (Colin Patrick McCabe via jing9)
|
||||||
|
|
||||||
|
HDFS-5283. Under construction blocks only inside snapshots should not be
|
||||||
|
counted in safemode threshhold. (Vinay via szetszwo)
|
||||||
|
|
||||||
|
HDFS-5257. addBlock() retry should return LocatedBlock with locations else client
|
||||||
|
will get AIOBE. (Vinay via jing9)
|
||||||
|
|
||||||
|
HDFS-5427. Not able to read deleted files from snapshot directly under
|
||||||
|
snapshottable dir after checkpoint and NN restart. (Vinay via jing9)
|
||||||
|
|
||||||
|
HDFS-5443. Delete 0-sized block when deleting an under-construction file that
|
||||||
|
is included in snapshot. (jing9)
|
||||||
|
|
||||||
|
HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed
|
||||||
|
file/directory while deletion. (jing9)
|
||||||
|
|
||||||
|
HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on
|
||||||
|
restart. (jing9 and Vinay)
|
||||||
|
|
||||||
|
HDFS-5474. Deletesnapshot can make Namenode in safemode on NN restarts.
|
||||||
|
(Sathish via jing9)
|
||||||
|
|
||||||
|
HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold,
|
||||||
|
leads to NN safemode. (Vinay via jing9)
|
||||||
|
|
||||||
|
HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart
|
||||||
|
leads nn safemode. (jing9)
|
||||||
|
|
||||||
|
HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a
|
||||||
|
segment. (Todd Lipcon via atm)
|
||||||
|
|
||||||
|
HDFS-4201. NPE in BPServiceActor#sendHeartBeat. (jxiang via cmccabe)
|
||||||
|
|
||||||
|
HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe)
|
||||||
|
|
||||||
|
HDFS-5657. race condition causes writeback state error in NFS gateway (brandonli)
|
||||||
|
|
||||||
|
HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip
|
||||||
|
address. (Benoy Antony via jing9)
|
||||||
|
|
||||||
|
HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (sathish
|
||||||
|
via cmccabe)
|
||||||
|
|
||||||
|
HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. (JamesLi via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down.
|
||||||
|
(brandonli)
|
||||||
|
|
||||||
|
HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. (umamahesh)
|
||||||
|
|
||||||
|
HDFS-5343. When cat command is issued on snapshot files getting unexpected result.
|
||||||
|
(Sathish via umamahesh)
|
||||||
|
|
||||||
|
HDFS-5297. Fix dead links in HDFS site documents. (Akira Ajisaka via
|
||||||
|
Arpit Agarwal)
|
||||||
|
|
||||||
|
HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws
|
||||||
|
IllegalArgumentException when accessing another cluster. (Yongjun Zhang via
|
||||||
|
Colin Patrick McCabe)
|
||||||
|
|
||||||
|
HDFS-5833. Fix SecondaryNameNode javadoc. (Bangtao Zhou via Arpit Agarwal)
|
||||||
|
|
||||||
|
HDFS-5844. Fix broken link in WebHDFS.apt.vm. (Akira Ajisaka via
|
||||||
|
Arpit Agarwal)
|
||||||
|
|
||||||
HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin
|
HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin
|
||||||
Patrick McCabe)
|
Patrick McCabe)
|
||||||
|
|
||||||
|
|
@ -316,9 +540,6 @@ Release 2.4.0 - UNRELEASED
|
||||||
HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be
|
HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be
|
||||||
closed before method returns (Ted Yu via todd)
|
closed before method returns (Ted Yu via todd)
|
||||||
|
|
||||||
HDFS-5842. Cannot create hftp filesystem when using a proxy user ugi and a doAs
|
|
||||||
on a secure cluster. (jing9)
|
|
||||||
|
|
||||||
BREAKDOWN OF HDFS-2832 SUBTASKS AND RELATED JIRAS
|
BREAKDOWN OF HDFS-2832 SUBTASKS AND RELATED JIRAS
|
||||||
|
|
||||||
HDFS-4985. Add storage type to the protocol and expose it in block report
|
HDFS-4985. Add storage type to the protocol and expose it in block report
|
||||||
|
|
@ -656,227 +877,6 @@ Release 2.4.0 - UNRELEASED
|
||||||
HDFS-5724. modifyCacheDirective logging audit log command wrongly as
|
HDFS-5724. modifyCacheDirective logging audit log command wrongly as
|
||||||
addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe)
|
addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe)
|
||||||
|
|
||||||
|
|
||||||
Release 2.3.0 - UNRELEASED
|
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
|
||||||
|
|
||||||
NEW FEATURES
|
|
||||||
|
|
||||||
IMPROVEMENTS
|
|
||||||
|
|
||||||
HDFS-5360. Improvement of usage message of renameSnapshot and
|
|
||||||
deleteSnapshot. (Shinichi Yamashita via wang)
|
|
||||||
|
|
||||||
HDFS-5331. make SnapshotDiff.java to a o.a.h.util.Tool interface implementation.
|
|
||||||
(Vinayakumar B via umamahesh)
|
|
||||||
|
|
||||||
HDFS-4657. Limit the number of blocks logged by the NN after a block
|
|
||||||
report to a configurable value. (Aaron T. Myers via Colin Patrick
|
|
||||||
McCabe)
|
|
||||||
|
|
||||||
HDFS-5344. Make LsSnapshottableDir as Tool interface implementation. (Sathish via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5544. Adding Test case For Checking dfs.checksum type as NULL value. (Sathish via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5568. Support includeSnapshots option with Fsck command. (Vinayakumar B via umamahesh)
|
|
||||||
|
|
||||||
HDFS-4983. Numeric usernames do not work with WebHDFS FS. (Yongjun Zhang via
|
|
||||||
jing9)
|
|
||||||
|
|
||||||
HDFS-5592. statechangeLog of completeFile should be logged only in case of success.
|
|
||||||
(Vinayakumar via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5662. Can't decommission a DataNode due to file's replication factor
|
|
||||||
larger than the rest of the cluster size. (brandonli)
|
|
||||||
|
|
||||||
HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options.
|
|
||||||
(shv)
|
|
||||||
|
|
||||||
HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark.
|
|
||||||
(Plamen Jeliazkov via shv)
|
|
||||||
|
|
||||||
HDFS-5677. Need error checking for HA cluster configuration.
|
|
||||||
(Vincent Sheffer via cos)
|
|
||||||
|
|
||||||
HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile().
|
|
||||||
(Haohui Mai via Arpit Agarwal)
|
|
||||||
|
|
||||||
OPTIMIZATIONS
|
|
||||||
|
|
||||||
BUG FIXES
|
|
||||||
|
|
||||||
HDFS-5307. Support both HTTP and HTTPS in jsp pages (Haohui Mai via
|
|
||||||
brandonli)
|
|
||||||
|
|
||||||
HDFS-5291. Standby namenode after transition to active goes into safemode.
|
|
||||||
(jing9)
|
|
||||||
|
|
||||||
HDFS-5317. Go back to DFS Home link does not work on datanode webUI
|
|
||||||
(Haohui Mai via brandonli)
|
|
||||||
|
|
||||||
HDFS-5316. Namenode ignores the default https port (Haohui Mai via
|
|
||||||
brandonli)
|
|
||||||
|
|
||||||
HDFS-5281. COMMIT request should not block. (brandonli)
|
|
||||||
|
|
||||||
HDFS-5337. should do hsync for a commit request even there is no pending
|
|
||||||
writes (brandonli)
|
|
||||||
|
|
||||||
HDFS-5335. Hive query failed with possible race in dfs output stream.
|
|
||||||
(Haohui Mai via suresh)
|
|
||||||
|
|
||||||
HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA
|
|
||||||
clusters. (jing9)
|
|
||||||
|
|
||||||
HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter
|
|
||||||
token. (brandonli)
|
|
||||||
|
|
||||||
HDFS-5330. fix readdir and readdirplus for large directories (brandonli)
|
|
||||||
|
|
||||||
HDFS-5370. Typo in Error Message: different between range in condition
|
|
||||||
and range in error message. (Kousuke Saruta via suresh)
|
|
||||||
|
|
||||||
HDFS-5365. Fix libhdfs compile error on FreeBSD9. (Radim Kolar via cnauroth)
|
|
||||||
|
|
||||||
HDFS-5347. Add HDFS NFS user guide. (brandonli)
|
|
||||||
|
|
||||||
HDFS-5403. WebHdfs client cannot communicate with older WebHdfs servers
|
|
||||||
post HDFS-5306. (atm)
|
|
||||||
|
|
||||||
HDFS-5171. NFS should create input stream for a file and try to share it
|
|
||||||
with multiple read requests. (Haohui Mai via brandonli)
|
|
||||||
|
|
||||||
HDFS-5413. hdfs.cmd does not support passthrough to any arbitrary class.
|
|
||||||
(cnauroth)
|
|
||||||
|
|
||||||
HDFS-5433. When reloading fsimage during checkpointing, we should clear
|
|
||||||
existing snapshottable directories. (Aaron T. Myers via wang)
|
|
||||||
|
|
||||||
HDFS-5432. TestDatanodeJsp fails on Windows due to assumption that loopback
|
|
||||||
address resolves to host name localhost. (cnauroth)
|
|
||||||
|
|
||||||
HDFS-5065. TestSymlinkHdfsDisable fails on Windows. (ivanmi)
|
|
||||||
|
|
||||||
HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes
|
|
||||||
cache expires too quickly (Chris Nauroth via Sanjay)
|
|
||||||
|
|
||||||
HDFS-5037. Active NN should trigger its own edit log rolls. (wang)
|
|
||||||
|
|
||||||
HDFS-5035. getFileLinkStatus and rename do not correctly check permissions
|
|
||||||
of symlinks. (Andrew Wang via Colin Patrick McCabe)
|
|
||||||
|
|
||||||
HDFS-5456. NameNode startup progress creates new steps if caller attempts to
|
|
||||||
create a counter for a step that doesn't already exist. (cnauroth)
|
|
||||||
|
|
||||||
HDFS-5458. Datanode failed volume threshold ignored if exception is thrown
|
|
||||||
in getDataDirsFromURIs. (Mike Mellenthin via wang)
|
|
||||||
|
|
||||||
HDFS-5252. Stable write is not handled correctly in someplace. (brandonli)
|
|
||||||
|
|
||||||
HDFS-5364. Add OpenFileCtx cache. (brandonli)
|
|
||||||
|
|
||||||
HDFS-5469. Add configuration property for the sub-directroy export path
|
|
||||||
(brandonli)
|
|
||||||
|
|
||||||
HDFS-5519. COMMIT handler should update the commit status after sync
|
|
||||||
(brandonli)
|
|
||||||
|
|
||||||
HDFS-5372. In FSNamesystem, hasReadLock() returns false if the current
|
|
||||||
thread holds the write lock (Vinaykumar B via umamahesh)
|
|
||||||
|
|
||||||
HDFS-4516. Client crash after block allocation and NN switch before lease recovery for
|
|
||||||
the same file can cause readers to fail forever (VinaayKumar B via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5014. Process register commands with out holding BPOfferService lock.
|
|
||||||
(Vinaykumar B via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5288. Close idle connections in portmap (Haohui Mai via brandonli)
|
|
||||||
|
|
||||||
HDFS-5407. Fix typos in DFSClientCache (Haohui Mai via brandonli)
|
|
||||||
|
|
||||||
HDFS-5548. Use ConcurrentHashMap in portmap (Haohui Mai via brandonli)
|
|
||||||
|
|
||||||
HDFS-5577. NFS user guide update (brandonli)
|
|
||||||
|
|
||||||
HDFS-5563. NFS gateway should commit the buffered data when read request comes
|
|
||||||
after write to the same file (brandonli)
|
|
||||||
|
|
||||||
HDFS-4997. libhdfs doesn't return correct error codes in most cases (cmccabe)
|
|
||||||
|
|
||||||
HDFS-5587. add debug information when NFS fails to start with duplicate user
|
|
||||||
or group names (brandonli)
|
|
||||||
|
|
||||||
HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is
|
|
||||||
set to false. (jing9)
|
|
||||||
|
|
||||||
HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is
|
|
||||||
enabled. (Colin Patrick McCabe via jing9)
|
|
||||||
|
|
||||||
HDFS-5283. Under construction blocks only inside snapshots should not be
|
|
||||||
counted in safemode threshhold. (Vinay via szetszwo)
|
|
||||||
|
|
||||||
HDFS-5257. addBlock() retry should return LocatedBlock with locations else client
|
|
||||||
will get AIOBE. (Vinay via jing9)
|
|
||||||
|
|
||||||
HDFS-5427. Not able to read deleted files from snapshot directly under
|
|
||||||
snapshottable dir after checkpoint and NN restart. (Vinay via jing9)
|
|
||||||
|
|
||||||
HDFS-5443. Delete 0-sized block when deleting an under-construction file that
|
|
||||||
is included in snapshot. (jing9)
|
|
||||||
|
|
||||||
HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed
|
|
||||||
file/directory while deletion. (jing9)
|
|
||||||
|
|
||||||
HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on
|
|
||||||
restart. (jing9 and Vinay)
|
|
||||||
|
|
||||||
HDFS-5474. Deletesnapshot can make Namenode in safemode on NN restarts.
|
|
||||||
(Sathish via jing9)
|
|
||||||
|
|
||||||
HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold,
|
|
||||||
leads to NN safemode. (Vinay via jing9)
|
|
||||||
|
|
||||||
HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart
|
|
||||||
leads nn safemode. (jing9)
|
|
||||||
|
|
||||||
HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a
|
|
||||||
segment. (Todd Lipcon via atm)
|
|
||||||
|
|
||||||
HDFS-4201. NPE in BPServiceActor#sendHeartBeat. (jxiang via cmccabe)
|
|
||||||
|
|
||||||
HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe)
|
|
||||||
|
|
||||||
HDFS-5657. race condition causes writeback state error in NFS gateway (brandonli)
|
|
||||||
|
|
||||||
HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip
|
|
||||||
address. (Benoy Antony via jing9)
|
|
||||||
|
|
||||||
HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (sathish
|
|
||||||
via cmccabe)
|
|
||||||
|
|
||||||
HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. (JamesLi via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down.
|
|
||||||
(brandonli)
|
|
||||||
|
|
||||||
HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. (umamahesh)
|
|
||||||
|
|
||||||
HDFS-5343. When cat command is issued on snapshot files getting unexpected result.
|
|
||||||
(Sathish via umamahesh)
|
|
||||||
|
|
||||||
HDFS-5297. Fix dead links in HDFS site documents. (Akira Ajisaka via
|
|
||||||
Arpit Agarwal)
|
|
||||||
|
|
||||||
HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws
|
|
||||||
IllegalArgumentException when accessing another cluster. (Yongjun Zhang via
|
|
||||||
Colin Patrick McCabe)
|
|
||||||
|
|
||||||
HDFS-5833. Fix SecondaryNameNode javadoc. (Bangtao Zhou via Arpit Agarwal)
|
|
||||||
|
|
||||||
HDFS-5844. Fix broken link in WebHDFS.apt.vm. (Akira Ajisaka via
|
|
||||||
Arpit Agarwal)
|
|
||||||
|
|
||||||
Release 2.2.0 - 2013-10-13
|
Release 2.2.0 - 2013-10-13
|
||||||
|
|
||||||
INCOMPATIBLE CHANGES
|
INCOMPATIBLE CHANGES
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue