Commit Graph

53 Commits

Author SHA1 Message Date
Tsz-wo Sze c3f6575ca4 HDFS-2147. Move cluster network topology to block management and fix some javac warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148112 13f79535-47bb-0310-9956-ffa450edef68
2011-07-19 00:26:21 +00:00
Eli Collins 81001b87c1 HDFS-2157. Improve header comment in o.a.h.hdfs.server.namenode.NameNode. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147980 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 17:23:25 +00:00
Suresh Srinivas 8a77d0b289 HDFS-2143. Federation: In cluster web console, add link to namenode page that displays live and dead datanodes. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147964 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 16:45:28 +00:00
Aaron Myers eaa0638c12 HDFS-2152. TestWriteConfigurationToDFS causing the random failures. (Uma Maheswara Rao G via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147762 13f79535-47bb-0310-9956-ffa450edef68
2011-07-18 07:07:58 +00:00
Tsz-wo Sze c163455df4 HDFS-2159. Deprecate DistributedFileSystem.getClient() and fixed the deprecated warnings in DFSAdmin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147359 13f79535-47bb-0310-9956-ffa450edef68
2011-07-16 05:12:40 +00:00
Tsz-wo Sze c093580824 HDFS-2153. Move DFSClientAdapter to test and fix some javac warnings in OfflineEditsViewerHelper.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147340 13f79535-47bb-0310-9956-ffa450edef68
2011-07-15 22:46:43 +00:00
Tsz-wo Sze f582aa4492 HDFS-2154. In TestDFSShell, use TEST_ROOT_DIR and fix some deprecated warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147184 13f79535-47bb-0310-9956-ffa450edef68
2011-07-15 15:09:43 +00:00
Aaron Myers c54c117407 HDFS-2120. on reconnect, DN can connect to NN even with different source versions. (John George via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146516 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 23:44:42 +00:00
Tsz-wo Sze 8327e70be8 HDFS-2140. Move Host2NodesMap to the blockmanagement package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146514 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 23:24:36 +00:00
Tsz-wo Sze 13a26379ed HDFS-2131. Add new tests for the -overwrite/-f option in put and copyFromLocal by HADOOP-7361. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145843 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 03:01:25 +00:00
Jitendra Nath Pandey 2c5dd549e3 HDFS-1977. Stop using StringUtils.stringifyException(). Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145834 13f79535-47bb-0310-9956-ffa450edef68
2011-07-13 01:11:01 +00:00
Michael Stack 94f3b578ef HDFS-2054 BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() -- moved the change notice into 0.22 section (i'd originally committed it in trunk section)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145753 13f79535-47bb-0310-9956-ffa450edef68
2011-07-12 20:28:36 +00:00
Michael Stack 714edd65ac HDFS-2054 BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully()
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145751 13f79535-47bb-0310-9956-ffa450edef68
2011-07-12 20:23:39 +00:00
Aaron Myers 1ba3ddbe6d HDFS-2132. Potential resource leak in EditLogFileOutputStream.close. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145428 13f79535-47bb-0310-9956-ffa450edef68
2011-07-12 02:18:30 +00:00
Tsz-wo Sze b9189f7b15 HDFS-2134. Move DecommissionManager to the blockmanagement package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145393 13f79535-47bb-0310-9956-ffa450edef68
2011-07-11 23:06:36 +00:00
Tsz-wo Sze 6ec9b178c6 HDFS-2034. Length in DFSInputStream.getBlockRange(..) becomes -ve when reading only from a currently being written block. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144480 13f79535-47bb-0310-9956-ffa450edef68
2011-07-08 20:13:26 +00:00
Todd Lipcon 209fd3f9fc HDFS-2111. Add tests for ensuring that the DN will start with a few bad data directories. Contributed by Harsh J Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144100 13f79535-47bb-0310-9956-ffa450edef68
2011-07-08 00:16:07 +00:00
Tsz-wo Sze 5c778cdee3 HDFS-1990. Fix resource leaks in BlockReceiver.close(). Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143147 13f79535-47bb-0310-9956-ffa450edef68
2011-07-05 17:19:07 +00:00
Eli Collins 1e5e03c73c HDFS-1753. Resource Leak in StreamFile. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143106 13f79535-47bb-0310-9956-ffa450edef68
2011-07-05 15:31:58 +00:00
Tsz-wo Sze 09c8adfb18 HDFS-2109. Store uMask as member variable to DFSClient.Conf. Contributed by Bharath Mundlapudi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141767 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 00:21:51 +00:00
Matthew Foley 7bd41f031f HDFS-2011. Removal and restoration of storage directories on checkpointing failure doesn't work properly. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141748 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 23:21:58 +00:00
Eli Collins 3af51887b4 HDFS-2118. Couple dfs data dir improvements. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141713 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 20:56:37 +00:00
Matthew Foley 5147e283ad HDFS-1955. FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826. Contributed by Matt Foley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141658 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 18:38:01 +00:00
Eli Collins 8851db12a1 Minor update to HDFS-2110.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141416 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 07:05:32 +00:00
Tsz-wo Sze 09b6f98de4 HDFS-2107. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140939 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 01:31:15 +00:00
Tsz-wo Sze 97b6ca4dd7 Revert 1140913 and 1140909 for HDFS-2107.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140920 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 00:26:41 +00:00
Tsz-wo Sze d58e3efe92 Fix CHANGES.txt (HDFS-2106 should be HDFS-2107) and add NumberReplicas.java.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140913 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 23:57:02 +00:00
Tsz-wo Sze 1bcfe45e47 HDFS-2106. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140909 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 23:43:03 +00:00
Eli Collins 1834fb99f5 HDFS-2053. Bug in INodeDirectory#computeContentSummary warning. Contributed by Michael Noll
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140707 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 16:21:46 +00:00
Eli Collins 7663caab5a HDFS-2110. StreamFile and ByteRangeInputStream cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140694 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 15:59:31 +00:00
Aaron Myers f43e0ffa7e HDFS-1723. quota errors messages should use the same scale. (Jim Plush via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140030 13f79535-47bb-0310-9956-ffa450edef68
2011-06-27 07:05:50 +00:00
Aaron Myers 604383b22d HDFS-1381. HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters (Jim Plush via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139715 13f79535-47bb-0310-9956-ffa450edef68
2011-06-26 05:39:50 +00:00
Aaron Myers 6894edebd9 HDFS-1321. If service port and main port are the same, there is no clear log message explaining the issue. (Jim Plush via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139473 13f79535-47bb-0310-9956-ffa450edef68
2011-06-25 00:39:29 +00:00
Aaron Myers 4c4eed13d5 HDFS-2082. SecondaryNameNode web interface doesn't show the right info. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139397 13f79535-47bb-0310-9956-ffa450edef68
2011-06-24 18:18:55 +00:00
Tsz-wo Sze 2f48fae72a HDFS-2087. Declare methods in DataTransferProtocol interface, and change Sender and Receiver to implement the interface.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139124 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 23:57:18 +00:00
Tsz-wo Sze fd9997989c HDFS-2092. Remove some object references to Configuration in DFSClient. Contributed by Bharath Mundlapudi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139097 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 22:24:59 +00:00
Tanping Wang 42863b9baf HDFS-2086. If the include hosts list contains host names, after restarting namenode, data nodes registration is denied. Contributed by Tanping Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139090 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 22:13:58 +00:00
Tanping Wang 15e68cb374 HDFS-2083 Query JMX statistics over http via JMXJsonServlet. (tanping)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138645 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 21:42:46 +00:00
Aaron Myers a851ce5dcb HDFS-2100. Improve TestStorageRestore. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138262 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 00:14:49 +00:00
Tsz-wo Sze 3f190b3e1a HDFS-1568. Improve the log messages in DataXceiver. Contributed by Joey Echeverria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138098 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 17:12:06 +00:00
Eli Collins e45025c7ce HDFS-420. Fuse-dfs should cache fs handles. Contributed by Brian Bockelman and Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137675 13f79535-47bb-0310-9956-ffa450edef68
2011-06-20 16:03:11 +00:00
Jitendra Nath Pandey 7964df9c94 HDFS-1734. 'Chunk size to view' option is not working in Name Node UI. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136975 13f79535-47bb-0310-9956-ffa450edef68
2011-06-17 18:42:23 +00:00
Suresh Srinivas 58dc1381e0 HDFS-1692. In secure mode, Datanode process doesn't exit when disks fail. Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136741 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 23:35:11 +00:00
Eli Collins 9185f8b003 HDFS-2055. Add hflush support to libhdfs. Contributed by Travis Crawford
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136646 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 20:14:54 +00:00
Matthew Foley 01a407d9df HDFS-1656. Fixes an issue to do with fetching of delegation tokens in HftpFileSystem. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136608 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 19:04:26 +00:00
Suresh Srinivas 3361e76e30 Moved HDFS-1359 and HDFS-1439 description under trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136565 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 17:45:00 +00:00
Suresh Srinivas 53268e2155 HDFS-2073. Add @Override annotation to NameNode. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136230 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 22:41:46 +00:00
Todd Lipcon 6a3963cc8b HDFS-2071. Use of isConnected() in DataXceiver is invalid. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136205 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 21:36:56 +00:00
Todd Lipcon f7c0c44de2 Move HDFS-941 to 0.22 section of CHANGES.txt since it was voted to go into that branch as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136204 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 21:35:33 +00:00
Suresh Srinivas b1f806ab2c HDFS-1942. Datanode must exist when all the block pool service threads exit. Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136132 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 17:39:33 +00:00