Commit Graph

1470 Commits

Author SHA1 Message Date
Robert Joseph Evans d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:57:23 +00:00
Robert Joseph Evans 59e4199d84 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409311 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 19:21:25 +00:00
Robert Joseph Evans b2456ca3b8 svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409266 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 17:32:55 +00:00
Eli Collins a780f0ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:17:19 +00:00
Alejandro Abdelnur 368f628ce5 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409087 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:12:03 +00:00
Uma Maheswara Rao G 0800aa90dd HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409071 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 03:10:10 +00:00
Suresh Srinivas a5976bee37 Moving HDFS-4106 to Release 2.0.3 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409038 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 00:02:53 +00:00
Daryn Sharp 4741064250 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 15:29:04 +00:00
Eli Collins 3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:28:33 +00:00
Aaron Myers b3e42a1ed5 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408531 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:26:20 +00:00
Eli Collins c1a2098304 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 22:20:43 +00:00
Robert Joseph Evans 7ff7f67a82 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408401 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 18:51:27 +00:00
Thomas White 42f4691ead Add new files missed from HADOOP-8860 commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408288 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 13:54:27 +00:00
Alejandro Abdelnur 9d5205aadd HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. (tomwhite via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407658 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 21:44:00 +00:00
Suresh Srinivas a4b1c675b6 Moving HDFS-4080 to Incompatible Change section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407567 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:09:21 +00:00
Suresh Srinivas db71de2e11 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407566 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:07:04 +00:00
Suresh Srinivas c7ab9779d2 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407556 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:39:20 +00:00
Eli Collins 312eb23598 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407345 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 02:57:05 +00:00
Daryn Sharp be94bf6b57 HDFS-3990. NN's health report has severe performance problems (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407333 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 00:53:11 +00:00
Suresh Srinivas 0f7a4337ac HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 19:54:55 +00:00
Konstantin Shvachko d511052be5 Move HDFS-3625 and HDFS-4138 under 2.0.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407189 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 18:01:38 +00:00
Uma Maheswara Rao G f1fe91ec95 HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407182 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 17:45:46 +00:00
Konstantin Shvachko c44f37a7a5 Move HDFS-3625 under 0.23.5
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406739 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 17:59:35 +00:00
Konstantin Shvachko 1ab97373de HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406734 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 17:45:01 +00:00
Aaron Myers 817a26b6c8 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 06:29:37 +00:00
Suresh Srinivas c013142a12 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406413 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 00:48:17 +00:00
Tsz-wo Sze 1e7010cf38 HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406382 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:34:29 +00:00
Suresh Srinivas 251230a126 HADOOP-9004. Reverting the commit r1406202 to address patch issue
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406379 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:23:51 +00:00
Todd Lipcon a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:05:34 +00:00
Tsz-wo Sze 1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 21:04:32 +00:00
Daryn Sharp 54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 19:27:47 +00:00
Suresh Srinivas b13a5cdcb7 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406202 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 16:12:43 +00:00
Daryn Sharp 3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:57:58 +00:00
Suresh Srinivas dca8dd7a20 Add HDFS-4046 to Release 2.0.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406019 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 00:22:23 +00:00
Suresh Srinivas 159e507995 HDFS-4046. Adding the missed file in revision 1406011
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406012 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:50:29 +00:00
Suresh Srinivas e0ce1b2475 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406011 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:49:33 +00:00
Tsz-wo Sze 7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:26:34 +00:00
Tsz-wo Sze d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
2012-11-03 00:20:03 +00:00
Todd Lipcon a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 20:35:51 +00:00
Daryn Sharp 19befa0748 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404985 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 14:56:22 +00:00
Suresh Srinivas 07e0d7730d HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403956 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 02:33:44 +00:00
Suresh Srinivas cd0d206bb8 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403922 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 23:12:12 +00:00
Uma Maheswara Rao G b2822e3742 Moved HDFS-3809 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403769 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 16:32:01 +00:00
Uma Maheswara Rao G 7ccdb67d5c Moved HDFS-3789 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403765 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 16:22:42 +00:00
Uma Maheswara Rao G 52df4b3e78 Moved HDFS-3695 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403748 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:51:49 +00:00
Uma Maheswara Rao G 1e07fece6e Moved HDFS-3573 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403740 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:38:12 +00:00
Daryn Sharp deef03c5d6 HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403714 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 14:21:00 +00:00
Suresh Srinivas 7604a276a7 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403616 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:48:58 +00:00
Suresh Srinivas ba7a2e3898 Moved HDFS-4122 to Release 2.0.3 section. It is also moved to Incompatible Changes section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403570 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 22:43:58 +00:00
Suresh Srinivas 1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 14:11:04 +00:00
Suresh Srinivas 4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 05:10:29 +00:00
Suresh Srinivas cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 23:10:53 +00:00
Suresh Srinivas fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 19:03:57 +00:00
Suresh Srinivas abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 18:59:11 +00:00
Suresh Srinivas b6d09f67ab Moving HDFS-4121 from trunk to Release 2.0.3 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402843 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:41:43 +00:00
Suresh Srinivas cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:25:02 +00:00
Tsz-wo Sze 3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:22:49 +00:00
Tsz-wo Sze 0e796b61e8 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402599 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:08:38 +00:00
Tsz-wo Sze 2d74f68054 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:53:25 +00:00
Tsz-wo Sze ba2ee1d7fb HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402265 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:44:46 +00:00
Suresh Srinivas 163577f905 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:32:41 +00:00
Suresh Srinivas 611684e2e5 HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402203 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 16:15:59 +00:00
Suresh Srinivas 464edf2439 Moving HDFS-2434 from Release 2.0.3 section to trunk section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401446 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:27:16 +00:00
Suresh Srinivas aa42e2161d HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:02:09 +00:00
Daryn Sharp a92313f7bd HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401309 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 15:03:53 +00:00
Tsz-wo Sze 75cdb5bb49 HDFS-4099. Clean up replication code and add more javadoc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400986 13f79535-47bb-0310-9956-ffa450edef68
2012-10-22 18:30:16 +00:00
Uma Maheswara Rao G 35ec20b7c6 HDFS-4022. Replication not happening for appended block. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400578 13f79535-47bb-0310-9956-ffa450edef68
2012-10-21 06:31:31 +00:00
Tsz-wo Sze 661a8d176a HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400345 13f79535-47bb-0310-9956-ffa450edef68
2012-10-20 00:06:12 +00:00
Alejandro Abdelnur a4f30ff53c reverting commit 1399898 (HADOOP-8887)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399972 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 05:38:26 +00:00
Suresh Srinivas 0603447f2a HDFS-4072. On file deletion remove corresponding blocks pending replications. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399965 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 04:55:11 +00:00
Eli Collins 7da5d03c35 HDFS-4053. Increase the default block size. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399908 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:56:30 +00:00
Alejandro Abdelnur 53c598ab11 HADOOP-8887. Use a Maven plugin to build the native code using CMake. (cmccabe via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399898 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:40:41 +00:00
Eli Collins 57ee22e589 HADOOP-8925. Remove the packaging. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:30:11 +00:00
Tsz-wo Sze 4af8761e4c HDFS-4074. Remove the unused default constructor from INode. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399866 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 21:29:12 +00:00
Tsz-wo Sze c1bd54daa3 HDFS-4073. Two minor improvements to FSDirectory. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399861 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 21:18:25 +00:00
Eli Collins 4d5600f6c7 HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399443 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 21:34:48 +00:00
Eli Collins a258263ecf HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399096 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 04:58:24 +00:00
Eli Collins 24015b7684 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399093 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 04:39:07 +00:00
Aaron Myers 402836479f HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399062 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 01:10:55 +00:00
Eli Collins e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 21:59:15 +00:00
Suresh Srinivas 0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 19:39:50 +00:00
Eli Collins b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 16:29:21 +00:00
Suresh Srinivas b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 03:37:49 +00:00
Eli Collins a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 02:12:59 +00:00
Aaron Myers 557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 01:59:46 +00:00
Aaron Myers f5f763eb15 Update CHANGES.txt to have HDFS-3678 under release 2.0.3 instead of 3.0.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398603 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 01:31:26 +00:00
Todd Lipcon ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 00:55:29 +00:00
Tsz-wo Sze 698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
2012-10-15 14:05:31 +00:00
Tsz-wo Sze ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
2012-10-15 13:48:56 +00:00
Jason Darrell Lowe f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 19:49:40 +00:00
Suresh Srinivas 89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 14:32:16 +00:00
Suresh Srinivas 94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 04:35:42 +00:00
Suresh Srinivas 4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 23:10:47 +00:00
Todd Lipcon 7ca007b241 Merge CHANGES for HDFS-3077 into the main CHANGES.txt file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397352 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 22:51:34 +00:00
Suresh Srinivas 2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 18:08:27 +00:00
Todd Lipcon ff8f84ccf6 Merge trunk into branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 06:14:26 +00:00
Suresh Srinivas 33c16f2a24 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 05:17:03 +00:00
Aaron Myers 8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 00:32:46 +00:00
Jason Darrell Lowe 08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 21:15:06 +00:00
Eli Collins c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 18:42:54 +00:00
Thomas Graves a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 17:35:18 +00:00
Eli Collins 03c96ef29e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 00:18:27 +00:00
Todd Lipcon 17b32bb2de HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395731 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:19:21 +00:00
Todd Lipcon 70fc5cf01c HDFS-4017. Unclosed FileInputStream in GetJournalEditServlet. Contributed by Chao Shi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1395727 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:11:48 +00:00
Eli Collins 5dcdc8aa58 HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395708 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:34:14 +00:00
Eli Collins 3a4cf1c064 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:11:53 +00:00
Eli Collins 5a5473b29f HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:35:51 +00:00
Eli Collins e32af6034b HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:16:08 +00:00
Aaron Myers 353958dccc HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394864 13f79535-47bb-0310-9956-ffa450edef68
2012-10-06 00:13:28 +00:00
Thomas Graves d35169d9ba HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394609 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 15:51:10 +00:00
Suresh Srinivas dfb8369c29 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394385 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 07:02:52 +00:00
Suresh Srinivas a41f808c3c HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394376 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 06:22:26 +00:00
Aaron Myers 6582da034b HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394340 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 00:54:05 +00:00
Alejandro Abdelnur 016b86867b HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394169 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 17:45:42 +00:00
Eli Collins ee13fb4f69 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393890 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:53:28 +00:00
Eli Collins 38943644e0 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393884 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:41:04 +00:00
Eli Collins 2c66a9f5ae HDFS-2127. Add a test that ensure AccessControlExceptions contain a full path. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393878 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:06:56 +00:00
Todd Lipcon 10a0eaaf0a HDFS-4004. TestJournalNode#testJournal fails because of test case execution order. Contributed by Chao Shi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1393870 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 01:40:12 +00:00
Eli Collins 5c19b6b7b6 Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393830 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 23:38:08 +00:00
Eli Collins 43ae84761f HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393777 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:30:45 +00:00
Eli Collins f8f79a02aa HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 19:13:53 +00:00
Robert Joseph Evans af647bb3ce Preparing for release 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:15:39 +00:00
Harsh J 34becbb019 HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 10:57:53 +00:00
Aaron Myers 648ba4a36b HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391763 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 07:30:45 +00:00
Aaron Myers e8dc3b3a8a HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391708 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 00:51:48 +00:00
Todd Lipcon 802ccafcd9 Fix some spurious whitespace changes in branch (per Suresh's review)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1391247 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 22:37:58 +00:00
Robert Joseph Evans 01c0dc98bb HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391121 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 17:31:48 +00:00
Eli Collins a33ae4020d HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 05:03:42 +00:00
Eli Collins 47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 21:25:04 +00:00
Tsz-wo Sze a7bcdcc051 HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390466 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 13:23:21 +00:00
Todd Lipcon b1ceaac3e6 Merge trunk into branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1390199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 22:43:04 +00:00
Suresh Srinivas 248756eac6 Moving HDFS-234 from trunk to Release 2.0.0-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389494 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 17:44:32 +00:00
Harsh J 9c9b3f09ed HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389010 13f79535-47bb-0310-9956-ffa450edef68
2012-09-23 10:50:44 +00:00
Harsh J bd76d9a827 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68
2012-09-22 18:56:07 +00:00
Eli Collins fa6d519657 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388335 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 06:17:29 +00:00
Eli Collins 3ea3508319 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388331 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 05:48:42 +00:00
Eli Collins 7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 04:51:43 +00:00
Eli Collins d26f05b7f5 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387838 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 01:33:13 +00:00
Todd Lipcon 8a3e64c77f HDFS-3956. QJM: purge temporary files when no longer within retention period. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387817 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 23:40:59 +00:00
Todd Lipcon f26c63df21 Amend HFDS-3955. Forgot an import of ImmutableList in previous patch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387740 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 20:24:12 +00:00
Todd Lipcon 3ccd905d8a HDFS-3955. QJM: Make acceptRecovery() atomic. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387706 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 18:57:11 +00:00
Todd Lipcon 663e7484c0 HDFS-3950. QJM: misc TODO cleanup, improved log messages, etc. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387704 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 18:52:15 +00:00
Alejandro Abdelnur 8bf6b80f2b Reverting HADOOP-8805
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387697 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 18:06:42 +00:00
Alejandro Abdelnur 7fb42f8f4b HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387688 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 17:39:46 +00:00
Todd Lipcon e9f4de5ced Merge trunk into branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387449 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 04:34:55 +00:00
Alejandro Abdelnur 9f6cfe32e4 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387298 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 18:15:37 +00:00
Eli Collins a8e4bb81b2 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 17:42:09 +00:00
Eli Collins ea6a36e2e7 HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387273 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 17:32:01 +00:00
Eli Collins 7e3776ca6e HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 16:59:47 +00:00
Alejandro Abdelnur c419b1385d HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386994 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 05:45:57 +00:00
Todd Lipcon 83c14fbd24 HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1386863 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 21:51:40 +00:00
Eli Collins 4d2e77bc1c Revert previous commit - accidentally included two changes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386783 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 19:28:14 +00:00
Eli Collins 8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 19:25:05 +00:00
Alejandro Abdelnur 0de9642514 HDFS-3938. remove current limitations from HttpFS docs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384842 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:28:47 +00:00
Thomas White d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:05:30 +00:00
Aaron Myers d8e386f01a HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:44:23 +00:00
Aaron Myers 86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 23:48:25 +00:00
Aaron Myers 853db9ec24 HDFS-3926. QJM: Add user documentation for QJM. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384595 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 23:02:32 +00:00
Todd Lipcon 40d56f1741 HDFS-3894. QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384592 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 23:00:22 +00:00
Suresh Srinivas d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 05:46:18 +00:00
Eli Collins 4f312cfa70 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 19:15:38 +00:00
Eli Collins 2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:36:01 +00:00
Todd Lipcon 80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:32:57 +00:00
Eli Collins f0c3ed79dd HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:21:31 +00:00
Eli Collins 414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:10:58 +00:00
Eli Collins dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 21:24:12 +00:00
Todd Lipcon a93ba1648a HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383252 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 06:33:47 +00:00
Todd Lipcon 8a8c9c18d3 HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383251 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 06:31:42 +00:00
Todd Lipcon c859e87d1e HDFS-3915. QJM: Failover fails with auth error in secure cluster. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383242 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 04:53:08 +00:00
Todd Lipcon c5199cace6 HDFS-3914. QJM: acceptRecovery should abort current segment. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383148 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 23:20:49 +00:00
Todd Lipcon 729ec86907 HDFS-3899. Add client side metrics for QJM. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383139 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 22:39:46 +00:00
Todd Lipcon 959afc0fd3 HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383137 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 22:30:52 +00:00
Todd Lipcon 60c20e559b HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383041 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:53:41 +00:00
Todd Lipcon ca4582222e HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383039 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:51:15 +00:00
Todd Lipcon aa65777ef0 HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383033 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:46:58 +00:00
Eli Collins e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:46:13 +00:00
Todd Lipcon 1cea56d6ef Merge trunk into QJM branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383030 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:45:45 +00:00
Tsz-wo Sze 009235f4a9 HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382836 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 13:43:28 +00:00
Eli Collins 3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
2012-09-09 06:37:31 +00:00
Arun Murthy 681408f898 Set date for hadoop-2.0.2-alpha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:39:45 +00:00
Arun Murthy 7851676f22 Preparing for hadoop-2.0.2-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:09:48 +00:00
Aaron Myers 16234cbd5f HDFS-3897. QJM: TestBlockToken fails after HDFS-3893. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381842 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 02:01:21 +00:00
Aaron Myers df801074c9 HDFS-3893. QJM: Make QJM work with security enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381770 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 21:42:14 +00:00
Alejandro Abdelnur 9da626af41 HDFS-3895. hadoop-client must include commons-cli (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381719 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 19:03:37 +00:00
Uma Maheswara Rao G 0654590853 Removed unnecessary .org files added in previous commit HDFS-3809
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381700 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:05:30 +00:00
Uma Maheswara Rao G 6fd7df77a5 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381699 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:03:16 +00:00
Todd Lipcon 8b88542f60 Amend HDFS-3726. Add previously missing file JournalOutOfSyncException.java
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381681 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 16:59:51 +00:00
Daryn Sharp 82b981cca4 HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381606 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 14:06:58 +00:00
Todd Lipcon cae8116a14 HDFS-3726. If a logger misses an RPC, don't retry that logger until next segment. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381482 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 07:03:57 +00:00
Todd Lipcon 437948ea1c HDFS-3891. Make selectInputStreams throw IOE instead of RTE. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381481 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 06:57:18 +00:00
Eli Collins 01db4d2bb2 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 06:19:30 +00:00
Eli Collins 91e832e7b4 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:42:09 +00:00
Todd Lipcon 99ec5bd8d3 Merge trunk into QJM branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380990 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:57:47 +00:00
Todd Lipcon 31142aa892 HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:53:15 +00:00
Todd Lipcon c334cc89a8 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:40:23 +00:00
Todd Lipcon 13daca1ef6 HDFS-3870. Add metrics to JournalNode. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380980 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:30:51 +00:00
Todd Lipcon f6b7f067c3 HDFS-3884. Journal format() should reset cached values. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380979 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:27:49 +00:00
Todd Lipcon 72485f3112 HDFS-3869. Expose non-file journal manager details in web UI. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380978 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:16:02 +00:00
Todd Lipcon 8021d9199f HDFS-3863. Track last "committed" txid in QJM. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380976 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:13:19 +00:00
Tsz-wo Sze 658e7b5818 HDFS-3888. Clean up BlockPlacementPolicyDefault. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380939 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 23:56:10 +00:00