Commit Graph

1217 Commits

Author SHA1 Message Date
Tsz-wo Sze 88eea21572 HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree. Contributed by daryn
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416064 13f79535-47bb-0310-9956-ffa450edef68
2012-12-01 22:29:54 +00:00
Daryn Sharp 64fe19e0d4 HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416034 13f79535-47bb-0310-9956-ffa450edef68
2012-12-01 18:18:58 +00:00
Tsz-wo Sze 571da54179 HDFS-4213. Add an API to hsync for updating the last block length at the namenode. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415799 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 19:24:30 +00:00
Aaron Myers d866f81edb Reverting initial commit of HDFS-3680 pending further comments.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415797 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 19:19:01 +00:00
Aaron Myers a85a0293c7 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415794 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 19:11:24 +00:00
Tsz-wo Sze 6b08d7de5f HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415480 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 02:51:25 +00:00
Tsz-wo Sze 1634e980af HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414874 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 19:19:27 +00:00
Aaron Myers 2b8824853b HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414500 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 01:38:31 +00:00
Tsz-wo Sze 9047eb5162 HDFS-4209. Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory and INodeDirectory.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414447 13f79535-47bb-0310-9956-ffa450edef68
2012-11-27 22:36:20 +00:00
Suresh Srinivas 7e56bfe405 HDFS-4200. Reduce the size of synchronized sections in PacketResponder. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413826 13f79535-47bb-0310-9956-ffa450edef68
2012-11-26 20:47:58 +00:00
Tsz-wo Sze 0f1899ee19 HDFS-4216. Do not ignore QuotaExceededException when adding symlinks.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412237 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 19:27:48 +00:00
Tsz-wo Sze 506938f0b3 HDFS-4215. Remove locking from addToParent(..) since it is used in image loading, and add INode.isFile().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411947 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 00:13:53 +00:00
Konstantin Shvachko 573c41c266 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. (shv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411508 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 02:00:20 +00:00
Daryn Sharp c944d0666c HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411229 13f79535-47bb-0310-9956-ffa450edef68
2012-11-19 15:04:28 +00:00
Tsz-wo Sze d66f9e8269 HDFS-4206. Change the fields in INode and its subclasses to private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410996 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 22:03:11 +00:00
Alejandro Abdelnur 6f80a2a76c HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410824 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 04:10:29 +00:00
Eli Collins ecbb41923c HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410812 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 02:11:50 +00:00
Jitendra Nath Pandey 1cbc38a878 HDFS-4105. The SPNEGO user for secondary namenode should use the web keytab. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410691 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 03:30:48 +00:00
Aaron Myers 320c32a289 HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410587 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:51:39 +00:00
Todd Lipcon 51ca2fd3e9 HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410584 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:45:48 +00:00
Eli Collins 96f28d878e HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409995 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 20:37:41 +00:00
Daryn Sharp 298eb42657 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409988 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 20:33:30 +00:00
Uma Maheswara Rao G 8a2de21315 HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409905 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 18:25:55 +00:00
Daryn Sharp 97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 15:51:03 +00:00
Robert Joseph Evans d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:57:23 +00:00
Robert Joseph Evans 59e4199d84 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409311 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 19:21:25 +00:00
Robert Joseph Evans b2456ca3b8 svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409266 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 17:32:55 +00:00
Eli Collins a780f0ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:17:19 +00:00
Alejandro Abdelnur 368f628ce5 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409087 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:12:03 +00:00
Uma Maheswara Rao G 0800aa90dd HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409071 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 03:10:10 +00:00
Suresh Srinivas a5976bee37 Moving HDFS-4106 to Release 2.0.3 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409038 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 00:02:53 +00:00
Daryn Sharp 4741064250 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 15:29:04 +00:00
Eli Collins 3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:28:33 +00:00
Aaron Myers b3e42a1ed5 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408531 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:26:20 +00:00
Eli Collins c1a2098304 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 22:20:43 +00:00
Robert Joseph Evans 7ff7f67a82 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408401 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 18:51:27 +00:00
Suresh Srinivas a4b1c675b6 Moving HDFS-4080 to Incompatible Change section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407567 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:09:21 +00:00
Suresh Srinivas db71de2e11 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407566 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:07:04 +00:00
Suresh Srinivas c7ab9779d2 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407556 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:39:20 +00:00
Eli Collins 312eb23598 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407345 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 02:57:05 +00:00
Daryn Sharp be94bf6b57 HDFS-3990. NN's health report has severe performance problems (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407333 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 00:53:11 +00:00
Suresh Srinivas 0f7a4337ac HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 19:54:55 +00:00
Konstantin Shvachko d511052be5 Move HDFS-3625 and HDFS-4138 under 2.0.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407189 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 18:01:38 +00:00
Uma Maheswara Rao G f1fe91ec95 HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407182 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 17:45:46 +00:00
Konstantin Shvachko c44f37a7a5 Move HDFS-3625 under 0.23.5
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406739 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 17:59:35 +00:00
Konstantin Shvachko 1ab97373de HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406734 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 17:45:01 +00:00
Aaron Myers 817a26b6c8 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 06:29:37 +00:00
Tsz-wo Sze 1e7010cf38 HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406382 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:34:29 +00:00
Todd Lipcon a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:05:34 +00:00
Tsz-wo Sze 1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 21:04:32 +00:00
Daryn Sharp 54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 19:27:47 +00:00
Daryn Sharp 3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:57:58 +00:00
Suresh Srinivas dca8dd7a20 Add HDFS-4046 to Release 2.0.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406019 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 00:22:23 +00:00
Tsz-wo Sze 7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:26:34 +00:00
Tsz-wo Sze d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
2012-11-03 00:20:03 +00:00
Todd Lipcon a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 20:35:51 +00:00
Daryn Sharp 19befa0748 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404985 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 14:56:22 +00:00
Suresh Srinivas 07e0d7730d HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403956 13f79535-47bb-0310-9956-ffa450edef68
2012-10-31 02:33:44 +00:00
Suresh Srinivas cd0d206bb8 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403922 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 23:12:12 +00:00
Uma Maheswara Rao G b2822e3742 Moved HDFS-3809 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403769 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 16:32:01 +00:00
Uma Maheswara Rao G 7ccdb67d5c Moved HDFS-3789 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403765 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 16:22:42 +00:00
Uma Maheswara Rao G 52df4b3e78 Moved HDFS-3695 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403748 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:51:49 +00:00
Uma Maheswara Rao G 1e07fece6e Moved HDFS-3573 entry in CHANGES.txt from trunk to 2.0.3-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403740 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 15:38:12 +00:00
Daryn Sharp deef03c5d6 HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403714 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 14:21:00 +00:00
Suresh Srinivas 7604a276a7 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403616 13f79535-47bb-0310-9956-ffa450edef68
2012-10-30 05:48:58 +00:00
Suresh Srinivas ba7a2e3898 Moved HDFS-4122 to Release 2.0.3 section. It is also moved to Incompatible Changes section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403570 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 22:43:58 +00:00
Suresh Srinivas 1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 14:11:04 +00:00
Suresh Srinivas 4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
2012-10-29 05:10:29 +00:00
Suresh Srinivas cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 23:10:53 +00:00
Suresh Srinivas fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 19:03:57 +00:00
Suresh Srinivas abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
2012-10-28 18:59:11 +00:00
Suresh Srinivas b6d09f67ab Moving HDFS-4121 from trunk to Release 2.0.3 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402843 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:41:43 +00:00
Suresh Srinivas cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:25:02 +00:00
Tsz-wo Sze 3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:22:49 +00:00
Tsz-wo Sze 0e796b61e8 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402599 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 18:08:38 +00:00
Tsz-wo Sze 2d74f68054 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:53:25 +00:00
Tsz-wo Sze ba2ee1d7fb HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402265 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:44:46 +00:00
Suresh Srinivas 163577f905 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 18:32:41 +00:00
Suresh Srinivas 611684e2e5 HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402203 13f79535-47bb-0310-9956-ffa450edef68
2012-10-25 16:15:59 +00:00
Suresh Srinivas 464edf2439 Moving HDFS-2434 from Release 2.0.3 section to trunk section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401446 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:27:16 +00:00
Suresh Srinivas aa42e2161d HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 20:02:09 +00:00
Daryn Sharp a92313f7bd HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401309 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 15:03:53 +00:00
Tsz-wo Sze 75cdb5bb49 HDFS-4099. Clean up replication code and add more javadoc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400986 13f79535-47bb-0310-9956-ffa450edef68
2012-10-22 18:30:16 +00:00
Uma Maheswara Rao G 35ec20b7c6 HDFS-4022. Replication not happening for appended block. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400578 13f79535-47bb-0310-9956-ffa450edef68
2012-10-21 06:31:31 +00:00
Tsz-wo Sze 661a8d176a HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400345 13f79535-47bb-0310-9956-ffa450edef68
2012-10-20 00:06:12 +00:00
Suresh Srinivas 0603447f2a HDFS-4072. On file deletion remove corresponding blocks pending replications. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399965 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 04:55:11 +00:00
Eli Collins 7da5d03c35 HDFS-4053. Increase the default block size. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399908 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 22:56:30 +00:00
Tsz-wo Sze 4af8761e4c HDFS-4074. Remove the unused default constructor from INode. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399866 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 21:29:12 +00:00
Tsz-wo Sze c1bd54daa3 HDFS-4073. Two minor improvements to FSDirectory. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399861 13f79535-47bb-0310-9956-ffa450edef68
2012-10-18 21:18:25 +00:00
Eli Collins 4d5600f6c7 HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399443 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 21:34:48 +00:00
Eli Collins a258263ecf HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399096 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 04:58:24 +00:00
Eli Collins 24015b7684 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399093 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 04:39:07 +00:00
Aaron Myers 402836479f HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399062 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 01:10:55 +00:00
Eli Collins e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 21:59:15 +00:00
Suresh Srinivas 0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 19:39:50 +00:00
Eli Collins b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 16:29:21 +00:00
Suresh Srinivas b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 03:37:49 +00:00
Eli Collins a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 02:12:59 +00:00
Aaron Myers 557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 01:59:46 +00:00
Aaron Myers f5f763eb15 Update CHANGES.txt to have HDFS-3678 under release 2.0.3 instead of 3.0.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398603 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 01:31:26 +00:00
Todd Lipcon ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 00:55:29 +00:00
Tsz-wo Sze 698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
2012-10-15 14:05:31 +00:00
Tsz-wo Sze ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
2012-10-15 13:48:56 +00:00
Suresh Srinivas 89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 14:32:16 +00:00
Suresh Srinivas 94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 04:35:42 +00:00
Suresh Srinivas 4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 23:10:47 +00:00
Todd Lipcon 7ca007b241 Merge CHANGES for HDFS-3077 into the main CHANGES.txt file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397352 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 22:51:34 +00:00
Suresh Srinivas 2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 18:08:27 +00:00
Aaron Myers 8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 00:32:46 +00:00
Jason Darrell Lowe 08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 21:15:06 +00:00
Eli Collins c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 18:42:54 +00:00
Thomas Graves a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
2012-10-10 17:35:18 +00:00
Eli Collins 03c96ef29e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 00:18:27 +00:00
Todd Lipcon 17b32bb2de HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395731 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 19:19:21 +00:00
Eli Collins 5dcdc8aa58 HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395708 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:34:14 +00:00
Eli Collins 3a4cf1c064 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:11:53 +00:00
Eli Collins 5a5473b29f HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:35:51 +00:00
Eli Collins e32af6034b HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68
2012-10-07 21:16:08 +00:00
Aaron Myers 353958dccc HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394864 13f79535-47bb-0310-9956-ffa450edef68
2012-10-06 00:13:28 +00:00
Thomas Graves d35169d9ba HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394609 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 15:51:10 +00:00
Suresh Srinivas dfb8369c29 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394385 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 07:02:52 +00:00
Suresh Srinivas a41f808c3c HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394376 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 06:22:26 +00:00
Aaron Myers 6582da034b HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394340 13f79535-47bb-0310-9956-ffa450edef68
2012-10-05 00:54:05 +00:00
Alejandro Abdelnur 016b86867b HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394169 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 17:45:42 +00:00
Eli Collins ee13fb4f69 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393890 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:53:28 +00:00
Eli Collins 38943644e0 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393884 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:41:04 +00:00
Eli Collins 2c66a9f5ae HDFS-2127. Add a test that ensure AccessControlExceptions contain a full path. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393878 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 02:06:56 +00:00
Eli Collins 43ae84761f HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393777 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 21:30:45 +00:00
Eli Collins f8f79a02aa HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 19:13:53 +00:00
Robert Joseph Evans af647bb3ce Preparing for release 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 14:15:39 +00:00
Aaron Myers 648ba4a36b HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391763 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 07:30:45 +00:00
Aaron Myers e8dc3b3a8a HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391708 13f79535-47bb-0310-9956-ffa450edef68
2012-09-29 00:51:48 +00:00
Robert Joseph Evans 01c0dc98bb HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391121 13f79535-47bb-0310-9956-ffa450edef68
2012-09-27 17:31:48 +00:00
Eli Collins 47dfcf45af HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 21:25:04 +00:00
Tsz-wo Sze a7bcdcc051 HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390466 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 13:23:21 +00:00
Suresh Srinivas 248756eac6 Moving HDFS-234 from trunk to Release 2.0.0-alpha section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389494 13f79535-47bb-0310-9956-ffa450edef68
2012-09-24 17:44:32 +00:00
Harsh J 9c9b3f09ed HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389010 13f79535-47bb-0310-9956-ffa450edef68
2012-09-23 10:50:44 +00:00
Eli Collins fa6d519657 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388335 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 06:17:29 +00:00
Eli Collins 3ea3508319 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388331 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 05:48:42 +00:00
Eli Collins 7dee7f11f6 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68
2012-09-21 04:51:43 +00:00
Eli Collins d26f05b7f5 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387838 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 01:33:13 +00:00
Alejandro Abdelnur 7fb42f8f4b HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387688 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 17:39:46 +00:00
Eli Collins a8e4bb81b2 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387278 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 17:42:09 +00:00
Eli Collins 7e3776ca6e HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 16:59:47 +00:00
Alejandro Abdelnur c419b1385d HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386994 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 05:45:57 +00:00
Alejandro Abdelnur 0de9642514 HDFS-3938. remove current limitations from HttpFS docs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384842 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:28:47 +00:00
Aaron Myers 86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 23:48:25 +00:00
Suresh Srinivas d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 05:46:18 +00:00
Eli Collins 4f312cfa70 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 19:15:38 +00:00
Eli Collins 2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:36:01 +00:00
Todd Lipcon 80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:32:57 +00:00
Eli Collins f0c3ed79dd HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:21:31 +00:00
Eli Collins 414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:10:58 +00:00
Eli Collins dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 21:24:12 +00:00
Eli Collins e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:46:13 +00:00
Tsz-wo Sze 009235f4a9 HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382836 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 13:43:28 +00:00
Eli Collins 3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
2012-09-09 06:37:31 +00:00
Arun Murthy 681408f898 Set date for hadoop-2.0.2-alpha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:39:45 +00:00
Arun Murthy 7851676f22 Preparing for hadoop-2.0.2-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:09:48 +00:00
Alejandro Abdelnur 9da626af41 HDFS-3895. hadoop-client must include commons-cli (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381719 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 19:03:37 +00:00
Uma Maheswara Rao G 6fd7df77a5 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381699 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:03:16 +00:00
Daryn Sharp 82b981cca4 HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381606 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 14:06:58 +00:00
Eli Collins 01db4d2bb2 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 06:19:30 +00:00
Todd Lipcon 31142aa892 HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:53:15 +00:00
Todd Lipcon c334cc89a8 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:40:23 +00:00
Tsz-wo Sze 658e7b5818 HDFS-3888. Clean up BlockPlacementPolicyDefault. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380939 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 23:56:10 +00:00
Tsz-wo Sze f3927595cc HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380934 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 23:48:01 +00:00
Alejandro Abdelnur 4244c1443c HDFS-3866. HttpFS POM should have property where to download tomcat from (zero45 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380927 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 22:55:40 +00:00
Robert Joseph Evans f5943c1eef Updated CHANGES.txt for 0.23.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380906 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 21:45:33 +00:00
Uma Maheswara Rao G 3969bcb7c9 HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380003 13f79535-47bb-0310-9956-ffa450edef68
2012-09-02 16:20:13 +00:00
Suresh Srinivas da3bd67138 HDFS-3880. Use Builder to build RPC server in HDFS. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379917 13f79535-47bb-0310-9956-ffa450edef68
2012-09-02 06:20:41 +00:00
Harsh J 54e612bfb9 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379828 13f79535-47bb-0310-9956-ffa450edef68
2012-09-01 19:22:11 +00:00
Tsz-wo Sze 50222ff529 HDFS-3871. Change NameNodeProxies to use RetryUtils. Contributed by Arun C Murthy
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379743 13f79535-47bb-0310-9956-ffa450edef68
2012-09-01 11:41:15 +00:00
Owen O'Malley c76a7893f9 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab.
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379646 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 22:31:03 +00:00
Daryn Sharp 94c69f2c82 HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379623 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:31:55 +00:00
Daryn Sharp 3819c964fa HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379615 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:24:48 +00:00
Suresh Srinivas 2fd49f5a57 HDFS-3833. TestDFSShell fails on windows due to concurrent file read/write. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379525 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 17:43:35 +00:00
Eli Collins 7d1c8d92f9 HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379278 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 04:08:23 +00:00
Eli Collins 34d1e73235 HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379172 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 21:40:28 +00:00
Daryn Sharp bb64f860eb HDFS-3861. Deadlock in DFSClient (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379093 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 19:46:14 +00:00
Aaron Myers b2d186d865 HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378413 13f79535-47bb-0310-9956-ffa450edef68
2012-08-29 01:19:07 +00:00
Aaron Myers d4d2bf73a9 HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378364 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 22:09:27 +00:00
Aaron Myers 8d724dd8b9 HDFS-3860. HeartbeatManager#Monitor may wrongly hold the writelock of namesystem. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378228 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 17:01:38 +00:00
Eli Collins 36c5388080 Fixup CHANGELOG for HDFS-3856.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377936 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 01:45:26 +00:00
Eli Collins b29cb2d997 HDFS-3856. TestHDFSServerPorts failure is causing surefire fork failure. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377934 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 01:41:13 +00:00
Suresh Srinivas 735046ebec HDFS-3851. DFSOutputStream class code cleanup. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377372 13f79535-47bb-0310-9956-ffa450edef68
2012-08-26 04:00:26 +00:00
Aaron Myers 56285e1bee HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377367 13f79535-47bb-0310-9956-ffa450edef68
2012-08-26 00:31:12 +00:00
Suresh Srinivas deead78e35 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:03:22 +00:00
Eli Collins a11042365f HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377137 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 22:10:38 +00:00
Aaron Myers 92cb6b093c HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377046 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 18:52:59 +00:00
Suresh Srinivas a95bbb107f Correcting the jira number back to HDFS-3834 from HDFS-3844. I should pay better attention.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377008 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 17:53:19 +00:00
Suresh Srinivas 8c8d679cd5 Correcting the jira number from HDFS-3834 to HDFS-3844 for the commit 1377001
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377007 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 17:51:10 +00:00
Suresh Srinivas 7a1dc1ab70 HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 17:36:22 +00:00
Tsz-wo Sze c46de830da HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376928 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 14:15:14 +00:00
Eli Collins c10a73350e Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376701 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 21:08:19 +00:00
Eli Collins 6885d03501 HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Whang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376689 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 20:49:55 +00:00
Aaron Myers de8b34a70e HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376188 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:47:07 +00:00
Jitendra Nath Pandey 901b1739c6 HDFS-3819. Should check whether invalidate work percentage default value is not greater than 1.0f. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376185 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 18:44:44 +00:00
Suresh Srinivas 30bd8ef9d1 Moving HDFS-2686 and HDFS-3832 to branch-2 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376142 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 17:04:08 +00:00
Suresh Srinivas 380870d544 HDFS-3832. Remove protocol methods related to DistributedUpgrade. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376139 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:59:50 +00:00
Eli Collins 89e16be81b HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376129 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:26:50 +00:00
Eli Collins 2b030c6a4a HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376121 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:19:27 +00:00
Suresh Srinivas a99cfe3ca0 HDFS-3817. Avoid printing SafeModeException stack trace in RPC server. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376054 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 13:59:40 +00:00
Suresh Srinivas 557b937f47 HDFS-3827. TestHASafeMode#assertSafemode method should be made static. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375828 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 22:25:49 +00:00
Suresh Srinivas 6c0ccb5989 HDFS-2686. Remove DistributedUpgrade related code. Contributed by Suresh Srinivas
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375800 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 21:18:40 +00:00
Eli Collins a6262430ff HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375383 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 03:48:00 +00:00
Eli Collins 97bb7b180e HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375336 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 00:00:33 +00:00
Suresh Srinivas 086c855198 HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374645 13f79535-47bb-0310-9956-ffa450edef68
2012-08-18 19:50:15 +00:00
Aaron Myers fccace6116 HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374355 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 16:52:07 +00:00
Tsz-wo Sze ffbadbdd36 HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode. Contributed by Jing Zhao and Weiyan Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374127 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 01:54:16 +00:00
Tsz-wo Sze 87d87b04e6 HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374122 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 01:42:35 +00:00
Aaron Myers bbe4584ebf HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374106 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 23:47:33 +00:00
Eli Collins cf93dfba4e HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374040 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 20:35:50 +00:00
Eli Collins 4524655afd HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373928 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 17:13:13 +00:00
Eli Collins f75deca0f9 HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373664 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 22:43:01 +00:00
Todd Lipcon 89153a9c68 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373567 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 18:53:13 +00:00
Tsz-wo Sze 9dff7876d9 HDFS-3802. StartupOption.name in HdfsServerConstants should be final. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373253 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 08:07:29 +00:00
Tsz-wo Sze f41497c141 HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373193 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 02:23:21 +00:00
Suresh Srinivas 6c96039693 HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373174 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:33:53 +00:00
Suresh Srinivas 28e87740c5 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:28:41 +00:00
Suresh Srinivas 231a52a7df Reverting previous incomplete change r1373170 for HDFS-3723
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373172 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:25:07 +00:00
Suresh Srinivas f026d8bb1b HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373170 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:03:19 +00:00
Eli Collins f98d8eb291 HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373094 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:59:54 +00:00
Daryn Sharp f46b6ea55c HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373090 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:56:49 +00:00
Todd Lipcon b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:11:40 +00:00
Tsz-wo Sze 0c27c77080 HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372707 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 03:02:43 +00:00
Todd Lipcon ab3ab17a43 HDFS-3792. Fix two findbugs introduced by HDFS-3695. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372690 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 00:52:10 +00:00
Aaron Myers 4139298b61 HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372676 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 00:04:55 +00:00
Todd Lipcon c93185df66 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372628 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:26:39 +00:00
Todd Lipcon c9ed8342f5 Move HDFS-2330 and HDFS-3190 to branch-2 section, since they have been backported from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372605 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:52:17 +00:00
Todd Lipcon 7aacfd5a08 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 19:36:31 +00:00
Aaron Myers bbe0e823db Revert HDFS-3719. See discussion there and HDFS-3770 for more info.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372544 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 18:42:51 +00:00
Eli Collins bcb715459c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371555 13f79535-47bb-0310-9956-ffa450edef68
2012-08-10 03:42:36 +00:00
Todd Lipcon 9d0f8792a9 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:13:54 +00:00
Aaron Myers 9ea7c06468 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371495 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 21:31:12 +00:00
Aaron Myers fb970f3df7 HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371231 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 14:44:05 +00:00
Jakob Homan ac31ae6a79 HDFS-3768. Exception in TestJettyHelper is incorrect. Contributed by Eli Reisman.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370952 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:34:03 +00:00
Todd Lipcon 6dcf2e4815 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370937 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:15:40 +00:00
Aaron Myers b587af4631 HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370898 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 19:11:30 +00:00
Aaron Myers 34554d1e11 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370649 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 02:53:56 +00:00
Eli Collins c12e994eda HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370495 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 20:17:59 +00:00
Alejandro Abdelnur 754fd7b2fb HDFS-3291. add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370387 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 17:43:32 +00:00
Aaron Myers 9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 16:40:03 +00:00
Aaron Myers f7b37c009b HDFS-3579. libhdfs: fix exception handling. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370015 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 21:02:30 +00:00
Aaron Myers 294b514596 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369848 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 13:59:00 +00:00
Alejandro Abdelnur 42d071ab6f HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368733 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 22:10:51 +00:00
Alejandro Abdelnur fe17d871d0 HDFS-3513. HttpFS should cache filesystems. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368304 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 23:09:19 +00:00
Aaron Myers 8ea7112595 HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367844 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 02:16:57 +00:00
Tsz-wo Sze cb787968c5 HDFS-3667. Add retry support to WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367841 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 01:41:23 +00:00
Tsz-wo Sze 556be2af92 svn merge -c -1366601 for reverting HDFS-3667.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367407 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 04:33:59 +00:00
Aaron Myers aeade62b95 HDFS-3732. fuse_dfs: incorrect configuration value checked for connection expiry timer period. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367199 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:07:07 +00:00
Tsz-wo Sze e4eec269d9 HDFS-3667. Add retry support to WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366601 13f79535-47bb-0310-9956-ffa450edef68
2012-07-28 05:57:47 +00:00
Suresh Srinivas 0c4e670eff HDFS-3679. fuse_dfs notrash option sets usetrash. Contributed by Conrad Meyer.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366545 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 21:51:07 +00:00
Daryn Sharp cbd59c1c50 HDFS-3553. Hftp proxy tokens are broken (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366471 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 18:02:56 +00:00
Aaron Myers c1ea9b4490 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 00:26:21 +00:00
Alejandro Abdelnur 4d4560189a HDFS-3113. httpfs does not support delegation tokens. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365988 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:39:05 +00:00
Tsz-wo Sze 8f395c2f78 HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365839 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 23:37:25 +00:00
Todd Lipcon 972953bd77 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:52:38 +00:00
Aaron Myers 56b0912b6c HDFS-3720. hdfs.h must get packaged. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365759 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:21:14 +00:00
Aaron Myers d8f3913856 HDFS-3711. Manually convert remaining tests to JUnit4. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365119 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 15:19:08 +00:00
Eli Collins 1fd21078d8 HDFS-3709. TestStartup tests still binding to the ephemeral port. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364865 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 01:53:29 +00:00
Todd Lipcon b7b8db51de HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364698 13f79535-47bb-0310-9956-ffa450edef68
2012-07-23 16:27:59 +00:00
Aaron Myers decd9e1c74 Move entry for HDFS-3583 in CHANGES.txt to be under branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363949 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 20:46:25 +00:00
Aaron Myers 02a5551ba3 HDFS-3608. fuse_dfs: detect changes in UID ticket cache. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363904 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 19:15:52 +00:00
Todd Lipcon 9833468302 HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363899 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 18:58:58 +00:00
Eli Collins 6383679872 HDFS-3690. BlockPlacementPolicyDefault incorrectly casts LOG. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363576 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 23:04:01 +00:00
Eli Collins 5d5a83877a HDFS-1249. With fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363466 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:37:47 +00:00
Eli Collins 7d5d63c13e HDFS-3675. libhdfs: follow documented return codes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363459 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:26:04 +00:00
Eli Collins 15eec42316 HDFS-3673. libhdfs: fix some compiler warnings. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363457 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:22:56 +00:00
Todd Lipcon 23b6ed973e HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363175 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:42:13 +00:00
Daryn Sharp 0a6806ce8c HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363170 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 23:21:30 +00:00
Tsz-wo Sze 6e56376023 HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362976 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 15:12:47 +00:00
Eli Collins d61c5bcb0b Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362760 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:11:01 +00:00
Eli Collins 6981b14003 Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362759 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 05:05:50 +00:00
Aaron Myers e2253b539e HDFS-3583. Convert remaining tests to Junit4. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362753 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 03:46:28 +00:00
Eli Collins 527933f4f3 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 21:26:58 +00:00
Todd Lipcon 6df36b58e1 HDFS-3625. Fix TestBackupNode by properly initializing edit log during startup. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362189 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 18:54:46 +00:00
Eli Collins 572823c82c HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362177 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 18:29:25 +00:00
Eli Collins 69f7a329ba HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362119 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 16:42:53 +00:00
Harsh J 0e8e499ff4 HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361894 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 02:58:03 +00:00
Eli Collins 64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 19:43:39 +00:00
Eli Collins 2eb39c55d6 HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361565 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 17:19:01 +00:00
Eli Collins 32d4c148df HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361463 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 01:07:57 +00:00
Eli Collins f5dd4583bb HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361459 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:47:43 +00:00
Eli Collins cfd692b866 HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361454 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:34:28 +00:00
Eli Collins 06d635cd2c HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361449 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:18:56 +00:00
Eli Collins 8c2a2f909c HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361446 13f79535-47bb-0310-9956-ffa450edef68
2012-07-14 00:03:58 +00:00
Eli Collins dcf0ac7a8a HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361440 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 23:28:03 +00:00
Harsh J d9911e923d HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361059 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 07:20:27 +00:00
Eli Collins bfa51a33d0 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361021 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:44:27 +00:00
Eli Collins 0f3ba4870b HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361008 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:10:04 +00:00
Eli Collins e2318c2895 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361005 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 23:52:48 +00:00
Sanjay Radia 6a59f08a15 HDFS-3630 Modify TestPersistBlocks to use both flush and hflush (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360991 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 22:46:53 +00:00
Eli Collins 4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:01:49 +00:00
Eli Collins 8ced7381a4 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360485 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 00:12:15 +00:00
Eli Collins cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 17:58:02 +00:00
Aaron Myers 664ca6b75e HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360255 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 16:09:18 +00:00
Harsh J 2c27b5826d HDFS-3611. NameNode prints unnecessary WARNs about edit log normally skipping a few bytes. Contributed by Colin Patrick McCabe. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360001 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 03:37:07 +00:00
Harsh J c81aed0271 HDFS-3613. GSet prints some INFO level values, which aren't really very useful to all. Contributed by Andrew Wang. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359999 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 03:15:03 +00:00
Harsh J 3b5ea87502 HDFS-3629. Fix the typo in the error message about inconsistent storage layout version. Contributed by Brandon Li. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359905 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 21:14:27 +00:00
Aaron Myers fb4a6ac9e9 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359824 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 18:28:13 +00:00
Harsh J e0f96aa249 HDFS-3555. idle client socket triggers DN ERROR log (should be INFO or DEBUG). Contributed by Andy Isaacson. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359619 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 11:52:13 +00:00
Aaron Myers b6a9d38c09 Move CHANGES.txt entry for HDFS-3067 to branch-2 instead of trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359331 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 18:34:36 +00:00
Eli Collins 9facccfd28 Update CHANGES.txt for 2391 merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358849 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 22:06:03 +00:00
Eli Collins 5952c7bb62 HDFS-3614. Revert unused MiniDFSCluster constructor from HDFS-3049. Contributed by Arun Murthy
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358825 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 19:53:14 +00:00
Eli Collins 21fdf16b0d HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358822 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 19:41:55 +00:00
Uma Maheswara Rao G 07295260b1 HDFS-3482. hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without values. Contributed by Madhukara Phatak.
Submitted by:	Madhukara Phatak.
Reviewed by:	Uma Maheswara Rao G.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358812 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:39:09 +00:00
Eli Collins 52f5c70330 HDFS-711. hdfsUtime does not handle atime = 0 or mtime = 0 correctly. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358810 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:29:00 +00:00
Eli Collins 9bebba6605 Fixup CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358805 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:18:55 +00:00
Eli Collins 6dcf42262d HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358804 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:15:30 +00:00
Uma Maheswara Rao G d4fb882163 HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay.
Submitted by:	Vinay
Reviewed by:	Uma Maheswara Rao G


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358794 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 17:42:19 +00:00
Harsh J e5b00f1bdc HDFS-2988. Improve error message when storage directory lock fails. Contributed by Miomir Boljanovic. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358683 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 00:36:38 +00:00
Eli Collins 535b039581 HDFS-3604. Add dfs.webhdfs.enabled to hdfs-default.xml. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358659 13f79535-47bb-0310-9956-ffa450edef68
2012-07-07 22:35:14 +00:00
Todd Lipcon e0ef844280 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357970 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 22:18:30 +00:00
Tsz-wo Sze 4d0cab2729 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357442 13f79535-47bb-0310-9956-ffa450edef68
2012-07-05 01:31:57 +00:00
Eli Collins 359b4efd19 HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356971 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 21:43:25 +00:00
Todd Lipcon 3728d16160 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356939 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:55:29 +00:00
Todd Lipcon b8389e4c73 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 20:45:21 +00:00
Todd Lipcon 8dd3148e73 HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356525 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 23:59:41 +00:00
Todd Lipcon 7accbabdee HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356388 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 18:21:49 +00:00
Alejandro Abdelnur 2b2344a57e HDFS-3575. HttpFS does not log Exception Stacktraces (brocknoland via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356330 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 16:41:33 +00:00
Tsz-wo Sze 28e8151ad3 HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match. Contributed by Ashish Singhi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356086 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 07:26:03 +00:00
Alejandro Abdelnur 5a8ea48c37 HDFS-3580. incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK (adi2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355593 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:58:32 +00:00
Todd Lipcon 802f885a55 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:24:29 +00:00
Alejandro Abdelnur 34605c9594 HDS-3491. HttpFs does not set permissions correctly (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355556 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 20:59:11 +00:00
Suresh Srinivas d8198d9273 Fixed CHANGES.txt name typo
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355190 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 23:01:00 +00:00
Suresh Srinivas 19dd66a3f6 HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Collin McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355189 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 23:00:10 +00:00
Todd Lipcon 1d54e2b331 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355174 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 21:46:12 +00:00
Aaron Myers 9255cb83c8 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355141 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 20:04:49 +00:00
Eli Collins 550853203b HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355089 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 17:54:52 +00:00
Tsz-wo Sze f105784d6a svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:25:32 +00:00
Tsz-wo Sze 44389399d4 HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:11:22 +00:00
Todd Lipcon 5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 22:41:41 +00:00
Alejandro Abdelnur c03f1dcf30 Re-amendment to previous commit JIRA was HDFS-3481
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354611 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:20:47 +00:00
Alejandro Abdelnur 38f8b0aee5 Amendment to previous commit, correct JIRA is HDFS-3113
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354602 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:09:48 +00:00
Alejandro Abdelnur d263653ae2 HDFS-3481. Refactor HttpFS handling of JAX-RS query string parameters (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354599 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:06:37 +00:00
Tsz-wo Sze bf1649d5fd HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354316 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 02:51:39 +00:00
Eli Collins 0270889b4e HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354144 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 18:14:09 +00:00
Tsz-wo Sze bbab35e6d8 HDFS-3498. Support replica removal in BlockPlacementPolicy and make BlockPlacementPolicyDefault extensible for reusing code in subclasses. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353807 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 03:25:47 +00:00
Tsz-wo Sze 361ea9a62c HDFS-3516. Check content-type in WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353800 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 01:58:13 +00:00
Daryn Sharp 60f4f25afa HDFS-3549. Fix dist tar build fails in hadoop-hdfs-raid project. (Jason Lowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353695 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 18:26:29 +00:00
Daryn Sharp 4b88923e19 HDFS-3550. Fix raid javadoc warnings. (Jason Lowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353592 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 15:28:09 +00:00
Tsz-wo Sze 5572f73d45 HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350825 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 23:00:36 +00:00
Uma Maheswara Rao G 7a5c2e8790 Updated CHANGES.txt for HDFS-3408(BKJM : Namenode format fails, if there is no BK root) And HDFS-3389(Document the BKJM usage in Namenode HA)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350733 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 18:35:58 +00:00
Tsz-wo Sze 9d2b1b2ee8 HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350384 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 20:17:54 +00:00
Eli Collins 29d39bcc7b HDFS-3480. Multiple SLF4J binding warning. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349643 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:53:24 +00:00
Aaron Myers 9cabf93e7a HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349639 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:29:57 +00:00
Eli Collins fda95a6a3d HDFS-3478. Test quotas with Long.Max_Value. Contributed by Sujay Rau
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349634 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:04:20 +00:00
Eli Collins 6702d5dbd4 HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 03:31:47 +00:00
Eli Collins 07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:42:52 +00:00