Commit Graph

911 Commits

Author SHA1 Message Date
Tsz-wo Sze 1634e980af HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414874 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 19:19:27 +00:00
Aaron Myers 2b8824853b HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414500 13f79535-47bb-0310-9956-ffa450edef68
2012-11-28 01:38:31 +00:00
Tsz-wo Sze 9047eb5162 HDFS-4209. Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory and INodeDirectory.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414447 13f79535-47bb-0310-9956-ffa450edef68
2012-11-27 22:36:20 +00:00
Suresh Srinivas 7e56bfe405 HDFS-4200. Reduce the size of synchronized sections in PacketResponder. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413826 13f79535-47bb-0310-9956-ffa450edef68
2012-11-26 20:47:58 +00:00
Tsz-wo Sze 0f1899ee19 HDFS-4216. Do not ignore QuotaExceededException when adding symlinks.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412237 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 19:27:48 +00:00
Tsz-wo Sze 506938f0b3 HDFS-4215. Remove locking from addToParent(..) since it is used in image loading, and add INode.isFile().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411947 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 00:13:53 +00:00
Konstantin Shvachko 573c41c266 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. (shv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411508 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 02:00:20 +00:00
Daryn Sharp c944d0666c HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411229 13f79535-47bb-0310-9956-ffa450edef68
2012-11-19 15:04:28 +00:00
Tsz-wo Sze d66f9e8269 HDFS-4206. Change the fields in INode and its subclasses to private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410996 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 22:03:11 +00:00
Alejandro Abdelnur 6f80a2a76c HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410824 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 04:10:29 +00:00
Eli Collins ecbb41923c HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410812 13f79535-47bb-0310-9956-ffa450edef68
2012-11-18 02:11:50 +00:00
Jitendra Nath Pandey 1cbc38a878 HDFS-4105. The SPNEGO user for secondary namenode should use the web keytab. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410691 13f79535-47bb-0310-9956-ffa450edef68
2012-11-17 03:30:48 +00:00
Aaron Myers 320c32a289 HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410587 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:51:39 +00:00
Todd Lipcon 51ca2fd3e9 HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410584 13f79535-47bb-0310-9956-ffa450edef68
2012-11-16 21:45:48 +00:00
Eli Collins 96f28d878e HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409995 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 20:37:41 +00:00
Daryn Sharp 298eb42657 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409988 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 20:33:30 +00:00
Uma Maheswara Rao G 8a2de21315 HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409905 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 18:25:55 +00:00
Daryn Sharp 97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 15:51:03 +00:00
Robert Joseph Evans d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 14:57:23 +00:00
Robert Joseph Evans 59e4199d84 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409311 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 19:21:25 +00:00
Robert Joseph Evans b2456ca3b8 svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409266 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 17:32:55 +00:00
Eli Collins a780f0ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:17:19 +00:00
Alejandro Abdelnur 368f628ce5 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409087 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:12:03 +00:00
Uma Maheswara Rao G 0800aa90dd HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409071 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 03:10:10 +00:00
Suresh Srinivas a5976bee37 Moving HDFS-4106 to Release 2.0.3 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409038 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 00:02:53 +00:00
Daryn Sharp 4741064250 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 15:29:04 +00:00
Eli Collins 3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:28:33 +00:00
Aaron Myers b3e42a1ed5 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408531 13f79535-47bb-0310-9956-ffa450edef68
2012-11-13 01:26:20 +00:00
Eli Collins c1a2098304 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 22:20:43 +00:00
Robert Joseph Evans 7ff7f67a82 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408401 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 18:51:27 +00:00
Suresh Srinivas a4b1c675b6 Moving HDFS-4080 to Incompatible Change section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407567 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:09:21 +00:00
Suresh Srinivas db71de2e11 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407566 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:07:04 +00:00
Suresh Srinivas c7ab9779d2 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407556 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 17:39:20 +00:00
Eli Collins 312eb23598 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407345 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 02:57:05 +00:00
Daryn Sharp be94bf6b57 HDFS-3990. NN's health report has severe performance problems (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407333 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 00:53:11 +00:00
Suresh Srinivas 0f7a4337ac HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 19:54:55 +00:00
Konstantin Shvachko d511052be5 Move HDFS-3625 and HDFS-4138 under 2.0.3
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407189 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 18:01:38 +00:00
Uma Maheswara Rao G f1fe91ec95 HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407182 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 17:45:46 +00:00
Konstantin Shvachko c44f37a7a5 Move HDFS-3625 under 0.23.5
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406739 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 17:59:35 +00:00
Konstantin Shvachko 1ab97373de HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406734 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 17:45:01 +00:00
Aaron Myers 817a26b6c8 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 06:29:37 +00:00
Tsz-wo Sze 1e7010cf38 HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406382 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:34:29 +00:00
Todd Lipcon a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:05:34 +00:00
Tsz-wo Sze 1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 21:04:32 +00:00
Daryn Sharp 54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 19:27:47 +00:00
Daryn Sharp 3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:57:58 +00:00
Suresh Srinivas dca8dd7a20 Add HDFS-4046 to Release 2.0.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406019 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 00:22:23 +00:00
Tsz-wo Sze 7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 23:26:34 +00:00
Tsz-wo Sze d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
2012-11-03 00:20:03 +00:00
Todd Lipcon a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
2012-11-02 20:35:51 +00:00