Commit Graph

1910 Commits

Author SHA1 Message Date
Chris Nauroth e2efe52ac8 HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504679 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 21:57:24 +00:00
Chris Nauroth a5cd4b9bee HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504352 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 03:28:19 +00:00
Jing Zhao 68faa67f1b HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504326 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 00:04:28 +00:00
Colin McCabe b767ee07c2 fix misspelling in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504229 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 18:41:14 +00:00
Kihwal Lee d26334b410 HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503971 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 01:57:35 +00:00
Jason Darrell Lowe febc5040b9 HADOOP-9734. Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503954 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 00:06:48 +00:00
Colin McCabe badab7ed5e HDFS-4657. Limit the number of blocks logged by the NN after a block report to a configurable value. (Aaron Twinning Meyers via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503862 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 20:07:42 +00:00
Colin McCabe 32076136f7 HADOOP-9618. thread which detects GC pauses (Todd Lipcon via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503806 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 17:48:24 +00:00
Tsz-wo Sze 2d6049f1d6 HDFS-4992. Make balancer's mover thread count and dispatcher thread count configurable. Contributed by Max Lapan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503720 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 14:04:33 +00:00
Suresh Srinivas afaec5f52d HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503570 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 06:33:40 +00:00
Todd Lipcon 0880be20ac HDFS-4982. JournalNode should relogin from keytab before fetching logs from other JNs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502682 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 20:44:45 +00:00
Suresh Srinivas b47df4e3b9 HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502634 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 17:44:00 +00:00
Jing Zhao 3630a23c55 HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502400 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 00:11:31 +00:00
Colin McCabe 8767e4cde1 HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502373 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 21:31:04 +00:00
Chris Nauroth 2409882a47 HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502331 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 19:20:38 +00:00
Chris Nauroth 19346d8ca6 HDFS-4373. Add HTTP API for querying NameNode startup progress. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502328 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 19:04:26 +00:00
Suresh Srinivas 17420dcc71 HDFS-4980. Incorrect logging.properties file for hadoop-httpfs. Contributed by Mark Grover.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502302 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 18:05:34 +00:00
Chris Nauroth da8e962e39 HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502120 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 05:35:29 +00:00
Alejandro Abdelnur 59a5ab9d1c updating CHANGES.txt after committing MAPREDUCE-5333,HADOOP-9661,HADOOP-9355,HADOOP-9673,HADOOP-9414,HADOOP-9416,HDFS-4797,YARN-866,YARN-736,YARN-883 to 2.1-beta branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502075 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 00:22:14 +00:00
Tsz-wo Sze 36bd53a9a9 In CHANGES.txt, move HDFS-4908 and HDFS-4645 to 2.1.0-beta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502009 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 21:26:14 +00:00
Alejandro Abdelnur c6eaa8b37f HDFS-4969. WebhdfsFileSystem expects non-standard WEBHDFS Json element. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501868 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:32:05 +00:00
Jing Zhao 58d75576c4 HDFS-4962. Use enum for nfs constants. Contributed by Tsz Wo (Nicholas) SZE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501851 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:01:28 +00:00
Kihwal Lee 3a3109f8bf HDFS-4887. TestNNThroughputBenchmark exits abruptly. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501841 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 16:39:37 +00:00
Alejandro Abdelnur 3ed7c6e9e5 HDFS-4951. FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer. (rknater via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501451 13f79535-47bb-0310-9956-ffa450edef68
2013-07-09 18:41:26 +00:00
Alejandro Abdelnur 8fdd5083bf HDFS-4841. FsShell commands using secure webhfds fail ClientFinalizer shutdown hook. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501005 13f79535-47bb-0310-9956-ffa450edef68
2013-07-08 23:07:15 +00:00
Tsz-wo Sze 6770de7ec4 HDFS-4645. Move from randomly generated block ID to sequentially generated block ID. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500580 13f79535-47bb-0310-9956-ffa450edef68
2013-07-08 05:29:10 +00:00
Harsh J 81620ca1c9 HADOOP-8844. Add a plaintext fs -text test-case. Contributed by Akira AJISAKA. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500190 13f79535-47bb-0310-9956-ffa450edef68
2013-07-06 02:16:27 +00:00
Konstantin Boudnik ed70fb1608 HDFS-4860. Add additional attributes to JMX beans. Contributed by Trevor Lorimer
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500139 13f79535-47bb-0310-9956-ffa450edef68
2013-07-05 21:36:20 +00:00
Aaron Myers 5428bfbf53 HDFS-4465. Optimize datanode ReplicasMap and ReplicaInfo. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499659 13f79535-47bb-0310-9956-ffa450edef68
2013-07-04 05:52:13 +00:00
Brandon Li 2c9e837f1b HDFS-4948. mvn site for hadoop-hdfs-nfs fails. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499152 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 23:45:39 +00:00
Brandon Li 37f587563a HDFS-4762 Provide HDFS based NFSv3 and Mountd implementation. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499029 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 17:31:58 +00:00
Tsz-wo Sze 05fd0a706a HDFS-4943. WebHdfsFileSystem does not work when original file path has encoded chars. Contributed by Jerry He
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498962 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 14:58:35 +00:00
Colin McCabe 6735b70b4a HADOOP-9414. Refactor out FSLinkResolver and relevant helper methods.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498720 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 22:09:52 +00:00
Kihwal Lee ead7fa0413 HDFS-4888. Refactor and fix FSNamesystem.getTurnOffTip. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498665 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 20:20:27 +00:00
Thomas Graves aa7e148d1f Preparing for 0.23.9 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498480 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 14:29:45 +00:00
Tsz-wo Sze feb5b9641d HDFS-4797. BlockScanInfo does not override equals(..) and hashCode() consistently.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498202 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 01:28:22 +00:00
Chris Nauroth 750442812c HDFS-4944. WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498055 13f79535-47bb-0310-9956-ffa450edef68
2013-06-30 03:38:09 +00:00
Colin McCabe b6c7de68bc HADOOP-9673. NetworkTopology: When a node cannot be added, print out its location for diagnostic purposes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497176 13f79535-47bb-0310-9956-ffa450edef68
2013-06-27 01:22:43 +00:00
Chris Nauroth ca1058b27a HDFS-4932. Avoid a wide line on the name node webUI if we have more Journal nodes. Contributed by Fengdong Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497141 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 22:20:31 +00:00
Arun Murthy c918b5c02c Preparing for hadoop-2.1.0-beta release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496791 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 06:51:50 +00:00
Colin McCabe 03601136dd HADOOP-9355. Abstract Symlink tests to use either FileContext or FileSystem (Andrew Wang via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496690 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 00:35:39 +00:00
Chris Nauroth d74908bdb6 HDFS-4927. CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496350 13f79535-47bb-0310-9956-ffa450edef68
2013-06-25 05:05:20 +00:00
Jason Darrell Lowe 1087be1df4 HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495648 13f79535-47bb-0310-9956-ffa450edef68
2013-06-22 00:41:34 +00:00
Sanjay Radia 6cb5ad16d0 HADOOP-9619 Mark stability of .proto files (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495564 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 19:53:21 +00:00
Brandon Li b194cbc6dd Update CHANGES.txt to move HDFS-4772 to 2.1.0 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495543 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 19:05:00 +00:00
Konstantin Shvachko 3a06308118 Move changes for HDFS-4883 to 2.1.0 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495314 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 08:02:31 +00:00
Konstantin Shvachko 92cbba386f HDFS-4883. complete() should verify fileId. Contributed by Tao Luo.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495302 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 07:28:38 +00:00
Brandon Li 6ecf78a99b HDFS-4772. Add number of children in HdfsFileStatus. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495253 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 00:32:23 +00:00
Tsz-wo Sze c02953dbc3 HDFS-4908. Reduce snapshot inode memory usage.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494858 13f79535-47bb-0310-9956-ffa450edef68
2013-06-20 05:10:39 +00:00
Tsz-wo Sze c68b1d1b31 HDFS-4914. Use DFSClient.Conf instead of Configuration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494854 13f79535-47bb-0310-9956-ffa450edef68
2013-06-20 04:43:07 +00:00