Commit Graph

1262 Commits

Author SHA1 Message Date
Suresh Srinivas 9dbd2e7efc HADOOP-9760. Move GSet and related classes to common from HDFS. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505875 13f79535-47bb-0310-9956-ffa450edef68
2013-07-23 01:40:58 +00:00
Jing Zhao 11c073134a HDFS-5008. Make ClientProtocol#abandonBlock() idempotent. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505761 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 18:22:38 +00:00
Colin McCabe c1314eb2a3 HDFS-4817. Make HDFS advisory caching configurable on a per-file basis. (Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505753 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 18:15:18 +00:00
Jing Zhao febcf4d669 HDFS-5018. Misspelled DFSConfigKeys#DFS_NAMENODE_STALE_DATANODE_INTERVAL_DEFAULT in javadoc of DatanodeInfo#isStale(). Contributed by Ted Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505603 13f79535-47bb-0310-9956-ffa450edef68
2013-07-22 05:28:36 +00:00
Uma Maheswara Rao G 731a583c2b HDFS-4602. TestBookKeeperHACheckpoints fails. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505362 13f79535-47bb-0310-9956-ffa450edef68
2013-07-21 12:27:38 +00:00
Kihwal Lee 313dd02505 HDFS-5010. Reduce the frequency of getCurrentUser() calls from namenode. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505160 13f79535-47bb-0310-9956-ffa450edef68
2013-07-20 16:22:11 +00:00
Harsh J 0dc5824a83 HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is disabled but security is turned on. Contributed by Kousuke Saruta. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504784 13f79535-47bb-0310-9956-ffa450edef68
2013-07-19 07:00:40 +00:00
Jing Zhao 7e2aba0ab5 HDFS-5007. Replace hard-coded property keys with DFSConfigKeys fields. Contributed by Kousuke Saruta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504764 13f79535-47bb-0310-9956-ffa450edef68
2013-07-19 05:41:33 +00:00
Arun Murthy 31f29de05b Fixed CHANGES.txt to reflect that new content in branch-2 goes to hadoop-2.3.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504742 13f79535-47bb-0310-9956-ffa450edef68
2013-07-19 01:29:07 +00:00
Arun Murthy 87a02553ee Fixed CHANGES.txt to reflect that all fixes in 2.1.1-beta are now in 2.1.0-beta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504738 13f79535-47bb-0310-9956-ffa450edef68
2013-07-19 01:03:19 +00:00
Chris Nauroth e2efe52ac8 HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504679 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 21:57:24 +00:00
Chris Nauroth a5cd4b9bee HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504352 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 03:28:19 +00:00
Jing Zhao 68faa67f1b HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504326 13f79535-47bb-0310-9956-ffa450edef68
2013-07-18 00:04:28 +00:00
Colin McCabe b767ee07c2 fix misspelling in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504229 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 18:41:14 +00:00
Kihwal Lee d26334b410 HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503971 13f79535-47bb-0310-9956-ffa450edef68
2013-07-17 01:57:35 +00:00
Colin McCabe badab7ed5e HDFS-4657. Limit the number of blocks logged by the NN after a block report to a configurable value. (Aaron Twinning Meyers via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503862 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 20:07:42 +00:00
Tsz-wo Sze 2d6049f1d6 HDFS-4992. Make balancer's mover thread count and dispatcher thread count configurable. Contributed by Max Lapan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503720 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 14:04:33 +00:00
Suresh Srinivas afaec5f52d HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503570 13f79535-47bb-0310-9956-ffa450edef68
2013-07-16 06:33:40 +00:00
Todd Lipcon 0880be20ac HDFS-4982. JournalNode should relogin from keytab before fetching logs from other JNs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502682 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 20:44:45 +00:00
Suresh Srinivas b47df4e3b9 HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502634 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 17:44:00 +00:00
Jing Zhao 3630a23c55 HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502400 13f79535-47bb-0310-9956-ffa450edef68
2013-07-12 00:11:31 +00:00
Colin McCabe 8767e4cde1 HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502373 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 21:31:04 +00:00
Chris Nauroth 2409882a47 HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502331 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 19:20:38 +00:00
Chris Nauroth 19346d8ca6 HDFS-4373. Add HTTP API for querying NameNode startup progress. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502328 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 19:04:26 +00:00
Suresh Srinivas 17420dcc71 HDFS-4980. Incorrect logging.properties file for hadoop-httpfs. Contributed by Mark Grover.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502302 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 18:05:34 +00:00
Chris Nauroth da8e962e39 HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502120 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 05:35:29 +00:00
Alejandro Abdelnur 59a5ab9d1c updating CHANGES.txt after committing MAPREDUCE-5333,HADOOP-9661,HADOOP-9355,HADOOP-9673,HADOOP-9414,HADOOP-9416,HDFS-4797,YARN-866,YARN-736,YARN-883 to 2.1-beta branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502075 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 00:22:14 +00:00
Tsz-wo Sze 36bd53a9a9 In CHANGES.txt, move HDFS-4908 and HDFS-4645 to 2.1.0-beta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502009 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 21:26:14 +00:00
Alejandro Abdelnur c6eaa8b37f HDFS-4969. WebhdfsFileSystem expects non-standard WEBHDFS Json element. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501868 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:32:05 +00:00
Jing Zhao 58d75576c4 HDFS-4962. Use enum for nfs constants. Contributed by Tsz Wo (Nicholas) SZE.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501851 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:01:28 +00:00
Kihwal Lee 3a3109f8bf HDFS-4887. TestNNThroughputBenchmark exits abruptly. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501841 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 16:39:37 +00:00
Alejandro Abdelnur 3ed7c6e9e5 HDFS-4951. FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer. (rknater via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501451 13f79535-47bb-0310-9956-ffa450edef68
2013-07-09 18:41:26 +00:00
Alejandro Abdelnur 8fdd5083bf HDFS-4841. FsShell commands using secure webhfds fail ClientFinalizer shutdown hook. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501005 13f79535-47bb-0310-9956-ffa450edef68
2013-07-08 23:07:15 +00:00
Tsz-wo Sze 6770de7ec4 HDFS-4645. Move from randomly generated block ID to sequentially generated block ID. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500580 13f79535-47bb-0310-9956-ffa450edef68
2013-07-08 05:29:10 +00:00
Aaron Myers 5428bfbf53 HDFS-4465. Optimize datanode ReplicasMap and ReplicaInfo. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499659 13f79535-47bb-0310-9956-ffa450edef68
2013-07-04 05:52:13 +00:00
Brandon Li 2c9e837f1b HDFS-4948. mvn site for hadoop-hdfs-nfs fails. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499152 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 23:45:39 +00:00
Brandon Li 37f587563a HDFS-4762 Provide HDFS based NFSv3 and Mountd implementation. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499029 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 17:31:58 +00:00
Tsz-wo Sze 05fd0a706a HDFS-4943. WebHdfsFileSystem does not work when original file path has encoded chars. Contributed by Jerry He
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498962 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 14:58:35 +00:00
Kihwal Lee ead7fa0413 HDFS-4888. Refactor and fix FSNamesystem.getTurnOffTip. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498665 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 20:20:27 +00:00
Thomas Graves aa7e148d1f Preparing for 0.23.9 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498480 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 14:29:45 +00:00
Tsz-wo Sze feb5b9641d HDFS-4797. BlockScanInfo does not override equals(..) and hashCode() consistently.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498202 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 01:28:22 +00:00
Chris Nauroth 750442812c HDFS-4944. WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498055 13f79535-47bb-0310-9956-ffa450edef68
2013-06-30 03:38:09 +00:00
Chris Nauroth ca1058b27a HDFS-4932. Avoid a wide line on the name node webUI if we have more Journal nodes. Contributed by Fengdong Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497141 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 22:20:31 +00:00
Arun Murthy c918b5c02c Preparing for hadoop-2.1.0-beta release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496791 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 06:51:50 +00:00
Chris Nauroth d74908bdb6 HDFS-4927. CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496350 13f79535-47bb-0310-9956-ffa450edef68
2013-06-25 05:05:20 +00:00
Jason Darrell Lowe 1087be1df4 HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495648 13f79535-47bb-0310-9956-ffa450edef68
2013-06-22 00:41:34 +00:00
Brandon Li b194cbc6dd Update CHANGES.txt to move HDFS-4772 to 2.1.0 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495543 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 19:05:00 +00:00
Konstantin Shvachko 3a06308118 Move changes for HDFS-4883 to 2.1.0 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495314 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 08:02:31 +00:00
Konstantin Shvachko 92cbba386f HDFS-4883. complete() should verify fileId. Contributed by Tao Luo.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495302 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 07:28:38 +00:00
Brandon Li 6ecf78a99b HDFS-4772. Add number of children in HdfsFileStatus. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495253 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 00:32:23 +00:00