Commit Graph

2853 Commits

Author SHA1 Message Date
Haohui Mai 82be0f935d HDFS-6157. Fix the entry point of OfflineImageViewer for hdfs.cmd. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582098 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 22:34:25 +00:00
Suresh Srinivas 78b9321539 HDFS-6119. FSNamesystem code cleanup. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582073 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 21:32:32 +00:00
Suresh Srinivas 14556cc5d8 HDFS-6155. Fix Boxing/unboxing to parse a primitive findbugs warnings. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582068 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 21:27:33 +00:00
Jing Zhao fe8c3dc2b8 HDFS-5672. TestHASafeMode#testSafeBlockTracking fails in trunk. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581994 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 18:36:08 +00:00
Tsz-wo Sze a206399afd HDFS-6115. Call flush() for every append on block scan verification log. Contributed by Vinayakumar B
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581936 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 17:03:05 +00:00
Suresh Srinivas c00703dd08 HDFS-6150. Add inode id information in the logs to make debugging easier. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581914 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 16:32:44 +00:00
Haohui Mai b5935fab44 HDFS-6130. NPE when upgrading namenode from fsimages older than -32. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581713 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 07:30:20 +00:00
Arpit Agarwal 1fbb04e367 HDFS-5910. Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text. (Contributed by Benoy Antony)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581688 13f79535-47bb-0310-9956-ffa450edef68
2014-03-26 04:11:18 +00:00
Haohui Mai 867e0f8ea9 HDFS-5196. Provide more snapshot information in WebUI. Contributed by Shinichi Yamashita.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581427 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 17:53:51 +00:00
Jing Zhao 56205ca7d7 HDFS-5840. Follow-up to HDFS-5138 to improve error handling during partial upgrade failures. Contributed by Aaron T. Myers, Suresh Srinivas, and Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581260 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 06:48:15 +00:00
Suresh Srinivas 3a61d25457 HDFS-6125. Cleanup unnecessary cast in HDFS code base. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581242 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 05:51:11 +00:00
Arpit Agarwal c2ef7e239e HDFS-6124. Add final modifier to class members. (Contributed by Suresh Srinivas)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581124 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 23:32:37 +00:00
Chris Nauroth 328fc86bdb HDFS-5846. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581091 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 22:16:48 +00:00
Jing Zhao 6376cd38a1 Move HDFS-5138 to 2.4.0 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581074 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 21:32:43 +00:00
Jing Zhao 8076ff31eb HDFS-6135. In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581070 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 21:24:31 +00:00
Brandon Li 3bfd18c6b0 HDFS-6050. NFS does not handle exceptions correctly in a few places. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581055 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 20:49:30 +00:00
Kihwal Lee 7a18c4a199 HDFS-3087. Decomissioning on NN restart can complete without blocks being replicated. Contributed by Rushabh S Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580886 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 15:39:00 +00:00
Chris Nauroth 00ceaade05 HDFS-6140. WebHDFS cannot create a file with spaces in the name after HA failover changes. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580173 13f79535-47bb-0310-9956-ffa450edef68
2014-03-22 05:32:24 +00:00
Arpit Agarwal fc53af9c4c HDFS-6120. Fix and improve safe mode log messages. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580047 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 20:57:13 +00:00
Tsz-wo Sze 2fbd94db3e HDFS-6138. Add a user guide for how to use viewfs with federation. Contributed by sanjay and szetszwo
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580013 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 18:47:30 +00:00
Jing Zhao 9dab514b22 HDFS-6038. Allow JournalNode to handle editlog produced by new release with future layoutversion. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579813 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 23:06:06 +00:00
Andrew Wang 4f6397b4ac HDFS-6089. Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579692 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 17:43:16 +00:00
Tsz-wo Sze 7ec4308f82 HDFS-6129. When a replica is not found for deletion, do not throw an exception.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579670 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 15:50:38 +00:00
Haohui Mai aa4a045925 HDFS-6127. WebHDFS tokens cannot be renewed in HA setup. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579546 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 06:47:58 +00:00
Haohui Mai 44deaa8241 HDFS-6105. NN web UI for DN list loads the same jmx page multiple times. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579468 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 23:56:43 +00:00
Tsz-wo Sze cfb468332e HDFS-6123. Do not log stack trace for ReplicaAlreadyExistsException and SocketTimeoutException.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579396 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 21:04:21 +00:00
Jing Zhao 7817245d88 HDFS-6100. DataNodeWebHdfsMethods does not failover in HA mode. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579301 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 17:29:23 +00:00
Chris Nauroth 2b03ae9421 HDFS-6099. HDFS file system limits not enforced on renames. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579122 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 03:46:52 +00:00
Suresh Srinivas d0f7985f5c HDFS-6117. Print file path information in FileNotFoundException on INode ID mismatch. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579104 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 00:59:45 +00:00
Aaron Myers ed02d0c0ce HDFS-6112. NFS Gateway docs are incorrect for allowed hosts configuration. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579097 13f79535-47bb-0310-9956-ffa450edef68
2014-03-19 00:30:29 +00:00
Tsz-wo Sze 534a5ee346 Add TestSnapshotNameWithInvalidCharacters.java for HDFS-6068.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579005 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 18:35:19 +00:00
Tsz-wo Sze 02b25ce4ef HDFS-6068. Disallow snapshot names that are also invalid directory names. Contributed by sathish
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579004 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 18:34:19 +00:00
Colin McCabe bd98fa152d HDFS-6007. Update documentation about short-circuit local reads (iwasakims via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578994 13f79535-47bb-0310-9956-ffa450edef68
2014-03-18 18:14:04 +00:00
Jing Zhao 0b3ee72af8 HDFS-6090. Use MiniDFSCluster.Builder instead of deprecated constructors. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578669 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 23:53:48 +00:00
Chris Nauroth 6318afe3b9 HDFS-5516. WebHDFS does not require user name when anonymous http requests are disallowed. Contributed by Miodrag Radulovic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578549 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 20:25:10 +00:00
Colin McCabe 7096c290ed HDFS-6107: fix comment (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578511 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 18:54:03 +00:00
Colin McCabe d265dd9eb0 HDFS-6107. When a block cannot be cached due to limited space on the DataNode, it becomes uncacheable (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578508 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 18:46:33 +00:00
Arpit Agarwal 809e8bf5b7 HDFS-6094. The same block can be counted twice towards safe mode threshold. (Arpit Agarwal)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578478 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 17:37:55 +00:00
Colin McCabe 9a65a9aadc HDFS-6106. Reduce default for dfs.namenode.path.based.cache.refresh.interval.ms (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577798 13f79535-47bb-0310-9956-ffa450edef68
2014-03-15 07:52:19 +00:00
Andrew Wang d37c31a2db HDFS-6102. Lower the default maximum items per directory to fix PB fsimage loading. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577426 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 04:52:03 +00:00
Haohui Mai 38006007ea HDFS-6084. Namenode UI - Hadoop logo link shouldn't go to hadoop homepage. Contributed by Travis Thompson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577401 13f79535-47bb-0310-9956-ffa450edef68
2014-03-14 00:58:54 +00:00
Colin McCabe f730fa919e HDFS-6097. Zero-copy reads are incorrectly disabled on file offsets above 2GB (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577350 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 22:30:42 +00:00
Brandon Li 842aa2bc94 HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577319 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 21:03:59 +00:00
Suresh Srinivas 70aba7ffcf HDFS-5244. TestNNStorageRetentionManager#testPurgeMultipleDirs fails. Contributed bye Jinghui Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577254 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 17:21:09 +00:00
Arpit Agarwal f0fa038c7e HDFS-6096. TestWebHdfsTokens may timeout. (Contributed by szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576999 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 23:24:32 +00:00
Arpit Agarwal 20ec0c0474 HDFS-5705. Update CHANGES.txt for merging the original fix (r1555190) to branch-2 and branch-2.4.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576989 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 23:13:32 +00:00
Andrew Wang b849dd5df9 HDFS-6079. Timeout for getFileBlockStorageLocations does not work. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576979 13f79535-47bb-0310-9956-ffa450edef68
2014-03-12 22:54:57 +00:00
Colin McCabe a3616c58dd HDFS-6086. Fix a case where zero-copy or no-checksum reads were not allowed even when the block was cached. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576533 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 22:41:05 +00:00
Haohui Mai b027ef8858 HDFS-6072. Clean up dead code of FSImage. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576513 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 21:44:38 +00:00
Chris Nauroth 8d29768704 HDFS-5638. HDFS implementation of FileContext API for ACLs. Contributed by Vinayakumar B.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576405 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 16:13:43 +00:00