Commit Graph

3128 Commits

Author SHA1 Message Date
Brandon Li fb1f5bc618 HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610840 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 20:35:07 +00:00
Colin McCabe 7fe6ab7f91 HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610790 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 18:17:13 +00:00
Chris Nauroth 97b5fbc281 HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610549 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 22:49:08 +00:00
Brandon Li 3d9bea277a HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 21:48:44 +00:00
Chris Nauroth 3b54223c0f HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610474 13f79535-47bb-0310-9956-ffa450edef68
2014-07-14 18:10:03 +00:00
Chris Nauroth 23e61a7a25 HDFS-3851. Move attribution to release 2.6.0 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609858 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:22:16 +00:00
Chris Nauroth 1c6be51e5e HADOOP-8158. Move attribution to release 2.6.0 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609854 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 22:09:33 +00:00
Chris Nauroth c9676bb07c HDFS-2976. Move attribution to release 2.6.0 section in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609849 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 21:58:16 +00:00
Vinayakumar B 952b0fb18c HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609629 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 05:15:18 +00:00
Chris Nauroth 81930b75bd HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609618 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 03:06:11 +00:00
Jing Zhao b90dfe0b49 HDFS-6640. Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly in WebHdfs document (missed webhdfs/v1). Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609603 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 01:28:47 +00:00
Kihwal Lee 8f520386fb HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609543 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:18:22 +00:00
Chris Nauroth cce02e3bef HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609534 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 18:03:32 +00:00
Tsz-wo Sze e67b80ec3a HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609401 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 06:16:34 +00:00
Jing Zhao 36492f084b HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609388 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 05:01:41 +00:00
Colin McCabe d9c5f20333 HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609384 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 04:03:02 +00:00
Colin McCabe 8044a12ac0 HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609380 13f79535-47bb-0310-9956-ffa450edef68
2014-07-10 03:49:30 +00:00
Vinayakumar B 3b0db60113 HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609020 13f79535-47bb-0310-9956-ffa450edef68
2014-07-09 06:05:44 +00:00
Chris Nauroth 709d5cbd71 HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608940 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 20:29:42 +00:00
Chris Nauroth f62e93d591 HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608905 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 19:16:48 +00:00
Chris Nauroth 3470dd9a2f HDFS-6614. Addendum patch to shorten TestPread run time with smaller retry timeout setting. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608846 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 16:43:16 +00:00
Uma Maheswara Rao G cddd6184ad HDFS-5411. Update Bookkeeper dependency to 4.2.3. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608781 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:50:49 +00:00
Uma Maheswara Rao G 986c09f68e HDFS-4221. Remove the format limitation point from BKJM documentation as HDFS-3810 closed. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608776 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:31:37 +00:00
Uma Maheswara Rao G e6446b708d HDFS-4286. Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM. Contributed by Rakesh R.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608764 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 13:17:54 +00:00
Haohui Mai 76a621ffd2 HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608631 13f79535-47bb-0310-9956-ffa450edef68
2014-07-08 00:08:18 +00:00
Chris Nauroth 93c1bc8114 HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608522 13f79535-47bb-0310-9956-ffa450edef68
2014-07-07 17:37:04 +00:00
Andrew Wang 151c5deaf1 HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607735 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:10:54 +00:00
Andrew Wang f881f0e923 HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607732 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 20:02:14 +00:00
Andrew Wang 93e23a9915 HDFS-6613. Improve logging in caching classes. (wang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607697 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 17:13:59 +00:00
Uma Maheswara Rao G 160c912ee6 HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607685 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 16:08:44 +00:00
Steve Loughran b6fbaba8e9 HADOOP-9361: Strictly define FileSystem APIs - HDFS portion
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607597 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 12:09:45 +00:00
Karthik Kambatla 54dc17ce2f Preparing for release 2.6.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607538 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 05:55:05 +00:00
Andrew Wang 9b5d551ad9 HDFS-6610. TestShortCircuitLocalRead tests sometimes timeout on slow machines. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607496 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 23:02:24 +00:00
Colin McCabe 297e3c72fb HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607456 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 19:43:36 +00:00
Chris Nauroth 130182df1b HDFS-6614. shorten TestPread run time with a smaller retry timeout setting. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607447 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:57:25 +00:00
Andrew Wang 9dfe9cf400 HDFS-6612. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID. Contributed by Juan Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607442 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 18:37:00 +00:00
Chris Nauroth c89bf0184d HDFS-6603. Add XAttr with ACL test. Contributed by Stephen Chu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607239 13f79535-47bb-0310-9956-ffa450edef68
2014-07-02 03:20:25 +00:00
Chris Nauroth 0ca41a8f35 HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606927 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 20:46:44 +00:00
Kihwal Lee e8186a9dee HDFS-6558. Missing newline in the description of dfsadmin -rollingUpgrade. Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606855 13f79535-47bb-0310-9956-ffa450edef68
2014-06-30 18:17:56 +00:00
Steve Loughran 2f75cd1190 HDFS-6418. Regression: DFS_NAMENODE_USER_NAME_KEY missing
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606536 13f79535-47bb-0310-9956-ffa450edef68
2014-06-29 16:27:24 +00:00
Kihwal Lee 94a1462bd5 HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606371 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 15:21:46 +00:00
Uma Maheswara Rao G 78cafe34e6 HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606320 13f79535-47bb-0310-9956-ffa450edef68
2014-06-28 11:40:02 +00:00
Aaron Myers 5f880f79d2 HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606042 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 12:00:55 +00:00
Chris Nauroth 280bdb9a16 HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605928 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 23:12:45 +00:00
Chris Nauroth c3e26735a6 HADOOP-9705. FsShell cp -p does not preserve directory attibutes. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605672 13f79535-47bb-0310-9956-ffa450edef68
2014-06-26 05:36:54 +00:00
Tsz-wo Sze e3612e4428 HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605565 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 19:27:29 +00:00
Tsz-wo Sze 988bc17bc3 HADOOP-10674. Improve PureJavaCrc32 performance and use java.util.zip.CRC32 for Java 7 and above.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605239 13f79535-47bb-0310-9956-ffa450edef68
2014-06-25 02:22:15 +00:00
Aaron Myers 55a1defa50 HDFS-6475. WebHdfs clients fail without retry because incorrect handling of StandbyException. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605217 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 23:07:49 +00:00
Haohui Mai a92318c2ef HDFS-6587. Fix a typo in message issued from explorer.js. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605184 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 20:48:32 +00:00
Haohui Mai bdf3de9f6b HDFS-6593. Move SnapshotDiffInfo out of INodeDirectorySnapshottable. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605169 13f79535-47bb-0310-9956-ffa450edef68
2014-06-24 19:59:34 +00:00