Commit Graph

1654 Commits

Author SHA1 Message Date
Tsz-wo Sze 1096917649 HDFS-4611. Update FSImage for INodeReference.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463332 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 23:24:42 +00:00
Tsz-wo Sze 8ee6ecaea4 HDFS-4637. INodeDirectory#replaceSelf4Quota may incorrectly convert a newly created directory to an INodeDirectoryWithSnapshot. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463075 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 01:53:21 +00:00
Tsz-wo Sze 9602869d19 HDFS-4648. For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462865 13f79535-47bb-0310-9956-ffa450edef68
2013-03-30 23:57:27 +00:00
Tsz-wo Sze f5bbc2d950 Merge r1460409 through r1462697 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462698 13f79535-47bb-0310-9956-ffa450edef68
2013-03-30 03:50:03 +00:00
Todd Lipcon 1611b51a97 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
2013-03-28 20:58:45 +00:00
Tsz-wo Sze 25aab4203c HDFS-4636. Update quota usage when deleting files/dirs that were created after taking the latest snapshot. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462192 13f79535-47bb-0310-9956-ffa450edef68
2013-03-28 16:18:04 +00:00
Sanjay Radia 0e6604aab3 HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly (Chris Nauroth via Sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461846 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 20:49:48 +00:00
Todd Lipcon 4809bfa6ed HDFS-4618. Default transaction interval for checkpoints is too low. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461783 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:46:32 +00:00
Todd Lipcon 81192e4e41 HDFS-4621. Additional logging to help diagnose slow QJM syncs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461777 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:42:43 +00:00
Kihwal Lee c9f5052803 HDFS-4581. DataNode.checkDiskError should not be called on network errors. Contributed by Rohit Kochar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461597 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 14:21:13 +00:00
Suresh Srinivas fdf1e6e07e HDFS-4635. Move BlockManager#computeCapacity to LightWeightGSet. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461364 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 23:01:03 +00:00
Tsz-wo Sze ca3e09bab5 HDFS-4598. Fix the default value of ConcatSourcesParam and the WebHDFS doc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461040 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 09:54:48 +00:00
Tsz-wo Sze cc2f96f655 HDFS-4612. Not to use INode.getParent() when generating snapshot diff report. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460590 13f79535-47bb-0310-9956-ffa450edef68
2013-03-25 10:21:30 +00:00
Suresh Srinivas 698e3f8ae5 Merging trunk to branch HDFS-2802
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460410 13f79535-47bb-0310-9956-ffa450edef68
2013-03-24 15:56:18 +00:00
Suresh Srinivas 993a76f2dd HDFS-4627. Fix FSImageFormat#Loader NPE and synchronization issues. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460389 13f79535-47bb-0310-9956-ffa450edef68
2013-03-24 14:53:52 +00:00
Tsz-wo Sze 7ed618e324 HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459592 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:56:06 +00:00
Tsz-wo Sze c2e186bae6 HDFS-4615. Fix TestDFSShell failures on Windows. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459586 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:48:39 +00:00
Tsz-wo Sze e976294d35 HDFS-4609. TestAuditLogs should release log handles between tests. Contributed by Ivan Mitic
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459576 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:18:26 +00:00
Tsz-wo Sze 1b98d8dda3 HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific line separator; otherwise, it fails on Windows. Contributed by Ivan Mitic
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459573 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 23:11:20 +00:00
Aaron Myers 036c168f4f HDFS-4620. Documentation for dfs.namenode.rpc-address specifies wrong format. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459549 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 21:59:02 +00:00
Tsz-wo Sze ca7c588185 HDFS-4616. Update the FilesDeleted metric while deleting file/dir in the current tree. Contributed by Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1459485 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 19:30:35 +00:00
Aaron Myers a10fbb93e7 HDFS-4246. The exclude node list should be more forgiving, for each output stream. Contributed by Harsh J. Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459475 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 18:58:06 +00:00
Aaron Myers c92b59fd8d HDFS-4614. FSNamesystem#getContentSummary should use getPermissionChecker helper method. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1458593 13f79535-47bb-0310-9956-ffa450edef68
2013-03-20 00:36:13 +00:00
Tsz-wo Sze 9701555899 HDFS-4534. Add INodeReference in order to support rename with snapshots.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1458164 13f79535-47bb-0310-9956-ffa450edef68
2013-03-19 06:27:26 +00:00
Aaron Myers 64741f4635 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 17:20:13 +00:00
Tsz-wo Sze a5a66330a8 Merge r1455389 through r1457712 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457716 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 11:45:07 +00:00
Tsz-wo Sze 77f7bfa9ef HDFS-4556. Add snapshotdiff and LsSnapshottableDir tools to hdfs script. Contributed by Arpit Agarwal
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457712 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 11:36:59 +00:00
Suresh Srinivas 415d038319 HDFS-4604. TestJournalNode fails on Windows. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457069 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 18:59:20 +00:00
Suresh Srinivas 9c7c2f4f27 HDFS-4603. TestMiniDFSCluster fails on Windows. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457057 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 18:41:18 +00:00
Aaron Myers 807e08334e HDFS-4596. Shutting down namenode during checkpointing can lead to md5sum error. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456630 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 20:01:03 +00:00
Aaron Myers bcabbcdf4c HDFS-3277. fail over to loading a different FSImage if the first one we try to load is corrupt. Contributed by Colin Patrick McCabe and Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456578 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 18:04:04 +00:00
Daryn Sharp 2c42337545 HDFS-3367. WebHDFS doesn't use the logged in user when opening connections (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456469 13f79535-47bb-0310-9956-ffa450edef68
2013-03-14 15:14:13 +00:00
Kihwal Lee 7987bcf3f4 HDFS-3344. Unreliable corrupt blocks counting in TestProcessCorruptBlocks. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456172 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 21:58:19 +00:00
Aaron Myers 3bf09c5150 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456107 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 19:51:19 +00:00
Suresh Srinivas 1f3a18ff44 HDFS-4582. TestHostsFiles fails on Windows. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456060 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 17:43:34 +00:00
Suresh Srinivas c390683bcc HDFS-4583. TestNodeCount fails. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456052 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 17:15:38 +00:00
Suresh Srinivas 8c20a8f495 HDFS-4595. When short circuit read is fails, DFSClient does not fallback to regular reads. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456047 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 16:45:31 +00:00
Suresh Srinivas e4e13618e8 HDFS-4593. TestSaveNamespace fails on Windows. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455956 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 14:28:55 +00:00
Suresh Srinivas b8f3133e04 Adding file missed in the revision 1455805
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455807 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 06:06:21 +00:00
Suresh Srinivas 719c313be1 HDFS-4144. Create test for all snapshot-related metrics. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455805 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 06:05:00 +00:00
Aaron Myers 06f711d819 HDFS-4484. libwebhdfs compilation broken with gcc 4.6.2. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455782 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:59:00 +00:00
Aaron Myers 7c8419f14f HDFS-4522. LightWeightGSet expects incrementing a volatile to be atomic. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455780 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:55:20 +00:00
Aaron Myers 86a940f7ad HDFS-4592. Default values for access time precision are out of sync between hdfs-default.xml and the code. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455777 13f79535-47bb-0310-9956-ffa450edef68
2013-03-13 02:32:44 +00:00
Suresh Srinivas c5017c71e4 HDFS-4013. TestHftpURLTimeouts throws NPE. Contributed by Chao Shi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455755 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 23:37:03 +00:00
Aaron Myers 813e97494a HDFS-4586. TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455708 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 20:55:33 +00:00
Suresh Srinivas d49c50732e HDFS-4287. HTTPFS tests fail on Windows. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455605 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 16:35:09 +00:00
Tsz-wo Sze 3b3ea5c422 HDFS-4563. Update namespace/diskspace usage after deleting snapshots.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455396 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 02:41:25 +00:00
Tsz-wo Sze f35cd45811 Merge r1454237 through r1455388 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455390 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 01:58:43 +00:00
Suresh Srinivas 9daa958c5a HDFS-4572. Fix TestJournal failures on Windows. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455360 13f79535-47bb-0310-9956-ffa450edef68
2013-03-11 23:13:55 +00:00
Aaron Myers 9d62cdd680 HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455343 13f79535-47bb-0310-9956-ffa450edef68
2013-03-11 21:44:25 +00:00