Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,605 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

521 Commits

Author SHA1 Message Date
Todd Lipcon e4b5b99e8e HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1342043 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 20:43:00 +00:00
Tsz-wo Sze 08a39a9e73 svn merge -c 1341961 from trunk for HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1341962 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 18:01:11 +00:00
Eli Collins ca16f8bdae HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1341928 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 16:05:41 +00:00
Tsz-wo Sze 3ea532eefc svn merge -c 1341676 from trunk for HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1341677 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 23:19:33 +00:00
Tsz-wo Sze 8ba8542cde svn merge -c 1341141 from trunk for HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1341143 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 18:55:26 +00:00
Eli Collins 619cc6a775 HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1340842 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 21:15:16 +00:00
Uma Maheswara Rao G cb96cf17a9 svn merge 1340749:1340750 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1340754 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 15:32:34 +00:00
Todd Lipcon d4ae893a27 HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1340342 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-19 05:12:49 +00:00
Aaron Myers f03fc39e2c HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1340261 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 21:27:28 +00:00
Todd Lipcon 0e7ea9b56c HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339979 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 05:28:26 +00:00
Todd Lipcon e83cf11d92 HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339898 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 22:30:52 +00:00
Todd Lipcon c86a4cbe93 HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339744 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:49:36 +00:00
Eli Collins 84a39c2711 HDFS-3434. svn merge -c 1339712 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339725 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:22:59 +00:00
Eli Collins 0319ebb42a HDFS-1153. svn merge -c 1339706 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339713 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:01:23 +00:00
Aaron Myers 1faa95d662 HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339543 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 10:28:15 +00:00
Todd Lipcon d62694d97f HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339450 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 02:45:34 +00:00
Eli Collins 3f844f50dd HDFS-860. svn merge -c 1339413 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339414 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 22:58:00 +00:00
Alejandro Abdelnur 00875b37f6 HADOOP-8403. bump up POMs version to 2.0.1-SNAPSHOT. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339326 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 19:46:30 +00:00
Aaron Myers 4402866c74 HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339252 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 16:27:55 +00:00
Todd Lipcon 73766e6d1d Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339017 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 05:44:01 +00:00
Eli Collins b24cc33566 HDFS-3418. svn merge -c 1338830 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338833 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 19:06:05 +00:00
Eli Collins 053f50f713 HDFS-3419. svn merge -c 1338802 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338805 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 17:24:22 +00:00
Eli Collins 5ea3d6cf5d HDFS-3416. svn merge -c 1338784 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338800 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 17:20:53 +00:00
Eli Collins b20ef722c5 HDFS-3417. svn merge -c 1338767 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338780 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 16:17:21 +00:00
Todd Lipcon 715b4cfad1 HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338493 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 00:41:53 +00:00
Todd Lipcon 201038272f HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338489 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 00:31:35 +00:00
Todd Lipcon b81b987be8 HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338467 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-14 22:35:57 +00:00
Aaron Myers c0bacb578b HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338277 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-14 16:28:23 +00:00
Aaron Myers 8cb6cc9d91 HDFS-3404. Make putImage in GetImageServlet infer remote address to fetch from request. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337756 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-13 02:57:41 +00:00
Tsz-wo Sze a5da2f6d68 Merge r1329319 for HADOOP-8285 for the changes outside common. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337433 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 02:19:58 +00:00
Tsz-wo Sze c0795cd107 svn merge -c 1310649 from trunk for HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337423 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 01:04:44 +00:00
Thomas White dc576b9fa1 Merge -r 1337198:1337199 from trunk to branch-2. Fixes: MAPREDUCE-4148. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337200 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 15:04:24 +00:00
Aaron Myers 97a8118315 HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337031 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 06:02:33 +00:00
Eli Collins 6795b5ad8f HDFS-3400. svn merge -c 1337017 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337018 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 03:16:28 +00:00
Tsz-wo Sze c68efee78c svn merge -c 1336976 from trunk for HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336977 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 00:27:08 +00:00
Eli Collins c9a9756a2c HDFS-3401. svn merge -c 1336972 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336973 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 00:05:15 +00:00
Eli Collins a43a9cfe1a HDFS-3134. svn merge -c 1336943 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336944 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:15:19 +00:00
Tsz-wo Sze b41b4e9c43 svn merge -c 1336909 from trunk for HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336911 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 21:45:45 +00:00
Eli Collins 2dd260be1b HDFS-3230. svn merge -c 1336815 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336867 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 20:08:41 +00:00
Aaron Myers 8ae40b7085 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336693 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 13:53:30 +00:00
Uma Maheswara Rao G 6209fed67d Reverting (Need to re-do the patch. new BlockInfo does not set iNode )HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and direc 
tory scanning has happened.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336576 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 10:10:03 +00:00
Eli Collins 51c1985bc9 HDFS-3396. svn merge -c 1336495 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336496 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 06:32:12 +00:00
Eli Collins 037c8e99c1 HDFS-3328. svn merge -c 1336480 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336481 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 04:54:50 +00:00
Todd Lipcon d0f920fba8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336460 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 00:44:52 +00:00
Aaron Myers 34b9bc4e7f HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336327 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 18:21:38 +00:00
Uma Maheswara Rao G 1c52a01422 HDFS-234. Integration with BookKeeper logging system. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336103 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 11:32:40 +00:00
Tsz-wo Sze 16bdd99dfd svn merge -c 1335788 from trunk for removing the empty file FSInodeInfo.java for HDFS-3363. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1335789 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 21:55:47 +00:00
Uma Maheswara Rao G 0a9b3c4401 merge HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. Contributed by Ashish Singhi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1335723 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 19:53:04 +00:00
Eli Collins 797da76660 HDFS-3378. svn merge -c 1335309 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1335310 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 00:29:06 +00:00
Tsz-wo Sze d8156648fe svn merge -c 1335304 from trunk for HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1335305 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 00:08:12 +00:00