Commit Graph

602 Commits

Author SHA1 Message Date
Eli Collins 99a321419f HDFS-3129. NetworkTopology: add test that getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:07:30 +00:00
Tsz-wo Sze 67bdbd60cd (recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:14:12 +00:00
Tsz-wo Sze 5e38a9acea Revert 1305590 for HDFS-3089.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305598 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:09:14 +00:00
Tsz-wo Sze 1ebcc378af HDFS-3089. Move FSDatasetInterface and the related classes to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305590 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:01:47 +00:00
Aaron Myers 429baf606a Move CHANGES.txt entry for HDFS-2941 to the right version.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305453 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:11:19 +00:00
Aaron Myers ce1a7ec975 HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305447 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:02:40 +00:00
Todd Lipcon 840df19cee HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 01:54:14 +00:00
Todd Lipcon 39775dca68 Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 21:38:31 +00:00
Aaron Myers ea868d3d8b HDFS-3116. Typo in fetchdt error message. Contributed by AOE Takashi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304996 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 08:45:04 +00:00
Todd Lipcon 90ea037d21 HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 23:48:07 +00:00
Todd Lipcon 4cb809bf04 HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304681 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 00:21:52 +00:00
Todd Lipcon b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 06:29:40 +00:00
Eli Collins 4feef86372 HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 21:11:18 +00:00
Tsz-wo Sze 0c4acdc176 HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:10:20 +00:00
Todd Lipcon 2f820dde17 HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:14:09 +00:00
Todd Lipcon f55a1c0876 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 17:30:37 +00:00
Tsz-wo Sze 9e108e61fb HDFS-3086. Change Datanode not to send storage list in registration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:07:33 +00:00
Aaron Myers 4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 19:00:56 +00:00
Aaron Myers 21426e6e42 HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 01:00:14 +00:00
Tsz-wo Sze 6326605acb HDFS-3105. Add DatanodeStorage information to block recovery.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G f77b1a63ec HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:54:13 +00:00
Uma Maheswara Rao G 875080ce10 HDFS-3111. Missing license headers in trunk. Deleted this file from svn repositiry as this file was already empty. (Contributed by Uma MAheswara Rao G).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301876 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 07:06:42 +00:00
Uma Maheswara Rao G 3573d504e4 HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301871 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 06:50:36 +00:00
Tsz-wo Sze 2a0024403a HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 17:48:33 +00:00
Tsz-wo Sze 662b1887af HDFS-3088. Move FSDatasetInterface inner classes to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 17:32:57 +00:00
Tsz-wo Sze 9b2a324ba5 HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:27:40 +00:00
Tsz-wo Sze 7e5b60116e HDFS-3101. Cannot read empty file using WebHDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:01:23 +00:00
Todd Lipcon 49619e8997 HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:00:29 +00:00
Aaron Myers 65425b0961 HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 21:51:23 +00:00
Aaron Myers 6d96a28a08 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 20:26:29 +00:00
Tsz-wo Sze 1177d4edc2 HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301127 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 18:24:40 +00:00
Todd Lipcon 59eb544744 HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300814 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 05:36:03 +00:00
Alejandro Abdelnur a0ee9adfd3 HDFS-3057. httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIR (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300637 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 17:01:34 +00:00
Tsz-wo Sze 3e582c690c HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 22:52:17 +00:00
Eli Collins ab20dae519 HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299963 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 03:38:57 +00:00
Todd Lipcon 1a75ec8288 HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 19:41:21 +00:00
Suresh Srinivas 46a88ded0d Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68
2012-03-11 18:11:43 +00:00
Tsz-wo Sze c8f2889bde HDFS-3056: add the new file for the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299144 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 01:58:29 +00:00
Tsz-wo Sze 501a283986 HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 01:52:17 +00:00
Steve Loughran 381a9b2d58 HDFS-2966
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 13:17:04 +00:00
Uma Maheswara Rao G 069fb57f4e HDFS-2976 removed the unused imports that were missed in previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298508 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:56:43 +00:00
Uma Maheswara Rao G 6c0c140350 HDFS-2976 corrected the previous wrong commit for this issue.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298507 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:51:46 +00:00
Uma Maheswara Rao G b19d1186ab HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient.
(Contributed by Uma Maheswara Rao G)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298495 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:31:33 +00:00
Suresh Srinivas b874d06133 Moving HDFS-3036, HDFS-3014, HDFS-3003, HDFS-2878, HDFS-208, HDFS-2764, HDFS-2410, HDFS-2285, HDFS-2507 to 0.23.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298274 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 05:23:50 +00:00
Tsz-wo Sze 22738ae1d0 HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 19:44:47 +00:00
Eli Collins 0a2b413dff HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 19:16:03 +00:00
Suresh Srinivas 6f8d347b83 Moving HDFS-2158, HDFS-2188, HDFS-2334, HDFS-2477, HDFS-2495, HDFS-2476, HDFS-1580, HDFS-1765 to 0.23.3 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297903 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 09:15:30 +00:00
Tsz-wo Sze 0ee71adeb4 HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 02:42:46 +00:00
Aaron Myers 8e303014bc Fix up CHANGES.txt files post commit of HDFS-1623 and HADOOP-7454.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296540 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:50:04 +00:00
Todd Lipcon 87d1c67944 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:48:32 +00:00