Commit Graph

888 Commits

Author SHA1 Message Date
Eli Collins 550853203b HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355089 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 17:54:52 +00:00
Tsz-wo Sze f105784d6a svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354792 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:25:32 +00:00
Tsz-wo Sze 44389399d4 HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354790 13f79535-47bb-0310-9956-ffa450edef68
2012-06-28 01:11:22 +00:00
Todd Lipcon 5770a453f3 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354767 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 22:41:41 +00:00
Alejandro Abdelnur c03f1dcf30 Re-amendment to previous commit JIRA was HDFS-3481
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354611 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:20:47 +00:00
Alejandro Abdelnur 38f8b0aee5 Amendment to previous commit, correct JIRA is HDFS-3113
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354602 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:09:48 +00:00
Alejandro Abdelnur d263653ae2 HDFS-3481. Refactor HttpFS handling of JAX-RS query string parameters (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354599 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 16:06:37 +00:00
Tsz-wo Sze bf1649d5fd HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354316 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 02:51:39 +00:00
Eli Collins 0270889b4e HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354144 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 18:14:09 +00:00
Tsz-wo Sze bbab35e6d8 HDFS-3498. Support replica removal in BlockPlacementPolicy and make BlockPlacementPolicyDefault extensible for reusing code in subclasses. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353807 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 03:25:47 +00:00
Tsz-wo Sze 361ea9a62c HDFS-3516. Check content-type in WebHdfsFileSystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353800 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 01:58:13 +00:00
Daryn Sharp 60f4f25afa HDFS-3549. Fix dist tar build fails in hadoop-hdfs-raid project. (Jason Lowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353695 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 18:26:29 +00:00
Daryn Sharp 4b88923e19 HDFS-3550. Fix raid javadoc warnings. (Jason Lowe via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353592 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 15:28:09 +00:00
Tsz-wo Sze 5572f73d45 HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350825 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 23:00:36 +00:00
Uma Maheswara Rao G 7a5c2e8790 Updated CHANGES.txt for HDFS-3408(BKJM : Namenode format fails, if there is no BK root) And HDFS-3389(Document the BKJM usage in Namenode HA)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350733 13f79535-47bb-0310-9956-ffa450edef68
2012-06-15 18:35:58 +00:00
Tsz-wo Sze 9d2b1b2ee8 HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350384 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 20:17:54 +00:00
Eli Collins 29d39bcc7b HDFS-3480. Multiple SLF4J binding warning. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349643 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:53:24 +00:00
Aaron Myers 9cabf93e7a HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349639 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:29:57 +00:00
Eli Collins fda95a6a3d HDFS-3478. Test quotas with Long.Max_Value. Contributed by Sujay Rau
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349634 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 05:04:20 +00:00
Eli Collins 6702d5dbd4 HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 03:31:47 +00:00
Eli Collins 07b8584431 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:42:52 +00:00
Alejandro Abdelnur c83ccc5002 Amendment to my previous commit, fixing JIRA in CHANGES.txt from HDFS-3228 to HDFS-3428
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349556 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:02:56 +00:00
Alejandro Abdelnur 4d4661802e HDFS-3228. Move DelegationTokenRenewer to common (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 21:52:46 +00:00
Tsz-wo Sze 45fafc2b8f HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:27:15 +00:00
Eli Collins 8879653ab4 HDFS-3520. Add transfer rate logging to TransferFsImage. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349117 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:00:07 +00:00
Todd Lipcon 9947d8054c HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349114 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 04:15:18 +00:00
Tsz-wo Sze 543f86631b HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349088 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 01:55:51 +00:00
Eli Collins 9e7334a8fe HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349004 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:52:45 +00:00
Tsz-wo Sze ca39e780c4 HDFS-3052. Change INodeFile and INodeFileUnderConstruction to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348998 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 20:38:46 +00:00
Eli Collins 56d2ef6f5e HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348945 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 18:01:38 +00:00
Tsz-wo Sze 5991ed9cbd HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348287 13f79535-47bb-0310-9956-ffa450edef68
2012-06-09 00:54:10 +00:00
Todd Lipcon 51d889e369 Move several JIRAs from trunk to branch-2 section of CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348258 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 21:48:16 +00:00
Aaron Myers bc367be4ef HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348207 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 19:50:24 +00:00
Aaron Myers b98e26af58 HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347895 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 06:57:52 +00:00
Aaron Myers 072ae08a00 HDFS-3040. TestMulitipleNNDataBlockScanner is misspelled. Contributed by Madhukara Phatak.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347891 13f79535-47bb-0310-9956-ffa450edef68
2012-06-08 06:38:14 +00:00
Todd Lipcon 0b3af2a66b Move HDFS-3042 (automatic failover) to branch-2 section of CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347809 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:35:30 +00:00
Todd Lipcon 05a73a3a1e Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347796 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 21:06:13 +00:00
Todd Lipcon 6d8efb7378 HDFS-3485. DataTransferThrottler will over-throttle when currentTimeMillis jumps. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347751 13f79535-47bb-0310-9956-ffa450edef68
2012-06-07 18:41:24 +00:00
Todd Lipcon bef65d0601 HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347192 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 22:48:48 +00:00
Vinod Kumar Vavilapalli 9ae7639405 Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347136 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 21:19:33 +00:00
Eli Collins 8813f42175 HDFS-3505. DirectoryScanner does not join all threads in shutdown. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347117 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 20:56:26 +00:00
Aaron Myers a4b1793df0 HDFS-3266. DFSTestUtil#waitCorruptReplicas doesn't sleep between checks. Contributed by Madhukara Phatak.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346192 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 23:06:19 +00:00
Eli Collins 119a8c7b15 Updated CHANGES.txt files to reflect the 2.0.0-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346150 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 20:53:15 +00:00
Eli Collins 8bab8b7752 HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346106 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 19:37:56 +00:00
Aaron Myers d1207cbd88 HDFS-3442. Incorrect count for Missing Replicas in FSCK report. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345408 13f79535-47bb-0310-9956-ffa450edef68
2012-06-02 00:39:34 +00:00
Todd Lipcon f65f528356 Merge back changelog entries for HDFS-3042 into main CHANGES.txt files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345307 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 18:20:03 +00:00
Eli Collins f343419055 HDFS-3487. offlineimageviewer should give byte offset information when it encounters an exception. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344972 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 02:37:09 +00:00
Eli Collins 4eb6d65eef HDFS-3486. offlineimageviewer can't read fsimage files that contain persistent delegation tokens. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344970 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 02:31:29 +00:00
Eli Collins 675a7e4acb HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344908 13f79535-47bb-0310-9956-ffa450edef68
2012-05-31 21:02:08 +00:00
Tsz-wo Sze 83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 19:10:09 +00:00
Harsh J f2c3d3ac52 HDFS-3476. Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344394 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 18:33:41 +00:00
Harsh J 5cf21e4383 HDFS-3462. TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Contributed by Madhukara Phatak. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343798 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 16:01:44 +00:00
Harsh J befd45fcb1 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342520 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 07:04:35 +00:00
Konstantin Shvachko 2e0a15c488 HDFS-3368. Missing blocks due to bad DataNodes coming up and down.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 06:29:17 +00:00
Alejandro Abdelnur e937068c0b HDFS-3460. HttpFS proxyuser validation with Kerberos ON uses full principal name. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342334 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 16:51:04 +00:00
Todd Lipcon 14bf2d4357 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:27:51 +00:00
Todd Lipcon 74dfa8f1f2 HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 20:42:48 +00:00
Tsz-wo Sze ade42bce10 HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 17:59:30 +00:00
Eli Collins 445018cea8 HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 15:56:59 +00:00
Tsz-wo Sze aa80e6895d HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341676 13f79535-47bb-0310-9956-ffa450edef68
2012-05-22 23:18:04 +00:00
Tsz-wo Sze d69510a7f8 HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 18:51:15 +00:00
Eli Collins 260dfa367e HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 21:13:17 +00:00
Todd Lipcon d1a54b872d HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68
2012-05-19 05:13:38 +00:00
Aaron Myers ea0baa3609 HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340260 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 21:25:21 +00:00
Todd Lipcon 7d1f97b821 HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 05:28:18 +00:00
Todd Lipcon 5258d6bf3f HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339897 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 22:30:46 +00:00
Todd Lipcon 15ddb6634f HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339745 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 17:49:48 +00:00
Eli Collins 5ef725eb53 HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 17:01:13 +00:00
Eli Collins 6d71407582 HDFS-1153. dfsnodelist.jsp should handle invalid input parameters. Contributed by Ravi Phulari
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339706 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 16:55:49 +00:00
Aaron Myers 1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 10:23:18 +00:00
Todd Lipcon ba1e4a823a HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 02:45:47 +00:00
Eli Collins 97e1d5c9ad HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339413 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:57:18 +00:00
Aaron Myers 7286e8a9da HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 16:24:38 +00:00
Todd Lipcon 9142dcac9e Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339019 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 05:48:16 +00:00
Eli Collins dac828de0f HDFS-3197. Incorrect class comments in a few tests. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338880 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 20:37:12 +00:00
Eli Collins 7428aeca86 HDFS-3418. Rename BlockWithLocationsProto datanodeIDs field to storageIDs. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338830 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 19:03:14 +00:00
Eli Collins c4e4e56160 HDFS-3419. Cleanup LocatedBlock. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338802 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 17:23:50 +00:00
Eli Collins e9a7648f62 HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338784 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 16:23:52 +00:00
Eli Collins e4df14f8f1 HDFS-3417. Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338767 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 16:01:44 +00:00
Todd Lipcon 95710c15b7 HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338492 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 00:41:37 +00:00
Todd Lipcon 2a406d0437 Move HDFS-2759 to branch-2 section of CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338490 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 00:32:11 +00:00
Aaron Myers a8eef98f41 HDFS-3163. TestHDFSCLI.testAll fails if the user name is not all lowercase. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338486 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 00:14:51 +00:00
Todd Lipcon bcdb125643 HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338466 13f79535-47bb-0310-9956-ffa450edef68
2012-05-14 22:35:25 +00:00
Aaron Myers 05c5fcfb42 HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338275 13f79535-47bb-0310-9956-ffa450edef68
2012-05-14 16:25:17 +00:00
Harsh J f1560d379d HDFS-2312. FSNamesystem javadoc incorrectly says its for DNs. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337761 13f79535-47bb-0310-9956-ffa450edef68
2012-05-13 03:33:19 +00:00
Aaron Myers f22341ab1a HDFS-3404. Make putImage in GetImageServlet infer remote address to fetch from request. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337755 13f79535-47bb-0310-9956-ffa450edef68
2012-05-13 02:51:33 +00:00
Tsz-wo Sze 3d18382285 Move HDFS-3211 to 2.0.0 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337432 13f79535-47bb-0310-9956-ffa450edef68
2012-05-12 01:57:50 +00:00
Aaron Myers 5dbd09ee76 HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337030 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 05:57:37 +00:00
Eli Collins 8def56e51e HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337017 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 03:15:54 +00:00
Tsz-wo Sze ba6360e493 HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336976 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 00:25:48 +00:00
Eli Collins fcb4b1995b HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 00:03:37 +00:00
Eli Collins 98b00d7cc0 HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:13:02 +00:00
Tsz-wo Sze 7e8e983620 HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 21:41:25 +00:00
Eli Collins 6a0865440e HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 17:58:55 +00:00
Aaron Myers f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 13:49:06 +00:00
Eli Collins 54303465a6 HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 06:28:56 +00:00
Eli Collins a67054d7c3 HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336480 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 04:52:46 +00:00
Todd Lipcon b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 00:30:53 +00:00
Aaron Myers e3fbc52686 HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336324 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 18:16:40 +00:00
Eli Collins 1d7b980592 HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335309 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 00:25:34 +00:00
Tsz-wo Sze f0f9a3631f HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335304 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 00:06:09 +00:00
Todd Lipcon 7aa2889f82 HDFS-3375. Put client name in DataXceiver thread name for readBlock and keepalive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335270 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 21:34:30 +00:00
Todd Lipcon 567aed4f2c HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335222 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 19:56:23 +00:00
Todd Lipcon eca2c850a5 HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335115 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:42:19 +00:00
Eli Collins a2eb525ce1 Move HDFS-2617 commit message to the right place.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334223 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 22:01:57 +00:00
Eli Collins 5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 21:58:44 +00:00
Tsz-wo Sze 0bf8f11860 HDFS-3303. Remove Writable implementation from RemoteEditLogManifest. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334156 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 20:16:23 +00:00
Todd Lipcon a701c792f8 HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334116 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 18:50:54 +00:00
Tsz-wo Sze dd8b7ae9d8 HDFS-3350. In INode, add final to compareTo(..), equals(..) and hashCode(), and remove synchronized from updatePermissionStatus(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333679 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 23:33:44 +00:00
Todd Lipcon 25882b199b HDFS-3359. DFSClient.close should close cached sockets. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333624 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 21:13:43 +00:00
Aaron Myers 470b1197be HDFS-3351. NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333299 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 03:00:10 +00:00
Todd Lipcon cbc2424290 HDFS-3330. If GetImageServlet throws an Error or RTE, response should not have HTTP "OK" status. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333286 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:44:22 +00:00
Alejandro Abdelnur e1a961d1bc HDFS-3336. hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333236 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 22:47:04 +00:00
Tsz-wo Sze 8620a99d1e HDFS-3339. Change INode to package private. Contributed by John George
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332876 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 23:02:53 +00:00
Tsz-wo Sze 2af70cb517 HDFS-3293. Add toString(), equals(..) and hashCode() to JournalInfo. Contributed by Hari Mankude
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332458 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 22:57:22 +00:00
Matthew Foley c203c7628c HDFS-3265. PowerPc Build error. Contributed by Kumar Ravi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332107 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 08:27:34 +00:00
Uma Maheswara Rao G d5edc04635 HDFS-2743. Streamline usage of bookkeeper journal manager. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331790 13f79535-47bb-0310-9956-ffa450edef68
2012-04-28 16:17:25 +00:00
Eli Collins a22c138291 HDFS-3326. Append enabled log message uses the wrong variable. Contributed by Matthew Jacobs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331626 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 23:03:45 +00:00
Tsz-wo Sze cd271773ac HDFS-3331. In namenode, check superuser privilege for setBalancerBandwidth and acquire the write lock for finalizeUpgrade.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331598 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 21:17:53 +00:00
Tsz-wo Sze 920b8fac18 HDFS-3334. Fix ByteRangeInputStream stream leakage. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331570 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 20:13:17 +00:00
Alejandro Abdelnur 84b36cfd80 HDFS-3309. HttpFS (Hoop) chmod not supporting octal and sticky bit permissions. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331493 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 16:30:22 +00:00
Tsz-wo Sze 3e835c47d1 HDFS-3181. Fix a test case in TestLeaseRecovery2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331138 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 22:44:34 +00:00
Tsz-wo Sze 1a76c82a31 HDFS-3322. Use HdfsDataInputStream and HdfsDataOutputStream in Hdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331114 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 21:50:50 +00:00
Eli Collins 2b254dad2e HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330613 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 00:47:16 +00:00
Tsz-wo Sze 3b773da036 HDFS-3319. Change DFSOutputStream to not to start a thread in constructors.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330535 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:17:20 +00:00
Tsz-wo Sze 2584779166 HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330506 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 19:34:36 +00:00
Tsz-wo Sze f86352c2df HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330500 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 19:24:00 +00:00
Tsz-wo Sze 8e99d9a764 Move HDFS-3282 and HDFS-3298 to 2.0.0 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330443 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:57:28 +00:00
Tsz-wo Sze ea32198db4 HDFS-3298. Add HdfsDataOutputStream as a public API.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330064 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 23:39:43 +00:00
Alejandro Abdelnur f4711ef3ab HDFS-3314. HttpFS operation for getHomeDirectory is incorrect. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329715 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 13:46:25 +00:00
Tsz-wo Sze 93c5585d31 HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329462 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 21:27:01 +00:00
Sanjay Radia 589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
Tsz-wo Sze cdbe15ccdc HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 23:59:19 +00:00
Tsz-wo Sze 201af20406 Revert r1328482 for HDFS-3308.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328487 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 19:32:23 +00:00
Tsz-wo Sze ab8f458742 HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328482 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 19:16:58 +00:00
Aaron Myers 49ed783a3a HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328115 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:43:03 +00:00
Uma Maheswara Rao G c6d3537d33 HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327788 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 02:34:44 +00:00
Eli Collins 4550627cab HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:51:13 +00:00
Eli Collins 54e61ffdc0 HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:31:53 +00:00
Eli Collins 0c16ec4d6e HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327762 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:09:12 +00:00
Tsz-wo Sze 2bf8be3c72 HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327664 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 20:21:08 +00:00
Alejandro Abdelnur 8bda086d04 HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327627 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:51:22 +00:00
Tsz-wo Sze eeec4dc72a HDFS-3294. Fix code indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327365 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 03:25:08 +00:00
Tsz-wo Sze c80dbe5e09 HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 22:21:33 +00:00
Eli Collins 1d5861a8c4 HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326848 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 00:50:40 +00:00
Todd Lipcon 574f99bd6b HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326813 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 21:51:52 +00:00
Tsz-wo Sze f1667dee14 HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 19:31:34 +00:00
Todd Lipcon 258da66cc7 HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 19:08:29 +00:00
Aaron Myers 15fe3ae61b HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68
2012-04-14 01:51:03 +00:00
Tsz-wo Sze 841fdc5628 HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 23:41:01 +00:00
Aaron Myers d6533cc321 Move CHANGES.txt message for HDFS-2765 to be under 2.0.0 instead of trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326013 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 23:32:17 +00:00
Eli Collins 5a20d446cf HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 21:31:27 +00:00
Aaron Myers 4f230adc13 HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325531 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:28:44 +00:00
Aaron Myers 07a4367445 HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325518 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:11:32 +00:00
Todd Lipcon 72406e940a HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325414 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 18:08:00 +00:00
Aaron Myers 4ea042666c HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325119 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 05:27:03 +00:00
Aaron Myers 7f427646df HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325110 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 03:36:13 +00:00
Tsz-wo Sze ed678e52ce HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324892 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 17:49:28 +00:00
Todd Lipcon dab66bee55 HDFS-3249. Use ToolRunner.confirmPrompt in NameNode. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324564 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:28:58 +00:00
Todd Lipcon 21824d8232 HDFS-3247. Improve bootstrapStandby behavior when original NN is not active. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324558 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:16:06 +00:00
Eli Collins e235dd3760 HDFS-2696. Fix the fuse-fds build. Contributed by Bruno Mahé
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312068 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 01:55:05 +00:00
Eli Collins 80447bd35a HDFS-3244. Remove dead writable code from hdfs/protocol. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312061 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 01:10:38 +00:00
Todd Lipcon 58228e4e7b HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312029 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:31:18 +00:00
Todd Lipcon 7c2e10e0cd HDFS-3248. bootstrapStandby repeated twice in hdfs namenode usage message. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312028 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:28:25 +00:00
Todd Lipcon 3ffdb9152e HDFS-3094. add -nonInteractive and -force option to namenode -format command. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312025 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:22:38 +00:00
Eli Collins 926f0a5ae0 HDFS-3238. ServerCommand and friends don't need to be writables. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311774 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 15:03:17 +00:00
Todd Lipcon df3e1a3158 HDFS-3240. Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311577 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 05:12:00 +00:00
Aaron Myers 53dc8546d4 HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311556 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 02:25:40 +00:00
Aaron Myers 9597c81f35 HDFS-3236. NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311554 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 02:17:17 +00:00
Todd Lipcon 91528ce9ed HDFS-3234. Accidentally left log message in GetConf after HDFS-3226. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 00:59:38 +00:00
Eli Collins 706394d039 HDFS-3004. Implement Recovery Mode. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311394 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 19:39:58 +00:00
Uma Maheswara Rao G 3ced5ea066 HDFS-3119. Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file. Contributed by Ashish Singhi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311380 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 19:11:58 +00:00
Todd Lipcon ee5daee1b7 HDFS-3214. InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311125 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 03:22:41 +00:00
Tsz-wo Sze 74b4b45651 HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. Contributed by suresh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310649 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 00:52:12 +00:00
Todd Lipcon 2ab67dce11 HDFS-3226. Allow GetConf tool to print arbitrary keys. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310648 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 00:15:30 +00:00
Suresh Srinivas de3fb5c23a HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310630 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 23:03:00 +00:00
Tsz-wo Sze 58e920d1a0 HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310522 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:04:05 +00:00
Suresh Srinivas b3ac25048c HDFS-3136. Remove SLF4J dependency as HDFS does not need it to fix unnecessary warnings. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310476 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:50:31 +00:00
Todd Lipcon d166bd184d HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310185 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 06:31:10 +00:00
Eli Collins e505b7e704 HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310138 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 00:20:55 +00:00
Eli Collins 112c324151 HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310135 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 00:10:54 +00:00
Suresh Srinivas 861c872541 HDFS-3204. Minor modification to JournalProtocol.proto to make it generic. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310134 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 00:08:19 +00:00
Tsz-wo Sze 80bbefafaf HDFS-3178. Add states and state handler for journal synchronization in JournalService.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310115 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 22:35:53 +00:00
Suresh Srinivas 4c908d0987 HDFS-3109. Remove hsqldf exclusions from pom.xml. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309971 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 17:42:46 +00:00
Aaron Myers 8e739ff01e HDFS-3202. NamespaceInfo PB translation drops build version. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309955 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 17:18:26 +00:00
Eli Collins 663fbd46a8 HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309641 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 03:31:03 +00:00
Eli Collins 4f6e0a5a65 HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309629 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 00:02:11 +00:00
Aaron Myers ba688e11c1 HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309580 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:15:08 +00:00
Todd Lipcon a7d6bdc63b HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309526 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 18:40:43 +00:00
Eli Collins 4f7f58fa8b Updated CHANGES.txt to reflect HDFS-2564 merge
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309488 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 16:40:08 +00:00
Aaron Myers 7525ee5b67 HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 03:18:49 +00:00
Tsz-wo Sze 8c0366bf10 HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 02:51:34 +00:00
Todd Lipcon 9972a9633d HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 22:30:29 +00:00
Tsz-wo Sze e561cb9e78 HDFS-3176. Use MD5MD5CRC32FileChecksum.readFields() in JsonUtil . Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309114 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:44:53 +00:00
Tsz-wo Sze 0db8003e2e HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309103 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:26:57 +00:00
Suresh Srinivas e449de0526 HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 00:55:08 +00:00
Eli Collins 4f15b9dfed HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 23:20:34 +00:00
Eli Collins f44ca78179 Previous commit was for HDFS-3120, fixing up CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308615 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 23:15:43 +00:00
Eli Collins 72b3f302dc HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308614 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 23:13:06 +00:00
Robert Joseph Evans 57af34b776 Preping for 0.23.3 stabilization.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308473 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 19:13:53 +00:00
Tsz-wo Sze bc13dfb142 HDFS-3130. Move fsdataset implementation to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308437 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 17:38:56 +00:00
Eli Collins be8a0d1e62 HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308226 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 01:45:11 +00:00
Eli Collins ad0c49ec31 Fixup CHANGES.txt for HDFS-3144.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308206 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 22:14:14 +00:00
Eli Collins be7dd8333a HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308205 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 22:12:12 +00:00
Eli Collins 43afa4ee51 HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308174 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 18:41:58 +00:00
Aaron Myers a232d5c791 HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308159 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 17:27:54 +00:00
Eli Collins 0663dbaac0 HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308014 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 03:41:41 +00:00
Eli Collins 8bd825bb6f HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307890 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 19:58:51 +00:00
Eli Collins eeb687daa7 HDFS-3172. dfs.upgrade.permission is dead code. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307888 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 19:56:23 +00:00
Aaron Myers ff897e75c9 HDFS-3070. HDFS balancer doesn't ensure that hdfs-site.xml is loaded. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307841 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 16:20:54 +00:00
Eli Collins a8cbf19548 HDFS-3138. Move DatanodeInfo#ipcPort to DatanodeID. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307553 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 17:50:05 +00:00
Eli Collins c5c476ed6a Move HDFS-3137 to the right place in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 00:13:50 +00:00
Eli Collins 64641c28b5 HDFS-3137. Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307173 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 00:11:14 +00:00
Aaron Myers 51908783be HDFS-3142. TestHDFSCLI.testAll is failing. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307134 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 22:00:39 +00:00
Eli Collins da58921cf5 HDFS-3066. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307100 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:51:29 +00:00
Eli Collins e7444b2a07 HDFS-3160. httpfs should exec catalina instead of forking it. Contributed by Roman Shaposhnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 01:16:02 +00:00
Aaron Myers 17d22e6dc4 HDFS-3158. LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306635 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 22:59:52 +00:00
Tsz-wo Sze 99a68a1423 HDFS-3155. Clean up FSDataset implemenation related code.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306582 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 20:37:34 +00:00
Eli Collins 0475795066 HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306549 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 19:33:22 +00:00
Aaron Myers aa8cb2287f HDFS-3143. TestGetBlocks.testGetBlocks is failing. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306542 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 19:02:16 +00:00
Aaron Myers 991eddd043 Change "0.23.3" to "2.0.0" in CHANGES.txt files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306538 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 18:55:33 +00:00
Aaron Myers 1427468a72 HDFS-3156. TestDFSHAAdmin is failing post HADOOP-8202. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 17:58:23 +00:00
Suresh Srinivas 940dac52a7 HDFS-3125. Add JournalService to enable Journal Daemon. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305726 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 04:02:03 +00:00
Aaron Myers 466908e67b HDFS-3131. Improve TestStorageRestore. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305688 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 00:13:42 +00:00
Tsz-wo Sze 525ceb99ad HDFS-2413. Add an API DistributedFileSystem.isInSafeMode() and change DistributedFileSystem to @InterfaceAudience.LimitedPrivate. Contributed by harsh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305632 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:18:04 +00:00
Eli Collins 7ef57bfc81 Fix CHANGES.txt for HDFS-3129
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305631 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:16:11 +00:00
Tsz-wo Sze 67bdbd60cd (recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:14:12 +00:00
Tsz-wo Sze 5e38a9acea Revert 1305590 for HDFS-3089.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305598 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:09:14 +00:00
Tsz-wo Sze 1ebcc378af HDFS-3089. Move FSDatasetInterface and the related classes to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305590 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:01:47 +00:00
Aaron Myers 429baf606a Move CHANGES.txt entry for HDFS-2941 to the right version.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305453 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:11:19 +00:00
Aaron Myers ce1a7ec975 HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305447 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:02:40 +00:00
Aaron Myers ea868d3d8b HDFS-3116. Typo in fetchdt error message. Contributed by AOE Takashi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304996 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 08:45:04 +00:00
Todd Lipcon 4cb809bf04 HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304681 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 00:21:52 +00:00
Todd Lipcon b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 06:29:40 +00:00
Eli Collins 4feef86372 HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 21:11:18 +00:00
Tsz-wo Sze 0c4acdc176 HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:10:20 +00:00
Todd Lipcon 2f820dde17 HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:14:09 +00:00
Todd Lipcon f55a1c0876 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 17:30:37 +00:00
Tsz-wo Sze 9e108e61fb HDFS-3086. Change Datanode not to send storage list in registration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:07:33 +00:00
Aaron Myers 4ceca97606 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 19:00:56 +00:00
Tsz-wo Sze 6326605acb HDFS-3105. Add DatanodeStorage information to block recovery.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G f77b1a63ec HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:54:13 +00:00
Uma Maheswara Rao G 3573d504e4 HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301871 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 06:50:36 +00:00
Tsz-wo Sze 2a0024403a HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 17:48:33 +00:00
Tsz-wo Sze 662b1887af HDFS-3088. Move FSDatasetInterface inner classes to a package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 17:32:57 +00:00
Tsz-wo Sze 9b2a324ba5 HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:27:40 +00:00
Tsz-wo Sze 7e5b60116e HDFS-3101. Cannot read empty file using WebHDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:01:23 +00:00
Todd Lipcon 49619e8997 HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:00:29 +00:00
Aaron Myers 65425b0961 HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 21:51:23 +00:00
Aaron Myers 6d96a28a08 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 20:26:29 +00:00
Tsz-wo Sze 1177d4edc2 HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301127 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 18:24:40 +00:00
Todd Lipcon 59eb544744 HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300814 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 05:36:03 +00:00
Alejandro Abdelnur a0ee9adfd3 HDFS-3057. httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIR (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300637 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 17:01:34 +00:00
Tsz-wo Sze 3e582c690c HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 22:52:17 +00:00
Eli Collins ab20dae519 HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299963 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 03:38:57 +00:00
Todd Lipcon 1a75ec8288 HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 19:41:21 +00:00
Suresh Srinivas 46a88ded0d Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68
2012-03-11 18:11:43 +00:00
Tsz-wo Sze 501a283986 HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 01:52:17 +00:00
Steve Loughran 381a9b2d58 HDFS-2966
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 13:17:04 +00:00
Uma Maheswara Rao G b19d1186ab HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient.
(Contributed by Uma Maheswara Rao G)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298495 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:31:33 +00:00
Suresh Srinivas b874d06133 Moving HDFS-3036, HDFS-3014, HDFS-3003, HDFS-2878, HDFS-208, HDFS-2764, HDFS-2410, HDFS-2285, HDFS-2507 to 0.23.3 section
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298274 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 05:23:50 +00:00
Tsz-wo Sze 22738ae1d0 HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 19:44:47 +00:00
Eli Collins 0a2b413dff HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 19:16:03 +00:00
Suresh Srinivas 6f8d347b83 Moving HDFS-2158, HDFS-2188, HDFS-2334, HDFS-2477, HDFS-2495, HDFS-2476, HDFS-1580, HDFS-1765 to 0.23.3 section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297903 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 09:15:30 +00:00
Tsz-wo Sze 0ee71adeb4 HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 02:42:46 +00:00
Aaron Myers 8e303014bc Fix up CHANGES.txt files post commit of HDFS-1623 and HADOOP-7454.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296540 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:50:04 +00:00
Aaron Myers 8a99218853 HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296019 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:37:02 +00:00
Aaron Myers 6da670ce6a HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:26:54 +00:00
Tsz-wo Sze b2f67b4704 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 23:51:19 +00:00
Aaron Myers f22677ef8e HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295961 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 22:52:05 +00:00
Tsz-wo Sze 9e31bf675d HDFS-3021. Use generic type to declare FSDatasetInterface.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295929 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 21:58:39 +00:00
Arun Murthy 753c2ba66c HDFS-3012. Moving to hadoop-0.23.2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295310 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:07:03 +00:00
Todd Lipcon 28de3628f5 HDFS-3020. Fix editlog to automatically sync when buffer is full. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295239 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 19:57:18 +00:00
Jitendra Nath Pandey ca9b4de772 HDFS-3012. Exception while renewing delegation token. Contributed by Bobby Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295232 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 19:36:17 +00:00
Eli Collins fbf3a9ee3d HDFS-2992. Edit log failure trace should include transaction ID of error. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295227 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 19:31:36 +00:00
Todd Lipcon 34c73db5e1 HDFS-2991. Fix case where OP_ADD would not be logged in append(). Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295214 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 18:52:00 +00:00
Jitendra Nath Pandey e57fd85fd4 HDFS-3030. Remove getProtocolVersion and getProtocolSignature from translators.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295017 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 08:52:45 +00:00
Aaron Myers e58b7e202b HDFS-3014. FSEditLogOp and its subclasses should have toString() method. Contributed by Sho Shimauchi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294926 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 01:17:37 +00:00
Jitendra Nath Pandey daf782ca7e HDFS-3016. Security in unit tests. Contributed by Jaimin Jetly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294773 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:41:25 +00:00
Todd Lipcon 7decf112c0 HDFS-3024. Improve performance of stringification in addStoredBlock. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294754 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:04:13 +00:00
Tsz-wo Sze 12b3ce7205 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294431 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 01:10:53 +00:00
Aaron Myers b57260f848 HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 22:14:53 +00:00
Arun Murthy 1de3fa8653 Preparing for 0.23.3 release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 01:37:07 +00:00
Tsz-wo Sze dacbeb5f67 HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293487 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 00:15:37 +00:00
Suresh Srinivas 5293e5d1c5 HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:52:20 +00:00
Eli Collins 78f22bc525 HDFS-3008. Negative caching of local addrs doesn't work. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293419 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:14:04 +00:00
Suresh Srinivas 0e79131981 HDFS-3009. Remove duplicate code in DFSClient#isLocalAddress by using NetUtils. Contributed by Hari Mankude.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293390 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 19:29:41 +00:00
Aaron Myers 62c7e2edfc HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293338 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 17:03:17 +00:00
Tsz-wo Sze f11b0788df HDFS-2981. In hdfs-default.xml, the default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292626 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 02:27:07 +00:00
Tsz-wo Sze af70addc94 Move HDFS-2944 entry to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292624 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 02:23:46 +00:00
Todd Lipcon 475db83b87 HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292609 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 01:16:33 +00:00
Tsz-wo Sze efbc58f30c HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292419 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:47:39 +00:00
Steve Loughran a57b9b8335 HDFS-2725 script to mention dfs command
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245943 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 15:25:11 +00:00
Arun Murthy e38b7e6ddd Preparing for hadoop-0.23.1-rc2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245845 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:30:48 +00:00
Todd Lipcon 9ae4fac8dd HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:18:01 +00:00
Todd Lipcon a8e7f745cd HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:13:09 +00:00
Suresh Srinivas 257e9440ed Moving HDFS-2525 to relevant release section (0.23.2) in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245312 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 03:56:45 +00:00
Jitendra Nath Pandey b8448dea82 HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245118 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:58:19 +00:00
Suresh Srinivas ff91453227 HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:00:08 +00:00
Jitendra Nath Pandey f82e862e1f HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:43:01 +00:00
Todd Lipcon 3bd230af11 HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:27:37 +00:00
Aaron Myers a87328dfab HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:27:15 +00:00
Aaron Myers 2acafd1783 HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 20:57:48 +00:00
Suresh Srinivas a70bc6c6a2 HDFS-2815. Namenode sometimes oes not come out of safemode during NN crash + restart. Contributed by Uma Maheswara Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243673 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 20:11:43 +00:00
Tsz-wo Sze 52004aa8e9 HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 19:07:04 +00:00
Harsh J 8b730c867f HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243104 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 17:13:30 +00:00
Todd Lipcon 8be9441b9b HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 01:20:59 +00:00
Tsz-wo Sze 83fd3160da HDFS-2931. Switch DataNode's BlockVolumeChoosingPolicy to private-audience. Contributed by harsh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242891 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:15:15 +00:00
Tsz-wo Sze dc847b39fd HDFS-2486. Remove unnecessary priority level checks in UnderReplicatedBlocks. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242636 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 02:05:38 +00:00
Aaron Myers 3c6863ab4a Update CHANGES.txt to reflect the back-port of HDFS-2764 from trunk to branch-0.23.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242554 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:09:25 +00:00
Todd Lipcon a1574e1715 HDFS-2923. Namenode IPC handler count uses the wrong configuration key. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242220 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 05:28:40 +00:00
Jitendra Nath Pandey 987449b9b8 HDFS-2908. Add apache license header for StorageReport.java. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242192 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 00:24:06 +00:00
Tsz-wo Sze b6ffb08a46 HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242087 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 20:58:29 +00:00
Arun Murthy 647f374607 Preparing for release 0.23.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241795 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 07:27:58 +00:00
Aaron Myers 4d3dc530e8 HDFS-2764. TestBackupNode is racy. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241780 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 05:38:29 +00:00
Jitendra Nath Pandey 11db1b855f HDFS-2786. Fix host-based token incompatibilities in DFSUtil. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241766 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 03:55:36 +00:00
Suresh Srinivas 8e524e731c Fixing 0.23.1 version of the CHANGES.txt to make it consistent with the CHANGES.txt from 0.23.1 release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241751 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:58:28 +00:00
Arun Murthy eabe75d6f2 HDFS-2572. Moved to trunk section from 0.23.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241746 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:31:26 +00:00
Suresh Srinivas 28eadb7cd7 HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241519 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 16:59:48 +00:00
Konstantin Shvachko 7e4bd89590 HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:44:27 +00:00
Suresh Srinivas 2a9e430ff9 HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 13:33:35 +00:00
Eli Collins b837bbb7d5 HDFS-2893. The start/stop scripts don't start/stop the 2NN when using the default configuration. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240928 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 08:52:50 +00:00
Harsh J da7b0d90c6 HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 05:25:12 +00:00
Suresh Srinivas f88574acde HDFS-2880. Protobuf chagnes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240653 13f79535-47bb-0310-9956-ffa450edef68
2012-02-05 01:39:30 +00:00
Jitendra Nath Pandey 205f0470f4 HDFS-2785. Update webhdfs and httpfs for host-based token support. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240460 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 06:57:40 +00:00
Aaron Myers 447e81f51a HDFS-2889. getNumCurrentReplicas is package private but should be public on0.23 (see HDFS-2408). Contributed by Gregory Chanan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240412 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:01:06 +00:00
Tsz-wo Sze 38ad4b5036 HDFS-2879. Change FSDataset to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 07:26:02 +00:00
Todd Lipcon 6d5510dfb8 HDFS-2877. If locking of a storage dir fails, it will remove the other NN's lock file on exit. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239880 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 22:12:02 +00:00
Jitendra Nath Pandey 9eb8f4d267 HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 19:04:40 +00:00
Konstantin Shvachko 191db6a907 HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey c909aedbc1 HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 05:31:46 +00:00
Tsz-wo Sze dbbfaebb71 HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:46:50 +00:00
Suresh Srinivas 536b30ec91 HDFS-2835. Fix findbugs and javadoc issue with GetConf.java. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238779 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 20:03:49 +00:00
Suresh Srinivas 319021d6fb HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:59:58 +00:00
Tsz-wo Sze 8dfef7d2dc HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 17:36:42 +00:00
Jitendra Nath Pandey 98302971c2 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
2012-01-29 02:01:24 +00:00
Aaron Myers 976c07696d HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 20:26:13 +00:00
Todd Lipcon da91e0d427 HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:42:34 +00:00
Alejandro Abdelnur 0d5b734681 HDFS-2840. TestHostnameFilter should work with localhost or localhost.localdomain (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236940 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:24:46 +00:00
Alejandro Abdelnur cf16929584 HDFS-2837. mvn javadoc:javadoc not seeing LimitedPrivate class (revans2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236338 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:15:04 +00:00
Alejandro Abdelnur a7091893de HDFS-2836. HttpFSServer still has 2 javadoc warnings in trunk (revans2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236328 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 17:58:42 +00:00
Harsh J 7c69883917 HDFS-442. dfsthroughput in test jar throws NPE (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:10:28 +00:00
Eli Collins 5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
Todd Lipcon 1525aae4b3 HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:42:17 +00:00
Todd Lipcon c0016ba85f HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:07:49 +00:00
Todd Lipcon 12645ff6c0 HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:11:09 +00:00
Harsh J ece854211f HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234555 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:30:33 +00:00
Todd Lipcon c840548d6b HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:42:35 +00:00
Alejandro Abdelnur 654b90fa23 HDFS-2816. Fix missing license header in httpfs findbugsExcludeFile.xml. (hitesh via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:04:24 +00:00
Todd Lipcon f7d20b2198 HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233796 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:32:06 +00:00