Commit Graph

2303 Commits

Author SHA1 Message Date
Todd Lipcon 0663b51ed4 Amend HDFS-2948. NN throws NPE during shutdown if it fails to startup
Previous patch missed the case where the NN fails to start up when it's starting in standby state.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244813 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 00:58:03 +00:00
Todd Lipcon f7f2ef4447 HDFS-2935. Shared edits dir property should be suffixed with nameservice and namenodeID. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244761 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:20:37 +00:00
Todd Lipcon 05151ecf79 HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244759 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:19:12 +00:00
Jitendra Nath Pandey 3c145d3492 HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244753 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:00:18 +00:00
Aaron Myers 1fb0ab92f8 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:04:17 +00:00
Jitendra Nath Pandey f82e862e1f HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:43:01 +00:00
Todd Lipcon 3bd230af11 HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:27:37 +00:00
Todd Lipcon cdc8146bd4 HADOOP-8068. void methods can swallow exceptions when going through failover path. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244628 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:20:11 +00:00
Todd Lipcon 063be5749d HADOOP-6502. Improve the performance of Configuration.getClassByName when the class is not found by caching negative results. Contributed by Sharad Agarwal and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244620 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:10:21 +00:00
Alejandro Abdelnur 89bd2210a7 MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244264 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 23:09:05 +00:00
Mahadev Konar 83ab8f087b MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244254 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 22:49:00 +00:00
Vinod Kumar Vavilapalli 16a44b6fa5 MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244223 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 21:39:59 +00:00
Aaron Myers 011611c765 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 20:37:10 +00:00
Todd Lipcon f42e58c381 HADOOP-8071. Avoid an extra packet in client code when nagling is disabled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244189 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:47:02 +00:00
Todd Lipcon 439490f915 HDFS-2948. NN throws NPE during shutdown if it fails to startup. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244186 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:38:02 +00:00
Todd Lipcon 82ffe0e732 HADOOP-8070. Add a standalone benchmark for RPC call performance. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244185 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:29:42 +00:00
Vinod Kumar Vavilapalli 1903e544a4 MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:24:00 +00:00
Aaron Myers a0e4ae55f2 HDFS-2942. TestActiveStandbyElectorRealZK fails if build dir does not exist. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243827 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:43:58 +00:00
Aaron Myers 1b2ecc6336 HDFS-2947. On startup NN throws an NPE in the metrics system. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243826 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:42:25 +00:00
Aaron Myers a87328dfab HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:27:15 +00:00
Vinod Kumar Vavilapalli 0515b3322f MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 00:06:37 +00:00
Konstantin Shvachko ce778462ee MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243695 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:12:03 +00:00
Todd Lipcon db187cf40e Merge trunk into HA branch.
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Aaron Myers 2acafd1783 HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 20:57:48 +00:00
Suresh Srinivas a70bc6c6a2 HDFS-2815. Namenode sometimes oes not come out of safemode during NN crash + restart. Contributed by Uma Maheswara Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243673 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 20:11:43 +00:00
Tsz-wo Sze 52004aa8e9 HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 19:07:04 +00:00
Mahadev Konar 5c46ba4d48 MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243418 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 05:37:11 +00:00
Aaron Myers f6e407b436 HDFS-2939. TestHAStateTransitions fails on Windows. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243293 13f79535-47bb-0310-9956-ffa450edef68
2012-02-12 18:43:39 +00:00
Matthew Foley 00ee0585ab HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by Varun Kapoor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-12 07:47:35 +00:00
Harsh J 8b730c867f HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243104 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 17:13:30 +00:00
Harsh J 726f6e32ac Amend HADOOP-8055. Placed changes log in a released section, corrected to 0.23.2. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243096 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 16:57:07 +00:00
Harsh J 6bec4035bd HADOOP-8055. Hadoop tarball distribution lacks a core-site.xml (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243065 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 14:10:04 +00:00
Todd Lipcon 8be9441b9b HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 01:20:59 +00:00
Alejandro Abdelnur 27035f532d HADOOP-8051 HttpFS documentation it is not wired to the generated site (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242987 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 00:03:00 +00:00
Thomas Graves 0bf146b0dd MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:24:08 +00:00
Vinod Kumar Vavilapalli 56b6f4a8fc Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242902 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:55:15 +00:00
Tsz-wo Sze 83fd3160da HDFS-2931. Switch DataNode's BlockVolumeChoosingPolicy to private-audience. Contributed by harsh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242891 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:15:15 +00:00
Todd Lipcon a626fa04f9 Revert HDFS-2922 via svn merge -c -1242572
The patch broke a lot of unit tests in the nightly build. Will recommit after it is fixed.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242874 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:17:21 +00:00
Aaron Myers 05d56e5e7e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:01:01 +00:00
Thomas Graves 8e32744287 Fixing CHANGES.txt, move JIRAs from trunk to 0.23.2 section (tgraves).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242818 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 15:27:10 +00:00
Thomas Graves 73a72e0ef9 MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242790 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 14:30:00 +00:00
Tsz-wo Sze dc847b39fd HDFS-2486. Remove unnecessary priority level checks in UnderReplicatedBlocks. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242636 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 02:05:38 +00:00
Todd Lipcon c14bb61a82 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Eli Collins 8af96c7b22 HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242626 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 00:46:17 +00:00
Thomas Graves 2a2faac0de HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242616 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 00:17:49 +00:00
Eli Collins a63e12c4c8 HDFS-2922. HA: close out operation categories. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242572 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:33:20 +00:00
Aaron Myers 467059b4ab HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242564 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:23:47 +00:00
Aaron Myers 3c6863ab4a Update CHANGES.txt to reflect the back-port of HDFS-2764 from trunk to branch-0.23.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242554 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:09:25 +00:00
Todd Lipcon 2c9ca86c9c Fix weird unicode character in CHANGES.txt on HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242549 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 21:57:16 +00:00
Jitendra Nath Pandey b5d02a63cb HDFS-2915. HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242522 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 21:08:17 +00:00