Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,564 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2939 Commits

Author SHA1 Message Date
Eli Collins 2e4cf977ae HDFS-2752. HA: exit if multiple shared dirs are configured. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240916 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:24:11 +00:00
Eli Collins c17b4f8eef HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240914 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 08:21:06 +00:00
Harsh J da7b0d90c6 HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 05:25:12 +00:00
Suresh Srinivas f88574acde HDFS-2880. Protobuf chagnes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240653 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-05 01:39:30 +00:00
Eli Collins a660c5dd2c Add missing file from previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240601 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 20:13:48 +00:00
Eli Collins 7b913180be HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240600 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 20:12:51 +00:00
Jitendra Nath Pandey 205f0470f4 HDFS-2785. Update webhdfs and httpfs for host-based token support. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240460 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 06:57:40 +00:00
Aaron Myers ec6961b39c HDFS-2792. Make fsck work. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240449 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 03:10:39 +00:00
Aaron Myers 3cc71933e9 HDFS-2890. DFSUtil#getSuffixIDs should skip unset configurations. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240447 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 03:00:17 +00:00
Todd Lipcon 11df1c2561 HDFS-2874. Edit log should log to shared dirs before local dirs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240445 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 02:52:53 +00:00
Aaron Myers 447e81f51a HDFS-2889. getNumCurrentReplicas is package private but should be public on0.23 (see HDFS-2408). Contributed by Gregory Chanan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240412 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-04 00:01:06 +00:00
Aaron Myers 969318cfc2 HDFS-2863. Failures observed if dfs.edits.dir and shared.edits.dir have same directories. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240267 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 18:04:21 +00:00
Tsz-wo Sze 38ad4b5036 HDFS-2879. Change FSDataset to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 07:26:02 +00:00
Eli Collins d2b5531b0f HDFS-2769. HA: When HA is enabled with a shared edits dir, that dir should be marked required. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239988 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 03:10:57 +00:00
Aaron Myers 05ab55b705 HDFS-2860. TestDFSRollback#testRollback is failing. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239968 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-03 01:09:05 +00:00
Todd Lipcon 32c313d51c HDFS-2861. checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239886 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 22:21:57 +00:00
Todd Lipcon 6d5510dfb8 HDFS-2877. If locking of a storage dir fails, it will remove the other NN's lock file on exit. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239880 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 22:12:02 +00:00
Eli Collins 4324e1bcd7 HADOOP-7991. HA: the FailoverController should check the standby is ready before failing over. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239774 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:20:32 +00:00
Jitendra Nath Pandey 9eb8f4d267 HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:04:40 +00:00
Konstantin Shvachko 191db6a907 HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey c909aedbc1 HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 05:31:46 +00:00
Todd Lipcon 4d779e088a HDFS-2859. LOCAL_ADDRESS_MATCHER.match has NPE when called from DFSUtil.getSuffixIDs when the host is incorrect. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239356 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 22:02:29 +00:00
Todd Lipcon 048c416beb HDFS-2870. Fix log level for block debug info in processMisReplicatedBlocks. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239278 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 19:23:28 +00:00
Tsz-wo Sze dbbfaebb71 HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 07:46:50 +00:00
Eli Collins cf611255d6 HDFS-2742. HA: observed dataloss in replication stress test. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238940 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 05:16:49 +00:00
Aaron Myers 43679fcccd HDFS-2845. SBN should not allow browsing of the file system via web UI. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238897 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 01:29:06 +00:00
Suresh Srinivas 536b30ec91 HDFS-2835. Fix findbugs and javadoc issue with GetConf.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238779 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 20:03:49 +00:00
Suresh Srinivas 319021d6fb HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238747 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 18:59:58 +00:00
Tsz-wo Sze 8dfef7d2dc HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 17:36:42 +00:00
Eli Collins 6be13332db HDFS-2853. HA: NN fails to start if the shared edits dir is marked required. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238134 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 02:17:53 +00:00
Todd Lipcon 641f79a325 HDFS-2824. Fix failover when prior NN died just after creating an edit log segment. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238069 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 23:05:18 +00:00
Eli Collins 6884348444 HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 22:42:46 +00:00
Aaron Myers 9a8f119741 Amend HDFS-2841 to include new file which was omitted from original commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237971 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 20:32:35 +00:00
Todd Lipcon 846f97312c HDFS-2691. Fixes for pipeline recovery in an HA cluster: report RBW replicas immediately upon pipeline creation. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237935 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 19:16:15 +00:00
Aaron Myers 6122357da5 HDFS-2841. HAAdmin does not work if security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237534 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-30 02:52:27 +00:00
Jitendra Nath Pandey 98302971c2 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-29 02:01:24 +00:00
Aaron Myers 30dd704e6c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237157 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 20:33:30 +00:00
Aaron Myers 976c07696d HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 20:26:13 +00:00
Todd Lipcon 327c216c2f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 02:50:23 +00:00
Todd Lipcon da91e0d427 HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:42:34 +00:00
Alejandro Abdelnur 0d5b734681 HDFS-2840. TestHostnameFilter should work with localhost or localhost.localdomain (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236940 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:24:46 +00:00
Aaron Myers 2b2e56056e Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-28 00:21:07 +00:00
Alejandro Abdelnur 8a234f394e HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 23:53:35 +00:00
Jitendra Nath Pandey e7775e0b3b HDFS-2805. Add a test for a federated cluster with HA NNs. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236471 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 00:34:37 +00:00
Eli Collins fdf7b18247 HDFS-2838. NPE in FSNamesystem when in safe mode. Contributed by Gregory Chanan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236450 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 23:48:08 +00:00
Alejandro Abdelnur cf16929584 HDFS-2837. mvn javadoc:javadoc not seeing LimitedPrivate class (revans2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236338 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:15:04 +00:00
Aaron Myers 1c95060a72 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:03:46 +00:00
Alejandro Abdelnur a7091893de HDFS-2836. HttpFSServer still has 2 javadoc warnings in trunk (revans2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236328 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 17:58:42 +00:00
Jitendra Nath Pandey dea3164e00 HDFS-2809. Add test to verify that delegation tokens are honored after failover. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235495 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 21:06:27 +00:00
Jitendra Nath Pandey 0b2245a0f3 HDFS-2807. Service level authorizartion for HAServiceProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235431 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 19:31:49 +00:00
Aaron Myers 83bcb1bbf4 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 17:59:14 +00:00
Harsh J 7c69883917 HDFS-442. dfsthroughput in test jar throws NPE (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 06:10:28 +00:00
Eli Collins 5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 06:05:52 +00:00
Todd Lipcon fa4a33a566 Merge trunk into HA branch. 
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon 


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 00:00:05 +00:00
Todd Lipcon 1525aae4b3 HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 23:42:17 +00:00
Todd Lipcon 465663afbf HDFS-2804. Should not mark blocks under-replicated when exiting safemode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235033 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 22:22:46 +00:00
Todd Lipcon c0016ba85f HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 22:07:49 +00:00
Todd Lipcon 8d1c996242 HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235017 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 21:57:00 +00:00
Todd Lipcon c10853a6b9 HDFS-2820. Add a simple sanity check for HA config. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235013 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 21:49:43 +00:00
Todd Lipcon 12645ff6c0 HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 18:11:09 +00:00
Aaron Myers e42bbfbca2 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 18:07:27 +00:00
Harsh J ece854211f HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234555 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 17:30:33 +00:00
Aaron Myers c3e62de9ce HDFS-2737. Automatically trigger log rolls periodically on the active NN. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234256 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-21 03:17:26 +00:00
Todd Lipcon c840548d6b HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-21 00:42:35 +00:00
Alejandro Abdelnur 654b90fa23 HDFS-2816. Fix missing license header in httpfs findbugsExcludeFile.xml. (hitesh via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234135 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 21:04:24 +00:00
Aaron Myers 2abe5c818d Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 19:30:53 +00:00
Todd Lipcon f7d20b2198 HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233796 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 07:32:06 +00:00
Todd Lipcon 520a39ac2d HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-20 07:26:19 +00:00
Todd Lipcon 1aed1296dd HDFS-2812. When becoming active, the NN should treat all leases as freshly renewed. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233612 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 22:35:04 +00:00
Eli Collins fa6033a029 HDFS-2768. BackupNode stop can not close proxy connections because it is not a proxy instance. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233584 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 21:41:50 +00:00
Aaron Myers 02919e61f6 HDFS-2367. Enable the configuration of multiple HA cluster addresses. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233549 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 19:41:48 +00:00
Aaron Myers 3e17cdde56 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233533 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 19:02:07 +00:00
Todd Lipcon 1d2e706dd1 HDFS-2803. Add logging to LeaseRenewer for better lease expiration debugging. Contributed by Jimmy Xiang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233453 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 16:35:25 +00:00
Aaron Myers 6177bf6c8f Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233105 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-18 23:02:17 +00:00
Todd Lipcon a380dc8732 HDFS-2592. Balancer support for HA namenodes. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232531 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 18:39:09 +00:00
Todd Lipcon 4c7a6c6c3f Amend HDFS-2795. Fix PersistBlocks failure due to an NPE in isPopulatingReplQueues() 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232510 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 17:57:36 +00:00
Todd Lipcon 0c1450ca5d HDFS-2795. Standby NN takes a long time to recover from a dead DN starting up. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232285 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 03:21:08 +00:00
Todd Lipcon 212678f036 HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232284 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 03:10:25 +00:00
Eli Collins c53c94ec46 Update changelog for HDFS-362 to reflect the merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232205 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 22:43:11 +00:00
Aaron Myers d880c7cc78 HDFS-2772. On transition to active, standby should not swallow ELIE. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232197 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 22:16:15 +00:00
Aaron Myers 940eeb866c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 21:57:28 +00:00
Todd Lipcon 2f26475a39 HDFS-2747. Entering safe mode after starting SBN can NPE. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232176 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 21:46:05 +00:00
Eli Collins 1c24ae0cd8 HDFS-2789. TestHAAdmin.testFailover is failing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231577 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 20:19:55 +00:00
Eli Collins f02ea82bd1 HDFS-2790. FSNamesystem.setTimes throws exception with wrong configuration name in the message. Contributed by Arpit Gupta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231572 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 19:50:14 +00:00
Eli Collins 6b8bcfa916 HDFS-2788. HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231569 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 19:45:12 +00:00
Suresh Srinivas 72207596be HADOOP-7972. HAServiceProtocol exceptions need to be unwrapped. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 02:30:29 +00:00
Aaron Myers 8610a9231a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 18:40:50 +00:00
Jitendra Nath Pandey 6234f3d91c HADOOP-2776. Missing interface annotation on JournalSet. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230412 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 06:21:05 +00:00
Harsh J dcea80a21b HDFS-69. Improve the 'dfsadmin' commandline help. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230398 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 05:13:19 +00:00
Suresh Srinivas 09e5af76f3 HADOOP-7970. HAServiceProtocol methods must throw IOException.Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230351 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 01:39:30 +00:00
Aaron Myers 3e76f00baa Fix expected error text in assertion. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230254 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 21:14:30 +00:00
Aaron Myers ede7f21278 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 20:53:50 +00:00
Aaron Myers 4f1bf2fe23 HDFS-2738. FSEditLog.selectinputStreams is reading through in-progress streams even when non-in-progress are requested. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229931 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 08:32:10 +00:00
Aaron Myers a339836bbc HDFS-2766. Test for case where standby partially reads log and then performs checkpoint. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229929 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 08:26:18 +00:00
Todd Lipcon a4f4becf52 HDFS-2775. Fix TestStandbyCheckpoints.testBothNodesInStandbyState failing intermittently. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229901 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 06:14:13 +00:00
Todd Lipcon 298e867673 HDFS-2773. Reading edit logs from an earlier version should not leave blocks in under-construction state. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229900 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 06:08:13 +00:00
Todd Lipcon 190dc1c91b HDFS-2753. Fix standby getting stuck in safemode when blocks are written while SBN is down. Contributed by Hari Mankude and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229898 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 05:55:32 +00:00
Tsz-wo Sze 1c8e3e8854 Add HDFS-2499 to CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229897 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 05:40:57 +00:00
Jitendra Nath Pandey 8faf7e8fb6 HDFS-2739. SecondaryNameNode doesn't start up. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229877 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 02:54:48 +00:00
Todd Lipcon 44d070cd01 HDFS-2724. NN web UI can throw NPE after startup, before standby state is entered. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229466 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 03:46:05 +00:00
Todd Lipcon 526efb48a6 HDFS-2762. Fix TestCheckpoint timing out on HA branch. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229464 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 03:29:02 +00:00
Aaron Myers ade897636d Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 18:01:55 +00:00
Aaron Myers a7195bdd14 HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229028 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 04:53:20 +00:00
Todd Lipcon 736b1860ab HDFS-2730. Refactor shared HA-related test code into HATestUtil class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229023 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 04:12:37 +00:00
Harsh J 8819fda489 Merged HDFS-2349, HDFS-2729, HDFS-2726, HDFS-554, HDFS-1314, HADOOP-7910 to branch-0.23, updating CHANGES.txt for trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228567 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 03:44:48 +00:00
Eli Collins 2d0b340c47 HADOOP-7961. Move HA fencing to common. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228510 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 00:17:42 +00:00
Todd Lipcon 9a07ba8945 HDFS-2709. Appropriately handle error conditions in EditLogTailer. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228390 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 20:44:05 +00:00
Aaron Myers d680080da0 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 18:47:05 +00:00
Jitendra Nath Pandey 4efd3699a6 HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227887 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 23:03:31 +00:00
Alejandro Abdelnur 5f5561d057 Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 21:55:43 +00:00
Alejandro Abdelnur 6d45b9e31d HADOOP-7934. Normalize dependencies versions across all modules. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 19:46:42 +00:00
Aaron Myers 3187a3ae05 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 19:21:01 +00:00
Suresh Srinivas 472e971891 HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 18:57:01 +00:00
Todd Lipcon 5b8dcb20a2 HDFS-2291. Allow the StandbyNode to make checkpoints in an HA setup. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227411 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 00:22:54 +00:00
Todd Lipcon d004ddee76 HDFS-2720. Fix MiniDFSCluster HA support to work properly on Windows. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227284 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 19:50:41 +00:00
Aaron Myers cd81cc6664 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 18:47:51 +00:00
Harsh J 075122690c HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 14:15:15 +00:00
Aaron Myers 1423fff096 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226900 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 18:07:55 +00:00
Harsh J 05ed36cd52 HDFS-2722. HttpFs should not be using an int for block size. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226861 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 16:47:49 +00:00
Harsh J 8e8203f3c5 HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226239 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-01 12:06:49 +00:00
Harsh J 11905517f1 HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226211 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-01 03:11:48 +00:00
Todd Lipcon 737df8b67b HDFS-2716. Configuration needs to allow different dfs.http.addresses for each HA NN. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226020 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-31 01:53:23 +00:00
Todd Lipcon 20a6560bdf HDFS-2692. Fix bugs related to failover from/into safe mode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225709 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-30 00:30:27 +00:00
Todd Lipcon 15ebdd5664 HDFS-2714. Fix test cases which use standalone FSNamesystems. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225708 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-30 00:25:21 +00:00
Aaron Myers f216303598 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 18:25:48 +00:00
Harsh J 6c349f9420 HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225591 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 16:51:59 +00:00
Harsh J 41737432c0 HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225456 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 07:22:54 +00:00
Aaron Myers a500ba50c2 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1224965 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 18:18:36 +00:00
Alejandro Abdelnur ae0d48854d HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-26 19:37:25 +00:00
Alejandro Abdelnur 6b4f40cbf9 HttpFS server should check that upload requests have correct content-type. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221616 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 05:26:20 +00:00
Todd Lipcon 31c91706f7 HDFS-1972. Fencing mechanism for block invalidations and replications. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221608 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 04:32:40 +00:00
Todd Lipcon 36d1c49486 HDFS-2693. Fix synchronization issues around state transition. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221582 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 03:03:23 +00:00
Alejandro Abdelnur 8fe3dd3fea HDFS-2657. TestHttpFSServer and TestServerWebApp are failing on trunk. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221580 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 03:03:16 +00:00
Alejandro Abdelnur 45620eee68 HDFS-2646. Hadoop HttpFS introduced 4 findbug warnings. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221572 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 02:46:04 +00:00
Tsz-wo Sze 3503d9a4a8 HDFS-2706. Use configuration for blockInvalidateLimit if it is set. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221106 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 05:49:24 +00:00
Todd Lipcon 57ef902bbc HDFS-2682. When a FailoverProxyProvider is used, Client should not retry for 45 times if it is timing out to connect to server. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220965 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 21:49:39 +00:00
Todd Lipcon 4bb0456c66 HDFS-2678. When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220942 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 20:57:13 +00:00
Todd Lipcon 08bde10e24 Merge trunk into HA branch to pick up fix for bkjournal findbugs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220941 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 20:46:58 +00:00
Todd Lipcon dfba847eb6 Amend HDFS-234 (bkjournal contrib). Fix findbugs build 
- Fixes pom parent to point to hadoop-project instead of hadoop-project-dist
- Fix relative path in pom to have the correct number of ../s


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220940 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 20:42:25 +00:00
Alejandro Abdelnur de928a4aa0 HDFS-2658. HttpFS introduced 70 javadoc warnings. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220810 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 15:53:53 +00:00
Todd Lipcon 8ff28f4549 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:34:51 +00:00
Todd Lipcon 625d1b380a HDFS-2677. Web UI should indicate the NN state. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220613 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:26:07 +00:00
Todd Lipcon 329717264f HDFS-2679. Add interface to query current state to HAServiceProtocol. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220612 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 05:24:32 +00:00
Eli Collins 5e185702ea HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 18:12:48 +00:00
Todd Lipcon a89baed833 HDFS-2553. Fix BlockPoolSliceScanner spinning in a tight loop. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220317 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 01:13:00 +00:00
Todd Lipcon fa1edc9a1e HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220315 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-18 01:10:49 +00:00
Aaron Myers 08c9dc3780 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215367 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:31:46 +00:00
Suresh Srinivas 89553be90e HDFS-2687. Tests failing with ClassCastException post protobuf RPC changes. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215366 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:26:46 +00:00
Aaron Myers 52c1491155 HDFS-2694. Removal of Avro broke non-PB NN services. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215364 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:19:01 +00:00
Thomas White 9b7617a909 HDFS-2640. Javadoc generation hangs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215354 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 00:09:04 +00:00
Todd Lipcon 371f4228e8 HDFS-2684. Fix up some failing unit tests on HA branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215241 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 18:36:24 +00:00
Todd Lipcon cdb9f01ad4 HDFS-2667. Fix transition from active to standby. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215037 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 04:25:13 +00:00
Aaron Myers 71071b904d HDFS-2602. NN should log newly-allocated blocks without losing BlockInfo. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215036 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 04:18:58 +00:00
Aaron Myers 353bc3799d HDFS-2689. HA: BookKeeperEditLogInputStream doesn't implement isInProgress(). Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214965 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 21:54:00 +00:00
Aaron Myers d937abd434 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214944 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 20:05:38 +00:00
Alejandro Abdelnur 6cf3a15c52 HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214790 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 14:41:01 +00:00
Todd Lipcon afd0333196 HDFS-2683. Authority-based lookup of proxy provider fails if path becomes canonicalized. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214579 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 00:42:50 +00:00
Todd Lipcon b77c107ccb Committing rest of merge from trunk (accidentally only committed the HDFS portion before) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214546 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 23:34:04 +00:00
Todd Lipcon ecdf9da770 Fix treatment of NNHAStatusHeartbeat in protobuffer. 
Committing without pre-commit review since it's a pretty trivial merge fix


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214543 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 23:28:43 +00:00
Todd Lipcon 8134b1c870 Merge trunk into HA branch. 
Several conflicts around introduction of protobuf translator for DatanodeProtocol - mostly trivial resolutions.

NB: this does not successfully pass any tests since the HAStatus field needs
to be integrated into the HeartbeatResponse Protobuf implementation.
That will be a separate commit for clearer history.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214518 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 22:47:41 +00:00
Todd Lipcon 6c2da4bc0f HDFS-2680. DFSClient should construct failover proxy with exponential backoff. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214487 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 21:41:31 +00:00
Sanjay Radia d8dfcdcbc2 HDFS-2669 Enable protobuf rpc for ClientNamenodeProtocol 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214128 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 09:27:51 +00:00
Todd Lipcon 7e8accd68e HDFS-2671. NN should throw StandbyException in response to RPCs in STANDBY state. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214117 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:56:21 +00:00
Suresh Srinivas 95bdb29aaf r1214102 should have removed the file. Committing this to remove empty file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214103 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:25:47 +00:00
Suresh Srinivas 60dd76c6ab HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214102 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:20:23 +00:00
Todd Lipcon b9238e3bad HDFS-2675. Reduce warning verbosity when double-closing edit logs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214098 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:13:55 +00:00
Eli Collins bdc2a77d6b HDFS-2649. eclipse:eclipse build fails for hadoop-hdfs-httpfs. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214046 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 03:42:24 +00:00
Jitendra Nath Pandey 3cffe34177 HDFS-2661. Enable protobuf RPC for DatanodeProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214033 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 02:15:37 +00:00
Tsz-wo Sze 433a6e78f6 HDFS-2545. Change WebHDFS to support multiple namenodes in federation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214027 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 01:47:57 +00:00
Suresh Srinivas 3954a2fb1c HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213985 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:31:44 +00:00
Suresh Srinivas 6a609cb471 Reverting the patch r1213981 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213984 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:27:58 +00:00
Jitendra Nath Pandey 1f2f4e105b HDFS-234. Integration with BookKeeper logging system. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213983 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:27:13 +00:00
Suresh Srinivas b5229fd19b HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213981 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:22:28 +00:00
Suresh Srinivas 3001a172c8 Reverting r1213512 because it committed changes that were not part of the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213980 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:17:02 +00:00
Aaron Myers a0fe4f476a Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213867 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 19:02:37 +00:00
Suresh Srinivas f2f4e93413 HDFS-2650. Replace @inheritDoc with @Override. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213813 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 18:07:29 +00:00
Suresh Srinivas 4ec8424e5d HDFS-2666. Fix TestBackupNode failure. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213808 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 17:59:37 +00:00
Eli Collins c3f7c1f3e5 Add missing file to previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213593 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 08:10:29 +00:00
Eli Collins 5f39d6c239 HDFS-2654. Make BlockReaderLocal not extend RemoteBlockReader2. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213592 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 08:09:50 +00:00
Eli Collins 197634f2f7 HDFS-2653. DFSClient should cache whether addrs are non-local when short-circuiting is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213586 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 07:51:23 +00:00
Eli Collins 2892b058e0 Put HDFS-1765 in the right place in the changelog. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213541 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 02:23:07 +00:00
Eli Collins 43100e9c0e HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213537 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 01:58:25 +00:00
Suresh Srinivas 13345f3a85 HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213512 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 00:21:48 +00:00
Aaron Myers 89379bc1a3 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213389 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 19:41:20 +00:00
Konstantin Shvachko 3128c78636 JDiff output for release 0.22.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213146 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 05:45:08 +00:00
Sanjay Radia 48da033901 HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213143 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 05:36:35 +00:00
Konstantin Shvachko 2c1ee1d342 Preparing for release 0.22.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213121 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 00:26:01 +00:00
Suresh Srinivas 2740112bb6 HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213040 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-11 18:53:21 +00:00
Alejandro Abdelnur e7682e1496 HDFS-2511. Add dev script to generate HDFS protobufs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212609 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:21:19 +00:00
Jitendra Nath Pandey 38a19bc293 HDFS-2642. Protobuf translators for DatanodeProtocol. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212606 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 20:02:33 +00:00
Tsz-wo Sze 9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 09:26:33 +00:00
Todd Lipcon 2481474bd9 HDFS-2634. Standby needs to ingest latest edit logs before transitioning to active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1212187 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 23:55:40 +00:00
Alejandro Abdelnur 3334306512 HDFS-2178. Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212060 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:25:28 +00:00
Sanjay Radia 9f69ae5a9e HDFS-2597 ClientNameNodeProtocol in Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211769 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 06:48:45 +00:00
Aaron Myers d9ea5bb489 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211749 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 02:57:47 +00:00
Todd Lipcon 6016e95fee HDFS-2627. Determine DN's view of which NN is active based on heartbeat responses. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211735 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 02:00:20 +00:00
Aaron Myers a27adf3de4 HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 21:47:13 +00:00
Suresh Srinivas c17bb83644 HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 01:05:56 +00:00
Suresh Srinivas 7a59150bff HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 22:19:10 +00:00
Jitendra Nath Pandey b981daa07f HDFS-1580. Committing the test case, it was missed in earlier commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210749 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 02:15:56 +00:00
Jitendra Nath Pandey 8c0f2a0d59 HDFS-2618. Fix for the build failure caused by previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210746 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 02:08:48 +00:00
Suresh Srinivas 0a713035f2 HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 00:25:25 +00:00
Todd Lipcon f39aac60e0 Merge trunk into branch. 
Resolved conflicts generated by commit of HDFS-1580 in trunk:
- made EditLogInputStream.isInProgress public
- fixed trivial conflict in DFSConfigKeys


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210666 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 22:10:35 +00:00
Suresh Srinivas c256f8266d HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:52:23 +00:00
Todd Lipcon 6491444357 Fix to previous trunk merge - RPC's addProtocol method now needs an RpcKind 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210638 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:13:07 +00:00
Jitendra Nath Pandey d18e5b3844 HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210602 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 20:10:27 +00:00
Aaron Myers 8a4db4d331 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210547 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 18:00:44 +00:00
Todd Lipcon ad7fe4e21e HDFS-2625. TestDfsOverAvroRpc failing after introduction of HeartbeatResponse type. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210342 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 06:38:52 +00:00
Todd Lipcon c7f5167845 HDFS-2624. ConfiguredFailoverProxyProvider doesn't correctly stop ProtocolTranslators. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210341 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 06:37:46 +00:00
Todd Lipcon b3f28dbb3d HDFS-2626. BPOfferService.verifyAndSetNamespaceInfo needs to be synchronized. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210340 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 06:36:00 +00:00
Sanjay Radia 65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:44:36 +00:00
Todd Lipcon 74b1f069cc Amend HDFS-2616 to fix mocking in TestBPOfferService 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209315 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 00:03:17 +00:00
Todd Lipcon 28dbd56de0 HDFS-2623. Add test case for hot standby capability. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209256 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 21:37:08 +00:00
Todd Lipcon f4fa76719e HDFS-2612. Handle refreshNameNodes in federated HA clusters. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209249 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 21:26:08 +00:00
Todd Lipcon 4cbead8484 HDFS-2622. Fix TestDFSUpgrade in HA branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209230 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 20:38:46 +00:00
Suresh Srinivas 8dbb523768 HDFS-2616. Change DatanodeProtocol#sendHeartbeat() to return HeartbeatResponse. (suresh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208987 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 08:03:41 +00:00
Suresh Srinivas 1e346aa829 HDFS-1971. Send block report from datanode to both active and standby namenodes. (sanjay, todd via suresh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208925 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 01:10:28 +00:00
Todd Lipcon f87a4b40bc HDFS-1975. Support for sharing the namenode state from active to standby. Contributed by Jitendra Nath Pandey, Aaron T Myers, and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208813 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 21:46:22 +00:00
Aaron Myers 0eec2218a1 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208644 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 18:27:04 +00:00
Eli Collins 68ff73c802 Ammend HDFS-2570 to shorten description. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208313 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 07:49:15 +00:00
Todd Lipcon bb91ebb53c HDFS-2591. MiniDFSCluster support to mix and match federation with HA. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208297 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 06:49:30 +00:00
Alejandro Abdelnur afbc3aa30c HDFS-2606. webhdfs client filesystem impl must set the content-type header for create/append. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208157 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 00:25:54 +00:00
Tsz-wo Sze 0398a9e88d HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:38:59 +00:00
Aaron Myers ee97365f58 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208002 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 17:55:28 +00:00
Todd Lipcon 9146ad23f3 HDFS-2582. Scope dfs.ha.namenodes config by nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207738 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 02:27:45 +00:00
Konstantin Shvachko 68f56ca906 HDFS-2287. Fix second assert. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 00:03:49 +00:00
Konstantin Shvachko 3083d7d7db Fix CHANGES.txt. Moving changes from 0.21.1 section to 0.22.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207709 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 00:00:20 +00:00
Konstantin Shvachko 82da8fb490 Fix CHANGES.txt. Some changes have been committed under 0.21.1 section rather than 0.22.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207706 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:53:49 +00:00
Konstantin Shvachko 32935d3e67 Fix CHANGES.txt for HDFS-2346 in trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207700 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:40:24 +00:00
Eli Collins b32543d9ae HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 23:20:16 +00:00
Konstantin Shvachko 49c44117f3 Fix typo in HDFS-993 commit. Was -933. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207676 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 22:51:45 +00:00
Tsz-wo Sze 91a75ad34f Fix WebHDFS capitalization in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207585 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 20:47:38 +00:00
Aaron Myers 73b3de6204 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207490 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 18:21:46 +00:00
Matthew Foley e9c2307838 HDFS-2316. Record completion of umbrella jira. Contributed by Tsz Wo (Nicholas), Sze. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206990 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 06:30:49 +00:00
Tsz-wo Sze 4b65d10cfe HDFS-2590. Fix the missing links in the WebHDFS forrest doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206178 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-25 13:58:29 +00:00
Konstantin Shvachko 080a34143d HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE jiras. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205988 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 21:44:36 +00:00
Todd Lipcon 5f5b3bbdcd HDFS-2577. NN fails to start since it tries to start secret manager in safemode. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1205689 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 00:55:37 +00:00
Tsz-wo Sze d3a51478e3 HDFS-2587. Add apt doc for WebHDFS REST API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 22:02:19 +00:00
Matthew Foley db092f5048 HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 18:15:37 +00:00
Tsz-wo Sze 7381884e85 HDFS-2552. Add Forrest doc for WebHDFS REST API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205146 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 20:04:58 +00:00
Suresh Srinivas 49417594e8 HDFS-2519. Add protobuf service for DatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204825 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 06:25:13 +00:00
Todd Lipcon 6a0671977b Merge trunk into HDFS-1623 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1204794 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 03:18:47 +00:00
Tsz-wo Sze 2ab10e29d9 HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 02:57:04 +00:00
Konstantin Boudnik a2e66776a9 HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 02:15:49 +00:00
Suresh Srinivas 5293760973 HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 23:49:44 +00:00
Suresh Srinivas b76b85986e HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204709 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 21:11:43 +00:00
Suresh Srinivas 4754b80862 HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204707 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 21:10:04 +00:00
Todd Lipcon 39ce694d05 HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 19:27:00 +00:00
Todd Lipcon 68173af69d HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 19:03:31 +00:00
Suresh Srinivas 54ac7e5413 HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204544 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 15:39:33 +00:00
Eli Collins 9c2f4f634d HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 07:01:29 +00:00
Todd Lipcon 5bc66c4c86 HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 06:41:56 +00:00
Harsh J 67f25b0a1b HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 15:18:14 +00:00
Eli Collins 5573b691d5 HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 06:28:37 +00:00
Eli Collins 8686a00c7a HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 06:22:44 +00:00
Eli Collins 8e8bb50afd HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 04:27:59 +00:00
Eli Collins 513718f92d HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 04:13:32 +00:00
Eli Collins b2313021fd HDFS-2536. Remove unused imports. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:58:50 +00:00
Eli Collins 0e5c1a45bf HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:38:51 +00:00
Eli Collins 84f0c0f180 HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:29:20 +00:00
Eli Collins 7a8015c0e2 HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 02:51:50 +00:00
Eli Collins b7cd8c0f86 HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 02:34:25 +00:00
Todd Lipcon 1f92266516 HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 01:31:59 +00:00
Aaron Myers 67c372991c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1203781 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 18:29:26 +00:00
Todd Lipcon 905a127850 HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 09:04:20 +00:00
Thomas White 6a01c22755 HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 05:10:40 +00:00
Thomas White dc5a0ab245 HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:53:46 +00:00
Todd Lipcon 0864ef1908 HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:45:31 +00:00
Aaron Myers 0d171f6513 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202013 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 02:39:13 +00:00
Todd Lipcon 9a3f147fdd HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:13:58 +00:00
Todd Lipcon 51ce383112 HDFS-2532. Add timeout to TestDfsOverAvroRpc 
This test is timing out on trunk, causing tests below it to
fail spuriously. This patch doesn't fix the issue -- just adds
a JUnit timeout so that the failure is properly attributed
to this test.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201963 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 23:34:21 +00:00
Tsz-wo Sze 09a156fcce HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 04:19:45 +00:00
Tsz-wo Sze 94c631af1f HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 19:25:57 +00:00
Hairong Kuang 6dff9329d5 HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199024 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 00:16:23 +00:00
Tsz-wo Sze a590b498ac HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198903 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 20:05:16 +00:00
Hairong Kuang db13c99940 Add the missing test file to HDFS-2477. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197801 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-04 21:49:15 +00:00
Tsz-wo Sze 6afe3e0d22 HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 22:34:47 +00:00
Todd Lipcon 40fe96546f HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 06:54:59 +00:00
Todd Lipcon fd8c757b9f Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196904 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 01:02:28 +00:00
Todd Lipcon 11cf658d0a HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196902 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 01:00:25 +00:00
Todd Lipcon f84552ac35 HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196889 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 00:35:37 +00:00
Hairong Kuang a4baabe4a4 HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 16:31:21 +00:00
Aaron Myers 571d7990f4 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1196458 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 05:34:31 +00:00
Jitendra Nath Pandey bd21ddcb78 HDFS-2416. distcp with a webhdfs uri on a secure cluster fails. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 02:08:20 +00:00
Aaron Myers abe45f59ac HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 17:59:53 +00:00
Eli Collins 4961441584 HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 16:44:28 +00:00
Arun Murthy 4e42044b1c Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:46:22 +00:00
Konstantin Shvachko 22000ce96d HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:37:11 +00:00
Arun Murthy a3a4ccfed7 Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 06:02:53 +00:00
Todd Lipcon 1c940637b1 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 05:17:08 +00:00
Tsz-wo Sze bb8fd6a267 TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195754 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:31:06 +00:00
Todd Lipcon 3ab295994a HDFS-2523. Small NN fixes to include HAServiceProtocol and prevent NPE on shutdown. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1195753 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:29:59 +00:00
Tsz-wo Sze 8d1a09b741 HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 00:38:57 +00:00
Todd Lipcon c46876982e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 21:53:58 +00:00
Tsz-wo Sze 32cad9affe HDFS-2385. Support renew and cancel delegation tokens in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey 7cb77a3b1b HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 19:03:55 +00:00
Konstantin Shvachko 64c019cccc HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195013 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 20:11:35 +00:00
Tsz-wo Sze 2eca60199a Revert 1190677 for HDFS-2509. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194986 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 19:31:06 +00:00
Tsz-wo Sze 2dcd43c7b1 HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190708 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:19:21 +00:00
Thomas White cd77a1668f HADOOP-7763. Add top-level navigation to APT docs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:16:16 +00:00
Tsz-wo Sze c8ac31e9a0 HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190677 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 23:42:27 +00:00
Todd Lipcon 6b0963c53b HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190626 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:18:42 +00:00
Suresh Srinivas c0c938f242 HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190620 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 22:06:04 +00:00
Tsz-wo Sze 9692cfc9ae HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190491 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:28:26 +00:00
Eric Yang da1db28e93 HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190452 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 17:08:09 +00:00
Sanjay Radia b49c95a5d9 HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190127 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:52:00 +00:00
Tsz-wo Sze 4a98639a55 Move HDFS-2355, HDFS-2371 and HDFS-2298 entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190126 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:48:12 +00:00
Aaron Myers efb2d93f77 HDFS-2393. Mark appropriate methods of ClientProtocol with the idempotent annotation. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190088 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:26:44 +00:00
Aaron Myers 180646dea3 HDFS-2418. Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190078 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:15:07 +00:00
Tsz-wo Sze 8cb0d4b380 HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190077 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:13:26 +00:00
Todd Lipcon 221aadbc5b HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190071 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:47:19 +00:00
Todd Lipcon 646e855f6e HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190060 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:11:10 +00:00
Todd Lipcon ebb6cc60c4 HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190059 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 22:10:58 +00:00
Suresh Srinivas 456ca74b96 HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189901 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 18:09:42 +00:00
Tsz-wo Sze 10dc6b0927 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 00:02:19 +00:00
Tsz-wo Sze 753c14cf4e Move webhdfs entries from trunk to 0.23 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189541 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 23:49:45 +00:00
Tsz-wo Sze 758194382c HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey 8534e70044 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 18:15:58 +00:00
Tsz-wo Sze 8335995630 HDFS-2501. Add version prefix and root methods to webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 05:16:57 +00:00
Mahadev Konar d19cfe0164 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:07:13 +00:00
Suresh Srinivas a268a3c0e4 HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188487 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:32:49 +00:00
Suresh Srinivas 4846ca7863 HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188436 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 23:07:13 +00:00
Sanjay Radia 0920056f04 HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188300 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 19:08:03 +00:00
Suresh Srinivas 8fe95d276d Added missing files for HDFS-2489 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:46:59 +00:00
Suresh Srinivas 2b35e8aa4f HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188282 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:40:13 +00:00
Konstantin Shvachko 6e0991704f HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187965 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 20:17:04 +00:00
Steve Loughran a54ccc0bde HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187888 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:14:22 +00:00
Steve Loughran 2690d0db0e HDFS-2485 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187887 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 14:13:58 +00:00
Konstantin Shvachko 7dd869c2a9 HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187837 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-23 00:35:55 +00:00
Suresh Srinivas d2e1a71918 HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187505 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 19:03:18 +00:00
Tsz-wo Sze 7c48130d41 HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187140 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 00:27:08 +00:00
Suresh Srinivas 520d2502c5 HDFS-2459. Separate datatypes for Journal Protocol. (suresh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186896 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 16:31:57 +00:00
Suresh Srinivas 37137845c8 Merging change r1186579 for HDFS-2471 from 0.23 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186584 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 00:38:42 +00:00
Arun Murthy a6cc9bafa8 HDFS-2445. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186550 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:51:51 +00:00
Tsz-wo Sze 0bd8f0bd40 HDFS-2453. Fix http response code for partial content in webhdfs, added getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem and cleared content type in ExceptionHandler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186508 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:38:58 +00:00
Alejandro Abdelnur 01d408d5b0 Reverted HDFS-2474 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186501 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:29:01 +00:00
Alejandro Abdelnur 2edd042f8a HDFS-2474. Make GlobFilter class public. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186498 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:17:35 +00:00
Owen O'Malley 073a13aeb1 HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation 
tokens. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185842 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 20:33:16 +00:00
Jitendra Nath Pandey ab7e7dfd7e Merged r1185354 from trunk for HDFS-2188. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1185363 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 20:42:32 +00:00
Jitendra Nath Pandey 8d4842383e HDFS-2188. Make FSEditLog create its journals from a list of URIs rather than NNStorage. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185354 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 20:23:57 +00:00
Tsz-wo Sze 50cb2771e9 HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing file or creating a file without specifying the replication parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183554 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 23:25:09 +00:00
Konstantin Shvachko 4cb7a4854d HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183457 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 18:31:55 +00:00
Jitendra Nath Pandey 002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:24:20 +00:00
Tsz-wo Sze c46dbedaf9 HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183175 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 00:30:30 +00:00
Tsz-wo Sze 5904e00b4f HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183098 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 21:06:41 +00:00
Tsz-wo Sze 7d1a5078b7 HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183081 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 20:41:00 +00:00
Mahadev Konar e123a37bf1 HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182694 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 07:13:54 +00:00
Suresh Srinivas 7ca7832158 HDFS-2231. Configuration changes for HA namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1182626 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 00:09:55 +00:00
Aaron Myers c3792b4b3f Move line for HDFS-2422 under 0.23 instead of 0.24. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182220 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 06:26:26 +00:00
Harsh J 532872bf74 HDFS-2349. Corruption detected during block transfers should log WARNs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182205 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 04:48:52 +00:00
Suresh Srinivas f00198b16c HDFS-2301. Start/stop appropriate namenode services when transition to active and standby states. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1182080 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 20:44:34 +00:00
Aaron Myers f527f989af HDFS-2422. The NN should tolerate the same number of low-resource volumes as failed volumes (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181316 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 00:37:29 +00:00
Suresh Srinivas 676f488eff HDFS-2404. webhdfs liststatus json response is not correct. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180757 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-10 01:49:37 +00:00
Todd Lipcon 4cf6bc415f HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180541 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-09 03:59:21 +00:00
Steve Loughran 3ab2e79ad7 HDFS-2209 datanode connection failure logging 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180353 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-08 10:41:56 +00:00
Todd Lipcon 54e81464a3 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180202 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 20:28:39 +00:00
Alejandro Abdelnur 2b157c6b12 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180094 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 16:34:51 +00:00
Steve Loughran aace6cb631 HDFS-2209. Make MiniDFS easier to embed in other apps. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180077 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 15:30:32 +00:00
Aaron Myers 8b4f497af8 HDFS-1973. HA: HDFS clients must handle namenode failover and switch over to the new active namenode. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179896 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 23:26:14 +00:00
Alejandro Abdelnur 9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 23:10:31 +00:00
Sanjay Radia e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey 6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 21:30:06 +00:00
Tsz-wo Sze a2d7287873 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179856 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 21:17:19 +00:00
Aaron Myers 90727b82e0 HDFS-2407. getServerDefaults and getStats don't check operation category (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179685 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 16:14:50 +00:00
Aaron Myers 60dcc5f237 Merging trunk to HDFS-1623 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179484 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 01:16:48 +00:00
Tsz-wo Sze 1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:29:05 +00:00
Eric Yang 3edf3579c8 HADOOP-7684. Added init.d script for jobhistory server and 
secondary namenode. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:44:08 +00:00
Eric Yang abc2b45dfa HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:13:58 +00:00
Todd Lipcon 93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073. 
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 22:05:42 +00:00
Tsz-wo Sze dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-01 04:49:00 +00:00
Doug Cutting f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 18:01:27 +00:00
Jitendra Nath Pandey 1ae5b5e338 HDFS-2158. Add JournalSet to manage the set of journals. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177473 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 01:14:37 +00:00
Suresh Srinivas e90a5b4043 HDFS-2371. Refactor BlockSender.java for better readability. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177161 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 04:40:15 +00:00
Suresh Srinivas ab0402bc1d Merging trunk to HDFS-1623 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177130 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 00:42:47 +00:00
Suresh Srinivas 9992cae541 Reverting the previous trunk merge since it added other unintended changes in addition 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177127 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 00:33:34 +00:00
Suresh Srinivas 122113922f Merging trunk to HDFS-1623 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1177117 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 00:09:56 +00:00
Suresh Srinivas e9dd78d9fe HDFS-2355. Federation: enable using the same configuration file across all the nodes in the cluster. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177100 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 22:58:10 +00:00
Aaron Myers 484649acfe Removing entry for CHANGES.txt since this was back-ported to 0.23. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177020 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 19:01:32 +00:00
Aaron Myers 08db2a139d HDFS-2346. TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods (Laxman via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176994 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 18:06:26 +00:00
Tsz-wo Sze 96f9fc9199 HDFS-2363. Move datanodes size printing from FSNamesystem.metasave(..) to BlockManager. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176733 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 05:49:17 +00:00
Jitendra Nath Pandey 825f9c80a4 HDFS-2361. hftp is broken, fixed username checks in JspHelper. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176729 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 05:29:09 +00:00
Tsz-wo Sze 59265d6ed8 HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to hdfs-site.xml. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176719 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 04:51:29 +00:00
Todd Lipcon eb3a692a57 HDFS-2332. Add test for HADOOP-7629 (using an immutable FsPermission object as an RPC parameter fails). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176692 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 03:00:59 +00:00
Suresh Srinivas 201b7879ba HDFS-2373. Commands using webhdfs and hftp print unnecessary debug info on the console with security enabled. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176654 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-27 23:16:17 +00:00
Tsz-wo Sze bf78f15ffb HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176178 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-27 02:43:37 +00:00
Konstantin Shvachko 5a6f8e38c0 HDFS-2290. Block with corrupt replica is not getting replicated. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175175 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-24 15:04:34 +00:00
Tsz-wo Sze 83a83d3b73 HDFS-2356. Support case insensitive query parameter names in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175113 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-24 06:15:50 +00:00
Tsz-wo Sze d773bf0fb5 HDFS-46. Change default namespace quota of root directory from Integer.MAX_VALUE to Long.MAX_VALUE. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173990 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-22 08:25:20 +00:00
Sanjay Radia 7d8e9d6960 HADOOP-7524 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173488 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 04:25:55 +00:00
Tsz-wo Sze 4dc4e9e63f HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173468 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 02:56:08 +00:00
Aaron Myers c382e386b5 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1173012 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-20 07:40:04 +00:00
Matthew Foley 9d14f100c8 HDFS-2347. Fix checkpointTxnCount's comment about editlog size. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172916 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-20 00:26:32 +00:00
Tsz-wo Sze e34d2c075d HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172219 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-18 08:30:47 +00:00
Tsz-wo Sze dafa8f7a77 HDFS-362. FSEditLog should not writes long and short as UTF8, and should not use ArrayWritable for writing non-array items. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171945 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-17 10:53:44 +00:00
Aaron Myers 70a180d0f5 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171808 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 21:35:45 +00:00
Aaron Myers a89d4609b2 HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171711 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 18:38:32 +00:00
Tsz-wo Sze ff44372895 Revised the entry for HDFS-2318 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171615 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 15:05:25 +00:00
Tsz-wo Sze 78e3821b81 HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation tokens. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171611 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 15:02:30 +00:00
Tsz-wo Sze cde0e484e7 HDFS-2338. Add configuration option to enable/disable webhdfs. Contributed by jitendra 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171379 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 04:01:51 +00:00
Aaron Myers 6af0c27930 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1171315 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 23:07:48 +00:00
Tsz-wo Sze 376a1a2511 HDFS-2333. Change DFSOutputStream back to package private, otherwise, there are two SC_START_IN_CTOR findbugs warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171136 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 15:28:23 +00:00
Tsz-wo Sze be2b0921fa HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK version < 1.6.0_26. Contributed by Abhijit Suresh Shingate 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170996 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 08:04:46 +00:00
Aaron Myers f4b2b63807 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1170378 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 22:49:27 +00:00
Thomas White e4dc2e1f56 HDFS-2323. start-dfs.sh script fails for tarball install 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170233 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 16:53:57 +00:00
Tsz-wo Sze 6c3b59505b HDFS-2317. Support read access to HDFS in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170085 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 08:34:27 +00:00
Tsz-wo Sze 61d0b7530c HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http access to HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167662 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-11 01:41:42 +00:00
Todd Lipcon d10631f728 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1166495 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 01:39:07 +00:00
Konstantin Shvachko 8b9a2c7487 HDFS-2232. Generalize regular expressions in TestHDFSCLI. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166470 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 23:37:56 +00:00
Todd Lipcon 06e84a1bca HDFS-2223. Untangle depencencies between NN components. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166466 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 23:23:24 +00:00
Todd Lipcon 42d443fb79 HDFS-2314. MRV1 test compilation broken after HDFS-2197. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165860 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:25:35 +00:00
Jitendra Nath Pandey bdc3720d5b HDFS-2018. Move all journal stream management code into one place. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165826 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 20:27:38 +00:00
Aaron Myers 9e95326a2c HDFS-2313. Rat excludes has a typo for excluding editsStored files. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165477 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 01:51:30 +00:00
Todd Lipcon b0632df93a HDFS-2197. Refactor RPC call implementations out of NameNode class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165463 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 00:41:47 +00:00
Todd Lipcon d1438b501d HDFS-2310. TestBackupNode fails since HADOOP-7524 went in. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165461 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 00:34:57 +00:00
Aaron Myers 458c34a2ab Follow-up commit for HDFS-1620 since I missed some files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165103 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-04 19:38:50 +00:00
Aaron Myers 8ae98a9d1c HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants -> HdfsConstants. (Harsh J Chouraria via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165096 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-04 19:30:12 +00:00
Sanjay Radia b97a4d40c8 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 00:31:05 +00:00
Aaron Myers 2566043c2f HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164624 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 16:47:59 +00:00
Eli Collins 07c5741c9a HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164339 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 03:20:12 +00:00
Aaron Myers c5ef34a1e7 Revert 1164192 given review feedback provided after initial commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164199 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 18:25:51 +00:00
Aaron Myers d873f1155a HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164192 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 18:07:38 +00:00
Konstantin Shvachko 4f1a0e36fa HDFS-2258. Reset lease limits to default values in TestLeaseRecovery2. Contributed by Konstantin Shvachko 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163821 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 21:18:37 +00:00
Matthew Foley 1cd3791172 HDFS-1330 and HADOOP-6889. Added additional unit tests. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163463 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 00:58:19 +00:00
Tsz-wo Sze aba0e225fc HDFS-1217. Change some NameNode methods from public to package private. Constributed by Laxman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163081 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-30 04:02:22 +00:00
Arun Murthy 8b56463315 HDFS-2289. Ensure jsvc is bundled with the HDFS distribution artifact. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162421 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-27 19:07:04 +00:00
Todd Lipcon 5116ea4487 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1162279 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 22:46:17 +00:00
Todd Lipcon 23e7fc4f46 HDFS-2287. TestParallelRead has a small off-by-one bug. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162005 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:51:57 +00:00
Todd Lipcon 7cf49f5d9c HDFS-2286. DataXceiverServer logs AsynchronousCloseException at shutdown. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162003 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:44:13 +00:00
Hairong Kuang 73451ed2d9 HDFS-395. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161992 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 04:46:42 +00:00
Hairong Kuang e680023f8b Revert 1161976 since the log message was incorrectly marked the issue as HDFS-349. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161991 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 04:41:52 +00:00
Hairong Kuang 522fe14a89 Move change log for HDFS-395 from 0.23 section to trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161987 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 04:16:20 +00:00
Hairong Kuang e6339be188 HDFS-349. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161976 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 03:10:13 +00:00
Mahadev Konar a415733cf6 HADOOP-7578. Adding needed files in svn (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161781 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 22:27:24 +00:00
Mahadev Konar e096d0b225 HADOOP-7578. Fix a mess up in svn move (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161777 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 22:12:27 +00:00
Arun Murthy a44ffcc0be Preparing for hadoop-0.24.0 development. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 20:32:04 +00:00
Arun Murthy ee05510c42 Preparing for release 0.23.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:39:15 +00:00
Mahadev Konar 01f24e1af7 HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161711 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:31:02 +00:00
Arun Murthy 6316e66279 HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161335 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 00:20:52 +00:00
Arun Murthy cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 00:14:24 +00:00