Commit Graph

571 Commits

Author SHA1 Message Date
Arun Murthy eabe75d6f2 HDFS-2572. Moved to trunk section from 0.23.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241746 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:31:26 +00:00
Suresh Srinivas 28eadb7cd7 HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241519 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 16:59:48 +00:00
Konstantin Shvachko 7e4bd89590 HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:44:27 +00:00
Suresh Srinivas 2a9e430ff9 HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 13:33:35 +00:00
Eli Collins b837bbb7d5 HDFS-2893. The start/stop scripts don't start/stop the 2NN when using the default configuration. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240928 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 08:52:50 +00:00
Harsh J da7b0d90c6 HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 05:25:12 +00:00
Suresh Srinivas f88574acde HDFS-2880. Protobuf chagnes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240653 13f79535-47bb-0310-9956-ffa450edef68
2012-02-05 01:39:30 +00:00
Jitendra Nath Pandey 205f0470f4 HDFS-2785. Update webhdfs and httpfs for host-based token support. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240460 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 06:57:40 +00:00
Aaron Myers 447e81f51a HDFS-2889. getNumCurrentReplicas is package private but should be public on0.23 (see HDFS-2408). Contributed by Gregory Chanan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240412 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:01:06 +00:00
Tsz-wo Sze 38ad4b5036 HDFS-2879. Change FSDataset to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 07:26:02 +00:00
Todd Lipcon 6d5510dfb8 HDFS-2877. If locking of a storage dir fails, it will remove the other NN's lock file on exit. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239880 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 22:12:02 +00:00
Jitendra Nath Pandey 9eb8f4d267 HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 19:04:40 +00:00
Konstantin Shvachko 191db6a907 HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey c909aedbc1 HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 05:31:46 +00:00
Tsz-wo Sze dbbfaebb71 HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:46:50 +00:00
Suresh Srinivas 536b30ec91 HDFS-2835. Fix findbugs and javadoc issue with GetConf.java. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238779 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 20:03:49 +00:00
Suresh Srinivas 319021d6fb HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:59:58 +00:00
Tsz-wo Sze 8dfef7d2dc HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 17:36:42 +00:00
Jitendra Nath Pandey 98302971c2 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
2012-01-29 02:01:24 +00:00
Aaron Myers 976c07696d HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 20:26:13 +00:00
Todd Lipcon da91e0d427 HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:42:34 +00:00
Alejandro Abdelnur 0d5b734681 HDFS-2840. TestHostnameFilter should work with localhost or localhost.localdomain (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236940 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:24:46 +00:00
Alejandro Abdelnur cf16929584 HDFS-2837. mvn javadoc:javadoc not seeing LimitedPrivate class (revans2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236338 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:15:04 +00:00
Alejandro Abdelnur a7091893de HDFS-2836. HttpFSServer still has 2 javadoc warnings in trunk (revans2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236328 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 17:58:42 +00:00
Harsh J 7c69883917 HDFS-442. dfsthroughput in test jar throws NPE (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:10:28 +00:00
Eli Collins 5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
Todd Lipcon 1525aae4b3 HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:42:17 +00:00
Todd Lipcon c0016ba85f HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:07:49 +00:00
Todd Lipcon 12645ff6c0 HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:11:09 +00:00
Harsh J ece854211f HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234555 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:30:33 +00:00
Todd Lipcon c840548d6b HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:42:35 +00:00
Alejandro Abdelnur 654b90fa23 HDFS-2816. Fix missing license header in httpfs findbugsExcludeFile.xml. (hitesh via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 21:04:24 +00:00
Todd Lipcon f7d20b2198 HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233796 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:32:06 +00:00
Todd Lipcon 520a39ac2d HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:26:19 +00:00
Eli Collins fa6033a029 HDFS-2768. BackupNode stop can not close proxy connections because it is not a proxy instance. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233584 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 21:41:50 +00:00
Todd Lipcon 1d2e706dd1 HDFS-2803. Add logging to LeaseRenewer for better lease expiration debugging. Contributed by Jimmy Xiang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233453 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 16:35:25 +00:00
Eli Collins c53c94ec46 Update changelog for HDFS-362 to reflect the merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1232205 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 22:43:11 +00:00
Eli Collins f02ea82bd1 HDFS-2790. FSNamesystem.setTimes throws exception with wrong configuration name in the message. Contributed by Arpit Gupta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231572 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 19:50:14 +00:00
Eli Collins 6b8bcfa916 HDFS-2788. HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231569 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 19:45:12 +00:00
Jitendra Nath Pandey 6234f3d91c HADOOP-2776. Missing interface annotation on JournalSet. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230412 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 06:21:05 +00:00
Harsh J dcea80a21b HDFS-69. Improve the 'dfsadmin' commandline help. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230398 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 05:13:19 +00:00
Tsz-wo Sze 1c8e3e8854 Add HDFS-2499 to CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229897 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 05:40:57 +00:00
Jitendra Nath Pandey 8faf7e8fb6 HDFS-2739. SecondaryNameNode doesn't start up.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229877 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 02:54:48 +00:00
Aaron Myers a7195bdd14 HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229028 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 04:53:20 +00:00
Harsh J 8819fda489 Merged HDFS-2349, HDFS-2729, HDFS-2726, HDFS-554, HDFS-1314, HADOOP-7910 to branch-0.23, updating CHANGES.txt for trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1228567 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 03:44:48 +00:00
Jitendra Nath Pandey 4efd3699a6 HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227887 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 23:03:31 +00:00
Alejandro Abdelnur 5f5561d057 Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227859 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 21:55:43 +00:00
Suresh Srinivas 472e971891 HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 18:57:01 +00:00
Harsh J 075122690c HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 14:15:15 +00:00
Harsh J 05ed36cd52 HDFS-2722. HttpFs should not be using an int for block size. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226861 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 16:47:49 +00:00
Harsh J 8e8203f3c5 HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226239 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 12:06:49 +00:00
Harsh J 11905517f1 HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226211 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 03:11:48 +00:00
Harsh J 6c349f9420 HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225591 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 16:51:59 +00:00
Harsh J 41737432c0 HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225456 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 07:22:54 +00:00
Alejandro Abdelnur ae0d48854d HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224794 13f79535-47bb-0310-9956-ffa450edef68
2011-12-26 19:37:25 +00:00
Alejandro Abdelnur 6b4f40cbf9 HttpFS server should check that upload requests have correct content-type. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 05:26:20 +00:00
Alejandro Abdelnur 8fe3dd3fea HDFS-2657. TestHttpFSServer and TestServerWebApp are failing on trunk. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221580 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:03:16 +00:00
Alejandro Abdelnur 45620eee68 HDFS-2646. Hadoop HttpFS introduced 4 findbug warnings. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221572 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 02:46:04 +00:00
Tsz-wo Sze 3503d9a4a8 HDFS-2706. Use configuration for blockInvalidateLimit if it is set.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221106 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 05:49:24 +00:00
Alejandro Abdelnur de928a4aa0 HDFS-2658. HttpFS introduced 70 javadoc warnings. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220810 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 15:53:53 +00:00
Eli Collins 5e185702ea HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 18:12:48 +00:00
Todd Lipcon a89baed833 HDFS-2553. Fix BlockPoolSliceScanner spinning in a tight loop. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220317 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 01:13:00 +00:00
Todd Lipcon fa1edc9a1e HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220315 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 01:10:49 +00:00
Suresh Srinivas 89553be90e HDFS-2687. Tests failing with ClassCastException post protobuf RPC changes. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:26:46 +00:00
Aaron Myers 52c1491155 HDFS-2694. Removal of Avro broke non-PB NN services. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215364 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:19:01 +00:00
Thomas White 9b7617a909 HDFS-2640. Javadoc generation hangs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215354 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:09:04 +00:00
Sanjay Radia d8dfcdcbc2 HDFS-2669 Enable protobuf rpc for ClientNamenodeProtocol
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214128 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 09:27:51 +00:00
Suresh Srinivas 60dd76c6ab HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214102 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:20:23 +00:00
Todd Lipcon b9238e3bad HDFS-2675. Reduce warning verbosity when double-closing edit logs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214098 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:13:55 +00:00
Eli Collins bdc2a77d6b HDFS-2649. eclipse:eclipse build fails for hadoop-hdfs-httpfs. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214046 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 03:42:24 +00:00
Jitendra Nath Pandey 3cffe34177 HDFS-2661. Enable protobuf RPC for DatanodeProtocol.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214033 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 02:15:37 +00:00
Tsz-wo Sze 433a6e78f6 HDFS-2545. Change WebHDFS to support multiple namenodes in federation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214027 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 01:47:57 +00:00
Suresh Srinivas 3954a2fb1c HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213985 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:31:44 +00:00
Suresh Srinivas 6a609cb471 Reverting the patch r1213981
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213984 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:27:58 +00:00
Jitendra Nath Pandey 1f2f4e105b HDFS-234. Integration with BookKeeper logging system. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213983 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:27:13 +00:00
Suresh Srinivas b5229fd19b HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213981 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:22:28 +00:00
Suresh Srinivas 3001a172c8 Reverting r1213512 because it committed changes that were not part of the patch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213980 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:17:02 +00:00
Suresh Srinivas f2f4e93413 HDFS-2650. Replace @inheritDoc with @Override. Contributed by Hari Mankude.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213813 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 18:07:29 +00:00
Suresh Srinivas 4ec8424e5d HDFS-2666. Fix TestBackupNode failure. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213808 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 17:59:37 +00:00
Eli Collins 5f39d6c239 HDFS-2654. Make BlockReaderLocal not extend RemoteBlockReader2. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213592 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 08:09:50 +00:00
Eli Collins 197634f2f7 HDFS-2653. DFSClient should cache whether addrs are non-local when short-circuiting is enabled. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213586 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 07:51:23 +00:00
Eli Collins 2892b058e0 Put HDFS-1765 in the right place in the changelog.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213541 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 02:23:07 +00:00
Eli Collins 43100e9c0e HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213537 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 01:58:25 +00:00
Suresh Srinivas 13345f3a85 HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213512 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 00:21:48 +00:00
Sanjay Radia 48da033901 HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213143 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 05:36:35 +00:00
Konstantin Shvachko 2c1ee1d342 Preparing for release 0.22.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213121 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 00:26:01 +00:00
Suresh Srinivas 2740112bb6 HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213040 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 18:53:21 +00:00
Alejandro Abdelnur e7682e1496 HDFS-2511. Add dev script to generate HDFS protobufs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212609 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 20:21:19 +00:00
Jitendra Nath Pandey 38a19bc293 HDFS-2642. Protobuf translators for DatanodeProtocol.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212606 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 20:02:33 +00:00
Tsz-wo Sze 9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 09:26:33 +00:00
Alejandro Abdelnur 3334306512 HDFS-2178. Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212060 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 19:25:28 +00:00
Sanjay Radia 9f69ae5a9e HDFS-2597 ClientNameNodeProtocol in Protocol Buffers (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211769 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 06:48:45 +00:00
Aaron Myers a27adf3de4 HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:47:13 +00:00
Suresh Srinivas c17bb83644 HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 01:05:56 +00:00
Suresh Srinivas 7a59150bff HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:19:10 +00:00
Suresh Srinivas 0a713035f2 HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 00:25:25 +00:00
Suresh Srinivas c256f8266d HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:52:23 +00:00
Jitendra Nath Pandey d18e5b3844 HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210602 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 20:10:27 +00:00
Sanjay Radia 65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:44:36 +00:00
Alejandro Abdelnur afbc3aa30c HDFS-2606. webhdfs client filesystem impl must set the content-type header for create/append. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208157 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 00:25:54 +00:00
Tsz-wo Sze 0398a9e88d HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 23:38:59 +00:00
Konstantin Shvachko 68f56ca906 HDFS-2287. Fix second assert.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 00:03:49 +00:00
Konstantin Shvachko 3083d7d7db Fix CHANGES.txt. Moving changes from 0.21.1 section to 0.22.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207709 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 00:00:20 +00:00
Konstantin Shvachko 82da8fb490 Fix CHANGES.txt. Some changes have been committed under 0.21.1 section rather than 0.22.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207706 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:53:49 +00:00
Konstantin Shvachko 32935d3e67 Fix CHANGES.txt for HDFS-2346 in trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207700 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:40:24 +00:00
Eli Collins b32543d9ae HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:20:16 +00:00
Konstantin Shvachko 49c44117f3 Fix typo in HDFS-993 commit. Was -933.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207676 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 22:51:45 +00:00
Tsz-wo Sze 91a75ad34f Fix WebHDFS capitalization in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207585 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 20:47:38 +00:00
Matthew Foley e9c2307838 HDFS-2316. Record completion of umbrella jira. Contributed by Tsz Wo (Nicholas), Sze.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206990 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 06:30:49 +00:00
Tsz-wo Sze 4b65d10cfe HDFS-2590. Fix the missing links in the WebHDFS forrest doc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206178 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 13:58:29 +00:00
Tsz-wo Sze d3a51478e3 HDFS-2587. Add apt doc for WebHDFS REST API.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 22:02:19 +00:00
Matthew Foley db092f5048 HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:15:37 +00:00
Tsz-wo Sze 7381884e85 HDFS-2552. Add Forrest doc for WebHDFS REST API.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205146 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 20:04:58 +00:00
Suresh Srinivas 49417594e8 HDFS-2519. Add protobuf service for DatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204825 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 06:25:13 +00:00
Tsz-wo Sze 2ab10e29d9 HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:57:04 +00:00
Konstantin Boudnik a2e66776a9 HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:15:49 +00:00
Suresh Srinivas 5293760973 HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 23:49:44 +00:00
Suresh Srinivas b76b85986e HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204709 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:11:43 +00:00
Suresh Srinivas 4754b80862 HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204707 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:10:04 +00:00
Todd Lipcon 39ce694d05 HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:27:00 +00:00
Todd Lipcon 68173af69d HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:03:31 +00:00
Suresh Srinivas 54ac7e5413 HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204544 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 15:39:33 +00:00
Eli Collins 9c2f4f634d HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 07:01:29 +00:00
Todd Lipcon 5bc66c4c86 HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 06:41:56 +00:00
Harsh J 67f25b0a1b HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 15:18:14 +00:00
Eli Collins 5573b691d5 HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:28:37 +00:00
Eli Collins 8686a00c7a HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:22:44 +00:00
Eli Collins 8e8bb50afd HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:27:59 +00:00
Eli Collins 513718f92d HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:13:32 +00:00
Eli Collins b2313021fd HDFS-2536. Remove unused imports. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:58:50 +00:00
Eli Collins 0e5c1a45bf HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:38:51 +00:00
Eli Collins 84f0c0f180 HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:29:20 +00:00
Eli Collins 7a8015c0e2 HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 02:51:50 +00:00
Eli Collins b7cd8c0f86 HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 02:34:25 +00:00
Todd Lipcon 1f92266516 HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 01:31:59 +00:00
Todd Lipcon 905a127850 HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 09:04:20 +00:00
Thomas White 6a01c22755 HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 05:10:40 +00:00
Thomas White dc5a0ab245 HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:53:46 +00:00
Todd Lipcon 0864ef1908 HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:45:31 +00:00
Todd Lipcon 9a3f147fdd HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:13:58 +00:00
Tsz-wo Sze 09a156fcce HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 04:19:45 +00:00
Tsz-wo Sze 94c631af1f HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 19:25:57 +00:00
Hairong Kuang 6dff9329d5 HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199024 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 00:16:23 +00:00
Tsz-wo Sze a590b498ac HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198903 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:05:16 +00:00
Tsz-wo Sze 6afe3e0d22 HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 22:34:47 +00:00
Todd Lipcon 40fe96546f HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:54:59 +00:00
Todd Lipcon fd8c757b9f Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196904 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:02:28 +00:00
Todd Lipcon 11cf658d0a HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196902 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:00:25 +00:00
Todd Lipcon f84552ac35 HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196889 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 00:35:37 +00:00
Hairong Kuang a4baabe4a4 HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 16:31:21 +00:00
Jitendra Nath Pandey bd21ddcb78 HDFS-2416. distcp with a webhdfs uri on a secure cluster fails.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 02:08:20 +00:00
Aaron Myers abe45f59ac HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 17:59:53 +00:00
Eli Collins 4961441584 HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:44:28 +00:00
Arun Murthy 4e42044b1c Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:46:22 +00:00
Konstantin Shvachko 22000ce96d HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:37:11 +00:00
Arun Murthy a3a4ccfed7 Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 06:02:53 +00:00
Todd Lipcon 1c940637b1 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:17:08 +00:00
Tsz-wo Sze 8d1a09b741 HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:38:57 +00:00
Todd Lipcon c46876982e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:53:58 +00:00
Tsz-wo Sze 32cad9affe HDFS-2385. Support renew and cancel delegation tokens in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey 7cb77a3b1b HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 19:03:55 +00:00
Konstantin Shvachko 64c019cccc HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195013 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 20:11:35 +00:00
Tsz-wo Sze 2eca60199a Revert 1190677 for HDFS-2509.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194986 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 19:31:06 +00:00
Tsz-wo Sze 2dcd43c7b1 HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190708 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 00:19:21 +00:00
Tsz-wo Sze c8ac31e9a0 HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190677 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 23:42:27 +00:00
Todd Lipcon 6b0963c53b HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190626 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 22:18:42 +00:00
Tsz-wo Sze 9692cfc9ae HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190491 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 18:28:26 +00:00
Sanjay Radia b49c95a5d9 HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190127 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:52:00 +00:00
Tsz-wo Sze 4a98639a55 Move HDFS-2355, HDFS-2371 and HDFS-2298 entries from trunk to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190126 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:48:12 +00:00
Tsz-wo Sze 8cb0d4b380 HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum".
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:13:26 +00:00
Todd Lipcon 221aadbc5b HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:47:19 +00:00
Todd Lipcon 646e855f6e HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190060 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:11:10 +00:00
Suresh Srinivas 456ca74b96 HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189901 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 18:09:42 +00:00
Tsz-wo Sze 10dc6b0927 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 00:02:19 +00:00
Tsz-wo Sze 753c14cf4e Move webhdfs entries from trunk to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 23:49:45 +00:00
Tsz-wo Sze 758194382c HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey 8534e70044 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:15:58 +00:00
Tsz-wo Sze 8335995630 HDFS-2501. Add version prefix and root methods to webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 05:16:57 +00:00
Suresh Srinivas a268a3c0e4 HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188487 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 01:32:49 +00:00
Suresh Srinivas 4846ca7863 HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188436 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 23:07:13 +00:00
Sanjay Radia 0920056f04 HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188300 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 19:08:03 +00:00
Suresh Srinivas 2b35e8aa4f HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188282 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 18:40:13 +00:00
Konstantin Shvachko 6e0991704f HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187965 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 20:17:04 +00:00
Steve Loughran 2690d0db0e HDFS-2485
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187887 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 14:13:58 +00:00
Konstantin Shvachko 7dd869c2a9 HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187837 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 00:35:55 +00:00
Suresh Srinivas d2e1a71918 HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187505 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 19:03:18 +00:00
Tsz-wo Sze 7c48130d41 HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187140 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 00:27:08 +00:00
Suresh Srinivas 520d2502c5 HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186896 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 16:31:57 +00:00
Suresh Srinivas 37137845c8 Merging change r1186579 for HDFS-2471 from 0.23 branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186584 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 00:38:42 +00:00
Arun Murthy a6cc9bafa8 HDFS-2445. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186550 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:51:51 +00:00
Tsz-wo Sze 0bd8f0bd40 HDFS-2453. Fix http response code for partial content in webhdfs, added getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem and cleared content type in ExceptionHandler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186508 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 21:38:58 +00:00
Alejandro Abdelnur 01d408d5b0 Reverted HDFS-2474
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186501 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 21:29:01 +00:00
Alejandro Abdelnur 2edd042f8a HDFS-2474. Make GlobFilter class public. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186498 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 21:17:35 +00:00
Owen O'Malley 073a13aeb1 HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation
tokens. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185842 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 20:33:16 +00:00
Jitendra Nath Pandey 8d4842383e HDFS-2188. Make FSEditLog create its journals from a list of URIs rather than NNStorage. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185354 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 20:23:57 +00:00
Tsz-wo Sze 50cb2771e9 HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing file or creating a file without specifying the replication parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183554 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 23:25:09 +00:00
Konstantin Shvachko 4cb7a4854d HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183457 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 18:31:55 +00:00
Jitendra Nath Pandey 002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:24:20 +00:00
Tsz-wo Sze c46dbedaf9 HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183175 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 00:30:30 +00:00
Tsz-wo Sze 5904e00b4f HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183098 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 21:06:41 +00:00
Tsz-wo Sze 7d1a5078b7 HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183081 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:41:00 +00:00
Mahadev Konar e123a37bf1 HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182694 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 07:13:54 +00:00
Aaron Myers c3792b4b3f Move line for HDFS-2422 under 0.23 instead of 0.24.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:26:26 +00:00
Harsh J 532872bf74 HDFS-2349. Corruption detected during block transfers should log WARNs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182205 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 04:48:52 +00:00
Aaron Myers f527f989af HDFS-2422. The NN should tolerate the same number of low-resource volumes as failed volumes (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181316 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 00:37:29 +00:00
Suresh Srinivas 676f488eff HDFS-2404. webhdfs liststatus json response is not correct. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180757 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 01:49:37 +00:00
Todd Lipcon 4cf6bc415f HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-09 03:59:21 +00:00
Steve Loughran 3ab2e79ad7 HDFS-2209 datanode connection failure logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180353 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 10:41:56 +00:00
Todd Lipcon 54e81464a3 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180202 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:28:39 +00:00
Alejandro Abdelnur 2b157c6b12 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180094 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 16:34:51 +00:00
Steve Loughran aace6cb631 HDFS-2209. Make MiniDFS easier to embed in other apps.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:30:32 +00:00
Alejandro Abdelnur 9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:10:31 +00:00
Sanjay Radia e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey 6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:30:06 +00:00
Tsz-wo Sze a2d7287873 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179856 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:17:19 +00:00
Tsz-wo Sze 1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:29:05 +00:00
Todd Lipcon 93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073.
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 22:05:42 +00:00
Tsz-wo Sze dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:49:00 +00:00
Doug Cutting f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 18:01:27 +00:00
Jitendra Nath Pandey 1ae5b5e338 HDFS-2158. Add JournalSet to manage the set of journals.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177473 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 01:14:37 +00:00
Suresh Srinivas e90a5b4043 HDFS-2371. Refactor BlockSender.java for better readability. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177161 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 04:40:15 +00:00
Suresh Srinivas e9dd78d9fe HDFS-2355. Federation: enable using the same configuration file across all the nodes in the cluster. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177100 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 22:58:10 +00:00
Aaron Myers 484649acfe Removing entry for CHANGES.txt since this was back-ported to 0.23.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177020 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 19:01:32 +00:00
Aaron Myers 08db2a139d HDFS-2346. TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods (Laxman via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176994 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 18:06:26 +00:00
Tsz-wo Sze 96f9fc9199 HDFS-2363. Move datanodes size printing from FSNamesystem.metasave(..) to BlockManager. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176733 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 05:49:17 +00:00
Jitendra Nath Pandey 825f9c80a4 HDFS-2361. hftp is broken, fixed username checks in JspHelper.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176729 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 05:29:09 +00:00
Tsz-wo Sze 59265d6ed8 HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to hdfs-site.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176719 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 04:51:29 +00:00
Todd Lipcon eb3a692a57 HDFS-2332. Add test for HADOOP-7629 (using an immutable FsPermission object as an RPC parameter fails). Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176692 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 03:00:59 +00:00
Suresh Srinivas 201b7879ba HDFS-2373. Commands using webhdfs and hftp print unnecessary debug info on the console with security enabled. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176654 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 23:16:17 +00:00
Tsz-wo Sze bf78f15ffb HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176178 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 02:43:37 +00:00
Konstantin Shvachko 5a6f8e38c0 HDFS-2290. Block with corrupt replica is not getting replicated. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175175 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 15:04:34 +00:00
Tsz-wo Sze 83a83d3b73 HDFS-2356. Support case insensitive query parameter names in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175113 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 06:15:50 +00:00
Tsz-wo Sze d773bf0fb5 HDFS-46. Change default namespace quota of root directory from Integer.MAX_VALUE to Long.MAX_VALUE. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173990 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 08:25:20 +00:00
Sanjay Radia 7d8e9d6960 HADOOP-7524 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173488 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 04:25:55 +00:00
Tsz-wo Sze 4dc4e9e63f HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173468 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 02:56:08 +00:00
Matthew Foley 9d14f100c8 HDFS-2347. Fix checkpointTxnCount's comment about editlog size. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172916 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 00:26:32 +00:00
Tsz-wo Sze e34d2c075d HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172219 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 08:30:47 +00:00
Tsz-wo Sze dafa8f7a77 HDFS-362. FSEditLog should not writes long and short as UTF8, and should not use ArrayWritable for writing non-array items. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171945 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 10:53:44 +00:00
Aaron Myers a89d4609b2 HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171711 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 18:38:32 +00:00
Tsz-wo Sze ff44372895 Revised the entry for HDFS-2318 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171615 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 15:05:25 +00:00
Tsz-wo Sze 78e3821b81 HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation tokens.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171611 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 15:02:30 +00:00
Tsz-wo Sze cde0e484e7 HDFS-2338. Add configuration option to enable/disable webhdfs. Contributed by jitendra
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 04:01:51 +00:00
Tsz-wo Sze 376a1a2511 HDFS-2333. Change DFSOutputStream back to package private, otherwise, there are two SC_START_IN_CTOR findbugs warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171136 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 15:28:23 +00:00
Tsz-wo Sze be2b0921fa HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK version < 1.6.0_26. Contributed by Abhijit Suresh Shingate
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170996 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 08:04:46 +00:00
Thomas White e4dc2e1f56 HDFS-2323. start-dfs.sh script fails for tarball install
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170233 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 16:53:57 +00:00
Tsz-wo Sze 6c3b59505b HDFS-2317. Support read access to HDFS in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170085 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 08:34:27 +00:00
Tsz-wo Sze 61d0b7530c HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http access to HDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167662 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 01:41:42 +00:00
Konstantin Shvachko 8b9a2c7487 HDFS-2232. Generalize regular expressions in TestHDFSCLI. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166470 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 23:37:56 +00:00
Todd Lipcon 06e84a1bca HDFS-2223. Untangle depencencies between NN components. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166466 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 23:23:24 +00:00
Todd Lipcon 42d443fb79 HDFS-2314. MRV1 test compilation broken after HDFS-2197. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165860 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:25:35 +00:00
Jitendra Nath Pandey bdc3720d5b HDFS-2018. Move all journal stream management code into one place. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165826 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 20:27:38 +00:00
Aaron Myers 9e95326a2c HDFS-2313. Rat excludes has a typo for excluding editsStored files. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165477 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 01:51:30 +00:00
Todd Lipcon b0632df93a HDFS-2197. Refactor RPC call implementations out of NameNode class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165463 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 00:41:47 +00:00
Todd Lipcon d1438b501d HDFS-2310. TestBackupNode fails since HADOOP-7524 went in. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165461 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 00:34:57 +00:00
Aaron Myers 8ae98a9d1c HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants -> HdfsConstants. (Harsh J Chouraria via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165096 13f79535-47bb-0310-9956-ffa450edef68
2011-09-04 19:30:12 +00:00
Sanjay Radia b97a4d40c8 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
2011-09-03 00:31:05 +00:00
Aaron Myers 2566043c2f HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164624 13f79535-47bb-0310-9956-ffa450edef68
2011-09-02 16:47:59 +00:00
Aaron Myers c5ef34a1e7 Revert 1164192 given review feedback provided after initial commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164199 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 18:25:51 +00:00
Aaron Myers d873f1155a HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164192 13f79535-47bb-0310-9956-ffa450edef68
2011-09-01 18:07:38 +00:00
Konstantin Shvachko 4f1a0e36fa HDFS-2258. Reset lease limits to default values in TestLeaseRecovery2. Contributed by Konstantin Shvachko
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163821 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 21:18:37 +00:00
Matthew Foley 1cd3791172 HDFS-1330 and HADOOP-6889. Added additional unit tests. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163463 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 00:58:19 +00:00
Tsz-wo Sze aba0e225fc HDFS-1217. Change some NameNode methods from public to package private. Constributed by Laxman
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163081 13f79535-47bb-0310-9956-ffa450edef68
2011-08-30 04:02:22 +00:00
Arun Murthy 8b56463315 HDFS-2289. Ensure jsvc is bundled with the HDFS distribution artifact. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162421 13f79535-47bb-0310-9956-ffa450edef68
2011-08-27 19:07:04 +00:00
Todd Lipcon 23e7fc4f46 HDFS-2287. TestParallelRead has a small off-by-one bug. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162005 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 06:51:57 +00:00
Todd Lipcon 7cf49f5d9c HDFS-2286. DataXceiverServer logs AsynchronousCloseException at shutdown. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162003 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 06:44:13 +00:00
Hairong Kuang 73451ed2d9 HDFS-395. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161992 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:46:42 +00:00
Hairong Kuang 522fe14a89 Move change log for HDFS-395 from 0.23 section to trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161987 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:16:20 +00:00
Hairong Kuang e6339be188 HDFS-349. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161976 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 03:10:13 +00:00
Arun Murthy a44ffcc0be Preparing for hadoop-0.24.0 development.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:32:04 +00:00
Arun Murthy ee05510c42 Preparing for release 0.23.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:39:15 +00:00
Arun Murthy cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:14:24 +00:00