Commit Graph

84 Commits

Author SHA1 Message Date
Konstantin Shvachko 4cb7a4854d HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183457 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 18:31:55 +00:00
Jitendra Nath Pandey 002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:24:20 +00:00
Tsz-wo Sze c46dbedaf9 HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183175 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 00:30:30 +00:00
Tsz-wo Sze 5904e00b4f HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183098 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 21:06:41 +00:00
Tsz-wo Sze 7d1a5078b7 HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183081 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:41:00 +00:00
Mahadev Konar e123a37bf1 HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182694 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 07:13:54 +00:00
Aaron Myers c3792b4b3f Move line for HDFS-2422 under 0.23 instead of 0.24.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:26:26 +00:00
Harsh J 532872bf74 HDFS-2349. Corruption detected during block transfers should log WARNs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182205 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 04:48:52 +00:00
Aaron Myers f527f989af HDFS-2422. The NN should tolerate the same number of low-resource volumes as failed volumes (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181316 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 00:37:29 +00:00
Suresh Srinivas 676f488eff HDFS-2404. webhdfs liststatus json response is not correct. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180757 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 01:49:37 +00:00
Todd Lipcon 4cf6bc415f HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-09 03:59:21 +00:00
Steve Loughran 3ab2e79ad7 HDFS-2209 datanode connection failure logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180353 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 10:41:56 +00:00
Todd Lipcon 54e81464a3 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180202 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:28:39 +00:00
Alejandro Abdelnur 2b157c6b12 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180094 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 16:34:51 +00:00
Steve Loughran aace6cb631 HDFS-2209. Make MiniDFS easier to embed in other apps.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:30:32 +00:00
Alejandro Abdelnur 9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:10:31 +00:00
Sanjay Radia e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey 6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:30:06 +00:00
Tsz-wo Sze a2d7287873 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179856 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:17:19 +00:00
Tsz-wo Sze 1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:29:05 +00:00
Eric Yang 3edf3579c8 HADOOP-7684. Added init.d script for jobhistory server and
secondary namenode. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:44:08 +00:00
Eric Yang abc2b45dfa HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:13:58 +00:00
Todd Lipcon 93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073.
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 22:05:42 +00:00
Tsz-wo Sze dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:49:00 +00:00
Doug Cutting f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 18:01:27 +00:00
Jitendra Nath Pandey 1ae5b5e338 HDFS-2158. Add JournalSet to manage the set of journals.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177473 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 01:14:37 +00:00
Suresh Srinivas e90a5b4043 HDFS-2371. Refactor BlockSender.java for better readability. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177161 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 04:40:15 +00:00
Suresh Srinivas e9dd78d9fe HDFS-2355. Federation: enable using the same configuration file across all the nodes in the cluster. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177100 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 22:58:10 +00:00
Aaron Myers 484649acfe Removing entry for CHANGES.txt since this was back-ported to 0.23.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177020 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 19:01:32 +00:00
Aaron Myers 08db2a139d HDFS-2346. TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods (Laxman via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176994 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 18:06:26 +00:00
Tsz-wo Sze 96f9fc9199 HDFS-2363. Move datanodes size printing from FSNamesystem.metasave(..) to BlockManager. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176733 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 05:49:17 +00:00
Jitendra Nath Pandey 825f9c80a4 HDFS-2361. hftp is broken, fixed username checks in JspHelper.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176729 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 05:29:09 +00:00
Tsz-wo Sze 59265d6ed8 HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to hdfs-site.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176719 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 04:51:29 +00:00
Todd Lipcon eb3a692a57 HDFS-2332. Add test for HADOOP-7629 (using an immutable FsPermission object as an RPC parameter fails). Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176692 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 03:00:59 +00:00
Suresh Srinivas 201b7879ba HDFS-2373. Commands using webhdfs and hftp print unnecessary debug info on the console with security enabled. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176654 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 23:16:17 +00:00
Tsz-wo Sze bf78f15ffb HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176178 13f79535-47bb-0310-9956-ffa450edef68
2011-09-27 02:43:37 +00:00
Konstantin Shvachko 5a6f8e38c0 HDFS-2290. Block with corrupt replica is not getting replicated. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175175 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 15:04:34 +00:00
Tsz-wo Sze 83a83d3b73 HDFS-2356. Support case insensitive query parameter names in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175113 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 06:15:50 +00:00
Tsz-wo Sze d773bf0fb5 HDFS-46. Change default namespace quota of root directory from Integer.MAX_VALUE to Long.MAX_VALUE. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173990 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 08:25:20 +00:00
Sanjay Radia 7d8e9d6960 HADOOP-7524 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173488 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 04:25:55 +00:00
Tsz-wo Sze 4dc4e9e63f HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173468 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 02:56:08 +00:00
Matthew Foley 9d14f100c8 HDFS-2347. Fix checkpointTxnCount's comment about editlog size. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172916 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 00:26:32 +00:00
Tsz-wo Sze e34d2c075d HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172219 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 08:30:47 +00:00
Tsz-wo Sze dafa8f7a77 HDFS-362. FSEditLog should not writes long and short as UTF8, and should not use ArrayWritable for writing non-array items. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171945 13f79535-47bb-0310-9956-ffa450edef68
2011-09-17 10:53:44 +00:00
Aaron Myers a89d4609b2 HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171711 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 18:38:32 +00:00
Tsz-wo Sze ff44372895 Revised the entry for HDFS-2318 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171615 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 15:05:25 +00:00
Tsz-wo Sze 78e3821b81 HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation tokens.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171611 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 15:02:30 +00:00
Tsz-wo Sze cde0e484e7 HDFS-2338. Add configuration option to enable/disable webhdfs. Contributed by jitendra
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 04:01:51 +00:00
Tsz-wo Sze 376a1a2511 HDFS-2333. Change DFSOutputStream back to package private, otherwise, there are two SC_START_IN_CTOR findbugs warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171136 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 15:28:23 +00:00
Tsz-wo Sze be2b0921fa HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK version < 1.6.0_26. Contributed by Abhijit Suresh Shingate
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170996 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 08:04:46 +00:00