Commit Graph

1695 Commits

Author SHA1 Message Date
Arun Murthy 69dd284452 MAPREDUCE-3290. Fixed a NPE in ClientRMService.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190162 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 05:45:59 +00:00
Arun Murthy 34e6de8f85 MAPREDUCE-3258. Fixed AM & JobHistory web-ui to display counters properly. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190160 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 05:08:04 +00:00
Mahadev Konar 9b34900c89 MAPREDUCE-3209. Jenkins reports 160 FindBugs warnings (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190140 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:42:11 +00:00
Eli Collins 29b51cc116 HADOOP-7424. Log an error if the topology script doesn't handle multiple args. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190139 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:26:54 +00:00
Tsz-wo Sze 037964f45c Move HADOOP-7668, HADOOP-7509, HADOOP-7745, MAPREDUCE-2764, HADOOP-7766 and HADOOP-7721 entries from trunk to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190132 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:05:52 +00:00
Arun Murthy 3cccbc9e16 MAPREDUCE-2736. Removing bin/(start,stop)-mapred.sh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190129 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:00:03 +00:00
Arun Murthy caf07897a7 MAPREDUCE-2736. Resurrecting bin/mapred and bin/mapred-config.sh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190128 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:56:57 +00:00
Sanjay Radia b49c95a5d9 HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190127 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:52:00 +00:00
Tsz-wo Sze 4a98639a55 Move HDFS-2355, HDFS-2371 and HDFS-2298 entries from trunk to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190126 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:48:12 +00:00
Mahadev Konar b304062f1f MAPREDUCE-3186. User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190122 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:40:24 +00:00
Mahadev Konar 35b62e6e72 MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190110 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:16:29 +00:00
Tsz-wo Sze 659ea4c540 HADOOP-7360. Preserve relative paths that do not contain globs in FsShell. Contributed by Daryn Sharp and Kihwal Lee
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190109 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:13:49 +00:00
Thomas White 101962e598 HADOOP-7778. FindBugs warning in Token.getKind().
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190095 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:50:11 +00:00
Aaron Myers efb2d93f77 HDFS-2393. Mark appropriate methods of ClientProtocol with the idempotent annotation. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190088 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:26:44 +00:00
Arun Murthy 739acd6e14 MAPREDUCE-3284. Moved JobQueueClient to hadoop-mapreduce-client-core.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190084 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:21:09 +00:00
Aaron Myers 180646dea3 HDFS-2418. Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:15:07 +00:00
Tsz-wo Sze 8cb0d4b380 HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum".
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:13:26 +00:00
Todd Lipcon 221aadbc5b HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:47:19 +00:00
Todd Lipcon 78336e717b HADOOP-7753. Support fadvise and sync_file_range in NativeIO. Add ReadaheadPool infrastructure for use in HDFS and MR. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190067 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:19:13 +00:00
Todd Lipcon 646e855f6e HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190060 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:11:10 +00:00
Todd Lipcon ebb6cc60c4 HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190059 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:10:58 +00:00
Ramya Sunil 072ef952c3 HADOOP-7728. Enable task memory management to be configurable in hadoop config setup script. (ramya)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190035 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 21:11:16 +00:00
Vinod Kumar Vavilapalli b9f6890db9 MAPREDUCE-3281. Fixed one more bug due to which TestLinuxContainerExecutorWithMocks was failing. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 20:38:40 +00:00
Eli Collins 1ad8415b72 MAPREDUCE-2736. Remove unused contrib components dependent on MR1. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189982 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 20:06:26 +00:00
Eli Collins 48339bacdd HADOOP-7762. Common side of MR-2736. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189932 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 18:52:55 +00:00
Suresh Srinivas 456ca74b96 HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189901 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 18:09:42 +00:00
Arun Murthy 724f217343 MAPREDUCE-3228. Fixed MR AM to timeout RPCs to bad NodeManagers. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189879 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 17:32:02 +00:00
Steve Loughran a3c0a0e799 HADOOP-7772
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189847 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 16:29:44 +00:00
Vinod Kumar Vavilapalli 1b8511ef89 MAPREDUCE-3281. Fixed a bug in TestLinuxContainerExecutorWithMocks. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189818 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 15:55:41 +00:00
Vinod Kumar Vavilapalli f114dad5ef MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by Anupam Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189721 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:42:12 +00:00
Vinod Kumar Vavilapalli 2fe343f963 MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189711 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:03:17 +00:00
Arun Murthy f799e61269 MAPREDUCE-3279. Fixed TestJobHistoryParsing which assumed user name to be mapred all the time. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189670 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:31:44 +00:00
Arun Murthy fc74b5a25c MAPREDUCE-3259. Added java.library.path of NodeManager to ContainerLocalizer in LinuxContainerExecutor. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189667 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:28:34 +00:00
Arun Murthy db8ac0ec3c MAPREDUCE-3257. Added authorization checks for the protocol between ResourceManager and ApplicatoinMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189630 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:24:22 +00:00
Arun Murthy 5fadd4de2a MAPREDUCE-3175. Add authorization to admin web-pages such as /stacks, /jmx etc. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189619 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:11:08 +00:00
Mahadev Konar 33dc6578de MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically. (acmurthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189616 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:04:17 +00:00
Todd Lipcon 0e75187199 HADOOP-7761. Improve the performance of raw comparisons. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189613 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 05:59:05 +00:00
Arun Murthy 3e4efbb609 MAPREDUCE-3254. Fixed streaming to set the job.jar by using the right JobConf ctor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189587 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 02:47:07 +00:00
Thomas White e51c3a18ec HADOOP-7768. PreCommit-HADOOP-Build is failing on hadoop-auth-examples
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189552 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 00:13:31 +00:00
Tsz-wo Sze 10dc6b0927 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 00:02:19 +00:00
Arun Murthy 237154982b MAPREDUCE-3205. Fix memory specifications to be physical rather than virtual, allowing for a ratio between the two to be configurable. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189542 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 23:58:31 +00:00
Tsz-wo Sze 753c14cf4e Move webhdfs entries from trunk to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 23:49:45 +00:00
Tsz-wo Sze 758194382c HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey 2ce817aecf HADOOP-7766. The auth to local mappings are not being respected, with webhdfs and security enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189357 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:20:07 +00:00
Jitendra Nath Pandey 8534e70044 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:15:58 +00:00
Arun Murthy 46676b322b HADOOP-7764. Allow HttpServer to set both ACL list and path spec filters. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189314 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 17:04:45 +00:00
Arun Murthy 8aabd3d4e6 MAPREDUCE-2858. Added a WebApp Proxy for applications. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189036 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 06:29:21 +00:00
Tsz-wo Sze 8335995630 HDFS-2501. Add version prefix and root methods to webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 05:16:57 +00:00
Mahadev Konar 2adc51c618 MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189023 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 04:31:28 +00:00
Arun Murthy 29c6c3ed32 MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for applications.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189012 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:53:22 +00:00