Commit Graph

322 Commits

Author SHA1 Message Date
Arun Murthy e5badc0c1a Fixing CHANGES.txt to reflect 0.23 content.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195766 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:09:51 +00:00
Arun Murthy d36f847b87 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:00:58 +00:00
Mahadev Konar 68fa208b1c MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195761 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:51:56 +00:00
Arun Murthy b451dd7aaa MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195745 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:04:15 +00:00
Arun Murthy 5f7e991659 MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195743 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:57:22 +00:00
Arun Murthy b3f90c7060 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:33:29 +00:00
Arun Murthy 9db078212f MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:27:42 +00:00
Amar Kamat 7e056015ad MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195535 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 15:51:32 +00:00
Vinod Kumar Vavilapalli 21b1e1da49 MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195416 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 11:29:23 +00:00
Vinod Kumar Vavilapalli a75c4cf4e4 MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195383 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 09:55:29 +00:00
Vinod Kumar Vavilapalli 47a381e306 MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195349 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 06:42:06 +00:00
Vinod Kumar Vavilapalli 5f9e67e226 MAPREDUCE-2766. Fixed NM to set secure permissions for files and directories in distributed-cache. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195340 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 05:51:33 +00:00
Vinod Kumar Vavilapalli 273e092c93 MAPREDUCE-3313. Fixed initialization of ClusterMetrics which was failing TestResourceTrackerService sometimes. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 03:30:56 +00:00
Vinod Kumar Vavilapalli 1c8d64f38a MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195145 13f79535-47bb-0310-9956-ffa450edef68
2011-10-30 11:29:41 +00:00
Arun Murthy 7f4dc27757 MAPREDUCE-3256. Added authorization checks for the protocol between NodeManager and ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194850 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 09:35:36 +00:00
Alejandro Abdelnur 1bcff6860c Adding missing CHANGES.txt entry for MAPREDUCE-3014
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190585 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:27:08 +00:00
Vinod Kumar Vavilapalli c1e333f32f MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing NodeManager to crash. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190523 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 19:45:57 +00:00
Arun Murthy b93abdcd66 MAPREDUCE-3304. Fixed intermittent test failure due to a race in TestRMContainerAllocator#testBlackListedNodes. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190495 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 18:45:48 +00:00
Vinod Kumar Vavilapalli cbdb07f4ca MAPREDUCE-2775. Fixed ResourceManager and NodeManager to force a decommissioned node to shutdown. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190467 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 17:31:06 +00:00
Vinod Kumar Vavilapalli a39992ea63 MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 07:44:35 +00:00
Vinod Kumar Vavilapalli 670fa24b48 MAPREDUCE-2989. Modified JobHistory to link to task and AM logs from the JobHistoryServer. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:45:04 +00:00
Mahadev Konar 47c28ce14d MAPREDUCE-3292. In secure mode job submission fails with Provider org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier not found. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190171 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:13:18 +00:00
Mahadev Konar 062876bed7 MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190165 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 06:04:51 +00:00
Arun Murthy 69dd284452 MAPREDUCE-3290. Fixed a NPE in ClientRMService.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190162 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 05:45:59 +00:00
Arun Murthy 34e6de8f85 MAPREDUCE-3258. Fixed AM & JobHistory web-ui to display counters properly. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190160 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 05:08:04 +00:00
Mahadev Konar 9b34900c89 MAPREDUCE-3209. Jenkins reports 160 FindBugs warnings (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190140 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 02:42:11 +00:00
Mahadev Konar b304062f1f MAPREDUCE-3186. User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190122 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:40:24 +00:00
Mahadev Konar 35b62e6e72 MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190110 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:16:29 +00:00
Arun Murthy 739acd6e14 MAPREDUCE-3284. Moved JobQueueClient to hadoop-mapreduce-client-core.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190084 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:21:09 +00:00
Eli Collins 1ad8415b72 MAPREDUCE-2736. Remove unused contrib components dependent on MR1. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189982 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 20:06:26 +00:00
Arun Murthy 724f217343 MAPREDUCE-3228. Fixed MR AM to timeout RPCs to bad NodeManagers. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189879 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 17:32:02 +00:00
Vinod Kumar Vavilapalli 1b8511ef89 MAPREDUCE-3281. Fixed a bug in TestLinuxContainerExecutorWithMocks. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189818 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 15:55:41 +00:00
Vinod Kumar Vavilapalli f114dad5ef MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by Anupam Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189721 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:42:12 +00:00
Vinod Kumar Vavilapalli 2fe343f963 MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189711 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:03:17 +00:00
Arun Murthy f799e61269 MAPREDUCE-3279. Fixed TestJobHistoryParsing which assumed user name to be mapred all the time. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189670 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:31:44 +00:00
Arun Murthy fc74b5a25c MAPREDUCE-3259. Added java.library.path of NodeManager to ContainerLocalizer in LinuxContainerExecutor. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189667 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:28:34 +00:00
Arun Murthy db8ac0ec3c MAPREDUCE-3257. Added authorization checks for the protocol between ResourceManager and ApplicatoinMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189630 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:24:22 +00:00
Arun Murthy 5fadd4de2a MAPREDUCE-3175. Add authorization to admin web-pages such as /stacks, /jmx etc. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189619 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:11:08 +00:00
Mahadev Konar 33dc6578de MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically. (acmurthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189616 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:04:17 +00:00
Arun Murthy 3e4efbb609 MAPREDUCE-3254. Fixed streaming to set the job.jar by using the right JobConf ctor.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189587 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 02:47:07 +00:00
Arun Murthy 237154982b MAPREDUCE-3205. Fix memory specifications to be physical rather than virtual, allowing for a ratio between the two to be configurable. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189542 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 23:58:31 +00:00
Arun Murthy 8aabd3d4e6 MAPREDUCE-2858. Added a WebApp Proxy for applications. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189036 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 06:29:21 +00:00
Mahadev Konar 2adc51c618 MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189023 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 04:31:28 +00:00
Arun Murthy 29c6c3ed32 MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for applications.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189012 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:53:22 +00:00
Arun Murthy 03659985a0 MAPREDUCE-3269. Fixed log4j properties to correctly set logging options for JobHistoryServer vis-a-vis JobSummary logs. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188999 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:16:19 +00:00
Arun Murthy 7dcef364a9 MAPREDUCE-3263. Fixed the MAPREDUCE-3028 commit which broke MR1. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188997 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:12:50 +00:00
Arun Murthy 2486e4eb09 MAPREDUCE-3253. Fixed ContextFactory to clone JobContext correctly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188842 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 18:14:12 +00:00
Arun Murthy fffdf661e3 MAPREDUCE-2821. Added missing fields (resourcePerMap & resourcePerReduce) to JobSummary logs. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188528 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:26:14 +00:00
Mahadev Konar d19cfe0164 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:07:13 +00:00
Arun Murthy c70ee2488c MAPREDUCE-3248. Fixed log4j properties. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188476 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 01:03:08 +00:00
Arun Murthy 6217e54718 MAPREDUCE-3159. Ensure DefaultContainerExecutor doesn't delete application directories during app-init. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188466 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 00:36:19 +00:00
Todd Lipcon 43553df4e3 MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188424 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 22:33:02 +00:00
Arun Murthy a503755990 MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188388 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:19:31 +00:00
Arun Murthy 6288dfa873 MAPREDUCE-3028. Added job-end notification support. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188377 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:02:43 +00:00
Vinod Kumar Vavilapalli 7ce1c4ab35 MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188236 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 17:09:37 +00:00
Vinod Kumar Vavilapalli 4086566144 MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188043 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 08:41:48 +00:00
Vinod Kumar Vavilapalli 977d7cc5b9 MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187669 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 08:11:47 +00:00
Vinod Kumar Vavilapalli 665a90cbf3 MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187658 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:46:12 +00:00
Vinod Kumar Vavilapalli 5795fcfd99 MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187654 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:14:46 +00:00
Mahadev Konar e175574635 MAPREDUCE-3242. Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187587 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 22:44:39 +00:00
Mahadev Konar 4186121c08 MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187556 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 21:36:58 +00:00
Arun Murthy 89e7ca6a52 MAPREDUCE-3070. Fix NodeManager to use ephemeral ports by default. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187496 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:47:39 +00:00
Mahadev Konar 45b2bce871 MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187491 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:35:35 +00:00
Todd Lipcon 5945a05eee MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187183 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 05:20:27 +00:00
Arun Murthy 02d5fa3e62 MAPREDUCE-3226. Fix shutdown of fetcher threads. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187116 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 22:44:38 +00:00
Alejandro Abdelnur 49baada6cc MAPREDUCE-3204. mvn site:site fails on MapReduce. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187062 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 21:38:58 +00:00
Vinod Kumar Vavilapalli df2991c0cb MAPREDUCE-3104. Implemented Application-acls. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186748 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 11:45:38 +00:00
Arun Murthy aeae1ba497 MAPREDUCE-3188. Ensure correct shutdown in services. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186554 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:59:30 +00:00
Arun Murthy fc362b1caf MAPREDUCE-3179. Ensure failed tests exit with right error code. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186552 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:54:23 +00:00
Arun Murthy 7a2744c458 MAPREDUCE-3212. Fix usage/help message for bin/yarn. Contributed by Bhallamudi Venkata Siva Kamesh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186546 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:43:01 +00:00
Arun Murthy 7ca7fdadc4 MAPREDUCE-3208. Fix NPE task/container log appenders. Contributed by liangzhwa.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186542 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:38:17 +00:00
Arun Murthy 74748ec625 MAPREDUCE-2693. Fix NPE in job-blacklisting. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186529 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:02:21 +00:00
Jitendra Nath Pandey ba66ca6856 MAPREDUCE-3149. Add a test to verify that TokenCache handles file system uri with no authority. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186516 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 21:52:50 +00:00
Arun Murthy e549ac9369 MAPREDUCE-2788. Normalize resource requests in FifoScheduler appropriately. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186467 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:37:01 +00:00
Arun Murthy 9473b2e43f MAPREDUCE-3181. Fixed MapReduce runtime to load yarn-default.xml and yarn-site.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186458 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:28:11 +00:00
Vinod Kumar Vavilapalli 94e1703b72 MAPREDUCE-3176. Fixed ant mapreduce tests that are timing out because of wrong framework name. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186368 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 17:55:08 +00:00
Vinod Kumar Vavilapalli e3bb120e9f MAPREDUCE-3162. Separated application-init and container-init event types in NodeManager's Application state machine. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185988 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 06:40:03 +00:00
Vinod Kumar Vavilapalli 13e4562924 MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185976 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 05:21:18 +00:00
Vinod Kumar Vavilapalli 3e3abcb769 MAPREDUCE-3199. Fixed pom files to include correct log4j configuration for tests. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185967 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 04:30:27 +00:00
Mahadev Konar b4d20c707a MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185909 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 22:46:42 +00:00
Arun Murthy ab787f44aa MAPREDUCE-3165. Ensure logging options are set correctly for MR AM and tasks. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185887 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:45:38 +00:00
Arun Murthy 51a667bef8 MAPREDUCE-2762. Cleanup MR staging directory on completion. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185880 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:37:31 +00:00
Arun Murthy bb00ab68c3 MAPREDUCE-279. Adding a changelog to branch-0.23.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185488 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 05:30:32 +00:00
Mahadev Konar 9ff7c1b1de MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185486 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 05:08:32 +00:00
Arun Murthy c1d90772b6 MAPREDUCE-3068. Added a whitelist of environment variables for containers from the NodeManager and set MALLOC_ARENA_MAX for all daemons and containers. Contributed by Chris Riccomini.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185447 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 01:22:14 +00:00
Mahadev Konar 955d8eca21 MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX. (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185417 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 22:41:26 +00:00
Alejandro Abdelnur 15a1d9af19 MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 17:06:42 +00:00
Vinod Kumar Vavilapalli a26b1672a8 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185247 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 15:17:06 +00:00
Arun Murthy 9f36bdd731 MAPREDUCE-3127. Fixed CHANGES.txt to reflect correct jira.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184992 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 04:22:28 +00:00
Arun Murthy 6b2f3dd5ce MAPREDUCE-3101. Changed default value of yarn.resourcemanager.acl.enable to true and added some more documentation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184989 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 04:08:36 +00:00
Mahadev Konar 29f65be3e2 MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184979 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:22:16 +00:00
Arun Murthy 86e1c9536f MAPREDUCE-3136. Added documentation for setting up Hadoop clusters in both non-secure and secure mode for both HDFS & YARN.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184977 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:18:06 +00:00
Arun Murthy 4872615441 MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. Contributed by todd & acmurthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:14:10 +00:00
Mahadev Konar 94b3bf9f75 MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184971 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 01:19:51 +00:00
Mahadev Konar 68328ae926 MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184904 13f79535-47bb-0310-9956-ffa450edef68
2011-10-16 19:27:02 +00:00
Mahadev Konar b5e21e7e63 MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183545 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:49:19 +00:00
Mahadev Konar b3284c4607 MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183540 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:38:52 +00:00
Jitendra Nath Pandey 57f99c2b02 MAPREDUCE-3192. Fix Javadoc warning in JobClient.java and Cluster.java.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183513 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 21:49:35 +00:00
Arun Murthy 09eb725c06 MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:27:10 +00:00
Jitendra Nath Pandey 002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:24:20 +00:00