Commit Graph

129 Commits

Author SHA1 Message Date
Arun Murthy 4499878392 Merge -c 1189879 from trunk to branch-0.23 to fix MAPREDUCE-3228.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189880 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 17:32:39 +00:00
Vinod Kumar Vavilapalli 28676b5345 MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by Anupam Seth.
svn merge -c r1189721 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189723 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:44:57 +00:00
Vinod Kumar Vavilapalli c5028eaa38 MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189713 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 12:06:08 +00:00
Arun Murthy d5ae121690 Merge -c 1189670 from trunk to branch-0.23 to fix MAPREDUCE-3279.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189672 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 08:32:18 +00:00
Arun Murthy 23eb484fa1 Merge -c 1189630 from trunk to branch-0.23 to fix MAPREDUCE-3257.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189631 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:25:07 +00:00
Mahadev Konar 43ef9dbcb5 MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically. (acmurthy via mahadev) - Merging r1189616 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189617 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 06:06:30 +00:00
Arun Murthy b211fc72cc Merge -c 1189036 from trunk to branch-0.23 to fix for MAPREDUCE-2858.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189037 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 06:32:26 +00:00
Mahadev Konar 383b8ed9d9 MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev) - Merging r1189023 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189024 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 04:35:40 +00:00
Arun Murthy b0384fc087 Merge -c 1189012 from trunk to branch-0.23 to complete fix for MAPREDUCE-2977.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1189013 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 02:58:00 +00:00
Arun Murthy d22a142f94 Merge -c 1188842 from trunk to branch-0.23 to complete fix for MAPREDUCE-3253.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188843 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 18:14:45 +00:00
Arun Murthy 1bef05715d Merge -c 1188528 from trunk to branch-0.23 to complete fix for MAPREDUCE-2821.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188529 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:27:24 +00:00
Mahadev Konar ddccefbefb MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) - Merging r1188522 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188524 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:12:14 +00:00
Arun Murthy 1527edc627 Merge -c 1188388 from trunk to branch-0.23 to complete fix for MAPREDUCE-3252.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188467 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 00:41:52 +00:00
Todd Lipcon 21ded50c4d MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188423 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 22:32:47 +00:00
Arun Murthy 28d52eabfa Merge -c 1188377 from trunk to branch-0.23 to complete fix for MAPREDUCE-3028.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188378 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 21:03:22 +00:00
Vinod Kumar Vavilapalli df7a66844b MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188261 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 17:59:30 +00:00
Vinod Kumar Vavilapalli 6069c2a82d MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal.
svn merge -c r1188043 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1188044 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 08:44:54 +00:00
Vinod Kumar Vavilapalli b9e90a3319 MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar.
svn merge -c r1187669 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187670 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 08:13:20 +00:00
Vinod Kumar Vavilapalli 56072a170d MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash.
svn merge -c r1187658 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187659 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:48:42 +00:00
Vinod Kumar Vavilapalli 1605fb7dbc MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv)
svn merge -c r1187654 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187655 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 06:17:25 +00:00
Mahadev Konar cbd1258918 MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev) - Merging r1187556 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187558 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 21:38:45 +00:00
Mahadev Konar 1edb5c8f9e MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev) - Merging r1187491 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187492 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 18:38:26 +00:00
Todd Lipcon 5acc010db8 MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187182 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 05:20:14 +00:00
Arun Murthy fe370841e6 Merge -c 1187116 from trunk to branch-0.23 to complete fix for MAPREDUCE-3226.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1187119 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 22:45:08 +00:00
Vinod Kumar Vavilapalli 9a8b923418 MAPREDUCE-3104. Implemented Application-acls. (vinodkv)
svn merge -c r1186748 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186754 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 12:01:54 +00:00
Arun Murthy c56916f582 Merge -c 1186542 from trunk to branch-0.23 to complete fix for MAPREDUCE-3208.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186544 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:38:53 +00:00
Arun Murthy 38a73eebaf Merge -c 1186529 from trunk to branch-0.23 to complete fix for MAPREDUCE-2693.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:02:57 +00:00
Arun Murthy cad9bc8843 Merge -c 1186458 from trunk to branch-0.23 to complete fix for MAPREDUCE-3181.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186459 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 20:28:49 +00:00
Vinod Kumar Vavilapalli 3b39b29b9c MAPREDUCE-3176. Fixed ant mapreduce tests that are timing out because of wrong framework name. Contributed by Hitesh Shah.
svn merge -c r1186368 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1186369 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 17:58:32 +00:00
Vinod Kumar Vavilapalli e3b9d11da8 MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth.
svn merge -c r1185976 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185977 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 05:28:22 +00:00
Mahadev Konar a9fe990f7b MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev) - Merging r1185909 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185910 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 22:48:09 +00:00
Arun Murthy dfb1c18558 Merge -c 1185887 from trunk to branch-0.23 to complete fix for MAPREDUCE-3165.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185888 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:46:15 +00:00
Arun Murthy a990576916 Merge -c 1185880 from trunk to branch-0.23 to complete fix for MAPREDUCE-2762.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185881 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 21:38:08 +00:00
Mahadev Konar c1c9ad377e MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev) - Merging r1185486 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185487 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 05:13:11 +00:00
Arun Murthy df93e27dd6 Merge -c 1185447 from trunk to branch-0.23 to complete fix for MAPREDUCE-3068.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185448 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 01:23:14 +00:00
Vinod Kumar Vavilapalli 2ce6540fb0 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K.
svn merge -c r1185247 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1185250 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 15:21:34 +00:00
Mahadev Konar e2edc8f20b MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev) - Merging r1184971 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1184972 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 01:24:06 +00:00
Mahadev Konar 065ca399c8 MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev) - Merging r1184904 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1184905 13f79535-47bb-0310-9956-ffa450edef68
2011-10-16 19:30:13 +00:00
Jitendra Nath Pandey e8caaba2f3 Merged r1183513 from trunk for MAPREDUCE-3192.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1183579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-15 01:26:33 +00:00
Jitendra Nath Pandey 0672834f2d Merged r1183187 from trunk for MAPREDUCE-2764.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1183576 13f79535-47bb-0310-9956-ffa450edef68
2011-10-15 01:16:34 +00:00
Mahadev Konar 34418d0c91 MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev) - Merging r1183545 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1183547 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:52:05 +00:00
Arun Murthy 8876fb033f Merge -c 1183188 from trunk to branch-0.23 to fix MAPREDUCE-3124.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1183189 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:27:56 +00:00
Arun Murthy ea8f6cf534 Merge -c 1183185 from trunk to branch-0.23 to fix MAPREDUCE-3170.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1183186 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:17:11 +00:00
Arun Murthy c2ae3d6e36 Merge -c 1182616 from trunk to branch-0.23 to fix MAPREDUCE-2789.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1182617 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:29:53 +00:00
Arun Murthy b57ac1cf61 Merge -c 1182613 from trunk to branch-0.23 to fix MAPREDUCE-2666.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1182614 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:12:37 +00:00
Vinod Kumar Vavilapalli a6d54ece55 MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
svn merge -c r1182230 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1182231 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:53:14 +00:00
Arun Murthy 76fb42f94d Merge -c 1182008 from trunk to branch-0.23 to fix MAPREDUCE-3126.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1182009 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:30:00 +00:00
Vinod Kumar Vavilapalli 73b6474bac MAPREDUCE-2668. Fixed AuxServices to send a signal on application-finish to all the services. Contributed by Thomas Graves.
svn merge -c r1181803 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1181807 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:29:50 +00:00
Vinod Kumar Vavilapalli af72e41ee1 MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. (Chackaravarthy via vinodkv)
svn merge -c r1181793 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1181794 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:12:11 +00:00
Vinod Kumar Vavilapalli ddaf7c8a7f MAPREDUCE-3161. svn merge -c r1181622 --ignore-ancestry ../../trunk/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1181623 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 04:47:28 +00:00