Commit Graph

730 Commits

Author SHA1 Message Date
Arun Murthy d09ceac1f7 MAPREDUCE-2691. Increase threadpool size for launching containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175294 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 04:43:51 +00:00
Vinod Kumar Vavilapalli b549c10782 MAPREDUCE-3055. Simplified ApplicationAttemptId passing to ApplicationMaster via environment variable. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174785 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 14:07:42 +00:00
Vinod Kumar Vavilapalli 4806d7ba74 MAPREDUCE-2754. Fixed MR AM stdout, stderr and syslog to redirect to correct log-files. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174194 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 15:14:31 +00:00
Mahadev Konar 3557202a92 MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173909 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 23:52:50 +00:00
Vinod Kumar Vavilapalli d00b3c49f6 MAPREDUCE-2880. Improved classpath-construction for mapreduce AM and containers. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173783 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 18:28:23 +00:00
Vinod Kumar Vavilapalli 01fbb0fb45 MAPREDUCE-2930. Added the ability to be able to generate graphs from the state-machine definitions. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173524 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 08:37:00 +00:00
Arun Murthy 1d067c6e2b MAPREDUCE-2998. Fixed a bug in TaskAttemptImpl which caused it to fork bin/mapred too many times. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173456 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:26:48 +00:00
Vinod Kumar Vavilapalli b7660f2bc9 MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172704 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 17:01:50 +00:00
Vinod Kumar Vavilapalli 61900651b1 MAPREDUCE-3006. Fixed MapReduce AM to exit only after properly writing out history file. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172206 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 07:16:18 +00:00
Mahadev Konar d9ba4670ed MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171297 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 22:21:00 +00:00
Vinod Kumar Vavilapalli 4ba2acf336 MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can gracefully exit. Contributed by Abhijit Suresh Shingate.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170746 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 17:57:52 +00:00
Mahadev Konar 88b82a0f66 MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170459 13f79535-47bb-0310-9956-ffa450edef68
2011-09-14 07:26:37 +00:00
Mahadev Konar a3e8f6836b MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170379 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 22:55:22 +00:00
Arun Murthy 88ff272cfd MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170281 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:15:14 +00:00
Arun Murthy 53f921418d MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170279 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 18:12:02 +00:00
Arun Murthy 6165875dc6 MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169980 13f79535-47bb-0310-9956-ffa450edef68
2011-09-13 00:05:51 +00:00
Arun Murthy 7fa0bf3558 MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169973 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 23:17:27 +00:00
Vinod Kumar Vavilapalli be32d25c54 MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169763 13f79535-47bb-0310-9956-ffa450edef68
2011-09-12 14:24:32 +00:00
Arun Murthy 817ead65b9 MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 17:26:06 +00:00
Vinod Kumar Vavilapalli 8fb67650b1 MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167676 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 06:21:39 +00:00
Arun Murthy fafe8cd28e MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 01:44:58 +00:00
Arun Murthy b3c9c3c182 MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 20:59:34 +00:00
Arun Murthy 03c1015d6e MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:36:19 +00:00
Vinod Kumar Vavilapalli 6bdf5746d5 MAPREDUCE-2716. MRReliabilityTest job fails because of missing job-file. Contributed by Jeffrey Naisbitt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164805 13f79535-47bb-0310-9956-ffa450edef68
2011-09-03 06:22:03 +00:00
Vinod Kumar Vavilapalli ade0f0560f MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163585 13f79535-47bb-0310-9956-ffa450edef68
2011-08-31 11:38:32 +00:00
Mahadev Konar fb6ecb9b27 MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163050 13f79535-47bb-0310-9956-ffa450edef68
2011-08-29 23:27:47 +00:00
Arun Murthy a44ffcc0be Preparing for hadoop-0.24.0 development.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:32:04 +00:00
Arun Murthy 58676edf98 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:13:50 +00:00
Mahadev Konar 7c85f33ce1 MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 17:16:36 +00:00
Arun Murthy cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:14:24 +00:00