Vinod Kumar Vavilapalli
|
4086566144
|
MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188043 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-24 08:41:48 +00:00 |
Vinod Kumar Vavilapalli
|
977d7cc5b9
|
MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187669 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-22 08:11:47 +00:00 |
Vinod Kumar Vavilapalli
|
5795fcfd99
|
MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187654 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-22 06:14:46 +00:00 |
Vinod Kumar Vavilapalli
|
df2991c0cb
|
MAPREDUCE-3104. Implemented Application-acls. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186748 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-20 11:45:38 +00:00 |
Arun Murthy
|
74748ec625
|
MAPREDUCE-2693. Fix NPE in job-blacklisting. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186529 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-19 22:02:21 +00:00 |
Vinod Kumar Vavilapalli
|
13e4562924
|
MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185976 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-19 05:21:18 +00:00 |
Vinod Kumar Vavilapalli
|
3e3abcb769
|
MAPREDUCE-3199. Fixed pom files to include correct log4j configuration for tests. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185967 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-19 04:30:27 +00:00 |
Mahadev Konar
|
b4d20c707a
|
MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185909 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-18 22:46:42 +00:00 |
Arun Murthy
|
ab787f44aa
|
MAPREDUCE-3165. Ensure logging options are set correctly for MR AM and tasks. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185887 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-18 21:45:38 +00:00 |
Arun Murthy
|
51a667bef8
|
MAPREDUCE-2762. Cleanup MR staging directory on completion. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185880 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-18 21:37:31 +00:00 |
Mahadev Konar
|
9ff7c1b1de
|
MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185486 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-18 05:08:32 +00:00 |
Arun Murthy
|
c1d90772b6
|
MAPREDUCE-3068. Added a whitelist of environment variables for containers from the NodeManager and set MALLOC_ARENA_MAX for all daemons and containers. Contributed by Chris Riccomini.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185447 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-18 01:22:14 +00:00 |
Alejandro Abdelnur
|
15a1d9af19
|
MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185286 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-17 17:06:42 +00:00 |
Vinod Kumar Vavilapalli
|
a26b1672a8
|
MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185247 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-17 15:17:06 +00:00 |
Mahadev Konar
|
68328ae926
|
MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184904 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-16 19:27:02 +00:00 |
Arun Murthy
|
277e520579
|
MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM restart. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182613 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-12 23:12:01 +00:00 |
Vinod Kumar Vavilapalli
|
d6546fc0a4
|
MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182230 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-12 06:51:32 +00:00 |
Vinod Kumar Vavilapalli
|
7d5434c6b3
|
MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. Contributed by Chackaravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181793 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-11 14:09:32 +00:00 |
Vinod Kumar Vavilapalli
|
11b9dd4e84
|
MAPREDUCE-3161. Improved some javadocs and fixed some typos in YARN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181622 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-11 04:45:28 +00:00 |
Arun Murthy
|
42e93829e5
|
MAPREDUCE-3158. Fix test failures in MRv1 due to default framework being set to yarn. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181310 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-11 00:26:41 +00:00 |
Alejandro Abdelnur
|
4972959173
|
Reverted MAPREDUCE-3003
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180283 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-08 00:38:41 +00:00 |
Alejandro Abdelnur
|
68d1162f7a
|
MAPREDUCE-3003. Publish Yarn and MapReduce artifacts to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180155 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-07 19:01:01 +00:00 |
Vinod Kumar Vavilapalli
|
fa2529c931
|
MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180007 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-07 11:35:17 +00:00 |
Vinod Kumar Vavilapalli
|
f24dcb3449
|
MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-05 11:56:54 +00:00 |
Vinod Kumar Vavilapalli
|
66137cf17c
|
MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-05 11:43:05 +00:00 |
Vinod Kumar Vavilapalli
|
e979a3ddb1
|
MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-04 09:37:56 +00:00 |
Arun Murthy
|
12743d2169
|
MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178631 13f79535-47bb-0310-9956-ffa450edef68
|
2011-10-03 23:21:20 +00:00 |
Vinod Kumar Vavilapalli
|
063e33a862
|
MAPREDUCE-3098. Fixed RM and MR AM to report YarnApplicationState and application's FinalStatus separately. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177633 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-30 12:46:32 +00:00 |
Arun Murthy
|
964d4a1666
|
MAPREDUCE-2996. Add uber-ness information to JobHistory. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177531 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-30 06:47:53 +00:00 |
Arun Murthy
|
0b3c654d83
|
MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177487 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-30 03:08:35 +00:00 |
Vinod Kumar Vavilapalli
|
71886657f8
|
MAPREDUCE-3001. Added task-specific counters to AppMaster and JobHistory web-UIs. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177203 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-29 08:08:49 +00:00 |
Arun Murthy
|
312a7e7100
|
MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176762 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-28 07:31:03 +00:00 |
Arun Murthy
|
5f6adcf396
|
MAPREDUCE-3021. Change base urls for RM web-ui. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176681 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-28 01:23:04 +00:00 |
Mahadev Konar
|
70388cffe0
|
MAPREDUCE-3071. app master configuration web UI link under the Job menu opens up application menu. (thomas graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1176203 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-27 05:30:01 +00:00 |
Vinod Kumar Vavilapalli
|
1e6dfa7472
|
MAPREDUCE-2646. Fixed AMRMProtocol to return containers based on priority. Contributed by Sharad Agarwal and Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175859 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-26 13:25:27 +00:00 |
Arun Murthy
|
c9a7d3dbf9
|
MAPREDUCE-3090. Fix MR AM to use ApplicationAttemptId rather than (ApplicationId, startCount) consistently.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175718 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-26 08:44:41 +00:00 |
Arun Murthy
|
d09ceac1f7
|
MAPREDUCE-2691. Increase threadpool size for launching containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175294 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-25 04:43:51 +00:00 |
Vinod Kumar Vavilapalli
|
b549c10782
|
MAPREDUCE-3055. Simplified ApplicationAttemptId passing to ApplicationMaster via environment variable. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174785 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-23 14:07:42 +00:00 |
Vinod Kumar Vavilapalli
|
4806d7ba74
|
MAPREDUCE-2754. Fixed MR AM stdout, stderr and syslog to redirect to correct log-files. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174194 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-22 15:14:31 +00:00 |
Mahadev Konar
|
3557202a92
|
MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173909 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-21 23:52:50 +00:00 |
Vinod Kumar Vavilapalli
|
d00b3c49f6
|
MAPREDUCE-2880. Improved classpath-construction for mapreduce AM and containers. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173783 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-21 18:28:23 +00:00 |
Vinod Kumar Vavilapalli
|
01fbb0fb45
|
MAPREDUCE-2930. Added the ability to be able to generate graphs from the state-machine definitions. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173524 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-21 08:37:00 +00:00 |
Arun Murthy
|
1d067c6e2b
|
MAPREDUCE-2998. Fixed a bug in TaskAttemptImpl which caused it to fork bin/mapred too many times. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173456 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-21 01:26:48 +00:00 |
Vinod Kumar Vavilapalli
|
b7660f2bc9
|
MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172704 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-19 17:01:50 +00:00 |
Vinod Kumar Vavilapalli
|
61900651b1
|
MAPREDUCE-3006. Fixed MapReduce AM to exit only after properly writing out history file. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172206 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-18 07:16:18 +00:00 |
Mahadev Konar
|
d9ba4670ed
|
MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1171297 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-15 22:21:00 +00:00 |
Vinod Kumar Vavilapalli
|
4ba2acf336
|
MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can gracefully exit. Contributed by Abhijit Suresh Shingate.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170746 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-14 17:57:52 +00:00 |
Mahadev Konar
|
88b82a0f66
|
MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170459 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-14 07:26:37 +00:00 |
Mahadev Konar
|
a3e8f6836b
|
MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170379 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-13 22:55:22 +00:00 |
Arun Murthy
|
88ff272cfd
|
MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170281 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-13 18:15:14 +00:00 |
Arun Murthy
|
53f921418d
|
MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170279 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-13 18:12:02 +00:00 |
Arun Murthy
|
6165875dc6
|
MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169980 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-13 00:05:51 +00:00 |
Arun Murthy
|
7fa0bf3558
|
MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169973 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-12 23:17:27 +00:00 |
Vinod Kumar Vavilapalli
|
be32d25c54
|
MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169763 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-12 14:24:32 +00:00 |
Arun Murthy
|
817ead65b9
|
MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-11 17:26:06 +00:00 |
Vinod Kumar Vavilapalli
|
8fb67650b1
|
MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167676 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-11 06:21:39 +00:00 |
Arun Murthy
|
fafe8cd28e
|
MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166955 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-09 01:44:58 +00:00 |
Arun Murthy
|
b3c9c3c182
|
MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166901 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-08 20:59:34 +00:00 |
Arun Murthy
|
03c1015d6e
|
MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-06 23:36:19 +00:00 |
Vinod Kumar Vavilapalli
|
6bdf5746d5
|
MAPREDUCE-2716. MRReliabilityTest job fails because of missing job-file. Contributed by Jeffrey Naisbitt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164805 13f79535-47bb-0310-9956-ffa450edef68
|
2011-09-03 06:22:03 +00:00 |
Vinod Kumar Vavilapalli
|
ade0f0560f
|
MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163585 13f79535-47bb-0310-9956-ffa450edef68
|
2011-08-31 11:38:32 +00:00 |
Mahadev Konar
|
fb6ecb9b27
|
MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163050 13f79535-47bb-0310-9956-ffa450edef68
|
2011-08-29 23:27:47 +00:00 |
Arun Murthy
|
a44ffcc0be
|
Preparing for hadoop-0.24.0 development.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
|
2011-08-25 20:32:04 +00:00 |
Arun Murthy
|
58676edf98
|
MAPREDUCE-2879. Fix version for MR-279 to 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
|
2011-08-25 19:13:50 +00:00 |
Mahadev Konar
|
7c85f33ce1
|
MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
|
2011-08-25 17:16:36 +00:00 |
Arun Murthy
|
cd7157784e
|
HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
|
2011-08-25 00:14:24 +00:00 |