Commit Graph

205 Commits

Author SHA1 Message Date
Mahadev Konar 955d8eca21 MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX. (Arun Murthy via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185417 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 22:41:26 +00:00
Alejandro Abdelnur 15a1d9af19 MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 17:06:42 +00:00
Vinod Kumar Vavilapalli a26b1672a8 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185247 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 15:17:06 +00:00
Arun Murthy 9f36bdd731 MAPREDUCE-3127. Fixed CHANGES.txt to reflect correct jira.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184992 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 04:22:28 +00:00
Arun Murthy 6b2f3dd5ce MAPREDUCE-3101. Changed default value of yarn.resourcemanager.acl.enable to true and added some more documentation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184989 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 04:08:36 +00:00
Arun Murthy bc6220c538 MAPREDUCE-3136. Added the missing link to index.html.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184981 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:35:20 +00:00
Mahadev Konar 29f65be3e2 MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184979 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:22:16 +00:00
Arun Murthy 86e1c9536f MAPREDUCE-3136. Added documentation for setting up Hadoop clusters in both non-secure and secure mode for both HDFS & YARN.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184977 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:18:06 +00:00
Arun Murthy 4872615441 MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. Contributed by todd & acmurthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 02:14:10 +00:00
Mahadev Konar 94b3bf9f75 MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184971 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 01:19:51 +00:00
Mahadev Konar 68328ae926 MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184904 13f79535-47bb-0310-9956-ffa450edef68
2011-10-16 19:27:02 +00:00
Mahadev Konar b5e21e7e63 MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183545 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:49:19 +00:00
Mahadev Konar b3284c4607 MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183540 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 22:38:52 +00:00
Jitendra Nath Pandey 57f99c2b02 MAPREDUCE-3192. Fix Javadoc warning in JobClient.java and Cluster.java.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183513 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 21:49:35 +00:00
Arun Murthy 09eb725c06 MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:27:10 +00:00
Jitendra Nath Pandey 002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:24:20 +00:00
Arun Murthy c7fb49b3c5 MAPREDUCE-3170. Fixed job output commit for deep hierarchies. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183185 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:16:30 +00:00
Alejandro Abdelnur 59df2d48c3 MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header. (Hitesh Shah via tucu).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183160 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 23:16:07 +00:00
Alejandro Abdelnur e9544ef3d2 HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183068 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:23:59 +00:00
Mahadev Konar 6b6f02c51d MAPREDUCE-3133. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182688 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 07:07:01 +00:00
Arun Murthy 26d63ecdae MAPREDUCE-2789. Complete schedulingInfo on CLI. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182616 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:29:01 +00:00
Arun Murthy 277e520579 MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM restart. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182613 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:12:01 +00:00
Alejandro Abdelnur 327e02fdf4 MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs native. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 20:38:51 +00:00
Ravi Gummadi f143895bc2 MAPREDUCE-3166. [Rumen] Make Rumen use job history api instead of relying on current history file name format.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182330 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 12:19:02 +00:00
Ravi Gummadi efb3cd64a2 MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182293 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 09:58:14 +00:00
Vinod Kumar Vavilapalli d6546fc0a4 MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182230 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:51:32 +00:00
Vinod Kumar Vavilapalli 85588e5ce9 MAPREDUCE-3140. Fixed the invalid JobHistory URL for failed applications. Contributed by Subroto Sanyal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182216 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:23:20 +00:00
Alejandro Abdelnur 3f998db918 HADOOP-7642. create hadoop-dist module where TAR stitching would happen. Contributed by Thomas White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182151 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 00:27:32 +00:00
Arun Murthy ac64df85a9 MAPREDUCE-3148. Ported MAPREDUCE-2702 to old mapred api for aiding task recovery.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182008 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:27:51 +00:00
Arun Murthy b8f0836f94 MAPREDUCE-3126. Fixed a corner case in CapacityScheduler where headroom wasn't updated on changes to cluster size.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182000 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:24:32 +00:00
Vinod Kumar Vavilapalli 1c358b0796 MAPREDUCE-2668. Fixed AuxServices to send a signal on application-finish to all the services. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181803 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:26:17 +00:00
Vinod Kumar Vavilapalli 7d5434c6b3 MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. Contributed by Chackaravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181793 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:09:32 +00:00
Mahadev Konar 5a249b76d3 MAPREDUCE-3167. container-executor is not being packaged with the assembly target. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181634 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 06:58:20 +00:00
Vinod Kumar Vavilapalli 11b9dd4e84 MAPREDUCE-3161. Improved some javadocs and fixed some typos in YARN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181622 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 04:45:28 +00:00
Arun Murthy 42e93829e5 MAPREDUCE-3158. Fix test failures in MRv1 due to default framework being set to yarn. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181310 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 00:26:41 +00:00
Vinod Kumar Vavilapalli a8190ce5c5 MAPREDUCE-2988. Reenabled TestLinuxContainerExecutor reflecting the current NodeManager code. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180833 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 09:18:44 +00:00
Arun Murthy d0016c6120 MAPREDUCE-3154. Fix JobSubmitter to check for output specs before copying job submission files to fail fast. Contributed by Abhijit Suresh Shingate.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180774 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:29:38 +00:00
Arun Murthy 811a6a9e30 MAPREDUCE-3123. Fix NM to quote symlink names to escape special characters. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180772 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:27:01 +00:00
Arun Murthy 4f1cdab6d8 MAPREDUCE-3153. Fix TestFileOutputCommitter which was broken by MAPREDUCE-2702. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180769 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:10:45 +00:00
Arun Murthy 3ddb52cfc0 MAPREDUCE-2876. Use a different config for ContainerAllocationExpirer. Contributed by Anupam Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180767 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:06:47 +00:00
Konstantin Shvachko a09a2b48cd Move MAPREDUCE-3138 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180751 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 00:36:04 +00:00
Alejandro Abdelnur 4972959173 Reverted MAPREDUCE-3003
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180283 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 00:38:41 +00:00
Arun Murthy 047b175aac MAPREDUCE-2802. Ensure JobHistory filenames have jobId. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:44:37 +00:00
Arun Murthy 6b343adfe8 MAPREDUCE-3033. Ensure Master interface pays attention to classic v/s yarn frameworks. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180214 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:39:33 +00:00
Alejandro Abdelnur 68d1162f7a MAPREDUCE-3003. Publish Yarn and MapReduce artifacts to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180155 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 19:01:01 +00:00
Thomas White 02ce6b3d07 MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off by default. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180116 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 17:33:10 +00:00
Vinod Kumar Vavilapalli 02a81203bd MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:23:20 +00:00
Vinod Kumar Vavilapalli fa2529c931 MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 11:35:17 +00:00
Vinod Kumar Vavilapalli a56f3931d1 MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM crashes. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 09:17:57 +00:00
Mahadev Konar b8102dbdf8 MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per queue per user. (John George via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179936 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 05:27:36 +00:00