Commit Graph

1464 Commits

Author SHA1 Message Date
Arun Murthy 277e520579 MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM restart. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182613 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 23:12:01 +00:00
Alejandro Abdelnur 327e02fdf4 MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs native. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 20:38:51 +00:00
Ravi Gummadi f143895bc2 MAPREDUCE-3166. [Rumen] Make Rumen use job history api instead of relying on current history file name format.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182330 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 12:19:02 +00:00
Ravi Gummadi efb3cd64a2 MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182293 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 09:58:14 +00:00
Vinod Kumar Vavilapalli d6546fc0a4 MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182230 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:51:32 +00:00
Aaron Myers c3792b4b3f Move line for HDFS-2422 under 0.23 instead of 0.24.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:26:26 +00:00
Harsh J 0a96e88129 Move the HADOOP-6490 Changes note to the right section. Accidentally placed it under Bugs in r1182189.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182217 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:24:04 +00:00
Vinod Kumar Vavilapalli 85588e5ce9 MAPREDUCE-3140. Fixed the invalid JobHistory URL for failed applications. Contributed by Subroto Sanyal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182216 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:23:20 +00:00
Harsh J 68328e29be HADOOP-7736. Remove duplicate Path#normalizePath call.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182214 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 06:20:23 +00:00
Harsh J 532872bf74 HDFS-2349. Corruption detected during block transfers should log WARNs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182205 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 04:48:52 +00:00
Harsh J eba49b8b11 HADOOP-6490. Use StringUtils over String#replace in Path#normalizePath. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182189 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 03:19:01 +00:00
Alejandro Abdelnur 3f998db918 HADOOP-7642. create hadoop-dist module where TAR stitching would happen. Contributed by Thomas White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182151 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 00:27:32 +00:00
Arun Murthy ac64df85a9 MAPREDUCE-3148. Ported MAPREDUCE-2702 to old mapred api for aiding task recovery.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182008 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:27:51 +00:00
Arun Murthy b8f0836f94 MAPREDUCE-3126. Fixed a corner case in CapacityScheduler where headroom wasn't updated on changes to cluster size.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182000 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 18:24:32 +00:00
Vinod Kumar Vavilapalli 1c358b0796 MAPREDUCE-2668. Fixed AuxServices to send a signal on application-finish to all the services. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181803 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:26:17 +00:00
Vinod Kumar Vavilapalli 7d5434c6b3 MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. Contributed by Chackaravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181793 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 14:09:32 +00:00
Mahadev Konar 5a249b76d3 MAPREDUCE-3167. container-executor is not being packaged with the assembly target. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181634 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 06:58:20 +00:00
Vinod Kumar Vavilapalli 11b9dd4e84 MAPREDUCE-3161. Improved some javadocs and fixed some typos in YARN. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181622 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 04:45:28 +00:00
Aaron Myers f527f989af HDFS-2422. The NN should tolerate the same number of low-resource volumes as failed volumes (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181316 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 00:37:29 +00:00
Arun Murthy 42e93829e5 MAPREDUCE-3158. Fix test failures in MRv1 due to default framework being set to yarn. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1181310 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 00:26:41 +00:00
Vinod Kumar Vavilapalli a8190ce5c5 MAPREDUCE-2988. Reenabled TestLinuxContainerExecutor reflecting the current NodeManager code. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180833 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 09:18:44 +00:00
Arun Murthy d0016c6120 MAPREDUCE-3154. Fix JobSubmitter to check for output specs before copying job submission files to fail fast. Contributed by Abhijit Suresh Shingate.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180774 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:29:38 +00:00
Arun Murthy 811a6a9e30 MAPREDUCE-3123. Fix NM to quote symlink names to escape special characters. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180772 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:27:01 +00:00
Arun Murthy 4f1cdab6d8 MAPREDUCE-3153. Fix TestFileOutputCommitter which was broken by MAPREDUCE-2702. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180769 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:10:45 +00:00
Arun Murthy 3ddb52cfc0 MAPREDUCE-2876. Use a different config for ContainerAllocationExpirer. Contributed by Anupam Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180767 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 03:06:47 +00:00
Suresh Srinivas 676f488eff HDFS-2404. webhdfs liststatus json response is not correct. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180757 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 01:49:37 +00:00
Konstantin Shvachko a09a2b48cd Move MAPREDUCE-3138 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180751 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 00:36:04 +00:00
Todd Lipcon 4cf6bc415f HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-09 03:59:21 +00:00
Steve Loughran 3ab2e79ad7 HDFS-2209 datanode connection failure logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180353 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 10:41:56 +00:00
Alejandro Abdelnur 4972959173 Reverted MAPREDUCE-3003
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180283 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 00:38:41 +00:00
Todd Lipcon 0d1fe120c8 HADOOP-7627. Improve MetricsAsserts to give more understandable output on failure. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180259 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 21:54:38 +00:00
Arun Murthy 047b175aac MAPREDUCE-2802. Ensure JobHistory filenames have jobId. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:44:37 +00:00
Arun Murthy 6b343adfe8 MAPREDUCE-3033. Ensure Master interface pays attention to classic v/s yarn frameworks. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180214 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:39:33 +00:00
Todd Lipcon 54e81464a3 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180202 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:28:39 +00:00
Alejandro Abdelnur 68d1162f7a MAPREDUCE-3003. Publish Yarn and MapReduce artifacts to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180155 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 19:01:01 +00:00
Thomas White 02ce6b3d07 MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off by default. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180116 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 17:33:10 +00:00
Alejandro Abdelnur 2b157c6b12 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180094 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 16:34:51 +00:00
Steve Loughran aace6cb631 HDFS-2209. Make MiniDFS easier to embed in other apps.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:30:32 +00:00
Vinod Kumar Vavilapalli 02a81203bd MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:23:20 +00:00
Steve Loughran 639121c743 HADOOP-7727 fix some typos and tabs in CHANGES.TXT
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180019 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 12:22:48 +00:00
Vinod Kumar Vavilapalli fa2529c931 MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 11:35:17 +00:00
Vinod Kumar Vavilapalli a56f3931d1 MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM crashes. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 09:17:57 +00:00
Mahadev Konar b8102dbdf8 MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per queue per user. (John George via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179936 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 05:27:36 +00:00
Amar Kamat c1c0e8c9ea MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running tasks in Gridmix. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179933 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 04:59:58 +00:00
Eric Yang 77f79ee92b HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in
core-site.xml.  (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179915 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 01:10:08 +00:00
Alejandro Abdelnur 21cb78d246 HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179912 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 01:01:18 +00:00
Alejandro Abdelnur 9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:10:31 +00:00
Sanjay Radia e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey a90f8fb50f HADOOP-7721. Add a log before login in KerberosAuthenticationHandler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179869 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:41:11 +00:00
Jitendra Nath Pandey 6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:30:06 +00:00