Commit Graph

474 Commits

Author SHA1 Message Date
Robert Joseph Evans 09038b741d MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 22:20:15 +00:00
Robert Joseph Evans 5dcb594cb8 MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381614 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 14:20:43 +00:00
Eli Collins aa049397f1 Fix MAPREDUCE-4580 build breakage.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381315 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:34:03 +00:00
Suresh Srinivas 60af999c73 YARN-84. Use Builder to build RPC server. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380921 13f79535-47bb-0310-9956-ffa450edef68
2012-09-04 22:24:04 +00:00
Konstantin Shvachko ab986d7cf6 MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380310 13f79535-47bb-0310-9956-ffa450edef68
2012-09-03 18:54:27 +00:00
Jonathan Turner Eagles 94129df354 MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379617 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 21:25:25 +00:00
Thomas Graves 25e96e455b MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379599 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:43:46 +00:00
Robert Joseph Evans 63f941d2ad MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379595 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:37:41 +00:00
Robert Joseph Evans 015256524c MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379584 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 20:25:27 +00:00
Vinod Kumar Vavilapalli 65e447cd8b MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379146 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 21:02:55 +00:00
Robert Joseph Evans 6f6e170325 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 19:58:07 +00:00
Thomas White 2f1a133dcf MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379022 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 17:12:14 +00:00
Thomas White 95af351615 MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378873 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 09:57:45 +00:00
Vinod Kumar Vavilapalli cfe25b8828 MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377943 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 02:03:26 +00:00
Siddharth Seth 24e47ebc18 MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377922 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 00:40:02 +00:00
Siddharth Seth ffd2e01604 YARN-39. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377180 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 02:18:49 +00:00
Alejandro Abdelnur 7b541d619f MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377149 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 23:36:55 +00:00
Robert Joseph Evans aeb364d8b5 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 18:06:56 +00:00
Alejandro Abdelnur f909a1d4d7 MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376325 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 00:22:14 +00:00
Aaron Myers 0555a2145d MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376297 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 22:43:50 +00:00
Alejandro Abdelnur dc33a0765c MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376253 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 21:18:34 +00:00
Robert Joseph Evans ca2dc3e785 MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375687 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 17:46:07 +00:00
Robert Joseph Evans 0c2887b617 MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375602 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 15:20:21 +00:00
Thomas Graves 7fc6ad661d YARN-25. remove old aggregated logs (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374424 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 20:29:38 +00:00
Daryn Sharp 8fa10b184e HADOOP-7967. Need generalized multi-token filesystem support (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 14:05:11 +00:00
Thomas White 3204b1f450 MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373823 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 13:26:12 +00:00
Tsz-wo Sze 3cab01ba6e HADOOP-8700. Use enum to define the checksum constants in DataChecksum.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 01:32:10 +00:00
Alejandro Abdelnur 8fcad7e8e9 MAPREDUCE-4511. Add IFile readahead (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373669 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 23:08:40 +00:00
Thomas Graves dfad16fed2 MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:48:33 +00:00
Alejandro Abdelnur 4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:52:56 +00:00
Arun Murthy e1fdf62123 YARN-1. Promote YARN to be a sub-project of Apache Hadoop.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370666 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 05:22:27 +00:00
Alejandro Abdelnur 117145f1ad MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 18:14:47 +00:00
Jonathan Turner Eagles 72789336b2 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:29:29 +00:00
Siddharth Seth 3eb0cb27e8 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 21:55:37 +00:00
Thomas Graves 28320c5220 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 22:14:13 +00:00
Jonathan Turner Eagles 5938c86352 MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367789 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 21:26:08 +00:00
Thomas Graves 9d42fb2e8e MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367771 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 20:52:41 +00:00
Thomas Graves 735b50e8bd MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367713 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 19:20:03 +00:00
Robert Joseph Evans a37272e0e3 MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367601 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 15:08:47 +00:00
Thomas Graves e9bf6c56c5 MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367581 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 14:46:57 +00:00
Thomas Graves a3e695ab2c MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367539 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 13:39:41 +00:00
Thomas Graves d87b545165 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366258 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 01:48:09 +00:00
Alejandro Abdelnur 9d16c9354b MAPREDUCE-4417. add support for encrypted shuffle (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:23:05 +00:00
Thomas Graves cdef12644b MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365240 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 19:27:29 +00:00
Alejandro Abdelnur 9c9f29ac7e MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364020 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 23:19:23 +00:00
Thomas Graves d45922de2c svn merge --change -1363454 for reverting MAPREDUCE-4423
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363935 13f79535-47bb-0310-9956-ffa450edef68
2012-07-20 20:18:48 +00:00
Thomas Graves 8e69f883a0 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363454 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 18:19:59 +00:00
Alejandro Abdelnur c700642308 MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362751 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 03:36:46 +00:00
Alejandro Abdelnur 2e00d28f14 MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362722 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 23:31:16 +00:00
Robert Joseph Evans 603418c173 MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362612 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 19:14:33 +00:00