Commit Graph

242 Commits

Author SHA1 Message Date
Wangda Tan b3b4d4ccb5 MAPREDUCE-7118. Distributed cache conflicts breaks backwards compatability. (Jason Lowe via wangda)
Change-Id: I89ab4852b4ad305fec19812e8931c59d96581376
2018-07-19 14:26:05 -07:00
Arun Suresh 5670e89b2e MAPREDUCE-7101. Add config parameter to allow JHS to alway scan user dir irrespective of modTime. (Thomas Marquardt via asuresh) 2018-06-12 15:36:52 -07:00
Miklos Szegedi a2cdffb95a MAPREDUCE-7094. LocalDistributedCacheManager leaves classloaders open, which leaks FDs. Contributed by Adam Szita. 2018-05-17 11:16:04 -07:00
Jason Lowe 4571351ccc MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan 2018-04-12 11:12:46 -05:00
Robert Kanter edb202e493 MAPREDUCE-6441. Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes (wattsinabox, rchiang, haibochen via rkanter) 2018-03-26 14:55:53 -07:00
Billie Rinaldi 7dd385098c MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák 2018-02-26 14:32:46 -08:00
Wangda Tan 60f9e60b3b Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Jason Lowe a37e7f0ad8 MAPREDUCE-7022. Fast fail rogue jobs based on task scratch dir size. Contributed by Johan Gustavsson 2018-01-26 14:36:45 -06:00
Takanobu Asanuma 1a9c5d479e
MAPREDUCE-7034. Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-15 15:38:03 +09:00
Steve Loughran de09716fb8 MAPREDUCE-6977 Move logging APIs over to slf4j in hadoop-mapreduce-client-common.
Contributed by Jinjiang Ling.
2017-10-27 10:45:03 +01:00
Chris Trezzo e46d5bb962 MAPREDUCE-5951. Add support for the YARN Shared Cache. 2017-10-12 10:59:20 -07:00
Rohith Sharma K S 639f98cc9d MAPREDUCE-6951. Improve exception message when mapreduce.jobhistory.webapp.address is in wrong format. Contributed by Prabhu Joseph. 2017-10-11 14:27:38 +05:30
Andrew Wang 0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
Arpit Agarwal 8b7cbe3840 HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar. 2017-08-25 09:55:46 -07:00
Robert Kanter ab051bd42e MAPREDUCE-6936. Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common (haibochen via rkanter) 2017-08-16 16:14:04 -07:00
Ravi Prakash 43f0503286 MAPREDUCE-6910. MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPS. Contributed by Lantao Jin 2017-07-13 16:16:45 -07:00
Andrew Wang af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Sean Busbey f5517a8200
HADOOP-13921. Remove log4j classes from JobConf.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-06-01 13:35:14 +09:00
Akira Ajisaka d4015f8628
MAPREDUCE-6887. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin. 2017-05-30 14:48:58 +09:00
Andrew Wang 16ad896d5c Update maven version for 3.0.0-alpha4 development 2017-05-26 14:09:44 -07:00
Jason Lowe 1e71fe8c42 MAPREDUCE-6882. Increase MapReduce test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 2017-05-10 09:57:41 -05:00
Andrew Wang 5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Jian He 523411d69b YARN-4844 (Addendum). Change JobStatus(usedMem,reservedMem,neededMem)
back to int for compatibility. Contributed by Wangda Tan
2016-12-20 11:28:44 -08:00
Akira Ajisaka 209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Andrew Wang e1c6ef2efa HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 2016-11-08 16:33:55 -08:00
Wangda Tan 3d937457ee MAPREDUCE-6310. Add jdiff support to MapReduce. (Li Lu/vinodkv via wangda) 2016-08-19 16:26:29 -07:00
Andrew Wang da456ffd62 Preparing for 3.0.0-alpha2 development 2016-07-15 19:04:17 -07:00
Robert Kanter 0881ed3fc3 MAPREDUCE-6652. Add configuration property to prevent JHS from loading jobs with a task count greater than X (haibochen via rkanter) 2016-07-15 13:30:03 -07:00
Jian He 819224dcf9 YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan 2016-07-11 22:36:20 -07:00
Sangjin Lee 605b4b6136 MAPREDUCE-6719. The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store (Daniel Templeton via sjlee) 2016-06-21 11:25:11 -07:00
Wangda Tan c77a1095dc YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda) 2016-06-14 15:06:38 -07:00
Varun Vasudev 42f90ab885 YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan. 2016-05-29 21:24:16 +05:30
Junping Du 22fcd819f0 YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron.
(cherry picked from commit 2703ec6871)
2016-05-19 14:15:21 -07:00
Akira Ajisaka b357930526 MAPREDUCE-6693. ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit. Contributed by Ajith S. 2016-05-17 20:19:01 +09:00
Andrew Wang 3c5c57af28 HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1. 2016-05-12 18:27:28 -07:00
Andrew Wang ca5613af91 Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
This reverts commit 6b53802cba.
2016-05-12 15:32:45 -07:00
Andrew Wang 6b53802cba Update project version to 3.0.0-alpha1-SNAPSHOT. 2016-05-12 11:05:05 -07:00
Akira Ajisaka 4ee4e5ca2b MAPREDUCE-6526. Remove usage of metrics v1 from hadoop-mapreduce. (aajisaka) 2016-05-03 10:46:11 +09:00
Varun Vasudev e51a8c1056 YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron. 2016-03-07 15:26:44 +05:30
Robert Kanter 0f72da7e28 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) 2016-02-26 17:57:17 -08:00
Robert Kanter 4343a4cf77 MAPREDUCE-6640. mapred job -history command should be able to take Job ID (rkanter) 2016-02-23 17:37:49 -08:00
Robert Kanter 6eae4337d1 MAPREDUCE-6613. Change mapreduce.jobhistory.jhist.format default from json to binary (rchiang via rkanter) 2016-02-19 17:15:54 -08:00
Varun Vasudev 2440671a11 MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana. 2016-02-18 14:18:36 +05:30
Akira Ajisaka df99ea8a92 MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta. 2016-01-29 16:20:29 +09:00
Robert Kanter dca0dc8ac2 MAPREDUCE-6431. JobClient should be an AutoClosable (haibochen via rkanter) 2016-01-27 17:11:07 -08:00
Jason Lowe f634505d48 MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G 2015-11-24 22:07:26 +00:00
Jason Lowe cf953b6258 MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G 2015-10-29 18:05:01 +00:00
Zhihai Xu cbb249534a MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu 2015-08-28 12:13:23 -07:00
Jason Lowe d0e0ba8010 MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang 2015-07-31 18:17:54 +00:00
Jason Lowe 2ac87df578 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang 2015-07-01 16:00:03 +00:00