Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,574 Commits 326 Branches 371 Tags
Commit Graph

1503 Commits

Author SHA1 Message Date
Zhijie Shen
7180167d01 MAPREDUCE-6052. Supported overriding the default container-log4j.properties file per job. Contributed by Junping Du. 
(cherry picked from commit ed63b116465290fdb0acdf89170025f47b307599)
 2014-11-01 00:50:32 -07:00
Kihwal Lee
afbb279825 MAPREDUCE-6022. map_input_file is missing from streaming job 
environment. Contributed by Jason Lowe.
(cherry picked from commit b056048114bf4701ef9dd22486db937cb589e81b)
 2014-10-29 12:30:51 -05:00
Vinod Kumar Vavilapalli
6add7b19f6 MAPREDUCE-6142. Fixed test failures in TestJobHistoryEventHandler and TestMRTimelineEventHandling. Contributed by Zhijie Shen. 
(cherry picked from commit 3f1441245db047b5b7289fe06c4c3306fe8189af)
 2014-10-29 09:59:52 -07:00
Zhijie Shen
d92d4e32f2 MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter. 
(cherry picked from commit 971e91c8c03a23e4613ed3f071b4f982ee5a1b63)
 2014-10-27 21:09:20 -07:00
Zhijie Shen
71ab776b21 MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter. 
(cherry picked from commit 6b2f11b54bc679b0715fe66bd129e340e8c61c5c)
 2014-10-27 20:45:22 -07:00
Jian He
cca473a321 MAPREDUCE-6126. Fixed Rumen JobBuilder to ignore NormalizedResourceEvent. Contributed by Junping Du 
Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 9b973b7c83a5b78452b852860bc6c7a0bad1e2d0)
 2014-10-22 10:58:21 -07:00
Ivan Mitic
a78dd99d67 Revert "MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita." 
This reverts commit 71e05b190050aac2fa8ed6d7d6ad023a275c0f1e.
 2014-10-19 23:43:38 -04:00
Ivan Mitic
71e05b1900 MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita. 
(cherry picked from commit 7bbda6ef92e9bf4a28e67b8736067b38defab51e)
 2014-10-19 19:15:55 -04:00
Jason Lowe
8217665297 MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in client. Contributed by Rohith 
(cherry picked from commit 209b1699fcd150676d4cc47e8e817796086c1986)
 2014-10-17 19:53:35 +00:00
Jason Lowe
ec38eec165 MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov 
(cherry picked from commit f19771a24c2f90982cf6dec35889836a6146c968)
 2014-10-15 17:52:12 +00:00
Jason Lowe
9203ea7ea9 MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li 
(cherry picked from commit b9edad64034a9c8a121ec2b37792c190ba561e26)
 2014-10-15 15:59:56 +00:00
Jason Lowe
034fcaa540 MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang 
(cherry picked from commit 793dbf2465c01426a93bb26d08e377ffd3915340)
 2014-10-13 16:06:28 +00:00
Jason Lowe
5dbbabe85f MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai 
(cherry picked from commit bbe80cdc7b37cae50e46eaa00e75240d4a2aac68)
 2014-10-13 15:12:05 +00:00
cnauroth
308e336853 MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth. 
(cherry picked from commit 777877d079ecb025c293deac741800800e413179)
(cherry picked from commit f6278cbac50522302ee7ad3cbbe21d0aeefa76d8)
 2014-10-09 22:40:34 -07:00
cnauroth
4573bbe33d MAPREDUCE-6122. Fix CHANGES.txt. 
(cherry picked from commit 2f0166db560b180e8d07c10ba9ad4bfaf2aa7b36)
(cherry picked from commit 61be28f501ba3de0915c165c9d43fa38463722c0)
 2014-10-09 22:33:54 -07:00
cnauroth
3fe4e0d3df MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth. 
(cherry picked from commit 684170d5efdc11bcd9967168f44a428d1a72af3c)
(cherry picked from commit 85a2b907407c7719a31c64d3747810263b3ec57d)
 2014-10-09 22:30:25 -07:00
Jason Lowe
e835cb5c86 MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai 
(cherry picked from commit 2e789eb2261fa607489d8ae630fb77e8147d0266)
 2014-10-07 14:13:12 +00:00
Arun C. Murthy
d3e61c96b5 Branching for hadoop-2.6 2014-09-30 10:38:47 -07:00
Arun C. Murthy
6a60fa279a Preparing to branch hadoop-2.6 2014-09-30 10:37:03 -07:00
Jason Lowe
7b8f2f5b1d MAPREDUCE-6094. TestMRCJCFileInputFormat.testAddInputPath() fails on trunk. Contributed by Akira AJISAKA 
(cherry picked from commit 23fbfe36c31674907a26c8ecc6fd47888dfcc1ea)
 2014-09-29 18:14:11 +00:00
Allen Wittenauer
c65ef9ca1e MAPREDUCE-6072. Remove INSTALL document (Akira AJISAKA via aw) 2014-09-29 08:31:10 -07:00
Jian He
a6879b606e MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA 
(cherry picked from commit 5f16c98ad66b562760d5d947151a38f14875d21a)
 2014-09-26 18:06:19 -07:00
Allen Wittenauer
67d6fc3f01 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw) 2014-09-26 14:26:36 -07:00
Allen Wittenauer
e5d284664b MAPREDUCE-5796. Use current version of the archive name in DistributedCacheDeploy document (Akira AJISAKA via aw) 2014-09-26 12:59:59 -07:00
Allen Wittenauer
fe8222998f MAPREDUCE-6073. Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags (Tsuyoshi OZAWA via aw) 2014-09-26 11:17:11 -07:00
Zhijie Shen
7b3ecc547f MAPREDUCE-5831. Make MR client ignore unknown counters received from AM. Contributed by Junping Du. 
(cherry picked from commit 662fc11ae7ccea9d05dfe54b2a794bb08cfd70a4)
 2014-09-25 23:46:57 -07:00
Allen Wittenauer
7ffb636a54 MAPREDUCE-6093. minor distcp doc edits (Charles Lamb via aw) 2014-09-25 11:33:01 -07:00
Allen Wittenauer
afde00a0f5 MAPREDUCE-6109. Fix minor typo in distcp -p usage text (Charles Lamb via aw) 2014-09-25 11:28:50 -07:00
Jason Lowe
d5d9fd3255 MAPREDUCE-6104. TestJobHistoryParsing.testPartialJob fails in branch-2. Contributed by Mit Desai 
(cherry picked from commit 7af4c3888bf7be0822dc880170e5e3d09e9280f1)
 2014-09-24 16:10:28 +00:00
Zhijie Shen
b8d645539d MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev. 2014-09-22 10:41:55 -07:00
Jason Lowe
f4534746fb MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov 
(cherry picked from commit 7039b98e1c459e9e0d8caa28cdaa2868e2bde2eb)
 2014-09-22 15:22:58 +00:00
Jason Lowe
bdb864e5e1 MAPREDUCE-6091. YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view. Contributed by Sangjin Lee 
(cherry picked from commit 951847ba94442b8d928435decfbea9ea20882912)
 2014-09-19 20:17:44 +00:00
Karthik Kambatla
372bf54072 MAPREDUCE-6086. mapreduce.job.credentials.binary should allow all URIs. (Zhihai Xu via kasha) 
(cherry picked from commit 52945a33cc3fcb3b961cce0e7e3ca01291f2a223)
 2014-09-18 15:47:21 -07:00
Jason Lowe
44c7113133 MAPREDUCE-5891. Improved shuffle error handling across NM restarts. Contributed by Junping Du 
(cherry picked from commit 2c3da25fd718b3a9c1ed67f05b577975ae613f4e)
 2014-09-18 22:01:42 +00:00
Jason Lowe
4b4e44a8aa MAPREDUCE-6090. mapred hsadmin getGroups fails to connect in some cases. Contributed by Robert Kanter 
(cherry picked from commit 1cf31980474bf9ac28e51b6f014eae09eda9e15f)
 2014-09-18 21:02:13 +00:00
Karthik Kambatla
d22cd065ed Update CHANGES.txt to set the release date for 2.5.1 
(cherry picked from commit 17ffbe08642c622f099dd1cd9cb9e008ba98ea52)
 2014-09-11 17:36:06 -07:00
Jason Lowe
6f8abe7efe MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 9e28e089c6bcb0b264751bdfa1f994ce002ef2de)
 2014-09-11 16:20:51 +00:00
Jason Lowe
e6f108c99b MAPREDUCE-6075. HistoryServerFileSystemStateStore can create zero-length files. Contributed by Jason Lowe 
(cherry picked from commit 17a025d9dda9949f191b650e3ef96090880f568a)
 2014-09-10 22:12:24 +00:00
Jason Lowe
0b3f918b3b MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 45efc966ee1a1bda0271464dcee2564862d53b1f)
 2014-09-05 13:48:16 +00:00
Chris Douglas
69ee11dc93 MAPREDUCE-6063. Correct spill size calculation for spills wrapping the circular buffer. Contributed by zhihai xu. 2014-09-03 17:02:17 -07:00
Jason Lowe
27086f5942 MAPREDUCE-5931. Validate SleepJob command line parameters. Contributed by Gera Shegalov 
(cherry picked from commit 15366d922772afaa9457ed946533cdf4b5d01e2f)
 2014-08-29 19:52:10 +00:00
Chris Douglas
4f95017602 Fix typos in log messages. Contributed by Ray Chiang 2014-08-28 16:30:13 -07:00
Alejandro Abdelnur
5c37f02e27 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-08-28 15:05:07 -07:00
Jason Lowe
38df629367 MAPREDUCE-5885. build/test/test.mapred.spill causes release audit warnings. Contributed by Chen He 
(cherry picked from commit 812bd0c0e583fce925e3151510860ca9781b3e40)
 2014-08-27 15:22:06 +00:00
Karthik Kambatla
ba95033cc4 Fix CHANGES.txt entry for MAPREDUCE-6033. 
(cherry picked from commit 2d9b77d6170fe38757f7f48a4492f17ac669cbc2)
 2014-08-27 01:17:19 -07:00
Karthik Kambatla
2a3c8331fe Add a section for 2.5.1 in CHANGES.txt 
(cherry picked from commit dc154ab86d694e68f54c635043eb55d501d0e242)
 2014-08-27 00:56:17 -07:00
Zhijie Shen
7cad25ec94 MAPREDUCE-6044. Fully qualified intermediate done dir path breaks per-user dir creation on Windows. Contributed by Zhijie Shen. 
svn merge --ignore-ancestry -c 1619863 ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619864 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-22 17:08:17 +00:00
Sanford Ryza
53da85efaf MAPREDUCE-5130. Add missing job config options to mapred-default.xml (Ray Chiang via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619631 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-21 23:54:38 +00:00
Karthik Kambatla
c9d7647826 MAPREDUCE-5974. Allow specifying multiple MapOutputCollectors with fallback. (Todd Lipcon via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619496 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-21 17:39:54 +00:00
Karthik Kambatla
8b8fe3a425 Set the release date for 2.5.0 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1619238 13f79535-47bb-0310-9956-ffa450edef68
 2014-08-20 21:33:42 +00:00