Akira Ajisaka
e4360fd42f
MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita.
...
(cherry picked from commit 195793c6f3
)
(cherry picked from commit e42f576232
)
2015-10-01 10:31:43 +02:00
Jason Lowe
4104ab346f
MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne
...
(cherry picked from commit bc1bd7e5c4
)
(cherry picked from commit 30d0f10458
)
2015-09-26 10:32:27 -07:00
Vinod Kumar Vavilapalli
ab4c2ce248
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
...
(cherry picked from commit 9da81a3955
)
(cherry picked from commit d4b86e6f403edc6cdd687f978e3abff8752faa34)
2015-09-25 16:11:11 -07:00
Vinod Kumar Vavilapalli
b99a85139e
Creating 2.6.2 entries in CHANGES.txt files.
...
(cherry picked from commit 33474939a0
)
2015-09-25 16:00:06 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
41d19f4740
Release process for 2.6.1: Set the release date for 2.6.1
2015-09-23 15:15:36 -07:00
Vinod Kumar Vavilapalli
b4d876d837
Set the release date for 2.6.1-RC1
2015-09-16 12:04:57 -07:00
Vinod Kumar Vavilapalli
075d899d10
Set the release date for 2.6.1-RC0
2015-09-09 15:39:02 -07:00
Tsuyoshi Ozawa
6c0ad99b9d
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
...
(cherry picked from commit f4e2b3cc0b
)
(cherry picked from commit fb5b0ebb45
)
(cherry picked from commit 3a3dcf0bb689d6aa8bc524a31799067702814674)
2015-09-03 11:46:47 -07:00
Jason Lowe
41601eae6b
MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov
...
(cherry picked from commit 7dc3c1203d
)
(cherry picked from commit 87c2d915f1
)
(cherry picked from commit 1da62ba736f5f161a18a52b7ca0d212786f3848c)
2015-09-02 15:27:47 -07:00
Vinod Kumar Vavilapalli
262275d561
MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe.
...
(cherry picked from commit 9fc32c5c4d
)
(cherry picked from commit 32dc13d907
)
(cherry picked from commit aad56fe3a2f29e73a013b9afa9b44b151a34e0f3)
2015-09-02 15:12:21 -07:00
Robert Kanter
c253ac68eb
MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regression from MR1 (zxu via rkanter)
...
(cherry picked from commit d50e8f0928
)
(cherry picked from commit 756c254293
)
(cherry picked from commit 4f0fd74880e58958d89ca1cd4b7f665520595b2c)
2015-09-02 11:40:32 -07:00
Karthik Kambatla
2f66dff7ce
MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha)
...
(cherry picked from commit c66c3ac6bf
)
(cherry picked from commit f4d6c5e337
)
(cherry picked from commit 2b9cac26ec5457ad4e18ec418ff8249c37861eb8)
2015-09-02 11:32:08 -07:00
Akira Ajisaka
dcc0d4658c
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
...
(cherry picked from commit 4cec9975c0e2c2fcca090888dc2c5e149c5be1e9)
(cherry picked from commit 3de0bf9a35
)
(cherry picked from commit c3b2b377f19293797a88f4636f07e2ab8e18c78b)
2015-09-01 21:40:06 -07:00
Junping Du
8a9665a586
MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal to a reducer. Contributed by Jason Lowe.
...
(cherry picked from commit eccb7d46ef
)
(cherry picked from commit cacadea632
)
(cherry picked from commit 2abd4f61075739514fb3e63b118448895be02a30)
2015-09-01 20:10:20 -07:00
Jian He
e917ef3cfe
MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name properly. Contributed by Jason Lowe
...
(cherry picked from commit cff05bff1f
)
(cherry picked from commit 43b3b43cea
)
(cherry picked from commit 013e271036554020e3d26de4fcbb5b6970f5a9c0)
2015-08-31 15:49:24 -07:00
Gera Shegalov
1931fa5f4b
MAPREDUCE-6166. Reducers do not validate checksum of map outputs when fetching directly to disk. (Eric Payne via gera)
...
(cherry picked from commit af006937e8
)
(cherry picked from commit 7c7bccfc31
)
(cherry picked from commit 2e9dca584ba25809d9c6269e5f9326e09f55ed99)
2015-08-30 19:50:43 -07:00
Tsuyoshi Ozawa
5b3d9bf636
MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conections. Contributed by Kannan Rajah.
...
(cherry picked from commit 241336ca2b
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2015-02-10 03:54:54 +09:00
Karthik Kambatla
5913c5143b
Update release date for 2.5.2
...
(cherry picked from commit 1e9a3f42ff
)
2014-11-21 14:35:06 -08:00
Arun C. Murthy
98a4538cf4
Preparing to release hadoop-2.6.0-rc1.
...
(cherry picked from commit 9ff7315cbe
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-mapreduce-project/CHANGES.txt
hadoop-yarn-project/CHANGES.txt
2014-11-13 13:05:50 -08:00
Jason Lowe
9b383f6813
MAPREDUCE-6156. Fetcher - connect() doesn't handle connection refused correctly. Contributed by Junping Du
...
(cherry picked from commit 177e8090f5
)
2014-11-13 15:44:00 +00:00
Karthik Kambatla
ba01844260
Set the release date for 2.5.2
...
(cherry picked from commit 68a0508728
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
(cherry picked from commit 92de44c2c5
)
2014-11-10 15:24:14 -08:00
Arun C. Murthy
be31db82f7
Updated CHANGES.txt to reflect hadoop-2.6.0 release dates.
...
(cherry picked from commit 770cc14442
)
2014-11-09 18:53:55 -08:00
Kihwal Lee
c38c5752e4
MAPREDUCE-5958. Wrong reduce task progress if map output is compressed. Contributed by Emilio Coppa and Jason Lowe.
...
(cherry picked from commit 8f701ae07a
)
2014-11-06 15:56:50 -06:00
Jason Lowe
7be74ea09a
MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov
...
(cherry picked from commit 10f9f5101c
)
2014-11-06 15:12:37 +00:00
Jian He
d57dfac1ea
MAPREDUCE-6048. Fixed TestJavaSerialization failure. Contributed by Varun Vasudev
...
(cherry picked from commit 73068f677b
)
2014-11-04 20:21:04 -08:00
Karthik Kambatla
d76756dfe1
Adding release 2.5.2 to CHANGES.txt
...
(cherry picked from commit 4de56d27fb
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-11-04 16:52:56 -08:00
Zhijie Shen
7180167d01
MAPREDUCE-6052. Supported overriding the default container-log4j.properties file per job. Contributed by Junping Du.
...
(cherry picked from commit ed63b11646
)
2014-11-01 00:50:32 -07:00
Kihwal Lee
afbb279825
MAPREDUCE-6022. map_input_file is missing from streaming job
...
environment. Contributed by Jason Lowe.
(cherry picked from commit b056048114
)
2014-10-29 12:30:51 -05:00
Vinod Kumar Vavilapalli
6add7b19f6
MAPREDUCE-6142. Fixed test failures in TestJobHistoryEventHandler and TestMRTimelineEventHandling. Contributed by Zhijie Shen.
...
(cherry picked from commit 3f1441245d
)
2014-10-29 09:59:52 -07:00
Zhijie Shen
d92d4e32f2
MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter.
...
(cherry picked from commit 971e91c8c0
)
2014-10-27 21:09:20 -07:00
Zhijie Shen
71ab776b21
MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter.
...
(cherry picked from commit 6b2f11b54b
)
2014-10-27 20:45:22 -07:00
Jian He
cca473a321
MAPREDUCE-6126. Fixed Rumen JobBuilder to ignore NormalizedResourceEvent. Contributed by Junping Du
...
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 9b973b7c83
)
2014-10-22 10:58:21 -07:00
Ivan Mitic
a78dd99d67
Revert "MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita."
...
This reverts commit 71e05b1900
.
2014-10-19 23:43:38 -04:00
Ivan Mitic
71e05b1900
MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita.
...
(cherry picked from commit 7bbda6ef92
)
2014-10-19 19:15:55 -04:00
Jason Lowe
8217665297
MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in client. Contributed by Rohith
...
(cherry picked from commit 209b1699fc
)
2014-10-17 19:53:35 +00:00
Jason Lowe
ec38eec165
MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov
...
(cherry picked from commit f19771a24c
)
2014-10-15 17:52:12 +00:00
Jason Lowe
9203ea7ea9
MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li
...
(cherry picked from commit b9edad6403
)
2014-10-15 15:59:56 +00:00
Jason Lowe
034fcaa540
MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang
...
(cherry picked from commit 793dbf2465
)
2014-10-13 16:06:28 +00:00
Jason Lowe
5dbbabe85f
MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai
...
(cherry picked from commit bbe80cdc7b
)
2014-10-13 15:12:05 +00:00
cnauroth
308e336853
MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth.
...
(cherry picked from commit 777877d079
)
(cherry picked from commit f6278cbac5
)
2014-10-09 22:40:34 -07:00
cnauroth
4573bbe33d
MAPREDUCE-6122. Fix CHANGES.txt.
...
(cherry picked from commit 2f0166db56
)
(cherry picked from commit 61be28f501
)
2014-10-09 22:33:54 -07:00
cnauroth
3fe4e0d3df
MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth.
...
(cherry picked from commit 684170d5ef
)
(cherry picked from commit 85a2b90740
)
2014-10-09 22:30:25 -07:00
Jason Lowe
e835cb5c86
MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai
...
(cherry picked from commit 2e789eb226
)
2014-10-07 14:13:12 +00:00
Arun C. Murthy
d3e61c96b5
Branching for hadoop-2.6
2014-09-30 10:38:47 -07:00
Arun C. Murthy
6a60fa279a
Preparing to branch hadoop-2.6
2014-09-30 10:37:03 -07:00
Jason Lowe
7b8f2f5b1d
MAPREDUCE-6094. TestMRCJCFileInputFormat.testAddInputPath() fails on trunk. Contributed by Akira AJISAKA
...
(cherry picked from commit 23fbfe36c3
)
2014-09-29 18:14:11 +00:00
Allen Wittenauer
c65ef9ca1e
MAPREDUCE-6072. Remove INSTALL document (Akira AJISAKA via aw)
2014-09-29 08:31:10 -07:00
Jian He
a6879b606e
MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA
...
(cherry picked from commit 5f16c98ad6
)
2014-09-26 18:06:19 -07:00
Allen Wittenauer
67d6fc3f01
MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw)
2014-09-26 14:26:36 -07:00
Allen Wittenauer
e5d284664b
MAPREDUCE-5796. Use current version of the archive name in DistributedCacheDeploy document (Akira AJISAKA via aw)
2014-09-26 12:59:59 -07:00