1778 Commits

Author SHA1 Message Date
Jason Lowe
5923f50797 MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
(cherry picked from commit 9fbd579ab50f051c8ad63d316ca5a3e24822dcdd)
2016-01-15 16:53:34 +00:00
Akira Ajisaka
7c4be15991 MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki.
(cherry picked from commit 5cc44d18aa946ce2a7a9ffbd7bcce57b07e9e1cb)
2016-01-15 00:44:42 +09:00
Akira Ajisaka
6efee8907a MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
(cherry picked from commit 7b0964f354e90968c2dac2f7acc17214732aed64)
2016-01-14 10:41:22 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
8de365a11c MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
Removed multiple duplicate CHANGES.txt entries.

(cherry picked from commit 9b33a03900c9ffdb9f4b4c59161fdce39ca8c73d)
2016-01-13 15:04:09 -08:00
Jason Lowe
0af01092b6 MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
(cherry picked from commit f657b54281d517c69df0a23b97b47befa77d1dc2)
2016-01-12 23:58:01 +00:00
Jason Lowe
6944e7ef44 Add MR-5982 and MR-6492 to 2.6.4
(cherry picked from commit e5df366707e326d869f72db03b08228b33ff6e46)
2016-01-11 18:32:48 +00:00
Junping Du
51073c910c MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
(cherry picked from commit 8c1adeaa26a7eaaca891dccdb71ff085e598a7de)
2016-01-11 06:13:53 -08:00
Sangjin Lee
7458854888 MAPREDUCE-6577 addendum. Moved the changelog to 2.6.4 which is the earliest target.
(cherry picked from commit 355c0ce7237c5208557bb32ec0423819bb9b47b3)
2016-01-05 15:45:01 -08:00
Sangjin Lee
2dfa0613a1 MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
(cherry picked from commit f6f16118d38fcfe3b724f05fad752cb223f441ec)
2016-01-05 15:25:47 -08:00
Akira Ajisaka
6d235f0b91 MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R.
(cherry picked from commit 7dafee11d865c7c121c7886ac66aa9d088ea13f7)
2016-01-04 16:31:28 +09:00
Akira Ajisaka
247ab92464 Set release date for 2.6.3
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
2016-01-04 16:12:52 +09:00
Akira Ajisaka
a8314505d0 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
(cherry picked from commit 2a59d01503ed547bac15443fc273b5e04a2839d9)
2015-12-30 01:34:15 +09:00
Akira Ajisaka
1a06949126 MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka) 2015-12-30 01:04:11 +09:00
Wangda Tan
ca575e6add MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda)
(cherry picked from commit 32b3dc11eba8f2d8f22ca502bf30d6aa8839460e)
2015-12-28 11:04:30 -08:00
Rohith Sharma K S
2d0348c907 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit a308e86621b1a7692fe1004ed14c919fdaba03cd)
2015-12-24 12:00:37 +05:30
Akira Ajisaka
8607cb6074 MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
(cherry picked from commit 7995a6ea4dc524e5b17606359d09df72d771224a)
2015-12-21 00:16:39 +09:00
Xuan
5891d6ed55 MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit d4e766de931c1cc478561a211215c517ba1f341c)
2015-12-16 15:29:33 -08:00
Vinod Kumar Vavilapalli
74a011d73a Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev"
This reverts commit 3b10ff6a6f7becea181506c306a52973602b0481.
2015-12-16 15:12:24 -08:00
Zhihai Xu
65cbac9de4 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE
(cherry picked from commit 7092d47fc0b3b792dd31f967c01d460dc089f60b)
2015-12-15 21:49:22 -08:00
Xuan
3b10ff6a6f MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit fc470840a0b1f5dc8b3b13f7ed99fd68ba728216)
2015-12-07 14:15:50 -08:00
Junping Du
092c469059 Creating 2.6.4 entries in CHANGES.txt files.
(cherry picked from commit 028894281bccd4e2f37eebff2e46409404ef64b7)
2015-12-01 08:18:57 -08:00
Jason Lowe
854ef2be5b Update CHANGES.txt for commit of MR-6549 to branch-2.7 and branch-2.6.
(cherry picked from commit 43acf9ab8ef4eea7950fa99096cd99459cfa25ad)
2015-11-30 17:55:37 +00:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
2015-11-25 17:37:47 -08:00
Robert Kanter
7b4bf23b2a MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter)
(cherry picked from commit 6d84cc16b3e0685fef01d0e3526b0f7556ceff51)
2015-11-25 17:13:00 -08:00
Robert Kanter
8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)
2015-11-25 17:03:52 -08:00
Junping Du
628c782870 Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA.
(cherry picked from commit 15d577bfbb3f18fc95251d22378b53aa4210115f)
2015-11-25 09:16:22 -08:00
Akira Ajisaka
5794dc83b0 Fix indents in the 2.8.0 section of MapReduce CHANGES.txt.
(cherry picked from commit 177975e962284a2bbd954ebb32bf8f6da5fc975e)
2015-11-25 16:44:25 +09:00
Akira Ajisaka
c6cf7910a4 MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak.
(cherry picked from commit 5ec44fc35c129d266edaebbc6fa17754a89b2ad6)
2015-11-25 16:33:18 +09:00
Jason Lowe
2f18218508 MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G
(cherry picked from commit f634505d48d97e4d461980d68a0cbdf87223646d)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
2015-11-24 22:15:37 +00:00
Jason Lowe
ef3e01a1e4 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts
(cherry picked from commit cab3c7c8892ad33a7eb0955b01e99872ab95e192)
2015-11-24 22:01:53 +00:00
Jason Lowe
d13b646c61 Update CHANGES.txt for recent commits to branch-2.6.
(cherry picked from commit aa2009c37bc3c47035a5aea4a7449d3fe48569d4)
2015-11-23 21:58:57 +00:00
Jason Lowe
44011a1759 Update CHANGES.txt to reflect commit of MR-6377 to branch-2.7 and branch-2.6.
(cherry picked from commit be9f3bba73162ea6acc6fbc4b42f603fcbb9b371)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
2015-11-18 17:26:13 +00:00
Akira Ajisaka
8de7911eb3 MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
(cherry picked from commit a7f776ffdfc9f96d3091d99a2a87157b290cbfe0)
2015-11-17 15:18:32 +09:00
Jian He
f562c155d2 MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du 2015-11-16 17:08:22 -08:00
Sangjin Lee
3214c2331f MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee)
(cherry picked from commit 9ad708a0dfa5e82d1a17471b1cf3e76204b32cbc)
2015-11-11 16:22:28 -08:00
Jason Lowe
ee5c20ddef MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li
(cherry picked from commit df68eac825c2b64b2b2dc2193134afaf2a1d9076)
2015-11-11 17:27:03 +00:00
Tsuyoshi Ozawa
1c0c77e7f0 MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA.
(cherry picked from commit 668e897538e317d96784f75b4e1f979c72225db7)
2015-11-09 15:26:02 +09:00
Jason Lowe
8334d86472 Add 2.7.3 release to CHANGES.txt
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)
2015-11-04 16:27:28 +00:00
Sangjin Lee
b2d6ea5e18 Updated the 2.6.2 final release date.
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
2015-10-30 18:49:21 -07:00
Kihwal Lee
52819fe4ef MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla.
(cherry picked from commit 2868ca0328d908056745223fb38d9a90fd2811ba)
2015-10-30 14:57:57 -05:00
Jason Lowe
a7d8895b60 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du
(cherry picked from commit 6344b6a7694c70f296392b6462dba452ff762109)
2015-10-30 15:32:48 +00:00
Jason Lowe
055e11c53e Update CHANGES.txt to reflect commit of MR-6273 to branch-2.6
(cherry picked from commit 6ae9efaf5949bd5a5f4fd99b5777ce8f6d7f3a2c)
2015-10-30 15:19:49 +00:00
Jason Lowe
8dce482f61 Creating 2.6.3 entries in CHANGES.txt files.
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)
2015-10-30 14:52:06 +00:00
Jason Lowe
d6d642a4e3 Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7
(cherry picked from commit ecad1253b782070adc1d825af3ffd2e214823046)
2015-10-29 18:33:24 +00:00
Jason Lowe
145058003a MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
(cherry picked from commit cf953b6258b036fc482456b4591cfb98054f48f2)
2015-10-29 18:05:56 +00:00
Sangjin Lee
16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
Junping Du
801ce47e28 MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA
(cherry picked from commit eb6379ca25e1bb6d3978bd3a021723c38c95bec9)
2015-10-23 10:07:41 -07:00
Jason Lowe
7c002e2416 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li
(cherry picked from commit ee9b80acf84718b952cbb82380cd0a4dbe22dc79)
2015-10-21 21:45:51 +00:00
Jason Lowe
be72ed1c75 MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:11:48 +00:00
Robert Kanter
492142097b MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
(cherry picked from commit 0c4af0f99811a7138954391df3761aef9ff09155)
2015-10-20 17:34:56 -07:00