2158 Commits

Author SHA1 Message Date
Akira Ajisaka
70e232f36e MAPREDUCE-6520. Migrate MR Client test cases part 1.
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
(cherry picked from commit 7d665f0a987c17dcf8a26113c61a70dee196ee3d)
2016-03-11 22:26:03 +09:00
Allen Wittenauer
8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 81a7ad45c9b3f38a4b99e897bb304c362fb1bdf5.
2016-03-09 09:59:33 -08:00
Chris Nauroth
a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68c65956b3dd69b6a93baab1be2beac7)
2016-03-08 21:23:07 -08:00
Harsh J
5f059e03f5 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:43 +05:30
Robert Kanter
3d8ae9c577 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter)
(cherry picked from commit 0f72da7e281376f4fcbfbf3fb33f5d7fedcdb1aa)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
2016-03-06 19:26:12 -08:00
Masatake Iwasaki
9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfbb654be655fbca42f34bba5a05c2f6d)
2016-03-04 14:13:30 +09:00
Andrew Wang
c6e37f6782 HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:03:13 -08:00
Varun Vasudev
cb4f5ebd3e MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du.
(cherry picked from commit c6f2d761d5430eac6b9f07f137a7028de4e0660c)
(cherry picked from commit f1999fe2754cbf11b138fb048c7486cab9b02c97)
2016-02-23 13:07:40 +05:30
Andrew Wang
d31660ef4a MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula.
(cherry picked from commit 37577852ba54ba506b0b6c4db5e95d176f5e9b63)
(cherry picked from commit 7f6737951a124480af2f3fff9358865fff3ed091)
2016-02-19 16:33:44 -08:00
Tsuyoshi Ozawa
7ccb0e0601 MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy.
(cherry picked from commit 453e7e0d1091cf795152c8992c6c5cbc772d80d6)
2016-02-17 14:18:24 +09:00
Junping Du
aed60ae0bf Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-02-13 01:48:50 -08:00
Jason Lowe
83985eed2a MAPREDUCE-6191. Improve clearing stale state of Java serialization
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102ddab1b83fd69e4492a40c9901fb50675)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0dfcb10760cea589b8cef6ace8e36417)
2016-02-10 16:46:58 +00:00
Akira Ajisaka
321da0604a Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta."
This reverts commit 3f8a30c956d464b86f91be3f0136ed7e15604f02.
2016-02-10 23:45:44 +09:00
Akira Ajisaka
f943bf0e22 MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun.
(cherry picked from commit 10393d9a666419a5d8dc0cfb48da96e9c690c11e)
(cherry picked from commit 8cbe65a07dd0deb150e91b13e3a1cec13e3716ee)
2016-02-10 03:05:23 +09:00
Jason Lowe
5d653a3fd1 Update CHANGES.txt to reflect recent commits to branch-2.7 and branch-2.6.
(cherry picked from commit fba6e9f5ef3d032986888117b3e53808e7dcf873)
2016-02-09 16:56:12 +00:00
Akira Ajisaka
3f8a30c956 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit fe124da5ffc16e4795c3dd5542accd58361e1b08)
(cherry picked from commit e4c01b8b1ce511de24db00afacef1e737845a4f7)
2016-02-06 19:33:11 +09:00
Junping Du
847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Jason Lowe
1d322ca5cc MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong
(cherry picked from commit 43e669b22d9ac0b81ab8cc397c5d6d92bac986c6)
2016-02-02 19:32:04 +00:00
Wangda Tan
c487453b91 YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
2016-02-02 10:23:25 +08:00
Jason Lowe
7bb48ed162 MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong
(cherry picked from commit 59a212b6e1265adfa9b55c71b65a22157dfccf77)
2016-02-01 16:11:20 +00:00
Akira Ajisaka
ce5947916d MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta.
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
(cherry picked from commit 79cde21064a1fe274a4dcbf3dec4ed0d743876cf)
2016-01-29 16:20:45 +09:00
cnauroth
ced22ca78f MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth.
(cherry picked from commit 41da9a07738c6d019e2467f139750b7e2f50a914)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt

(cherry picked from commit bd01fdb64d17b6146fc3588040aba9ed53ca57f9)
2016-01-28 14:47:03 -08:00
Junping Du
7e3b092cf2 MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and FileOutputCommitter. Contributed by Akira AJISAKA.
(cherry picked from commit 86560a4978c498bd5e892c509a466807a812b8a7)
(cherry picked from commit db7ff115c0f8ed1c49a90ffd50722571f6b82181)
2016-01-28 06:20:13 -08:00
Jian He
d83b124c97 MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du
(cherry picked from commit da18bbedaffad1f3ac9c078675583e7cfb68790f)
2016-01-27 13:18:19 -08:00
Jian He
b6fe3c20c5 MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu 2016-01-25 23:01:52 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
2016-01-25 15:47:39 -08:00
Akira Ajisaka
8ffa844d48 MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki.
(cherry picked from commit a9386cae6ef80d10f6427950b8ca9b77d5f86ca3)
2016-01-25 11:40:08 +09:00
Akira Ajisaka
b85b8d90d1 MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki.
(cherry picked from commit 7f215ffdd5219fc585ec484073b317a940895a60)
2016-01-22 18:38:08 +09:00
Jason Lowe
de31bff67d MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
(cherry picked from commit 9fbd579ab50f051c8ad63d316ca5a3e24822dcdd)
2016-01-15 16:54:03 +00:00
Akira Ajisaka
6816481c72 MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki.
(cherry picked from commit 5cc44d18aa946ce2a7a9ffbd7bcce57b07e9e1cb)
(cherry picked from commit 7c4be1599152b29d329b4e61c21a935aa234d5a9)
2016-01-15 00:44:52 +09:00
Akira Ajisaka
d4d368d4e8 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
(cherry picked from commit 7b0964f354e90968c2dac2f7acc17214732aed64)
(cherry picked from commit 6efee8907af3f21d8526927cf5e676d9922b686b)
2016-01-14 10:41:45 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
e3e09aa1e7 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
Putting CHANGES.txt entry under 2.6.3 after the backport.
2016-01-13 15:05:43 -08:00
Jason Lowe
a22a7f61e4 MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
(cherry picked from commit f657b54281d517c69df0a23b97b47befa77d1dc2)
2016-01-12 23:59:06 +00:00
Wangda Tan
00fca06b43 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
(cherry picked from commit 9e792da01419998c2ebfafd7161070150d85d3ac)
2016-01-12 12:56:12 +08:00
Jason Lowe
bf6d50cda3 Add MR-5982 and MR-6492 to 2.6.4
(cherry picked from commit e5df366707e326d869f72db03b08228b33ff6e46)
2016-01-11 18:33:25 +00:00
Junping Du
d7e10f8174 MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
(cherry picked from commit 8c1adeaa26a7eaaca891dccdb71ff085e598a7de)
(cherry picked from commit 51073c910ccdfaa07f7b8dab290617b56e4d86b7)
2016-01-11 06:14:58 -08:00
Sangjin Lee
ae535ec93e MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
(cherry picked from commit f6f16118d38fcfe3b724f05fad752cb223f441ec)
(cherry picked from commit 28fd4c70cab27c2872dc6a63ddee223ccf53f21d)
2016-01-06 08:44:37 -08:00
Akira Ajisaka
5daa07481e MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R.
(cherry picked from commit 7dafee11d865c7c121c7886ac66aa9d088ea13f7)
(cherry picked from commit 6d235f0b91b9ba3041f5465f480278c33f01bd36)
2016-01-04 16:31:42 +09:00
Akira Ajisaka
22ac1a1ac0 Set release date for 2.6.3
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
2016-01-04 16:13:06 +09:00
Akira Ajisaka
2139458a98 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
(cherry picked from commit 2a59d01503ed547bac15443fc273b5e04a2839d9)
(cherry picked from commit a8314505d0c7fa4a3748bef4c156095bdfdd3fc0)
2015-12-30 01:34:26 +09:00
Akira Ajisaka
7063d8d013 MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka)
(cherry picked from commit 1a06949126df84ffed703547a88beee5ff0bec83)
2015-12-30 01:04:40 +09:00
Wangda Tan
aa85ce73de MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda)
(cherry picked from commit 32b3dc11eba8f2d8f22ca502bf30d6aa8839460e)
(cherry picked from commit ca575e6addb801accafa7e3a6dad08d75cf79bdc)
2015-12-28 11:08:31 -08:00
Rohith Sharma K S
550840f402 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit a308e86621b1a7692fe1004ed14c919fdaba03cd)
2015-12-24 12:02:53 +05:30
Akira Ajisaka
5f34cbff5c MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
(cherry picked from commit 7995a6ea4dc524e5b17606359d09df72d771224a)
(cherry picked from commit 8607cb6074b40733d8990618a44c490f9f303ae3)
2015-12-21 00:18:40 +09:00
Xuan
93c483889c MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
(cherry picked from commit d4e766de931c1cc478561a211215c517ba1f341c)
(cherry picked from commit 5891d6ed55fdc73da6afa8517ebe9f4d2b666473)
2015-12-16 15:31:09 -08:00
Zhihai Xu
c4febc7d02 MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
(cherry picked from commit 5b7078d06921893200163a3d29c8901c3c0107cb)
2015-12-15 22:42:19 -08:00
Junping Du
12fb8b4cc5 Add 2.6.4 as release entry to CHANGES.txt 2015-12-02 07:38:03 -08:00
Allen Wittenauer
81a7ad45c9 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:15:57 -08:00
Vinod Kumar Vavilapalli
efaef45a24 Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8.
Revert "Adding release 2.8.0 to CHANGES.txt"

This reverts commit 767815f3176c4776ea828994a662404df303f890.
2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
2015-11-25 17:37:47 -08:00