Konstantin V Shvachko
42c2d36ba6
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. Contributed by Naganarasimha G R. Backport by Inigo Goiri.
...
(cherry picked from commit 3164e7d838
)
2017-05-18 00:20:15 -07:00
Zhe Zhang
79f7bfbf22
MAPREDUCE-6873. MR Job Submission Fails if MR framework application path not on defaultFS. Contributed by Erik Krogen.
...
(cherry picked from commit de7efd2687
)
(cherry picked from commit 3f5dc51ec9
)
(cherry picked from commit 0acf2bca9c
)
2017-03-29 22:35:12 -07:00
Akira Ajisaka
a47d8283b1
Treat encrypted files as private. Contributed by Daniel Templeton.
...
(cherry picked from commit f01a69f84f
)
(cherry picked from commit 120f680318
)
2017-03-07 13:40:16 +09:00
Zhe Zhang
f5a4f69e9d
Addendum for HDFS-10534: revert accidental change to MiniHadoopClusterManager.java.
2017-01-26 10:50:48 -08:00
Zhe Zhang
03a67e1e62
HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki.
2017-01-26 10:34:00 -08:00
Junping Du
01dff41699
MAPREDUCE-6711. JobImpl fails to handle preemption events on state COMMITTING. Contributed by Prabhu Joseph.
...
(cherry picked from commit 679478d0c6
)
(cherry picked from commit bf87c523ab
)
(cherry picked from commit 031ad740b9
)
2017-01-07 22:14:44 -08:00
Jason Lowe
5aa26aa66e
MAPREDUCE-6724. Single shuffle to memory must not exceed Integer#MAX_VALUE. (Haibo Chen via gera)
...
(cherry picked from commit 0a405c4f71
)
2016-10-28 14:43:40 +00:00
Brahma Reddy Battula
7e241cfcba
HADOOP-13670. Update CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Brahma Reddy Battula
2016-10-06 17:56:45 +05:30
Jason Lowe
599146d10b
MAPREDUCE-6741. Add MR support to redact job conf properties. Contributed by Haibo Chen
...
(cherry picked from commit f1b74a3d9f
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2016-10-05 15:33:23 +00:00
Jason Lowe
7a2d602ae0
MAPREDUCE-6771. RMContainerAllocator sends container diagnostics event after corresponding completion event. Contributed by Haibo Chen
2016-09-29 16:05:41 +00:00
Jason Lowe
d499a8cccf
MAPREDUCE-4784. TestRecovery occasionally fails. Contributed by Haibo Chen
...
(cherry picked from commit f70f522e80
)
2016-08-30 14:11:49 +00:00
Jason Lowe
a852800d2f
MAPREDUCE-6768. TestRecovery.testSpeculative failed with NPE. Contributed by Haibo Chen
...
(cherry picked from commit 44d0af2611
)
2016-08-29 20:02:47 +00:00
Varun Saxena
30a4c0bb63
MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena)
2016-08-20 04:18:25 +05:30
Jason Lowe
4edff93c7c
MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger
...
(cherry picked from commit 703fdf86c6
)
2016-07-25 21:59:48 +00:00
Vinod Kumar Vavilapalli
c454639abf
HADOOP-13312. Updated CHANGES.txt to reflect all the changes in branch-2.7. Contributed by Akira Ajisaka.
2016-07-12 15:41:22 -07:00
Rohith Sharma K S
0bc531aa8f
Adding-release-2.7.4-to-CHANGES.txt
2016-06-21 11:27:13 +05:30
Vinod Kumar Vavilapalli
f4b58eae94
Preparing for 2.7.4 development: Updating snapshot version to 2.7.4 on branch-2.7.
2016-06-14 19:14:02 -07:00
Akira Ajisaka
d44873a2a0
HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
...
(cherry picked from commit e3ba9ad3f1
)
(cherry picked from commit d219550e8b
)
2016-06-14 10:23:17 +09:00
Jason Lowe
7ded648aee
MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg
...
(cherry picked from commit 9227dfc25f
)
2016-05-13 14:37:55 +00:00
Jian He
1918da8fc9
MAPREDUCE-6513. Job got hanged forever when one NM unstable for some
...
time. Contributed by Varun Saxena & Wangda Tan
2016-05-12 15:14:08 -07:00
Jason Lowe
5f698df901
MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan
...
(cherry picked from commit c9bb96fa81
)
2016-05-06 22:29:52 +00:00
Vinod Kumar Vavilapalli
9f51a3f430
MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan.
...
Updated the 2.7 branch patch to fix a minor issue in TestRMContainerAllocator.java
(cherry picked from commit 8d48266720
)
2016-05-05 19:39:25 -07:00
Jian He
f1e4f4d83a
MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du
...
(cherry picked from commit 1e48eefe58
)
2016-04-20 19:03:53 -07:00
Karthik Kambatla
cc6ae6fa7e
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
...
(cherry picked from commit 27d24f96ab
)
(cherry picked from commit b826168173
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-04-18 21:58:53 -07:00
Eric Payne
2ec5bb0fe8
MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors. Contributed by Rushabh Shah
...
(cherry picked from commit 1fec06e037
)
2016-04-18 16:12:53 +00:00
Robert Kanter
c9ba6fa9ba
MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter)
...
(cherry picked from commit ff0ee84d77
)
(cherry picked from commit f9f57265cf
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-04-14 14:58:45 -07:00
Junping Du
b4d24d7b0e
Add entry of MAPREDUCE-6670 to CHANGES.txt after backport.
2016-04-13 09:02:33 -07:00
Junping Du
683f313c1f
MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. Contributed by Gergely Novák.
...
(cherry picked from commit de96d7c88a
)
(cherry picked from commit 5574f82799
)
2016-04-13 08:59:22 -07:00
Wangda Tan
801c95c1cc
MAPREDUCE-6302. Preempt reducers after a configurable timeout irrespective of headroom. (kasha via wangda)
2016-04-08 14:35:28 -07:00
Akira Ajisaka
a112c0138a
MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina.
...
(cherry picked from commit 368c77376a
)
(cherry picked from commit 7a3fd1bc1a
)
2016-03-23 23:26:33 +09:00
Akira Ajisaka
04cc99152f
MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger.
...
(cherry picked from commit 0bfe5a0167
)
(cherry picked from commit 12c1cc889a
)
2016-03-23 13:23:29 +09:00
Akira Ajisaka
d593976ffc
MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak.
...
(cherry picked from commit 80fa70c4e1
)
(cherry picked from commit 365d236175
)
2016-03-17 18:13:20 +09:00
Robert Kanter
66e1e92ffd
MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter)
...
(cherry picked from commit 0f72da7e28
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-03-06 18:34:46 -08:00
Varun Vasudev
0edc764184
MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du.
...
(cherry picked from commit c6f2d761d5
)
(cherry picked from commit f1999fe275
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-02-23 14:45:07 +05:30
Andrew Wang
403934c011
MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 37577852ba
)
(cherry picked from commit 7f6737951a
)
2016-02-19 16:37:28 -08:00
Junping Du
63069389ee
Set the release date for 2.6.4.
...
(cherry picked from commit ec12ce8f48
)
(cherry picked from commit a28be9edc7
)
2016-02-13 01:50:30 -08:00
Jason Lowe
717b1a1f99
MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
...
(cherry picked from commit e3ace31e2b
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-02-10 16:58:57 +00:00
Jason Lowe
9d574368b5
MAPREDUCE-6191. Improve clearing stale state of Java serialization
...
testcase. (Sam Liu via Eric Yang)
(cherry picked from commit c379e102dd
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0d
)
2016-02-10 16:48:06 +00:00
Jason Lowe
6257ed8431
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu
...
(cherry picked from commit aa5b15b03b
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-02-09 16:33:07 +00:00
Junping Du
bfee573baf
Adding release 2.6.5 to CHANGES.txt
2016-02-02 18:19:08 -08:00
Jason Lowe
7f6d150c9a
MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong
...
(cherry picked from commit 43e669b22d
)
2016-02-02 19:32:37 +00:00
Jason Lowe
69c61fae0c
MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong
...
(cherry picked from commit 59a212b6e1
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-02-01 16:10:56 +00:00
Jian He
a1b75ff8c5
MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du
...
(cherry picked from commit da18bbedaf
)
2016-01-27 13:20:16 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
34c9289f6c
Release process for 2.7.2: Set the release date for 2.7.2
...
(cherry picked from commit ec4d2d9f40
)
2016-01-25 15:48:18 -08:00
Jason Lowe
296ecbd5ec
MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
2016-01-15 16:59:44 +00:00
Akira Ajisaka
b1ee278428
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
...
(cherry picked from commit 7b0964f354
)
(cherry picked from commit 6efee8907a
)
2016-01-14 10:42:02 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f93f912969
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
...
Putting CHANGES.txt entry under 2.6.3 after the backport.
(cherry picked from commit e3e09aa1e7
)
2016-01-13 15:08:13 -08:00
Jason Lowe
fec437ac31
Add MR-5982 and MR-6492 to 2.6.4
...
(cherry picked from commit e5df366707
)
2016-01-11 18:33:47 +00:00
Sangjin Lee
28fd4c70ca
MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
...
(cherry picked from commit f6f16118d3
)
2016-01-05 16:01:09 -08:00
Akira Ajisaka
68c68e187f
Set release date for 2.6.3
...
(cherry picked from commit db99e30f67
)
(cherry picked from commit 247ab92464
)
2016-01-04 16:14:30 +09:00