Jian He
|
e0f4397232
|
MAPREDUCE-6197. Cache MapOutputLocations in ShuffleHandler. Contributed by Junping Du
(cherry picked from commit d8107fcd1c )
|
2016-06-21 14:26:23 -07:00 |
Sangjin Lee
|
910742ad12
|
MAPREDUCE-6719. The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store (Daniel Templeton via sjlee)
(cherry picked from commit 605b4b6136 )
|
2016-06-21 11:26:55 -07:00 |
Akira Ajisaka
|
1ef89a767d
|
MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao.
(cherry picked from commit 51d497fa93 )
|
2016-06-17 11:05:13 +09:00 |
Wangda Tan
|
7eb524ddee
|
YARN-4844. Addendum patch, revert few changes to public and evolving to avoid breaking downstream projects as much as possible.
|
2016-06-16 11:09:56 -07:00 |
Wangda Tan
|
863bfa4d6a
|
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
|
2016-06-14 15:12:00 -07:00 |
Akira Ajisaka
|
d219550e8b
|
HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
(cherry picked from commit e3ba9ad3f1 )
|
2016-06-14 10:20:43 +09:00 |
Akira Ajisaka
|
db2d96b378
|
MAPREDUCE-6741. Refactor UncompressedSplitLineReader.fillBuffer(). Contributed by Daniel Templeton.
(cherry picked from commit 0b7b8a3776 )
|
2016-06-10 19:17:05 +09:00 |
Gera Shegalov
|
5a9929e19b
|
MAPREDUCE-6240. Hadoop client displays confusing error message. (gera)
(cherry picked from commit 0af96a1c08 )
|
2016-06-08 13:49:31 -07:00 |
Ming Ma
|
74e2b5efa2
|
MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
(cherry picked from commit 4a1cedc010 )
|
2016-06-06 14:34:47 -07:00 |
Arun Suresh
|
384a84828f
|
YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
(cherry picked from commit dc26601d8f )
|
2016-06-02 09:14:30 -07:00 |
Varun Vasudev
|
4f36c3d214
|
YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
|
2016-05-29 20:55:39 +05:30 |
Carlo Curino
|
c656977961
|
YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
(cherry picked from commit 013532a95e )
|
2016-05-25 16:58:19 -07:00 |
Jian He
|
396d222d7a
|
MAPREDUCE-6703. Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers. Contributed by Arun Suresh
(cherry picked from commit ae353ea969 )
|
2016-05-24 19:48:11 -07:00 |
Akira Ajisaka
|
a59f30272d
|
MAPREDUCE-6607. Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is set. Contributed by Kai Sasaki.
|
2016-05-23 07:25:52 +09:00 |
Jian He
|
db3cf5b354
|
MAPREDUCE-6696. Add a configuration to limit the number of map tasks allowed per job. Contributed by Zhihai Xu
(cherry picked from commit 21d2b90213 )
|
2016-05-19 19:25:48 -07:00 |
Junping Du
|
2703ec6871
|
YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron.
|
2016-05-19 14:10:15 -07:00 |
Robert Kanter
|
27aabcab45
|
MAPREDUCE-6686. Add a way to download the job config from the mapred CLI (rkanter)
(cherry picked from commit 992a49353f )
|
2016-05-18 12:16:45 -07:00 |
Junping Du
|
7e36b9159e
|
MAPREDUCE-6657. Job history server can fail on startup when NameNode is in start phase. Contributed by Haibo Chen.
(cherry picked from commit f6ef876fe1 )
|
2016-05-17 14:42:11 -07:00 |
Jason Lowe
|
9c47862d87
|
MAPREDUCE-6698. Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser. Contributed by Haibo Chen
(cherry picked from commit 34fddd1e91 )
|
2016-05-17 15:04:02 +00:00 |
Jason Lowe
|
51e06c085f
|
MAPREDUCE-6701. application master log can not be available when clicking jobhistory's am logs link. Contributed by Haibo Chen
(cherry picked from commit 12fa4ec141 )
|
2016-05-17 14:56:23 +00:00 |
Akira Ajisaka
|
19db965c27
|
MAPREDUCE-6693. ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit. Contributed by Ajith S.
(cherry picked from commit b357930526 )
|
2016-05-17 20:22:46 +09:00 |
Jason Lowe
|
08743edd70
|
MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 9227dfc25f )
|
2016-05-13 14:35:34 +00:00 |
Steve Loughran
|
eab6e633ee
|
MAPREDUCE-6639 Process hangs in LocatedFileStatusFetcher if FileSystem.get throws. Ryan Blue via stevel
|
2016-05-12 19:00:08 +01:00 |
Jason Lowe
|
d3dfed3fd0
|
MAPREDUCE-6684. High contention on scanning of user directory under immediate_done in Job History Server. Contributed by Haibo Chen
(cherry picked from commit 5ffb54694b )
|
2016-05-10 16:06:26 +00:00 |
Eric Payne
|
77d147e0ec
|
MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. Contributed by Nathan Roberts.
(cherry picked from commit cd35b692de )
|
2016-05-10 16:04:09 +00:00 |
Jason Lowe
|
d1aa3e0f89
|
MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan
(cherry picked from commit c9bb96fa81 )
|
2016-05-06 22:27:24 +00:00 |
Vinod Kumar Vavilapalli
|
e9c7a17bc8
|
MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan.
(cherry picked from commit 8d48266720 )
|
2016-05-05 19:05:44 -07:00 |
Robert Kanter
|
f9d6092108
|
MAPREDUCE-6675. TestJobImpl.testUnusableNode failed (haibochen via rkanter)
(cherry picked from commit 9d3fcdfbb3 )
|
2016-05-04 22:42:34 -07:00 |
Robert Kanter
|
cca8e9b90c
|
MAPREDUCE-6677. LocalContainerAllocator doesn't specify resource of the containers allocated (haibochen via rkanter)
(cherry picked from commit ecce3b7d53 )
|
2016-05-04 22:19:42 -07:00 |
Harsh J
|
2d7e4a8228
|
MAPREDUCE-2398. MRBench: setting the baseDir parameter has no effect. Contributed by Michael Noll and Wilfred Spiegelenburg.
(cherry picked from commit 7da5847cf1 )
|
2016-04-21 17:54:24 +05:30 |
Jian He
|
70a31458e0
|
MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du
(cherry picked from commit 1e48eefe58 )
|
2016-04-20 19:02:58 -07:00 |
Xuan
|
94e4d349b0
|
YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du
(cherry picked from commit e6c0742012 )
|
2016-04-16 19:40:11 -07:00 |
Eric Payne
|
edb096eab7
|
MAPREDUCE-6649. getFailureInfo not returning any failure info. Contributed by Eric Badger
|
2016-04-16 22:22:42 +00:00 |
Wangda Tan
|
ab23acdfda
|
MAPREDUCE-6513. MR job got hanged forever when one NM unstable for some time. (Varun Saxena via wangda)
|
2016-04-14 11:16:37 -07:00 |
Eric Payne
|
17c4f34b3d
|
MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors. Contributed by Rushabh Shah
(cherry picked from commit 1fec06e037 )
|
2016-04-09 18:27:03 +00:00 |
Robert Kanter
|
3584cbc355
|
MAPREDUCE-6647. MR usage counters use the resources requested instead of the resources allocated (haibochen via rkanter)
(cherry picked from commit 3be1ab485f )
|
2016-04-06 17:16:10 -07:00 |
Junping Du
|
5574f82799
|
MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. Contributed by Gergely Novák.
(cherry picked from commit de96d7c88a )
|
2016-04-06 08:35:51 -07:00 |
Akira Ajisaka
|
94b2ba89a4
|
MAPREDUCE-6663. [NNBench] Refactor nnbench as a Tool implementation. Contributed by Brahma Reddy Battula.
(cherry picked from commit 690d8a368d )
|
2016-03-30 11:44:33 +09:00 |
Akira Ajisaka
|
7b2cf29f4f
|
MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 0050fa5f1c )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
|
2016-03-29 18:20:01 +09:00 |
Rohith Sharma K S
|
f22ce96b50
|
MAPREDUCE-6662. Clear ASF Warnings on test data files. Contributed by Vinayakumar B
(cherry picked from commit 0ef8bbfd87 )
|
2016-03-29 10:35:04 +08:00 |
Junping Du
|
ae29b1a17b
|
MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 90fcb16c0f )
|
2016-03-28 05:31:46 -07:00 |
Akira Ajisaka
|
2b1f066d2d
|
Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote."
This reverts commit 0dc1453626 .
|
2016-03-28 16:05:55 +09:00 |
Jason Lowe
|
8360d98d6a
|
MAPREDUCE-6535. TaskID default constructor results in NPE on toString(). Contributed by Daniel Templeton
(cherry picked from commit 3f622a143c )
|
2016-03-25 20:07:56 +00:00 |
Akira Ajisaka
|
0dc1453626
|
MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 2c268cc936 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
|
2016-03-25 15:23:23 +09:00 |
Akira Ajisaka
|
7a3fd1bc1a
|
MAPREDUCE-6656. [NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363. Contributed by J.Andreina.
(cherry picked from commit 368c77376a )
|
2016-03-23 23:24:30 +09:00 |
Akira Ajisaka
|
12c1cc889a
|
MAPREDUCE-6580. Test failure: TestMRJobsWithProfiler. Contributed by Eric Badger.
(cherry picked from commit 0bfe5a0167 )
|
2016-03-23 13:19:08 +09:00 |
Li Lu
|
8bbb5efbfb
|
MAPREDUCE-6110. JobHistoryServer CLI throws NullPointerException with job ids that do not exist. (Kai Sasaki via gtcarrera9)
(cherry picked from commit 57ead18a85 )
|
2016-03-22 14:29:12 -07:00 |
Karthik Kambatla
|
95b59c17a7
|
YARN-4732. *ProcessTree classes have too many whitespace issues
(cherry picked from commit 7fae4c68e6 )
|
2016-03-20 10:47:56 -07:00 |
Wangda Tan
|
abfb2957d1
|
MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda)
(cherry picked from commit 6529c87551 )
|
2016-03-15 17:30:37 -07:00 |
Akira Ajisaka
|
c2e14d1bbb
|
MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote.
(cherry picked from commit 247a790609 )
|
2016-03-11 22:54:40 +09:00 |