Junping Du
|
51a3131a87
|
MAPREDUCE-6733. MapReduce JerseyTest tests failing with java.net.BindException: Address already in use. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit 1d053836b1 )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebServices.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebServicesAttempt.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebServicesAttempts.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebServicesJobConf.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebServicesJobs.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/webapp/TestAMWebServicesTasks.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServices.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesAttempts.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobConf.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobs.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesJobsQuery.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/webapp/TestHsWebServicesTasks.java
|
2016-07-15 11:36:04 -07:00 |
Robert Kanter
|
a2ef30cb2f
|
MAPREDUCE-6625. TestCLI#testGetJob fails occasionally (haibochen via rkanter)
(cherry picked from commit ad256beb50 )
|
2016-07-12 15:51:30 -07:00 |
Jian He
|
e94e6be772
|
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
|
2016-07-11 22:37:52 -07:00 |
Akira Ajisaka
|
b3b81b4f0e
|
HADOOP-13320. Fix arguments check in documentation for WordCount v2.0. Contributed by niccolo becchi.
(cherry picked from commit 9d46a49c74 )
|
2016-07-07 15:32:05 -07:00 |
Rohith Sharma K S
|
0a1a2ce070
|
MAPREDUCE-5803. Counters page display all task nevertheless of task type( Map or Reduce). Contributed by Kai Sasaki.
(cherry picked from commit 4fd37eed90 )
|
2016-06-28 09:45:15 +05:30 |
Akira Ajisaka
|
2830ee5f0f
|
MAPREDUCE-6725. Javadoc for CLI#listEvents() contains no-existent param. Contributed by shenyinjie.
(cherry picked from commit 0f23cd497b )
|
2016-06-25 00:27:18 +09:00 |
Tsuyoshi Ozawa
|
3ecbfdfdc2
|
MAPREDUCE-6721. mapreduce.reduce.shuffle.memory.limit.percent=0.0 should be legal to enforce shuffle to disk. (Gera Shegalov via ozawa)
This closes #102
(cherry picked from commit 79a7289165 )
|
2016-06-22 17:20:49 -07:00 |
Jian He
|
e0f4397232
|
MAPREDUCE-6197. Cache MapOutputLocations in ShuffleHandler. Contributed by Junping Du
(cherry picked from commit d8107fcd1c )
|
2016-06-21 14:26:23 -07:00 |
Sangjin Lee
|
910742ad12
|
MAPREDUCE-6719. The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store (Daniel Templeton via sjlee)
(cherry picked from commit 605b4b6136 )
|
2016-06-21 11:26:55 -07:00 |
Akira Ajisaka
|
1ef89a767d
|
MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao.
(cherry picked from commit 51d497fa93 )
|
2016-06-17 11:05:13 +09:00 |
Wangda Tan
|
7eb524ddee
|
YARN-4844. Addendum patch, revert few changes to public and evolving to avoid breaking downstream projects as much as possible.
|
2016-06-16 11:09:56 -07:00 |
Wangda Tan
|
863bfa4d6a
|
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
|
2016-06-14 15:12:00 -07:00 |
Akira Ajisaka
|
d219550e8b
|
HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
(cherry picked from commit e3ba9ad3f1 )
|
2016-06-14 10:20:43 +09:00 |
Akira Ajisaka
|
db2d96b378
|
MAPREDUCE-6741. Refactor UncompressedSplitLineReader.fillBuffer(). Contributed by Daniel Templeton.
(cherry picked from commit 0b7b8a3776 )
|
2016-06-10 19:17:05 +09:00 |
Gera Shegalov
|
5a9929e19b
|
MAPREDUCE-6240. Hadoop client displays confusing error message. (gera)
(cherry picked from commit 0af96a1c08 )
|
2016-06-08 13:49:31 -07:00 |
Ming Ma
|
74e2b5efa2
|
MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
(cherry picked from commit 4a1cedc010 )
|
2016-06-06 14:34:47 -07:00 |
Arun Suresh
|
384a84828f
|
YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
(cherry picked from commit dc26601d8f )
|
2016-06-02 09:14:30 -07:00 |
Varun Vasudev
|
4f36c3d214
|
YARN-4844. Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
|
2016-05-29 20:55:39 +05:30 |
Carlo Curino
|
c656977961
|
YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
(cherry picked from commit 013532a95e )
|
2016-05-25 16:58:19 -07:00 |
Jian He
|
396d222d7a
|
MAPREDUCE-6703. Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers. Contributed by Arun Suresh
(cherry picked from commit ae353ea969 )
|
2016-05-24 19:48:11 -07:00 |
Akira Ajisaka
|
a59f30272d
|
MAPREDUCE-6607. Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is set. Contributed by Kai Sasaki.
|
2016-05-23 07:25:52 +09:00 |
Jian He
|
db3cf5b354
|
MAPREDUCE-6696. Add a configuration to limit the number of map tasks allowed per job. Contributed by Zhihai Xu
(cherry picked from commit 21d2b90213 )
|
2016-05-19 19:25:48 -07:00 |
Junping Du
|
2703ec6871
|
YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron.
|
2016-05-19 14:10:15 -07:00 |
Robert Kanter
|
27aabcab45
|
MAPREDUCE-6686. Add a way to download the job config from the mapred CLI (rkanter)
(cherry picked from commit 992a49353f )
|
2016-05-18 12:16:45 -07:00 |
Junping Du
|
7e36b9159e
|
MAPREDUCE-6657. Job history server can fail on startup when NameNode is in start phase. Contributed by Haibo Chen.
(cherry picked from commit f6ef876fe1 )
|
2016-05-17 14:42:11 -07:00 |
Jason Lowe
|
9c47862d87
|
MAPREDUCE-6698. Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser. Contributed by Haibo Chen
(cherry picked from commit 34fddd1e91 )
|
2016-05-17 15:04:02 +00:00 |
Jason Lowe
|
51e06c085f
|
MAPREDUCE-6701. application master log can not be available when clicking jobhistory's am logs link. Contributed by Haibo Chen
(cherry picked from commit 12fa4ec141 )
|
2016-05-17 14:56:23 +00:00 |
Akira Ajisaka
|
19db965c27
|
MAPREDUCE-6693. ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit. Contributed by Ajith S.
(cherry picked from commit b357930526 )
|
2016-05-17 20:22:46 +09:00 |
Jason Lowe
|
08743edd70
|
MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 9227dfc25f )
|
2016-05-13 14:35:34 +00:00 |
Steve Loughran
|
eab6e633ee
|
MAPREDUCE-6639 Process hangs in LocatedFileStatusFetcher if FileSystem.get throws. Ryan Blue via stevel
|
2016-05-12 19:00:08 +01:00 |
Jason Lowe
|
d3dfed3fd0
|
MAPREDUCE-6684. High contention on scanning of user directory under immediate_done in Job History Server. Contributed by Haibo Chen
(cherry picked from commit 5ffb54694b )
|
2016-05-10 16:06:26 +00:00 |
Eric Payne
|
77d147e0ec
|
MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. Contributed by Nathan Roberts.
(cherry picked from commit cd35b692de )
|
2016-05-10 16:04:09 +00:00 |
Jason Lowe
|
d1aa3e0f89
|
MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan
(cherry picked from commit c9bb96fa81 )
|
2016-05-06 22:27:24 +00:00 |
Vinod Kumar Vavilapalli
|
e9c7a17bc8
|
MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan.
(cherry picked from commit 8d48266720 )
|
2016-05-05 19:05:44 -07:00 |
Robert Kanter
|
f9d6092108
|
MAPREDUCE-6675. TestJobImpl.testUnusableNode failed (haibochen via rkanter)
(cherry picked from commit 9d3fcdfbb3 )
|
2016-05-04 22:42:34 -07:00 |
Robert Kanter
|
cca8e9b90c
|
MAPREDUCE-6677. LocalContainerAllocator doesn't specify resource of the containers allocated (haibochen via rkanter)
(cherry picked from commit ecce3b7d53 )
|
2016-05-04 22:19:42 -07:00 |
Harsh J
|
2d7e4a8228
|
MAPREDUCE-2398. MRBench: setting the baseDir parameter has no effect. Contributed by Michael Noll and Wilfred Spiegelenburg.
(cherry picked from commit 7da5847cf1 )
|
2016-04-21 17:54:24 +05:30 |
Jian He
|
70a31458e0
|
MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du
(cherry picked from commit 1e48eefe58 )
|
2016-04-20 19:02:58 -07:00 |
Xuan
|
94e4d349b0
|
YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du
(cherry picked from commit e6c0742012 )
|
2016-04-16 19:40:11 -07:00 |
Eric Payne
|
edb096eab7
|
MAPREDUCE-6649. getFailureInfo not returning any failure info. Contributed by Eric Badger
|
2016-04-16 22:22:42 +00:00 |
Wangda Tan
|
ab23acdfda
|
MAPREDUCE-6513. MR job got hanged forever when one NM unstable for some time. (Varun Saxena via wangda)
|
2016-04-14 11:16:37 -07:00 |
Eric Payne
|
17c4f34b3d
|
MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors. Contributed by Rushabh Shah
(cherry picked from commit 1fec06e037 )
|
2016-04-09 18:27:03 +00:00 |
Robert Kanter
|
3584cbc355
|
MAPREDUCE-6647. MR usage counters use the resources requested instead of the resources allocated (haibochen via rkanter)
(cherry picked from commit 3be1ab485f )
|
2016-04-06 17:16:10 -07:00 |
Junping Du
|
5574f82799
|
MAPREDUCE-6670. TestJobListCache#testEviction sometimes fails on Windows with timeout. Contributed by Gergely Novák.
(cherry picked from commit de96d7c88a )
|
2016-04-06 08:35:51 -07:00 |
Akira Ajisaka
|
94b2ba89a4
|
MAPREDUCE-6663. [NNBench] Refactor nnbench as a Tool implementation. Contributed by Brahma Reddy Battula.
(cherry picked from commit 690d8a368d )
|
2016-03-30 11:44:33 +09:00 |
Akira Ajisaka
|
7b2cf29f4f
|
MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
(cherry picked from commit 0050fa5f1c )
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/TestMRJobClient.java
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/lib/partition/TestTotalOrderPartitioner.java
|
2016-03-29 18:20:01 +09:00 |
Rohith Sharma K S
|
f22ce96b50
|
MAPREDUCE-6662. Clear ASF Warnings on test data files. Contributed by Vinayakumar B
(cherry picked from commit 0ef8bbfd87 )
|
2016-03-29 10:35:04 +08:00 |
Junping Du
|
ae29b1a17b
|
MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 90fcb16c0f )
|
2016-03-28 05:31:46 -07:00 |
Akira Ajisaka
|
2b1f066d2d
|
Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote."
This reverts commit 0dc1453626 .
|
2016-03-28 16:05:55 +09:00 |
Jason Lowe
|
8360d98d6a
|
MAPREDUCE-6535. TaskID default constructor results in NPE on toString(). Contributed by Daniel Templeton
(cherry picked from commit 3f622a143c )
|
2016-03-25 20:07:56 +00:00 |