Commit Graph

1780 Commits

Author SHA1 Message Date
Junping Du eb6379ca25 MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA 2015-10-23 10:05:46 -07:00
Jason Lowe ee9b80acf8 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li 2015-10-21 21:44:43 +00:00
Jason Lowe cb26cd4bee MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:01:23 +00:00
Robert Kanter 0c4af0f998 MAPREDUCE-6495. Docs for archive-logs tool (rkanter) 2015-10-20 17:34:34 -07:00
Karthik Kambatla 4aa9b3e75c MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 2015-10-09 07:37:39 -07:00
Akira Ajisaka 584cf3bb35 MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 2015-10-09 10:54:12 +09:00
Robert Kanter 1bca1bb517 MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 2015-10-06 16:49:50 -07:00
rohithsharmaks 439f43ad3d MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) 2015-10-02 20:34:34 +05:30
Akira Ajisaka 195793c6f3 MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 2015-10-01 10:22:45 +02:00
Robert Kanter 5db371f52f MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter) 2015-09-30 17:33:53 -07:00
Jason Lowe ab11085b81 MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt 2015-09-28 22:12:03 +00:00
Harsh J 66dad854c0 MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian. 2015-09-28 13:12:43 +05:30
Robert Kanter d3c49e7662 MAPREDUCE-6480. archive-logs tool may miss applications (rkanter) 2015-09-25 15:02:42 -07:00
Zhihai Xu 97a08807ec MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu 2015-09-24 08:12:07 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 1f707ecffd Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:10:50 -07:00
Harsh J cc2b473990 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian. 2015-09-22 21:38:06 +05:30
Tsuyoshi Ozawa dfd807afab HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 2015-09-22 12:54:29 +09:00
Zhihai Xu e3ace31e2b MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu. 2015-09-19 00:10:06 -07:00
Haohui Mai 602335dfe6 MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. 2015-09-18 13:36:09 -07:00
Jason Lowe f97dc034fe Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2 2015-09-18 19:24:10 +00:00
Jason Lowe 288c8854a6 Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2 2015-09-18 15:14:18 +00:00
Jason Lowe ee4ee6af6a MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li 2015-09-17 21:37:39 +00:00
Jason Lowe 3f82f582e5 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li 2015-09-17 18:17:29 +00:00
Jason Lowe 58d1a02b8d MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 2015-09-17 14:30:18 +00:00
Haohui Mai 941001bfa6 MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu. 2015-09-16 13:06:26 -07:00
Jason Lowe 62943b8e3a MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R 2015-09-15 19:43:20 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) fbbb7ff1ed Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.
2015-09-10 13:45:57 -07:00
Jason Lowe 8e615588d5 MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla 2015-09-10 16:00:17 +00:00
Karthik Kambatla 119cc75e7e MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha) 2015-09-09 17:45:19 -07:00
Tsuyoshi Ozawa 9b685773ec MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li. 2015-09-05 11:21:03 +09:00
Akira Ajisaka 00804e2457 Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 75a2560e51.
2015-09-02 12:22:16 +09:00
Zhihai Xu cbb249534a MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu 2015-08-28 12:13:23 -07:00
Andrew Wang 50fa383704 Revert "MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)"
This reverts commit 61bf9cae6f.
2015-08-27 10:15:19 -07:00
Karthik Kambatla 61bf9cae6f MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha) 2015-08-22 00:39:04 -07:00
Akira Ajisaka 2ba90c93d7 MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote. 2015-08-21 10:41:54 +09:00
Vinod Kumar Vavilapalli 33474939a0 Creating 2.6.2 entries in CHANGES.txt files. 2015-08-20 17:21:06 -07:00
Karthik Kambatla 8dfec7a197 MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) 2015-08-15 00:52:11 -07:00
Karthik Kambatla 27d24f96ab MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 2015-08-14 12:29:50 -07:00
Allen Wittenauer fb1be0b310 MAPREDUCE-6257. Document encrypted spills (Bibin A Chundatt via aw) 2015-08-06 10:13:51 -07:00
Junping Du e73a928a63 MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter.
(cherry picked from commit c8469357ba)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
2015-08-06 07:03:46 -07:00
Jason Lowe d0e0ba8010 MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang 2015-07-31 18:17:54 +00:00
Zhihai Xu 93d50b7824 MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu 2015-07-30 23:07:31 -07:00
Allen Wittenauer cf74772064 MAPREDUCE-5801. Uber mode's log message is missing a vcore reason (Steven Wong via aw) 2015-07-21 10:58:52 -07:00
Chris Douglas f4ccdb11dc MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang 2015-07-14 14:55:43 -07:00
Akira Ajisaka e04faf8e46 MAPREDUCE-6421. Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression. Contributed by Brahma Reddy Battula. 2015-07-13 14:29:14 +09:00
Devaraj K fffb15bb43 MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing.
Contributed by zhihai xu.
2015-07-09 15:00:26 +05:30
Chris Douglas 7e2fe8c9f2 MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa 2015-07-07 10:27:04 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) bf89ddb9b8 Release process for 2.7.1: Set the release date for 2.7.1. 2015-07-06 16:39:59 -07:00
Devaraj K bff67dfe2f MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
2015-07-06 13:46:37 +05:30
Jason Lowe eac1d18943 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li 2015-07-01 18:01:22 +00:00