Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,535 Commits 326 Branches 371 Tags
Commit Graph

1760 Commits

Author SHA1 Message Date
Zhihai Xu
65cbac9de4 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE 
(cherry picked from commit 7092d47fc0b3b792dd31f967c01d460dc089f60b)
 2015-12-15 21:49:22 -08:00
Xuan
3b10ff6a6f MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev 
(cherry picked from commit fc470840a0b1f5dc8b3b13f7ed99fd68ba728216)
 2015-12-07 14:15:50 -08:00
Junping Du
092c469059 Creating 2.6.4 entries in CHANGES.txt files. 
(cherry picked from commit 028894281bccd4e2f37eebff2e46409404ef64b7)
 2015-12-01 08:18:57 -08:00
Jason Lowe
854ef2be5b Update CHANGES.txt for commit of MR-6549 to branch-2.7 and branch-2.6. 
(cherry picked from commit 43acf9ab8ef4eea7950fa99096cd99459cfa25ad)
 2015-11-30 17:55:37 +00:00
Vinod Kumar Vavilapalli
767815f317 Adding release 2.8.0 to CHANGES.txt 
(cherry picked from commit d57fd181c75c2578775fda0ec575b66da416adff)
 2015-11-25 17:37:47 -08:00
Robert Kanter
7b4bf23b2a MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter) 
(cherry picked from commit 6d84cc16b3e0685fef01d0e3526b0f7556ceff51)
 2015-11-25 17:13:00 -08:00
Robert Kanter
8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)
 2015-11-25 17:03:52 -08:00
Junping Du
628c782870 Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA. 
(cherry picked from commit 15d577bfbb3f18fc95251d22378b53aa4210115f)
 2015-11-25 09:16:22 -08:00
Akira Ajisaka
5794dc83b0 Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. 
(cherry picked from commit 177975e962284a2bbd954ebb32bf8f6da5fc975e)
 2015-11-25 16:44:25 +09:00
Akira Ajisaka
c6cf7910a4 MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak. 
(cherry picked from commit 5ec44fc35c129d266edaebbc6fa17754a89b2ad6)
 2015-11-25 16:33:18 +09:00
Jason Lowe
2f18218508 MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G 
(cherry picked from commit f634505d48d97e4d461980d68a0cbdf87223646d)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
 2015-11-24 22:15:37 +00:00
Jason Lowe
ef3e01a1e4 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 
(cherry picked from commit cab3c7c8892ad33a7eb0955b01e99872ab95e192)
 2015-11-24 22:01:53 +00:00
Jason Lowe
d13b646c61 Update CHANGES.txt for recent commits to branch-2.6. 
(cherry picked from commit aa2009c37bc3c47035a5aea4a7449d3fe48569d4)
 2015-11-23 21:58:57 +00:00
Jason Lowe
44011a1759 Update CHANGES.txt to reflect commit of MR-6377 to branch-2.7 and branch-2.6. 
(cherry picked from commit be9f3bba73162ea6acc6fbc4b42f603fcbb9b371)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-18 17:26:13 +00:00
Akira Ajisaka
8de7911eb3 MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun. 
(cherry picked from commit a7f776ffdfc9f96d3091d99a2a87157b290cbfe0)
 2015-11-17 15:18:32 +09:00
Jian He
f562c155d2 MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du 2015-11-16 17:08:22 -08:00
Sangjin Lee
3214c2331f MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) 
(cherry picked from commit 9ad708a0dfa5e82d1a17471b1cf3e76204b32cbc)
 2015-11-11 16:22:28 -08:00
Jason Lowe
ee5c20ddef MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li 
(cherry picked from commit df68eac825c2b64b2b2dc2193134afaf2a1d9076)
 2015-11-11 17:27:03 +00:00
Tsuyoshi Ozawa
1c0c77e7f0 MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA. 
(cherry picked from commit 668e897538e317d96784f75b4e1f979c72225db7)
 2015-11-09 15:26:02 +09:00
Jason Lowe
8334d86472 Add 2.7.3 release to CHANGES.txt 
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)
 2015-11-04 16:27:28 +00:00
Sangjin Lee
b2d6ea5e18 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:49:21 -07:00
Kihwal Lee
52819fe4ef MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla. 
(cherry picked from commit 2868ca0328d908056745223fb38d9a90fd2811ba)
 2015-10-30 14:57:57 -05:00
Jason Lowe
a7d8895b60 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du 
(cherry picked from commit 6344b6a7694c70f296392b6462dba452ff762109)
 2015-10-30 15:32:48 +00:00
Jason Lowe
055e11c53e Update CHANGES.txt to reflect commit of MR-6273 to branch-2.6 
(cherry picked from commit 6ae9efaf5949bd5a5f4fd99b5777ce8f6d7f3a2c)
 2015-10-30 15:19:49 +00:00
Jason Lowe
8dce482f61 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096cb010eb7f0afd9afd4ae0d67b2645f)
 2015-10-30 14:52:06 +00:00
Jason Lowe
d6d642a4e3 Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7 
(cherry picked from commit ecad1253b782070adc1d825af3ffd2e214823046)
 2015-10-29 18:33:24 +00:00
Jason Lowe
145058003a MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G 
(cherry picked from commit cf953b6258b036fc482456b4591cfb98054f48f2)
 2015-10-29 18:05:56 +00:00
Sangjin Lee
16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
Junping Du
801ce47e28 MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA 
(cherry picked from commit eb6379ca25e1bb6d3978bd3a021723c38c95bec9)
 2015-10-23 10:07:41 -07:00
Jason Lowe
7c002e2416 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li 
(cherry picked from commit ee9b80acf84718b952cbb82380cd0a4dbe22dc79)
 2015-10-21 21:45:51 +00:00
Jason Lowe
be72ed1c75 MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:11:48 +00:00
Robert Kanter
492142097b MAPREDUCE-6495. Docs for archive-logs tool (rkanter) 
(cherry picked from commit 0c4af0f99811a7138954391df3761aef9ff09155)
 2015-10-20 17:34:56 -07:00
Karthik Kambatla
2d8f9e3fd9 MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 
(cherry picked from commit 4aa9b3e75ca86917125e56e1b438668273a5d87f)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
 2015-10-09 07:54:47 -07:00
Akira Ajisaka
22ff37f5ce MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 
(cherry picked from commit 584cf3bb35b96749f711b9e7145cf3fb71897cd9)
 2015-10-09 10:58:15 +09:00
Robert Kanter
e5bf4594cc MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 
(cherry picked from commit 1bca1bb5175b5976a5a0e45b6e1c4486bdf87a0e)
 2015-10-06 16:50:18 -07:00
rohithsharmaks
7dd9ebdebc MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) 
(cherry picked from commit 439f43ad3defbac907eda2d139a793f153544430)
 2015-10-02 20:36:20 +05:30
Akira Ajisaka
e42f576232 MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 
(cherry picked from commit 195793c6f3e53a5c0527020477fe9c9158576f77)
 2015-10-01 10:26:00 +02:00
Robert Kanter
46ef5aa8eb MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter) 
(cherry picked from commit 5db371f52f5c6e894a7e6a5d523084f4b316a7ab)
 2015-09-30 17:34:03 -07:00
Jason Lowe
3c4c52a095 MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt 
(cherry picked from commit ab11085b81353e1617875deb10f3c8e2a8b91a1e)
 2015-09-28 22:13:03 +00:00
Harsh J
03e370e306 MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit 66dad854c0aea8c137017fcf198b165cc1bd8bdd)
 2015-09-28 13:14:20 +05:30
Robert Kanter
d8a5d2b2fc MAPREDUCE-6480. archive-logs tool may miss applications (rkanter) 
(cherry picked from commit 8fec882cfaac047af1892615fe32d8c3ca02e7f9)
 2015-09-25 15:00:07 -07:00
Zhihai Xu
e5ba1a0521 MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu 
(cherry picked from commit 97a08807ec328a6f455d941fe3d9a469d885caa6)
 2015-09-24 08:14:11 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1 
(cherry picked from commit 1f707ecffd80142c25ef0dee8708da49920646bc)
 2015-09-23 15:12:30 -07:00
Harsh J
38420754f5 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
 2015-09-22 21:38:31 +05:30
Tsuyoshi Ozawa
52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 
(cherry picked from commit dfd807afab0fae3839c9cc5d552aa0304444f956)
 2015-09-22 12:54:44 +09:00
Zhihai Xu
88a3a07636 MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu. 
(cherry picked from commit e3ace31e2b7e3a8dc6cf3dc044d5ef2a9aa12e29)
 2015-09-19 00:12:15 -07:00
Haohui Mai
0971503522 MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. 2015-09-18 13:36:22 -07:00
Jason Lowe
9240a021fc Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2 
(cherry picked from commit f97dc034fe5db5919294465509cfb63d73bcd58e)
 2015-09-18 19:25:09 +00:00
Jason Lowe
6641ab83eb Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2 
(cherry picked from commit 288c8854a698c4b8378f0cc9399a0cccef4f9049)
 2015-09-18 15:16:06 +00:00
Jason Lowe
f27f1ef44c MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li 
(cherry picked from commit ee4ee6af6a5a6299d27462adb6944206039bbbae)
 2015-09-17 21:38:44 +00:00