Wangda Tan
2d9f42d685
MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda)
...
(cherry picked from commit 6529c87551
)
2016-03-15 17:32:32 -07:00
Akira Ajisaka
cb97d8fa63
MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote.
...
(cherry picked from commit 247a790609
)
(cherry picked from commit c2e14d1bbb
)
2016-03-11 22:55:16 +09:00
Akira Ajisaka
097a03fb6d
Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1."
...
This reverts commit 70e232f36e
.
2016-03-11 22:55:01 +09:00
Akira Ajisaka
70e232f36e
MAPREDUCE-6520. Migrate MR Client test cases part 1.
...
(cherry picked from commit ef68b44195
)
(cherry picked from commit 7d665f0a98
)
2016-03-11 22:26:03 +09:00
Allen Wittenauer
8b4a8ff1b2
Revert "HADOOP-12366. expose calculated paths (aw)"
...
This reverts commit 81a7ad45c9
.
2016-03-09 09:59:33 -08:00
Chris Nauroth
a3cd43990c
HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
...
(cherry picked from commit 89b16d27e2
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/pom.xml
hadoop-mapreduce-project/pom.xml
(cherry picked from commit 38a031ce68
)
2016-03-08 21:23:07 -08:00
Harsh J
5f059e03f5
MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh)
2016-03-07 13:13:43 +05:30
Robert Kanter
3d8ae9c577
MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter)
...
(cherry picked from commit 0f72da7e28
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2016-03-06 19:26:12 -08:00
Masatake Iwasaki
9d551a3adf
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
...
(cherry picked from commit cbd31328a6
)
Conflicts:
hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
(cherry picked from commit 722182fdfb
)
2016-03-04 14:13:30 +09:00
Andrew Wang
c6e37f6782
HADOOP-11792. Remove all of the CHANGES.txt files.
2016-03-03 21:03:13 -08:00
Varun Vasudev
cb4f5ebd3e
MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du.
...
(cherry picked from commit c6f2d761d5
)
(cherry picked from commit f1999fe275
)
2016-02-23 13:07:40 +05:30
Andrew Wang
d31660ef4a
MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 37577852ba
)
(cherry picked from commit 7f6737951a
)
2016-02-19 16:33:44 -08:00
Tsuyoshi Ozawa
7ccb0e0601
MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy.
...
(cherry picked from commit 453e7e0d10
)
2016-02-17 14:18:24 +09:00
Junping Du
aed60ae0bf
Set the release date for 2.6.4.
...
(cherry picked from commit ec12ce8f48
)
(cherry picked from commit a28be9edc7
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2016-02-13 01:48:50 -08:00
Jason Lowe
83985eed2a
MAPREDUCE-6191. Improve clearing stale state of Java serialization
...
testcase. (Sam Liu via Eric Yang)
(cherry picked from commit c379e102dd
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0d
)
2016-02-10 16:46:58 +00:00
Akira Ajisaka
321da0604a
Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta."
...
This reverts commit 3f8a30c956
.
2016-02-10 23:45:44 +09:00
Akira Ajisaka
f943bf0e22
MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun.
...
(cherry picked from commit 10393d9a666419a5d8dc0cfb48da96e9c690c11e)
(cherry picked from commit 8cbe65a07dd0deb150e91b13e3a1cec13e3716ee)
2016-02-10 03:05:23 +09:00
Jason Lowe
5d653a3fd1
Update CHANGES.txt to reflect recent commits to branch-2.7 and branch-2.6.
...
(cherry picked from commit fba6e9f5ef
)
2016-02-09 16:56:12 +00:00
Akira Ajisaka
3f8a30c956
HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
...
(cherry picked from commit fe124da5ff
)
(cherry picked from commit e4c01b8b1c
)
2016-02-06 19:33:11 +09:00
Junping Du
847158811b
Adding release 2.6.5 to CHANGES.txt
2016-02-02 18:36:39 -08:00
Jason Lowe
1d322ca5cc
MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong
...
(cherry picked from commit 43e669b22d
)
2016-02-02 19:32:04 +00:00
Wangda Tan
c487453b91
YARN-4340. Add list API to reservation system. (Sean Po via wangda)
...
(cherry picked from commit 9875325d5c
)
2016-02-02 10:23:25 +08:00
Jason Lowe
7bb48ed162
MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong
...
(cherry picked from commit 59a212b6e1
)
2016-02-01 16:11:20 +00:00
Akira Ajisaka
ce5947916d
MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta.
...
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
(cherry picked from commit 79cde21064a1fe274a4dcbf3dec4ed0d743876cf)
2016-01-29 16:20:45 +09:00
cnauroth
ced22ca78f
MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth.
...
(cherry picked from commit 41da9a0773
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit bd01fdb64d
)
2016-01-28 14:47:03 -08:00
Junping Du
7e3b092cf2
MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and FileOutputCommitter. Contributed by Akira AJISAKA.
...
(cherry picked from commit 86560a4978
)
(cherry picked from commit db7ff115c0
)
2016-01-28 06:20:13 -08:00
Jian He
d83b124c97
MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du
...
(cherry picked from commit da18bbedaf
)
2016-01-27 13:18:19 -08:00
Jian He
b6fe3c20c5
MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu
2016-01-25 23:01:52 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5
Release process for 2.7.2: Set the release date for 2.7.2
...
(cherry picked from commit ec4d2d9f40
)
2016-01-25 15:47:39 -08:00
Akira Ajisaka
8ffa844d48
MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki.
...
(cherry picked from commit a9386cae6e
)
2016-01-25 11:40:08 +09:00
Akira Ajisaka
b85b8d90d1
MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki.
...
(cherry picked from commit 7f215ffdd5
)
2016-01-22 18:38:08 +09:00
Jason Lowe
de31bff67d
MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
...
(cherry picked from commit 9fbd579ab5
)
2016-01-15 16:54:03 +00:00
Akira Ajisaka
6816481c72
MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki.
...
(cherry picked from commit 5cc44d18aa
)
(cherry picked from commit 7c4be15991
)
2016-01-15 00:44:52 +09:00
Akira Ajisaka
d4d368d4e8
MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.
...
(cherry picked from commit 7b0964f354
)
(cherry picked from commit 6efee8907a
)
2016-01-14 10:41:45 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
e3e09aa1e7
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
...
Putting CHANGES.txt entry under 2.6.3 after the backport.
2016-01-13 15:05:43 -08:00
Jason Lowe
a22a7f61e4
MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
...
(cherry picked from commit f657b54281
)
2016-01-12 23:59:06 +00:00
Wangda Tan
00fca06b43
YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
...
(cherry picked from commit 9e792da014
)
2016-01-12 12:56:12 +08:00
Jason Lowe
bf6d50cda3
Add MR-5982 and MR-6492 to 2.6.4
...
(cherry picked from commit e5df366707
)
2016-01-11 18:33:25 +00:00
Junping Du
d7e10f8174
MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
...
(cherry picked from commit 8c1adeaa26
)
(cherry picked from commit 51073c910c
)
2016-01-11 06:14:58 -08:00
Sangjin Lee
ae535ec93e
MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
...
(cherry picked from commit f6f16118d3
)
(cherry picked from commit 28fd4c70ca
)
2016-01-06 08:44:37 -08:00
Akira Ajisaka
5daa07481e
MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R.
...
(cherry picked from commit 7dafee11d8
)
(cherry picked from commit 6d235f0b91
)
2016-01-04 16:31:42 +09:00
Akira Ajisaka
22ac1a1ac0
Set release date for 2.6.3
...
(cherry picked from commit db99e30f67
)
(cherry picked from commit 247ab92464
)
2016-01-04 16:13:06 +09:00
Akira Ajisaka
2139458a98
MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
...
(cherry picked from commit 2a59d01503
)
(cherry picked from commit a8314505d0
)
2015-12-30 01:34:26 +09:00
Akira Ajisaka
7063d8d013
MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka)
...
(cherry picked from commit 1a06949126
)
2015-12-30 01:04:40 +09:00
Wangda Tan
aa85ce73de
MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda)
...
(cherry picked from commit 32b3dc11eb
)
(cherry picked from commit ca575e6add
)
2015-12-28 11:08:31 -08:00
Rohith Sharma K S
550840f402
MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks)
...
(cherry picked from commit a308e86621
)
2015-12-24 12:02:53 +05:30
Akira Ajisaka
5f34cbff5c
MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
...
(cherry picked from commit 7995a6ea4d
)
(cherry picked from commit 8607cb6074
)
2015-12-21 00:18:40 +09:00
Xuan
93c483889c
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
...
(cherry picked from commit d4e766de93
)
(cherry picked from commit 5891d6ed55
)
2015-12-16 15:31:09 -08:00
Zhihai Xu
c4febc7d02
MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
...
(cherry picked from commit 5b7078d069
)
2015-12-15 22:42:19 -08:00
Junping Du
12fb8b4cc5
Add 2.6.4 as release entry to CHANGES.txt
2015-12-02 07:38:03 -08:00
Allen Wittenauer
81a7ad45c9
HADOOP-12366. expose calculated paths (aw)
2015-12-01 08:15:57 -08:00
Vinod Kumar Vavilapalli
efaef45a24
Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8.
...
Revert "Adding release 2.8.0 to CHANGES.txt"
This reverts commit 767815f317
.
2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli
767815f317
Adding release 2.8.0 to CHANGES.txt
...
(cherry picked from commit d57fd181c7
)
2015-11-25 17:37:47 -08:00
Robert Kanter
7b4bf23b2a
MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter)
...
(cherry picked from commit 6d84cc16b3
)
2015-11-25 17:13:00 -08:00
Robert Kanter
8c6273d117
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
...
(cherry picked from commit 7fd00b3db4
)
2015-11-25 17:03:52 -08:00
Junping Du
628c782870
Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA.
...
(cherry picked from commit 15d577bfbb
)
2015-11-25 09:16:22 -08:00
Akira Ajisaka
5794dc83b0
Fix indents in the 2.8.0 section of MapReduce CHANGES.txt.
...
(cherry picked from commit 177975e962
)
2015-11-25 16:44:25 +09:00
Akira Ajisaka
c6cf7910a4
MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak.
...
(cherry picked from commit 5ec44fc35c
)
2015-11-25 16:33:18 +09:00
Jason Lowe
2f18218508
MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G
...
(cherry picked from commit f634505d48
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestJobConf.java
2015-11-24 22:15:37 +00:00
Jason Lowe
ef3e01a1e4
MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts
...
(cherry picked from commit cab3c7c889
)
2015-11-24 22:01:53 +00:00
Jian He
b339a4b8d6
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
...
(cherry picked from commit 8676a118a1
)
2015-11-23 17:20:24 -08:00
Jason Lowe
d13b646c61
Update CHANGES.txt for recent commits to branch-2.6.
...
(cherry picked from commit aa2009c37b
)
2015-11-23 21:58:57 +00:00
Haohui Mai
469fef2a4f
HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng.
2015-11-22 16:18:16 -08:00
Jason Lowe
44011a1759
Update CHANGES.txt to reflect commit of MR-6377 to branch-2.7 and branch-2.6.
...
(cherry picked from commit be9f3bba73
)
Conflicts:
hadoop-mapreduce-project/CHANGES.txt
2015-11-18 17:26:13 +00:00
Akira Ajisaka
8de7911eb3
MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
...
(cherry picked from commit a7f776ffdf
)
2015-11-17 15:18:32 +09:00
Jian He
2cf084ac76
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit a4ff03b200
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-11-16 20:19:31 -08:00
Jian He
f562c155d2
MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du
2015-11-16 17:08:22 -08:00
Sangjin Lee
3214c2331f
MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee)
...
(cherry picked from commit 9ad708a0df
)
2015-11-11 16:22:28 -08:00
Jason Lowe
ee5c20ddef
MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li
...
(cherry picked from commit df68eac825
)
2015-11-11 17:27:03 +00:00
Jian He
a4ff03b200
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
...
(cherry picked from commit 8fbea531d7
)
2015-11-09 11:05:12 -08:00
Tsuyoshi Ozawa
1c0c77e7f0
MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA.
...
(cherry picked from commit 668e897538
)
2015-11-09 15:26:02 +09:00
Jason Lowe
8334d86472
Add 2.7.3 release to CHANGES.txt
...
(cherry picked from commit 0383a3973b
)
2015-11-04 16:27:28 +00:00
Sangjin Lee
b2d6ea5e18
Updated the 2.6.2 final release date.
...
(cherry picked from commit a4a6b5b4b4
)
2015-10-30 18:49:21 -07:00
Kihwal Lee
52819fe4ef
MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla.
...
(cherry picked from commit 2868ca0328
)
2015-10-30 14:57:57 -05:00
Jason Lowe
a7d8895b60
MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du
...
(cherry picked from commit 6344b6a769
)
2015-10-30 15:32:48 +00:00
Jason Lowe
055e11c53e
Update CHANGES.txt to reflect commit of MR-6273 to branch-2.6
...
(cherry picked from commit 6ae9efaf59
)
2015-10-30 15:19:49 +00:00
Jason Lowe
8dce482f61
Creating 2.6.3 entries in CHANGES.txt files.
...
(cherry picked from commit eadf7b3096
)
2015-10-30 14:52:06 +00:00
Tsuyoshi Ozawa
1c80473a41
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
...
(cherry picked from commit ce31b22739
)
2015-10-30 18:00:35 +09:00
Xuan
b505bf9e58
YARN-4313. Race condition in MiniMRYarnCluster when getting history
...
server address. Contributed by Jian He
(cherry picked from commit 7412ff48ee
)
2015-10-29 17:37:24 -07:00
Jason Lowe
d6d642a4e3
Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7
...
(cherry picked from commit ecad1253b7
)
2015-10-29 18:33:24 +00:00
Jason Lowe
145058003a
MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
...
(cherry picked from commit cf953b6258
)
2015-10-29 18:05:56 +00:00
Sangjin Lee
16db203a83
Set the release date for 2.6.2
2015-10-28 20:48:49 -07:00
Tsuyoshi Ozawa
3138b43f16
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 96677bef00
)
2015-10-27 12:35:20 +09:00
Junping Du
801ce47e28
MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA
...
(cherry picked from commit eb6379ca25
)
2015-10-23 10:07:41 -07:00
Jason Lowe
7c002e2416
MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li
...
(cherry picked from commit ee9b80acf8
)
2015-10-21 21:45:51 +00:00
Jason Lowe
be72ed1c75
MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh
2015-10-21 14:11:48 +00:00
Robert Kanter
492142097b
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
...
(cherry picked from commit 0c4af0f998
)
2015-10-20 17:34:56 -07:00
Sangjin Lee
180efe6677
YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
...
(cherry picked from commit 58590fef49
)
2015-10-16 16:57:32 -07:00
Haohui Mai
ee04add696
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
2015-10-13 15:24:29 -07:00
Karthik Kambatla
2d8f9e3fd9
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
...
(cherry picked from commit 4aa9b3e75c
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
2015-10-09 07:54:47 -07:00
Jason Lowe
0139517811
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
...
(cherry picked from commit a0bca2b5ad
)
2015-10-09 14:19:41 +00:00
Akira Ajisaka
22ff37f5ce
MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel.
...
(cherry picked from commit 584cf3bb35
)
2015-10-09 10:58:15 +09:00
Robert Kanter
e5bf4594cc
MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter)
...
(cherry picked from commit 1bca1bb517
)
2015-10-06 16:50:18 -07:00
Xuan
53bddc410f
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
...
(cherry picked from commit 8f08532bde
)
2015-10-02 18:53:04 -07:00
rohithsharmaks
7dd9ebdebc
MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks)
...
(cherry picked from commit 439f43ad3d
)
2015-10-02 20:36:20 +05:30
Akira Ajisaka
e42f576232
MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita.
...
(cherry picked from commit 195793c6f3
)
2015-10-01 10:26:00 +02:00
Robert Kanter
46ef5aa8eb
MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter)
...
(cherry picked from commit 5db371f52f
)
2015-09-30 17:34:03 -07:00
Jason Lowe
3c4c52a095
MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt
...
(cherry picked from commit ab11085b81
)
2015-09-28 22:13:03 +00:00
Harsh J
03e370e306
MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
...
(cherry picked from commit 66dad854c0
)
2015-09-28 13:14:20 +05:30
Robert Kanter
d8a5d2b2fc
MAPREDUCE-6480. archive-logs tool may miss applications (rkanter)
...
(cherry picked from commit 8fec882cfaac047af1892615fe32d8c3ca02e7f9)
2015-09-25 15:00:07 -07:00
Jian He
d458805690
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
...
(cherry picked from commit 89cab1ba5f
)
Conflicts:
hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
2015-09-24 10:30:04 -07:00
Jian He
c19e8ffdc7
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
...
(cherry picked from commit 83a18add10
)
2015-09-24 10:23:25 -07:00
Jian He
89dc37450c
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
...
(cherry picked from commit dfe2cb849f
)
2015-09-24 10:23:13 -07:00
Zhihai Xu
e5ba1a0521
MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
...
(cherry picked from commit 97a08807ec
)
2015-09-24 08:14:11 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f48af332a7
Release process for 2.6.1: Set the release date for 2.6.1
...
(cherry picked from commit 1f707ecffd
)
2015-09-23 15:12:30 -07:00
Harsh J
38420754f5
MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian.
...
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
2015-09-22 21:38:31 +05:30
Tsuyoshi Ozawa
52cc2ca488
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
...
(cherry picked from commit dfd807afab
)
2015-09-22 12:54:44 +09:00
Zhihai Xu
88a3a07636
MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
...
(cherry picked from commit e3ace31e2b
)
2015-09-19 00:12:15 -07:00
Haohui Mai
0971503522
MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu.
2015-09-18 13:36:22 -07:00
Jason Lowe
9240a021fc
Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2
...
(cherry picked from commit f97dc034fe
)
2015-09-18 19:25:09 +00:00
Wangda Tan
6041fc75d8
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
2015-09-18 10:19:32 -07:00
Jason Lowe
6641ab83eb
Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2
...
(cherry picked from commit 288c8854a6
)
2015-09-18 15:16:06 +00:00
Jason Lowe
f27f1ef44c
MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
...
(cherry picked from commit ee4ee6af6a
)
2015-09-17 21:38:44 +00:00
Jason Lowe
4861fadb17
MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
...
(cherry picked from commit 3f82f582e5
)
2015-09-17 18:18:28 +00:00
Jason Lowe
316296e35f
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
...
(cherry picked from commit 58d1a02b8d
)
2015-09-17 14:31:57 +00:00
Haohui Mai
ac2ed09be7
MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu.
2015-09-16 13:06:38 -07:00
Jason Lowe
52f56524d4
MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
...
(cherry picked from commit 62943b8e3a
)
2015-09-15 19:44:17 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cbf90f93f9
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
...
section given the large number of backports to 2.6.1.
(cherry picked from commit fbbb7ff1ed
)
2015-09-10 14:01:15 -07:00
Jason Lowe
7909462c3a
MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla
...
(cherry picked from commit 8e615588d5
)
2015-09-10 16:01:27 +00:00
Karthik Kambatla
999aa22509
MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha)
2015-09-09 17:49:23 -07:00
Tsuyoshi Ozawa
8bf5362014
MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
...
(cherry picked from commit 9b685773ec
)
2015-09-05 11:21:35 +09:00
Andrew Wang
355398e441
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
...
(cherry picked from commit e1feaf6db0
)
2015-09-04 13:48:42 -07:00
Akira Ajisaka
a61c0f5ca1
Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
...
This reverts commit 98446ee695
.
2015-09-02 12:26:25 +09:00
Zhihai Xu
297bda600e
MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu
...
(cherry picked from commit cbb249534a
)
2015-08-28 12:20:49 -07:00
Jian He
387076894f
YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S
...
(cherry picked from commit 57c7ae1aff
)
2015-08-24 20:37:18 -07:00
Akira Ajisaka
29819e7240
MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote.
...
(cherry picked from commit 2ba90c93d7
)
2015-08-21 10:43:05 +09:00
Vinod Kumar Vavilapalli
9da81a3955
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
2015-08-20 17:35:24 -07:00
Vinod Kumar Vavilapalli
45be1240d9
Creating 2.6.2 entries in CHANGES.txt files.
...
(cherry picked from commit 33474939a0
)
2015-08-20 17:23:54 -07:00
Karthik Kambatla
20734320a1
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 8dfec7a197
)
2015-08-15 00:53:13 -07:00
Karthik Kambatla
b826168173
MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha)
...
(cherry picked from commit 27d24f96ab
)
2015-08-14 12:40:38 -07:00
Junping Du
c8469357ba
MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter.
2015-08-06 07:00:42 -07:00
Colin Patrick Mccabe
07a042aa3c
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
...
(cherry picked from commit 21d10ccc6e
)
2015-07-31 15:02:01 -07:00
Jason Lowe
508da4d461
MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render(). Contributed by Ray Chiang
...
(cherry picked from commit d0e0ba8010
)
2015-07-31 18:19:52 +00:00
Zhihai Xu
9d40eead81
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
...
(cherry picked from commit 93d50b7824
)
2015-07-30 23:12:30 -07:00
Akira Ajisaka
4da8ff60ef
MAPREDUCE-5762. Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka)
2015-07-16 03:43:49 +09:00
Chris Douglas
2a0e551cd8
MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang
2015-07-14 14:56:21 -07:00
Akira Ajisaka
0ba2defb9e
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 19295b36d9
)
2015-07-13 17:53:27 +09:00
Akira Ajisaka
0e4d251fb2
MAPREDUCE-6421. Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit e04faf8e46
)
2015-07-13 14:29:39 +09:00
Devaraj K
3074d7082e
MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing.
...
Contributed by zhihai xu.
(cherry picked from commit fffb15bb43
)
2015-07-09 15:02:09 +05:30
Chris Douglas
5fbf91b453
MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
...
(cherry picked from commit 4990ccfdc742be9c0517557a6256fefcae0df67d)
2015-07-07 10:26:57 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a8bf34cad8
Release process for 2.7.1: Set the release date for 2.7.1.
...
(cherry picked from commit bf89ddb9b8
)
2015-07-06 16:41:00 -07:00
Devaraj K
415dd64461
MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to
...
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
(cherry picked from commit bff67dfe2f
)
2015-07-06 13:47:54 +05:30
Jason Lowe
8a4970e845
MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li
...
(cherry picked from commit eac1d18943
)
2015-07-01 18:02:17 +00:00
Jason Lowe
f3195eda27
MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li
...
(cherry picked from commit 826715622e
)
2015-07-01 17:50:47 +00:00
Jason Lowe
df4e1e4965
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
...
(cherry picked from commit 2ac87df578
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2015-07-01 16:07:54 +00:00
cnauroth
f7ba3c0045
HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu.
2015-06-30 16:55:10 -07:00
Robert Kanter
e5b0439bc1
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
...
(cherry picked from commit 3a72bfd082
)
2015-06-30 16:50:48 -07:00
Jason Lowe
fdfd5be2b3
MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li
...
(cherry picked from commit b6ba56457c
)
2015-06-30 21:24:38 +00:00
Vinod Kumar Vavilapalli
4155bb565e
Adding release 2.7.2 to CHANGES.txt.
...
(cherry picked from commit aad6a7d5db
)
2015-06-28 16:30:27 -07:00
Jason Lowe
31fd7a51d8
MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu
...
(cherry picked from commit aa5b15b03b
)
2015-06-25 19:52:23 +00:00