Commit Graph

2043 Commits

Author SHA1 Message Date
Jason Lowe ee5c20ddef MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li
(cherry picked from commit df68eac825)
2015-11-11 17:27:03 +00:00
Jian He a4ff03b200 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
(cherry picked from commit 8fbea531d7)
2015-11-09 11:05:12 -08:00
Tsuyoshi Ozawa 1c0c77e7f0 MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA.
(cherry picked from commit 668e897538)
2015-11-09 15:26:02 +09:00
Jason Lowe 8334d86472 Add 2.7.3 release to CHANGES.txt
(cherry picked from commit 0383a3973b)
2015-11-04 16:27:28 +00:00
Sangjin Lee b2d6ea5e18 Updated the 2.6.2 final release date.
(cherry picked from commit a4a6b5b4b4)
2015-10-30 18:49:21 -07:00
Kihwal Lee 52819fe4ef MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla.
(cherry picked from commit 2868ca0328)
2015-10-30 14:57:57 -05:00
Jason Lowe a7d8895b60 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du
(cherry picked from commit 6344b6a769)
2015-10-30 15:32:48 +00:00
Jason Lowe 055e11c53e Update CHANGES.txt to reflect commit of MR-6273 to branch-2.6
(cherry picked from commit 6ae9efaf59)
2015-10-30 15:19:49 +00:00
Jason Lowe 8dce482f61 Creating 2.6.3 entries in CHANGES.txt files.
(cherry picked from commit eadf7b3096)
2015-10-30 14:52:06 +00:00
Tsuyoshi Ozawa 1c80473a41 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
(cherry picked from commit ce31b22739)
2015-10-30 18:00:35 +09:00
Xuan b505bf9e58 YARN-4313. Race condition in MiniMRYarnCluster when getting history
server address. Contributed by Jian He

(cherry picked from commit 7412ff48ee)
2015-10-29 17:37:24 -07:00
Jason Lowe d6d642a4e3 Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7
(cherry picked from commit ecad1253b7)
2015-10-29 18:33:24 +00:00
Jason Lowe 145058003a MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
(cherry picked from commit cf953b6258)
2015-10-29 18:05:56 +00:00
Sangjin Lee 16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
Tsuyoshi Ozawa 3138b43f16 YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
(cherry picked from commit 96677bef00)
2015-10-27 12:35:20 +09:00
Junping Du 801ce47e28 MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA
(cherry picked from commit eb6379ca25)
2015-10-23 10:07:41 -07:00
Jason Lowe 7c002e2416 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li
(cherry picked from commit ee9b80acf8)
2015-10-21 21:45:51 +00:00
Jason Lowe be72ed1c75 MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:11:48 +00:00
Robert Kanter 492142097b MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
(cherry picked from commit 0c4af0f998)
2015-10-20 17:34:56 -07:00
Sangjin Lee 180efe6677 YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
(cherry picked from commit 58590fef49)
2015-10-16 16:57:32 -07:00
Haohui Mai ee04add696 HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu. 2015-10-13 15:24:29 -07:00
Karthik Kambatla 2d8f9e3fd9 MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
(cherry picked from commit 4aa9b3e75c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
2015-10-09 07:54:47 -07:00
Jason Lowe 0139517811 YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
(cherry picked from commit a0bca2b5ad)
2015-10-09 14:19:41 +00:00
Akira Ajisaka 22ff37f5ce MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel.
(cherry picked from commit 584cf3bb35)
2015-10-09 10:58:15 +09:00
Robert Kanter e5bf4594cc MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter)
(cherry picked from commit 1bca1bb517)
2015-10-06 16:50:18 -07:00
Xuan 53bddc410f YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
(cherry picked from commit 8f08532bde)
2015-10-02 18:53:04 -07:00
rohithsharmaks 7dd9ebdebc MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks)
(cherry picked from commit 439f43ad3d)
2015-10-02 20:36:20 +05:30
Akira Ajisaka e42f576232 MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita.
(cherry picked from commit 195793c6f3)
2015-10-01 10:26:00 +02:00
Robert Kanter 46ef5aa8eb MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter)
(cherry picked from commit 5db371f52f)
2015-09-30 17:34:03 -07:00
Jason Lowe 3c4c52a095 MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt
(cherry picked from commit ab11085b81)
2015-09-28 22:13:03 +00:00
Harsh J 03e370e306 MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit 66dad854c0)
2015-09-28 13:14:20 +05:30
Robert Kanter d8a5d2b2fc MAPREDUCE-6480. archive-logs tool may miss applications (rkanter)
(cherry picked from commit 8fec882cfaac047af1892615fe32d8c3ca02e7f9)
2015-09-25 15:00:07 -07:00
Jian He d458805690 YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
(cherry picked from commit 89cab1ba5f)

Conflicts:
	hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java
2015-09-24 10:30:04 -07:00
Jian He c19e8ffdc7 YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
(cherry picked from commit 83a18add10)
2015-09-24 10:23:25 -07:00
Jian He 89dc37450c YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
(cherry picked from commit dfe2cb849f)
2015-09-24 10:23:13 -07:00
Zhihai Xu e5ba1a0521 MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
(cherry picked from commit 97a08807ec)
2015-09-24 08:14:11 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1
(cherry picked from commit 1f707ecffd)
2015-09-23 15:12:30 -07:00
Harsh J 38420754f5 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit de1322aa76007832698af682a3b76042116043b9)
2015-09-22 21:38:31 +05:30
Tsuyoshi Ozawa 52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab)
2015-09-22 12:54:44 +09:00
Zhihai Xu 88a3a07636 MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu.
(cherry picked from commit e3ace31e2b)
2015-09-19 00:12:15 -07:00
Haohui Mai 0971503522 MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. 2015-09-18 13:36:22 -07:00
Jason Lowe 9240a021fc Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2
(cherry picked from commit f97dc034fe)
2015-09-18 19:25:09 +00:00
Wangda Tan 6041fc75d8 MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda) 2015-09-18 10:19:32 -07:00
Jason Lowe 6641ab83eb Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2
(cherry picked from commit 288c8854a6)
2015-09-18 15:16:06 +00:00
Jason Lowe f27f1ef44c MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li
(cherry picked from commit ee4ee6af6a)
2015-09-17 21:38:44 +00:00
Jason Lowe 4861fadb17 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li
(cherry picked from commit 3f82f582e5)
2015-09-17 18:18:28 +00:00
Jason Lowe 316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d)
2015-09-17 14:31:57 +00:00
Haohui Mai ac2ed09be7 MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu. 2015-09-16 13:06:38 -07:00
Jason Lowe 52f56524d4 MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks. Contributed by Naganarasimha G R
(cherry picked from commit 62943b8e3a)
2015-09-15 19:44:17 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) cbf90f93f9 Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed)
2015-09-10 14:01:15 -07:00