Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,918 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

7918 Commits

Author SHA1 Message Date
Jason Lowe f3b9f5e3d0 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du 
(cherry picked from commit 6344b6a769)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-10-30 15:34:14 +00:00
Jason Lowe 530b8a75cb MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists 
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestHistoryFileManager.java
 2015-10-30 15:15:49 +00:00
Jason Lowe 0af4f222a1 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 14:58:42 +00:00
Sangjin Lee 1d3bed1f94 Set the release date for 2.6.2 2015-10-28 20:57:16 -07:00
Xuan 9a97ff54e5 YARN-2859. ApplicationHistoryServer binds to default port 8188 in 
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 27414dac66)
(cherry picked from commit 9ce5069d16)
(cherry picked from commit 336be63dad)
 2015-10-28 10:55:31 -07:00
Sangjin Lee 6466ead9e0 Preparing for 2.6.3 development 2015-10-21 10:58:06 -07:00
Tsuyoshi Ozawa b898f8014f YARN-3798. ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED. (ozawa and Varun Saxena) 2015-10-21 23:08:02 +09:00
Jason Lowe ac865de725 YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks) 
(cherry picked from commit feaf034994)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 16:39:46 +00:00
Jason Lowe 528b809d2d YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith 
(cherry picked from commit a64dd3d24b)
 2015-10-08 16:33:34 +00:00
Jason Lowe 1484ebb602 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes 
after NM is reconnected. Contributed by zhihai xu
(cherry picked from commit 5b5bb8dcdc)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 16:01:20 +00:00
Jason Lowe 4770f190b8 YARN-3780. Should use equals when compare Resource in 
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
(cherry picked from commit c7ee6c151c)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:37:08 +00:00
Jason Lowe 2ecd173426 YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 
(cherry picked from commit 38aed1a94e)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:16:11 +00:00
Akira Ajisaka e4360fd42f MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 
(cherry picked from commit 195793c6f3)
(cherry picked from commit e42f576232)
 2015-10-01 10:31:43 +02:00
Jason Lowe 49335d9b2b YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu 
(cherry picked from commit 854d25b0c3)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
(cherry picked from commit 493f072008)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-09-30 16:12:09 +00:00
Jason Lowe c4cbbcbc26 YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R 
(cherry picked from commit 9757864fd6)
(cherry picked from commit 1b95bf9e1b)
 2015-09-28 10:48:40 -07:00
Jason Lowe 4104ab346f MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne 
(cherry picked from commit bc1bd7e5c4)
(cherry picked from commit 30d0f10458)
 2015-09-26 10:32:27 -07:00
Xuan 1828ba00be YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs. Contributed by Jian He 
(cherry picked from commit 9f7fcb54e798cf4fda1ea7972dd96491976e1857)
 2015-09-25 16:43:06 -07:00
Xuan d27f09c936 YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He. 
(cherry picked from commit db57d91ac91e895bcb9a23fa50af0b2fbcb1db5a)
 2015-09-25 16:30:49 -07:00
Jian He c09bb46579 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 214fd1408c21f596d1d15217c11b58b34561aab7)
 2015-09-25 16:26:18 -07:00
Jian He cc30002bc8 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit 6b3b487d3f4883a6e849c71886da52c4c4d9f0bf)
 2015-09-25 16:25:13 -07:00
Vinod Kumar Vavilapalli ab4c2ce248 MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du. 
(cherry picked from commit 9da81a3955)
(cherry picked from commit d4b86e6f403edc6cdd687f978e3abff8752faa34)
 2015-09-25 16:11:11 -07:00
Vinod Kumar Vavilapalli b99a85139e Creating 2.6.2 entries in CHANGES.txt files. 
(cherry picked from commit 33474939a0)
 2015-09-25 16:00:06 -07:00
Sangjin Lee 4cb7dbaead Preparing for 2.6.2 development: mvn versions:set -DnewVersion=2.6.2 2015-09-25 15:51:13 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 41d19f4740 Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:15:36 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) e8c4544d8e YARN-3248. Moving it to improvements section in CHANGES.txt. 
(cherry picked from commit df52ff92ae)
 2015-09-23 15:04:39 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 4697d94c6a CHANGES.txt: Dropping YARN-3379 as only the refactor part of it exists in branch-2.6.1. 2015-09-23 13:52:16 -07:00
Vinod Kumar Vavilapalli b4d876d837 Set the release date for 2.6.1-RC1 2015-09-16 12:04:57 -07:00
Hitesh Shah dba2b60fdd YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai. 
(cherry picked from commit 265ed1fe80)
(cherry picked from commit 55b794e7fa)
 2015-09-15 17:30:15 -07:00
Vinod Kumar Vavilapalli 9c4a6e1270 Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai." 
This reverts commit 8a47d1aa55.
 2015-09-15 17:30:15 -07:00
Zhijie Shen d57c3f0a26 YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong. 
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
(cherry picked from commit c9ee316045)
 2015-09-15 17:30:15 -07:00
Xuan 7af5d6b4ba YARN-3248. Display count of nodes blacklisted by apps in the web UI. 
Contributed by Varun Vasudev

(cherry picked from commit 4728bdfa15)
(cherry picked from commit e26b6e55e9)
 2015-09-15 17:30:06 -07:00
Jian He e914220ab9 YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong 
(cherry picked from commit 4e886eb9cb)

(cherry picked from commit 3f0c9e5fe3)
 2015-09-14 12:54:01 -07:00
Zhijie Shen 3ab820e696 YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong. 
(cherry picked from commit eb6bf91eea)
(cherry picked from commit 68cddb894a)
 2015-09-11 11:53:51 -07:00
Xuan 85ec6eb37a YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't 
work in ATS / RM web ui. Contributed by Naganarasimha G R

(cherry picked from commit 3ff1ba2a7b)
(cherry picked from commit b6eb36dbdc)
 2015-09-11 11:49:11 -07:00
Zhijie Shen f4154bdee8 YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong. 
(cherry picked from commit 85f6d67fa7)
(cherry picked from commit 426535007b)
 2015-09-11 11:45:29 -07:00
Vinod Kumar Vavilapalli 075d899d10 Set the release date for 2.6.1-RC0 2015-09-09 15:39:02 -07:00
Vinod Kumar Vavilapalli c86d9bd10b Preparing for release 2.6.1: Posting release notes generated. 2015-09-09 15:31:14 -07:00
Vinod Kumar Vavilapalli 3462a00dd2 Preparing for release 2.6.1: mvn versions:set -DnewVersion=2.6.1 2015-09-09 15:29:57 -07:00
Vinod Kumar Vavilapalli cfb012a255 Preparing for release 2.6.1: Updating site update page. 2015-09-09 15:29:03 -07:00
Colin Patrick Mccabe adc3405321 HDFS-7552. Change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration (Liang Xie via Colin P. McCabe) 
(cherry picked from commit a4876c130f)

(cherry picked from commit 22f72c7946)
 2015-09-09 14:59:31 -07:00
yliu 0adcfe6c7e HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu) 
(cherry picked from commit 146db49f7f)
 2015-09-08 22:57:36 -07:00
Jian He 2b526ba757 YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe 
(cherry picked from commit 7a445fcfab)

(cherry picked from commit 703fa1b141)
 2015-09-08 22:57:35 -07:00
Xuan d59bf81e08 YARN-3999. RM hangs on draing events. Contributed by Jian He 
(cherry picked from commit 3ae716fa69)
(cherry picked from commit 2ebdf5bfce)
 2015-09-08 22:57:35 -07:00
Jonathan Eagles 6ed2486c7e YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles) 
(cherry picked from commit 3cd02b9522)
(cherry picked from commit 899df5bce0)
 2015-09-08 22:57:34 -07:00
Jian He 92742b4402 YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R 
(cherry picked from commit 258623ff8b)

(cherry picked from commit 1d1e7682c9)
 2015-09-08 22:57:28 -07:00
cnauroth c3928b3068 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong. 
(cherry picked from commit 85aec75ce5)
(cherry picked from commit 27eecaef10)
 2015-09-08 17:21:58 -07:00
Vinod Kumar Vavilapalli 33537078a8 HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 2015-09-08 16:45:38 -07:00
Colin Patrick Mccabe a976acc02d HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit a4d9acc51d)
(cherry picked from commit 9264b7e119)
 2015-09-08 16:18:30 -07:00
Colin Patrick Mccabe 2e86d1f254 HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs, instead of copying them. (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 7b424f938c)
(cherry picked from commit cbd11681ce)
 2015-09-08 16:12:45 -07:00
Colin Patrick Mccabe 4363145128 HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe) 
(cherry picked from commit 75a326aaff)

(cherry picked from commit 06552a15d5)
 2015-09-08 15:32:17 -07:00