Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,899 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

7899 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze d2518fd562 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 14:34:51 -08:00
Tsz-Wo Nicholas Sze 83fcbd49a7 Revert "HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags." 
This reverts commit 09dbb11566.
 2015-11-24 14:08:45 -08:00
Jason Lowe 5074d836b0 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 
(cherry picked from commit cab3c7c889)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-24 22:03:39 +00:00
Tsz-Wo Nicholas Sze 09dbb11566 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 12:40:24 -08:00
Kihwal Lee 238458b259 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: Ibd44ff1bf92bad7262db724990a6a64c1975ffb6
 2015-11-24 09:44:50 -08:00
Sangjin Lee b9a6f9aa16 HDFS-9083. Replication violates block placement policy (Rushabh Shah) 2015-11-23 16:06:18 -08:00
Sangjin Lee a9001a210a YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha) 2015-11-23 14:14:50 -08:00
Jason Lowe 16e3dc24c5 MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:15:14 +00:00
Jason Lowe e307078e78 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestLineRecordReader.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:07:39 +00:00
Jason Lowe 271875a426 YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu 
(cherry picked from commit ff9c13e0a7)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestContainerLogsPage.java
(cherry picked from commit e8410c0175)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-11-23 20:57:57 +00:00
Jason Lowe 5f05e5e5ba YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev 2015-11-23 20:27:00 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 5633fb844a HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 70c26703f4)
 2015-11-23 10:05:44 -08:00
Xuan 11c2326acb YARN-2859-addendum: fix the remaining issue from the previous patch. 2015-11-19 10:29:58 -08:00
Akira Ajisaka 68b1abe5cc HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c819)
(cherry picked from commit c74e42b4a2)
 2015-11-19 20:56:08 +09:00
Jason Lowe 937d9653a7 MAPREDUCE-6377. JHS sorting on state column not working in webUi. 
Contributed by zhihai xu.
(cherry picked from commit 790a861766)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-18 17:17:58 +00:00
Akira Ajisaka 866d0f6f04 HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 2015-11-17 16:11:47 +09:00
Sangjin Lee 719fbf813e MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) 
(cherry picked from commit 9ad708a0df)
 2015-11-11 16:50:15 -08:00
Akira Ajisaka 6c178cc321 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas. 
(cherry picked from commit 23d0db551c)
(cherry picked from commit f6f128c867)
 2015-11-11 16:18:18 +09:00
Sangjin Lee f55e1a4f3e HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 18:00:03 -08:00
Steve Loughran 6165fd8663 HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. 
(cherry picked from commit 2bc3f1064f)
 2015-11-08 17:22:46 -08:00
Jason Lowe cab916cc7b HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 
(cherry picked from commit b2017d9b03)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-06 17:12:19 +00:00
Wangda Tan fb7be09f20 YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda) 
(cherry picked from commit 0783184f4b)
 2015-11-06 09:10:12 -08:00
Tsuyoshi Ozawa 6b27de0f36 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 
(cherry picked from commit ce31b22739)
 2015-11-06 00:19:41 -08:00
cnauroth 0b55634b9c HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 
(cherry picked from commit 7fc1f2f5cf)
 2015-11-05 17:24:51 -08:00
Tsuyoshi Ozawa 5a00b23106 YARN-4312. TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out. Contributed by Varun Saxena. 
(cherry picked from commit 6636441911)
 2015-11-05 10:40:23 -08:00
Haohui Mai da70755b4d HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 
(cherry picked from commit 8549fa5dc9)
 2015-11-05 10:37:07 -08:00
cnauroth 46c7a8977a HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed33)
 2015-11-05 10:31:00 -08:00
Sangjin Lee 8f8f3b1027 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b4)
 2015-10-30 18:51:50 -07:00
Sangjin Lee ccc0c54501 YARN-2859 addendum. Re-added the entry to hadoop-yarn/CHANGES.txt under 2.6.3. 2015-10-30 14:46:04 -07:00
Suresh Srinivas 22095d7a72 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e58)
 2015-10-30 14:38:51 -07:00
Akira Ajisaka eedbd033d3 HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. Contributed by Rakesh R. 
(cherry picked from commit 966f9508c3)
(cherry picked from commit 3249c3ce56)
 2015-10-30 14:02:44 -07:00
Jason Lowe f3b9f5e3d0 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du 
(cherry picked from commit 6344b6a769)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-10-30 15:34:14 +00:00
Jason Lowe 530b8a75cb MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists 
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestHistoryFileManager.java
 2015-10-30 15:15:49 +00:00
Jason Lowe 0af4f222a1 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2015-10-30 14:58:42 +00:00
Sangjin Lee 1d3bed1f94 Set the release date for 2.6.2 2015-10-28 20:57:16 -07:00
Xuan 9a97ff54e5 YARN-2859. ApplicationHistoryServer binds to default port 8188 in 
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 27414dac66)
(cherry picked from commit 9ce5069d16)
(cherry picked from commit 336be63dad)
 2015-10-28 10:55:31 -07:00
Sangjin Lee 6466ead9e0 Preparing for 2.6.3 development 2015-10-21 10:58:06 -07:00
Tsuyoshi Ozawa b898f8014f YARN-3798. ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED. (ozawa and Varun Saxena) 2015-10-21 23:08:02 +09:00
Jason Lowe ac865de725 YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks) 
(cherry picked from commit feaf034994)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 16:39:46 +00:00
Jason Lowe 528b809d2d YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith 
(cherry picked from commit a64dd3d24b)
 2015-10-08 16:33:34 +00:00
Jason Lowe 1484ebb602 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes 
after NM is reconnected. Contributed by zhihai xu
(cherry picked from commit 5b5bb8dcdc)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 16:01:20 +00:00
Jason Lowe 4770f190b8 YARN-3780. Should use equals when compare Resource in 
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
(cherry picked from commit c7ee6c151c)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:37:08 +00:00
Jason Lowe 2ecd173426 YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 
(cherry picked from commit 38aed1a94e)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-10-08 15:16:11 +00:00
Akira Ajisaka e4360fd42f MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 
(cherry picked from commit 195793c6f3)
(cherry picked from commit e42f576232)
 2015-10-01 10:31:43 +02:00
Jason Lowe 49335d9b2b YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu 
(cherry picked from commit 854d25b0c3)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
(cherry picked from commit 493f072008)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-09-30 16:12:09 +00:00
Jason Lowe c4cbbcbc26 YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R 
(cherry picked from commit 9757864fd6)
(cherry picked from commit 1b95bf9e1b)
 2015-09-28 10:48:40 -07:00
Jason Lowe 4104ab346f MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne 
(cherry picked from commit bc1bd7e5c4)
(cherry picked from commit 30d0f10458)
 2015-09-26 10:32:27 -07:00
Xuan 1828ba00be YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs. Contributed by Jian He 
(cherry picked from commit 9f7fcb54e798cf4fda1ea7972dd96491976e1857)
 2015-09-25 16:43:06 -07:00
Xuan d27f09c936 YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He. 
(cherry picked from commit db57d91ac91e895bcb9a23fa50af0b2fbcb1db5a)
 2015-09-25 16:30:49 -07:00
Jian He c09bb46579 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 214fd1408c21f596d1d15217c11b58b34561aab7)
 2015-09-25 16:26:18 -07:00