Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,916 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

7916 Commits

Author SHA1 Message Date
Zhihai Xu 2d125f2bee MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki 
(cherry picked from commit 5b7078d069)
 2015-12-15 01:05:49 -08:00
Arun Suresh c53d45a687 YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh) 
(cherry picked from commit 9b272ccae7)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmcontainer/RMContainerImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
 2015-12-14 23:50:55 -08:00
Zhihai Xu 70289432f7 YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 
(cherry picked from commit 3a76a010b8)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-14 22:17:23 -08:00
Karthik Kambatla 843dac5353 YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha) 
(cherry picked from commit 2abec14ec6)
 2015-12-09 10:53:26 -08:00
Akira Ajisaka 80037436c6 YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang. 
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
(cherry picked from commit 925bb94d87db7e916ed380d4512225e796f9e03d)
 2015-12-09 16:30:39 +09:00
Wangda Tan 5b063d6b7f YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda) 
(cherry picked from commit 7e4715186d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 7013f9d6cd)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-08 14:34:53 -08:00
Vinod Kumar Vavilapalli e7e0c4c0dd HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:37:06 -08:00
cnauroth 339714baa0 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 
(cherry picked from commit 1b525a9c32)
(cherry picked from commit faf1c60899)
 2015-12-08 11:29:06 -08:00
Tsuyoshi Ozawa b345ffd7df YARN-4348. ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread. (ozawa) 
(cherry picked from commit 0460b8a8a3)
 2015-12-08 13:41:17 +09:00
Zhe Zhang 203c7a648b Addendum fix for HDFS-9314 to fix compilation error caused by diamond operator. 
Change-Id: Ia8b8142c2cd3b5ec413a7da2bf037be64040dc85
 2015-12-04 10:57:24 -08:00
Zhe Zhang 4c631e8c73 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. Contributed by Xiao Chen. 
Change-Id: Idf99293085531165239369155c039b55db0eed83

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-04 09:51:17 -08:00
Zhe Zhang 089169e4e5 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. Contributed by Ming Ma. Branch-2.7 patch contributed by Xiao Chen. 
Change-Id: Iadaee6be2b44f7b0322d7b0e58f8fc983ef463f6

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-03 23:24:21 -08:00
Zhe Zhang 30dc4334bf HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.6 patch contributed by Xiao Chen. 
Change-Id: Id08ade6862db1b8caf87ac9d786797d4fa7098a0
 2015-12-03 11:01:01 -08:00
Junping Du e710a11a7f Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:28:37 -08:00
Andrew Wang b2dd21e82d HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424)
(cherry picked from commit ce1111ceea)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java

(cherry picked from commit 10e8a67d23)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2015-11-30 15:01:08 -08:00
Jason Lowe 53dccddfdb MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-30 17:51:37 +00:00
Jason Lowe f61e3320cb YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla 
(cherry picked from commit f5acf94eca)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/nodelabels/TestFileSystemNodeLabelsStore.java
 2015-11-24 23:59:40 +00:00
Tsz-Wo Nicholas Sze d2518fd562 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 14:34:51 -08:00
Tsz-Wo Nicholas Sze 83fcbd49a7 Revert "HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags." 
This reverts commit 09dbb11566.
 2015-11-24 14:08:45 -08:00
Jason Lowe 5074d836b0 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 
(cherry picked from commit cab3c7c889)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-24 22:03:39 +00:00
Tsz-Wo Nicholas Sze 09dbb11566 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 12:40:24 -08:00
Kihwal Lee 238458b259 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: Ibd44ff1bf92bad7262db724990a6a64c1975ffb6
 2015-11-24 09:44:50 -08:00
Sangjin Lee b9a6f9aa16 HDFS-9083. Replication violates block placement policy (Rushabh Shah) 2015-11-23 16:06:18 -08:00
Sangjin Lee a9001a210a YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha) 2015-11-23 14:14:50 -08:00
Jason Lowe 16e3dc24c5 MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:15:14 +00:00
Jason Lowe e307078e78 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestLineRecordReader.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:07:39 +00:00
Jason Lowe 271875a426 YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu 
(cherry picked from commit ff9c13e0a7)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestContainerLogsPage.java
(cherry picked from commit e8410c0175)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-11-23 20:57:57 +00:00
Jason Lowe 5f05e5e5ba YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev 2015-11-23 20:27:00 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 5633fb844a HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 70c26703f4)
 2015-11-23 10:05:44 -08:00
Xuan 11c2326acb YARN-2859-addendum: fix the remaining issue from the previous patch. 2015-11-19 10:29:58 -08:00
Akira Ajisaka 68b1abe5cc HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c819)
(cherry picked from commit c74e42b4a2)
 2015-11-19 20:56:08 +09:00
Jason Lowe 937d9653a7 MAPREDUCE-6377. JHS sorting on state column not working in webUi. 
Contributed by zhihai xu.
(cherry picked from commit 790a861766)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-18 17:17:58 +00:00
Akira Ajisaka 866d0f6f04 HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 2015-11-17 16:11:47 +09:00
Sangjin Lee 719fbf813e MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) 
(cherry picked from commit 9ad708a0df)
 2015-11-11 16:50:15 -08:00
Akira Ajisaka 6c178cc321 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas. 
(cherry picked from commit 23d0db551c)
(cherry picked from commit f6f128c867)
 2015-11-11 16:18:18 +09:00
Sangjin Lee f55e1a4f3e HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 18:00:03 -08:00
Steve Loughran 6165fd8663 HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. 
(cherry picked from commit 2bc3f1064f)
 2015-11-08 17:22:46 -08:00
Jason Lowe cab916cc7b HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 
(cherry picked from commit b2017d9b03)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-06 17:12:19 +00:00
Wangda Tan fb7be09f20 YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda) 
(cherry picked from commit 0783184f4b)
 2015-11-06 09:10:12 -08:00
Tsuyoshi Ozawa 6b27de0f36 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 
(cherry picked from commit ce31b22739)
 2015-11-06 00:19:41 -08:00
cnauroth 0b55634b9c HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 
(cherry picked from commit 7fc1f2f5cf)
 2015-11-05 17:24:51 -08:00
Tsuyoshi Ozawa 5a00b23106 YARN-4312. TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out. Contributed by Varun Saxena. 
(cherry picked from commit 6636441911)
 2015-11-05 10:40:23 -08:00
Haohui Mai da70755b4d HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 
(cherry picked from commit 8549fa5dc9)
 2015-11-05 10:37:07 -08:00
cnauroth 46c7a8977a HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed33)
 2015-11-05 10:31:00 -08:00
Sangjin Lee 8f8f3b1027 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b4)
 2015-10-30 18:51:50 -07:00
Sangjin Lee ccc0c54501 YARN-2859 addendum. Re-added the entry to hadoop-yarn/CHANGES.txt under 2.6.3. 2015-10-30 14:46:04 -07:00
Suresh Srinivas 22095d7a72 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e58)
 2015-10-30 14:38:51 -07:00
Akira Ajisaka eedbd033d3 HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. Contributed by Rakesh R. 
(cherry picked from commit 966f9508c3)
(cherry picked from commit 3249c3ce56)
 2015-10-30 14:02:44 -07:00
Jason Lowe f3b9f5e3d0 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du 
(cherry picked from commit 6344b6a769)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-10-30 15:34:14 +00:00
Jason Lowe 530b8a75cb MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists 
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
(cherry picked from commit 1ea90144d5)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestHistoryFileManager.java
 2015-10-30 15:15:49 +00:00