Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,918 Commits 326 Branches 371 Tags
Commit Graph

7918 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junping Du
0f9dd48842 YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R. 
(cherry picked from commit 50bd067e1d63d4c80dc1e7bf4024bfaf42cf4416)
(cherry picked from commit 1a2ef845b54166194b133e524ad9533cc259aed2)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java
 2015-12-17 05:53:56 -08:00
Zhihai Xu
9d9e0eaae8 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE 
(cherry picked from commit 7092d47fc0b3b792dd31f967c01d460dc089f60b)
 2015-12-15 21:53:22 -08:00
Zhihai Xu
2d125f2bee MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki 
(cherry picked from commit 5b7078d06921893200163a3d29c8901c3c0107cb)
 2015-12-15 01:05:49 -08:00
Arun Suresh
c53d45a687 YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh) 
(cherry picked from commit 9b272ccae78918e7d756d84920a9322187d61eed)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmcontainer/RMContainerImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/event/SchedulerEventType.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
 2015-12-14 23:50:55 -08:00
Zhihai Xu
70289432f7 YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 
(cherry picked from commit 3a76a010b85176f2bcb85ed6f74c25dcb8acfe4d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-14 22:17:23 -08:00
Karthik Kambatla
843dac5353 YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha) 
(cherry picked from commit 2abec14ec6e7d6d8b7e59239ed2596a15adc8475)
 2015-12-09 10:53:26 -08:00
Akira Ajisaka
80037436c6 YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang. 
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
(cherry picked from commit 925bb94d87db7e916ed380d4512225e796f9e03d)
 2015-12-09 16:30:39 +09:00
Wangda Tan
5b063d6b7f YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda) 
(cherry picked from commit 7e4715186d31ac889fba26d453feedcebb11fc70)

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 7013f9d6cda88e72a839b1c55757615b55101beb)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-08 14:34:53 -08:00
Vinod Kumar Vavilapalli
e7e0c4c0dd HDFS-9273. Moving to 2.6.3 CHANGES section to reflect the backport. 2015-12-08 11:37:06 -08:00
cnauroth
339714baa0 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 
(cherry picked from commit 1b525a9c32fabd8919c80717a58afbfa7fdce27e)
(cherry picked from commit faf1c608990408e2aa59a5e676f86d0c82dbd7f3)
 2015-12-08 11:29:06 -08:00
Tsuyoshi Ozawa
b345ffd7df YARN-4348. ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread. (ozawa) 
(cherry picked from commit 0460b8a8a3de232f236f49ef6769d38cda62cc28)
 2015-12-08 13:41:17 +09:00
Zhe Zhang
203c7a648b Addendum fix for HDFS-9314 to fix compilation error caused by diamond operator. 
Change-Id: Ia8b8142c2cd3b5ec413a7da2bf037be64040dc85
 2015-12-04 10:57:24 -08:00
Zhe Zhang
4c631e8c73 HDFS-9314. Improve BlockPlacementPolicyDefault's picking of excess replicas. Contributed by Xiao Chen. 
Change-Id: Idf99293085531165239369155c039b55db0eed83

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-04 09:51:17 -08:00
Zhe Zhang
089169e4e5 HDFS-9313. Possible NullPointerException in BlockManager if no excess replica can be chosen. Contributed by Ming Ma. Branch-2.7 patch contributed by Xiao Chen. 
Change-Id: Iadaee6be2b44f7b0322d7b0e58f8fc983ef463f6

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-03 23:24:21 -08:00
Zhe Zhang
30dc4334bf HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. Contributed by Brahma Reddy Battula. Branch-2.6 patch contributed by Xiao Chen. 
Change-Id: Id08ade6862db1b8caf87ac9d786797d4fa7098a0
 2015-12-03 11:01:01 -08:00
Junping Du
e710a11a7f Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:28:37 -08:00
Andrew Wang
b2dd21e82d HDFS-9470. Encryption zone on root not loaded from fsimage after NN restart. Xiao Chen via wang. 
(cherry picked from commit 9b8e50b424d060e16c1175b1811e7abc476e2468)
(cherry picked from commit ce1111ceea830cce5f0833db55201e0e88c3b199)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java

(cherry picked from commit 10e8a67d23200d2b6fbab7a050adf922b27e77c4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
 2015-11-30 15:01:08 -08:00
Jason Lowe
53dccddfdb MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4b7d73afd41276ba9a06ec06a0e1762)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-30 17:51:37 +00:00
Jason Lowe
f61e3320cb YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla 
(cherry picked from commit f5acf94ecafb301a0cc8e8f91f19c8bcbc8da701)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/nodelabels/TestFileSystemNodeLabelsStore.java
 2015-11-24 23:59:40 +00:00
Tsz-Wo Nicholas Sze
d2518fd562 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 14:34:51 -08:00
Tsz-Wo Nicholas Sze
83fcbd49a7 Revert "HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags." 
This reverts commit 09dbb11566410f2e9101555637ad81c7acc7edfd.
 2015-11-24 14:08:45 -08:00
Jason Lowe
5074d836b0 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 
(cherry picked from commit cab3c7c8892ad33a7eb0955b01e99872ab95e192)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-24 22:03:39 +00:00
Tsz-Wo Nicholas Sze
09dbb11566 HDFS-9434. Recommission a datanode with 500k blocks may pause NN for 30 seconds for printing info log messags. 2015-11-24 12:40:24 -08:00
Kihwal Lee
238458b259 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: Ibd44ff1bf92bad7262db724990a6a64c1975ffb6
 2015-11-24 09:44:50 -08:00
Sangjin Lee
b9a6f9aa16 HDFS-9083. Replication violates block placement policy (Rushabh Shah) 2015-11-23 16:06:18 -08:00
Sangjin Lee
a9001a210a YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha) 2015-11-23 14:14:50 -08:00
Jason Lowe
16e3dc24c5 MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d66b1d2a6ac2158be32bd35ad2e69bd)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:15:14 +00:00
Jason Lowe
e307078e78 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 
(cherry picked from commit 077250d8d7b4b757543a39a6ce8bb6e3be356c6f)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestLineRecordReader.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestLineRecordReader.java
 2015-11-23 21:07:39 +00:00
Jason Lowe
271875a426 YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu 
(cherry picked from commit ff9c13e0a739bb13115167dc661b6a16b2ed2c04)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestContainerLogsPage.java
(cherry picked from commit e8410c0175518a7ca4f44921e950050854895563)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-11-23 20:57:57 +00:00
Jason Lowe
5f05e5e5ba YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev 2015-11-23 20:27:00 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
5633fb844a HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 70c26703f462e97361924eaf6cbf80be1fce309f)
 2015-11-23 10:05:44 -08:00
Xuan
11c2326acb YARN-2859-addendum: fix the remaining issue from the previous patch. 2015-11-19 10:29:58 -08:00
Akira Ajisaka
68b1abe5cc HDFS-9431. DistributedFileSystem#concat fails if the target path is relative. Contributed by Kazuho Fujii. 
(cherry picked from commit ac1aa6c8197268ea83f44747199d560be9e299ae)
(cherry picked from commit c74e42b4a2293c8adb99b22929047a8d07242d06)
 2015-11-19 20:56:08 +09:00
Jason Lowe
937d9653a7 MAPREDUCE-6377. JHS sorting on state column not working in webUi. 
Contributed by zhihai xu.
(cherry picked from commit 790a861766dcd60212d83f444f2f96d3acf20a94)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-11-18 17:17:58 +00:00
Akira Ajisaka
866d0f6f04 HDFS-8615. Correct HTTP method in WebHDFS document. Contributed by Brahma Reddy Battula. 2015-11-17 16:11:47 +09:00
Sangjin Lee
719fbf813e MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) 
(cherry picked from commit 9ad708a0dfa5e82d1a17471b1cf3e76204b32cbc)
 2015-11-11 16:50:15 -08:00
Akira Ajisaka
6c178cc321 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas. 
(cherry picked from commit 23d0db551cc63def9acbab2473e58fb1c52f85e0)
(cherry picked from commit f6f128c8676981a33ccc55c92321244391f9a3ac)
 2015-11-11 16:18:18 +09:00
Sangjin Lee
f55e1a4f3e HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 18:00:03 -08:00
Steve Loughran
6165fd8663 HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. 
(cherry picked from commit 2bc3f1064f5a5eea1c6b384f68b2d1c2fb427e8f)
 2015-11-08 17:22:46 -08:00
Jason Lowe
cab916cc7b HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 
(cherry picked from commit b2017d9b032af20044fdf60ddbd1575a554ccb79)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-06 17:12:19 +00:00
Wangda Tan
fb7be09f20 YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda) 
(cherry picked from commit 0783184f4b3f669f7211e42b395b62d63144100d)
 2015-11-06 09:10:12 -08:00
Tsuyoshi Ozawa
6b27de0f36 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 
(cherry picked from commit ce31b22739512804da38cf87e0ce1059e3128da3)
 2015-11-06 00:19:41 -08:00
cnauroth
0b55634b9c HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 
(cherry picked from commit 7fc1f2f5cf4312d72aeffb1a9cef497d00c60adb)
 2015-11-05 17:24:51 -08:00
Tsuyoshi Ozawa
5a00b23106 YARN-4312. TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out. Contributed by Varun Saxena. 
(cherry picked from commit 66364419118c64c9d1c623f808f027ac45688759)
 2015-11-05 10:40:23 -08:00
Haohui Mai
da70755b4d HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty principal names. Contributed by Stephen Chu. 
(cherry picked from commit 8549fa5dc95d3e94e49c9b92734aec0509693a2a)
 2015-11-05 10:37:07 -08:00
cnauroth
46c7a8977a HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed3311ea1fd8f5ed1cb6b1c0abc5c90425)
 2015-11-05 10:31:00 -08:00
Sangjin Lee
8f8f3b1027 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b470b1e7a3c5e2d38433429c455bc709)
 2015-10-30 18:51:50 -07:00
Sangjin Lee
ccc0c54501 YARN-2859 addendum. Re-added the entry to hadoop-yarn/CHANGES.txt under 2.6.3. 2015-10-30 14:46:04 -07:00
Suresh Srinivas
22095d7a72 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e587956105897ccff2d4dd4b473aaf8bc)
 2015-10-30 14:38:51 -07:00
Akira Ajisaka
eedbd033d3 HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. Contributed by Rakesh R. 
(cherry picked from commit 966f9508c3ce9dcc63dd2b169150f573699f94a7)
(cherry picked from commit 3249c3ce56cc7b719599b4b0100cf6dfdeabb4df)
 2015-10-30 14:02:44 -07:00