Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,280 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9280 Commits

Author SHA1 Message Date
Akira Ajisaka d44873a2a0 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f1)
(cherry picked from commit d219550e8b)
 2016-06-14 10:23:17 +09:00
Masatake Iwasaki 5a3fed0602 HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims) 
cherry-picked from 6fcde2e38d
 2016-06-09 20:48:58 +00:00
Eric Payne 577466c1f2 Added missing entries to hadoop-yarn-project/CHANGES.txt for YARN-5069 YARN-5009 YARN-5008 YARN-4751 YARN-3362 2016-06-09 16:28:37 +00:00
Jason Lowe ab0679ed3f YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du 
(cherry picked from commit c41699965e)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-06-08 17:57:59 +00:00
Jason Lowe fdea6ee0d1 YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran 
(cherry picked from commit 8c8a377cac)
 2016-06-08 14:16:36 +00:00
Zhe Zhang 9b68eda274 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster. 
(cherry picked from commit 6de9213df1)
(cherry picked from commit 06e38c835d)
(cherry picked from commit 0274636529)
 2016-06-06 16:09:14 -07:00
Xiaoyu Yao 97e79662b6 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore. 
(cherry picked from commit 6a76250b39)
 2016-06-03 12:55:31 -07:00
Akira Ajisaka fe08ba439e HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki. 
(cherry picked from commit 69555fca06)
(cherry picked from commit 3dd557e4b6)
 2016-06-02 18:55:36 +09:00
Jason Lowe f0520a2c94 YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong 
(cherry picked from commit 1ba31fe9e9)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c
 2016-05-25 21:49:21 +00:00
Tsz-Wo Nicholas Sze d3bdea7f7f HDFS-9365. Balaner does not work with the HDFS-6376 HA setup. 2016-05-24 13:52:05 -07:00
Naganarasimha 94a9a5d014 YARN-4751. In 2.7, Labeled queue usage not shown properly in capacity scheduler UI. Contributed by Eric Payne 2016-05-25 04:48:14 +08:00
Jason Lowe 27aeab63c7 YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger 
(cherry picked from commit ac954486c5)
 2016-05-23 15:57:54 +00:00
Chris Nauroth 0abb366364 HADOOP-13154. S3AFileSystem printAmazonServiceException/printAmazonClientException appear copy & paste of AWS examples. Contributed by Steve Loughran. 2016-05-19 21:40:17 -07:00
Eric Payne 0ee36fd511 YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger. 2016-05-16 21:12:26 +00:00
Naganarasimha 8f17395029 YARN-3362. Add node label usage in RM CapacityScheduler web UI. Contributed by Eric Payne. 2016-05-17 02:39:50 +08:00
Jason Lowe 7ded648aee MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit 9227dfc25f)
 2016-05-13 14:37:55 +00:00
Jian He 1918da8fc9 MAPREDUCE-6513. Job got hanged forever when one NM unstable for some 
time. Contributed by Varun Saxena & Wangda Tan
 2016-05-12 15:14:08 -07:00
Kihwal Lee 6e62b6fd83 HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su. 
(cherry picked from commit 0c4c7b3b62)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
 2016-05-12 11:26:27 -05:00
Colin Patrick Mccabe a61e04171f HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe) 
(cherry picked from commit f0252ad252)
(cherry picked from commit 43f32d3f4a)
(cherry picked from commit 154332bb54)
 2016-05-10 11:22:13 -07:00
Kihwal Lee 0467efcc09 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah. 
(cherry picked from commit b9e5a32fa1)
Added a CHANGES.txt entry.
 2016-05-09 15:56:51 -05:00
Akira Ajisaka b8e01da1b3 HADOOP-13084. Fix ASF License warnings in branch-2.7. Contributed by Brahma Reddy Battula. 2016-05-08 15:41:59 -07:00
Jason Lowe 09fc02be67 YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena 
(cherry picked from commit b2ed6ae731)
 2016-05-06 23:03:23 +00:00
Jason Lowe 5f698df901 MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan 
(cherry picked from commit c9bb96fa81)
 2016-05-06 22:29:52 +00:00
Robert Kanter b0bcb4e728 Remove parent's env vars from child processes 2016-05-06 09:33:36 -07:00
Masatake Iwasaki dd8aba3fad HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 2016-05-06 15:57:06 +09:00
Vinod Kumar Vavilapalli 9f51a3f430 MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan. 
Updated the 2.7 branch patch to fix a minor issue in TestRMContainerAllocator.java

(cherry picked from commit 8d48266720)
 2016-05-05 19:39:25 -07:00
Tsz-Wo Nicholas Sze 2340e29084 HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 16:07:08 -07:00
Jason Lowe 4311e5f353 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts 
(cherry picked from commit c6b4839168)
 2016-05-03 17:38:19 +00:00
Harsh J d490cfc42c HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9)
 2016-05-02 17:52:14 -07:00
Kihwal Lee 6347f8f4d4 HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 
(cherry picked from commit 7da540d03e)
Updated CHANGES.txt
 2016-04-29 16:07:20 -05:00
Tsz-Wo Nicholas Sze c927f938fe HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:28:23 -07:00
Jason Lowe e12c9e3348 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 
(cherry picked from commit 4a8508501b)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2016-04-29 15:07:07 +00:00
Jason Lowe dbb7458735 Revert "YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe" 
This reverts commit 77ef473981.
 2016-04-29 14:38:30 +00:00
Jian He 77ef473981 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 
(cherry picked from commit 4a8508501b)
 2016-04-28 22:00:42 -07:00
Jian He d7b2da6518 YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe 
(cherry picked from commit a9707dceaf)
 2016-04-28 21:45:17 -07:00
Kihwal Lee a3ece8b5b4 HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla. 2016-04-28 16:47:04 -05:00
Arpit Agarwal 92548e09c6 HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:47:53 -07:00
Eric Payne 2ec33c4e3c YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda / Eric Badger 2016-04-26 16:14:07 +00:00
Akira Ajisaka 076215024b HDFS-10245. Fix the findbugs warnings in branch-2.7. Contributed by Brahma Reddy Battula. 2016-04-25 22:03:48 +09:00
Kihwal Lee 0bb23e22ce HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d)
 2016-04-22 15:22:42 -05:00
Kihwal Lee 9e3b91b141 HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang. 
(cherry picked from commit 5d4255a801)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2016-04-22 11:47:18 -05:00
Tsz-Wo Nicholas Sze e7f1b8fcb3 HDFS-10319. Balancer should not try to pair storages with different types. 2016-04-21 15:36:28 -07:00
Andrew Wang b8febb774a HADOOP-13042. Restore lost leveldbjni LICENSE and NOTICE changes. 
(cherry picked from commit fea50c5440)
(cherry picked from commit c28e4b0651)
(cherry picked from commit bae229ae27)

 Conflicts:
	LICENSE.txt
 2016-04-21 13:51:52 -07:00
Jian He f1e4f4d83a MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du 
(cherry picked from commit 1e48eefe58)
 2016-04-20 19:03:53 -07:00
Arpit Agarwal 12c6c2c9a6 HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou) 2016-04-19 11:28:01 -07:00
Karthik Kambatla cc6ae6fa7e MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 
(cherry picked from commit 27d24f96ab)

(cherry picked from commit b826168173)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-04-18 21:58:53 -07:00
Eric Payne 2ec5bb0fe8 MAPREDUCE-6633. AM should retry map attempts if the reduce task encounters commpression related errors. Contributed by Rushabh Shah 
(cherry picked from commit 1fec06e037)
 2016-04-18 16:12:53 +00:00
Walter Su 91ca90fdd1 HDFS-10275. TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly. Contributed by Lin Yiqun. 
(cherry picked from commit ab903029a9)
 2016-04-18 20:30:48 +08:00
Jason Lowe 0ad4634585 YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee 
(cherry picked from commit 69f3d428d5)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java
 2016-04-15 20:52:11 +00:00
Akira Ajisaka 80d279b481 HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi. 
(cherry picked from commit 6e6b6dd5aa)
(cherry picked from commit 5ae74507c0)
 2016-04-15 14:26:52 +09:00