Commit Graph

9298 Commits

Author SHA1 Message Date
Akira Ajisaka e8c253d500 HADOOP-13297. Add missing dependency in setting maven-remote-resource-plugin to fix builds. Contributed by Sean Busbey.
(cherry picked from commit 7bd5d4272c)
(cherry picked from commit 02b037f625)
2016-07-11 17:24:35 -07:00
Jason Lowe 6759cbc56a HADOOP-13362. DefaultMetricsSystem leaks the source name when a source unregisters. Contributed by Junping Du 2016-07-11 20:58:40 +00:00
Andrew Wang 830516b8c5 HADOOP-13350. Additional fix to LICENSE and NOTICE. Contributed by Xiao Chen. 2016-07-07 10:45:01 -07:00
Andrew Wang 5ebebc6524 HDFS-10488. Update WebHDFS documentation regarding CREATE and MKDIR default permissions. Contributed by Wellington Chevreuil.
(cherry picked from commit 728623242f)
2016-07-07 10:38:33 -07:00
Yongjun Zhang 81f0d56c57 HDFS-10396. Using -diff option with DistCp may get "Comparison method violates its general contract" exception. Contributed by Yongjun Zhang.
(cherry picked from commit 8113855b3a)
2016-06-28 23:45:19 -07:00
Chris Douglas 7595d89612 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri.
Cherry picked from commit #8652cce5b2
2016-06-27 14:32:42 +01:00
Masatake Iwasaki 01f5e609a2 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims)
(cherry picked from commit 67089875f0)
2016-06-22 23:52:44 +09:00
Brahma Reddy Battula 6a1fc34595 HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula) 2016-06-21 16:12:46 +05:30
Rohith Sharma K S 4a498f5fa1 YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe. 2016-06-21 11:32:34 +05:30
Rohith Sharma K S 0bc531aa8f Adding-release-2.7.4-to-CHANGES.txt 2016-06-21 11:27:13 +05:30
Akira Ajisaka e19cd05a87 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde.
(cherry picked from commit fc6b50cc57)
(cherry picked from commit 39ea0891d2)
2016-06-20 17:11:23 +09:00
Brahma Reddy Battula be94ed6ceb HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:43:18 +05:30
Xiaoyu Yao 138d0f0bc4 HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen.
(cherry picked from commit ddf66427ff)
2016-06-16 20:19:13 -07:00
Konstantin V Shvachko 10574bce81 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 19:11:58 -07:00
Akira Ajisaka 5c3ae65f76 HADOOP-12893. Verify LICENSE.txt and NOTICE.txt. Contributed by Xiao Chen, Andrew Wang, and Akira Ajisaka. 2016-06-16 13:41:05 +09:00
Arpit Agarwal aca4310f32 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula)
(cherry picked from commit 02949b2151)
2016-06-14 23:13:48 -07:00
Vinod Kumar Vavilapalli f4b58eae94 Preparing for 2.7.4 development: Updating snapshot version to 2.7.4 on branch-2.7. 2016-06-14 19:14:02 -07:00
Kihwal Lee 8854cdd9ee HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina)
(cherry picked from commit 4014ce5990)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
2016-06-14 08:25:09 -05:00
Akira Ajisaka d44873a2a0 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
(cherry picked from commit e3ba9ad3f1)
(cherry picked from commit d219550e8b)
2016-06-14 10:23:17 +09:00
Masatake Iwasaki 5a3fed0602 HDFS-9905. WebHdfsFileSystem#runWithRetry should display original stack trace on error. (Wei-Chiu Chuang via iwasakims)
cherry-picked from 6fcde2e38d
2016-06-09 20:48:58 +00:00
Eric Payne 577466c1f2 Added missing entries to hadoop-yarn-project/CHANGES.txt for YARN-5069 YARN-5009 YARN-5008 YARN-4751 YARN-3362 2016-06-09 16:28:37 +00:00
Jason Lowe ab0679ed3f YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
(cherry picked from commit c41699965e)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
2016-06-08 17:57:59 +00:00
Jason Lowe fdea6ee0d1 YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran
(cherry picked from commit 8c8a377cac)
2016-06-08 14:16:36 +00:00
Zhe Zhang 9b68eda274 HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster.
(cherry picked from commit 6de9213df1)
(cherry picked from commit 06e38c835d)
(cherry picked from commit 0274636529)
2016-06-06 16:09:14 -07:00
Xiaoyu Yao 97e79662b6 HDFS-8548. Minicluster throws NPE on shutdown. Contributed by surendra singh lilhore.
(cherry picked from commit 6a76250b39)
2016-06-03 12:55:31 -07:00
Akira Ajisaka fe08ba439e HDFS-9476. TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail. Contributed by Masatake Iwasaki.
(cherry picked from commit 69555fca06)
(cherry picked from commit 3dd557e4b6)
2016-06-02 18:55:36 +09:00
Jason Lowe f0520a2c94 YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong
(cherry picked from commit 1ba31fe9e9)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c
2016-05-25 21:49:21 +00:00
Tsz-Wo Nicholas Sze d3bdea7f7f HDFS-9365. Balaner does not work with the HDFS-6376 HA setup. 2016-05-24 13:52:05 -07:00
Naganarasimha 94a9a5d014 YARN-4751. In 2.7, Labeled queue usage not shown properly in capacity scheduler UI. Contributed by Eric Payne 2016-05-25 04:48:14 +08:00
Jason Lowe 27aeab63c7 YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger
(cherry picked from commit ac954486c5)
2016-05-23 15:57:54 +00:00
Chris Nauroth 0abb366364 HADOOP-13154. S3AFileSystem printAmazonServiceException/printAmazonClientException appear copy & paste of AWS examples. Contributed by Steve Loughran. 2016-05-19 21:40:17 -07:00
Eric Payne 0ee36fd511 YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger. 2016-05-16 21:12:26 +00:00
Naganarasimha 8f17395029 YARN-3362. Add node label usage in RM CapacityScheduler web UI. Contributed by Eric Payne. 2016-05-17 02:39:50 +08:00
Jason Lowe 7ded648aee MAPREDUCE-6558. multibyte delimiters with compressed input files generate duplicate records. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 9227dfc25f)
2016-05-13 14:37:55 +00:00
Jian He 1918da8fc9 MAPREDUCE-6513. Job got hanged forever when one NM unstable for some
time. Contributed by Varun Saxena & Wangda Tan
2016-05-12 15:14:08 -07:00
Kihwal Lee 6e62b6fd83 HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su.
(cherry picked from commit 0c4c7b3b62)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
2016-05-12 11:26:27 -05:00
Colin Patrick Mccabe a61e04171f HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe)
(cherry picked from commit f0252ad252)
(cherry picked from commit 43f32d3f4a)
(cherry picked from commit 154332bb54)
2016-05-10 11:22:13 -07:00
Kihwal Lee 0467efcc09 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah.
(cherry picked from commit b9e5a32fa1)
Added a CHANGES.txt entry.
2016-05-09 15:56:51 -05:00
Akira Ajisaka b8e01da1b3 HADOOP-13084. Fix ASF License warnings in branch-2.7. Contributed by Brahma Reddy Battula. 2016-05-08 15:41:59 -07:00
Jason Lowe 09fc02be67 YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena
(cherry picked from commit b2ed6ae731)
2016-05-06 23:03:23 +00:00
Jason Lowe 5f698df901 MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan
(cherry picked from commit c9bb96fa81)
2016-05-06 22:29:52 +00:00
Robert Kanter b0bcb4e728 Remove parent's env vars from child processes 2016-05-06 09:33:36 -07:00
Masatake Iwasaki dd8aba3fad HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 2016-05-06 15:57:06 +09:00
Vinod Kumar Vavilapalli 9f51a3f430 MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan.
Updated the 2.7 branch patch to fix a minor issue in TestRMContainerAllocator.java

(cherry picked from commit 8d48266720)
2016-05-05 19:39:25 -07:00
Tsz-Wo Nicholas Sze 2340e29084 HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 16:07:08 -07:00
Jason Lowe 4311e5f353 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts
(cherry picked from commit c6b4839168)
2016-05-03 17:38:19 +00:00
Harsh J d490cfc42c HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh)
(cherry picked from commit 54e612bfb9)
2016-05-02 17:52:14 -07:00
Kihwal Lee 6347f8f4d4 HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah.
(cherry picked from commit 7da540d03e)
Updated CHANGES.txt
2016-04-29 16:07:20 -05:00
Tsz-Wo Nicholas Sze c927f938fe HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:28:23 -07:00
Jason Lowe e12c9e3348 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe
(cherry picked from commit 4a8508501b)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
2016-04-29 15:07:07 +00:00