Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,756 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

11756 Commits

Author SHA1 Message Date
Xiaoyu Yao e0fc749a46 HDFS-11011. Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'. Contributed by Xiaobing Zhou. 
(cherry picked from commit 85f6fec0370b3cd94d6c2f19920c0b6d33f127c6)
(cherry picked from commit c2ba4b650168be4fad7ffdb546b8a0d985268393)
 2016-10-25 11:22:07 -07:00
Zhe Zhang 262518fa5b HDFS-11015. Enforce timeout in balancer. Contributed by Kihwal Lee. 
(cherry picked from commit f6367c5f44)
(cherry picked from commit ff806cbfc7)
 2016-10-25 10:59:03 -07:00
Xiao Chen a8aabf9be6 HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing. 
(cherry picked from commit 09ef97dccb)
 2016-10-25 09:59:48 -07:00
Chris Nauroth 3d5f41544a HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth. 
(cherry picked from commit 309a43925c)
(cherry picked from commit 05d772e297)
 2016-10-25 09:03:19 -07:00
Akira Ajisaka 444312b54b HADOOP-13514. Upgrade maven surefire plugin to 2.19.1. Contributed by Ewan Higgs. 
(cherry picked from commit dbd205762e)
(cherry picked from commit 6bb23a14b6)
 2016-10-25 15:58:57 +09:00
Chris Nauroth 02f0472d1e HADOOP-12774. s3a should use UGI.getCurrentUser.getShortname() for username. Contributed by Steve Loughran. 
(cherry picked from commit 3372e94030)
(cherry picked from commit 5c2f67bdae)
 2016-10-24 21:54:25 -07:00
Chris Nauroth 78970e0db3 HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth. 
(cherry picked from commit d8fa1cfa67)
(cherry picked from commit 5b7cbb5a3c)
 2016-10-24 21:23:00 -07:00
Kihwal Lee c82910203c HDFS-11042. Add missing cleanupSSLConfig() call for tests that use setupSSLConfig(). Contributed by Kuhu Shukla. 
(cherry picked from commit 086577c67a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFWithSWebhdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java
 2016-10-24 09:00:28 -05:00
Jian He dab611e605 Revert YARN-4126. RM should not issue delegation tokens in unsecure mode. 
(cherry picked from commit bb8214cab8)
 2016-10-23 16:56:12 -07:00
Xiaoyu Yao 7d826631ea HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao. 
(cherry picked from commit d0a347984d)
 2016-10-23 10:59:10 -07:00
Xiaoyu Yao 751568e1d3 Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao." 
This reverts commit b82364759c.
 2016-10-23 08:30:20 -07:00
Benoy Antony 653ceab7d3 HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter. Contributed by Hrishikesh Gadre. 2016-10-21 19:43:22 -07:00
Xiaoyu Yao b82364759c HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao. 
(cherry picked from commit be72372248)
 2016-10-21 15:05:57 -07:00
Xiao Chen 7d19394bd5 HADOOP-13381. KMS clients should use KMS Delegation Tokens from current UGI. Contributed by Xiao Chen. 
(cherry picked from commit 8ebf2e95d2)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit 8fe4b2429a)
 2016-10-21 14:59:56 -07:00
Steve Loughran 4b56954fea HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-21 19:12:03 +01:00
Brahma Reddy Battula 5754772bd6 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-21 16:22:42 +05:30
Mingliang Liu cfac82a443 HDFS-10998. Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA. Contributed by Xiaobing Zhou 
(cherry picked from commit d7d87deece)
 2016-10-20 19:59:32 -07:00
Andrew Wang b0a77db3a2 HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng. 
(cherry picked from commit 480302b4ba)
(cherry picked from commit 3fecfe1352)
 2016-10-20 18:00:07 -07:00
Steve Loughran da7e2f08f1 Revert "HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran." 
This reverts commit 671d219c9c.
 2016-10-20 22:49:11 +01:00
Anu Engineer 671d219c9c HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-20 12:50:49 -07:00
Wei-Chiu Chuang b4edd115b4 HDFS-11018. Incorrect check and message in FsDatasetImpl#invalidate. Contributed by Yiqun Lin. 
(cherry picked from commit 6d2da38d16)

Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java

(cherry picked from commit 6f4192d77d)
 2016-10-20 12:41:00 -07:00
Steve Loughran 2b575a90f3 Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula" 
This reverts commit b63dd7b63b.
 2016-10-20 19:43:16 +01:00
Brahma Reddy Battula b63dd7b63b HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 
(cherry picked from commit f872c6bc03)
 2016-10-20 21:49:21 +05:30
Kihwal Lee f57d81955e HDFS-10627. Volume Scanner marks a block as "suspect" even if the exception is network-related. Contributed by Rushabh S Shah. 
(cherry picked from commit 5c0bffddc0)
 2016-10-20 11:02:57 -05:00
Brahma Reddy Battula d2fde9c8b0 HDFS-9480. Expose nonDfsUsed via StorageTypeStats. Contributed by Brahma Reddy Battula 
(cherry picked from commit 4c73be135c)
 2016-10-20 20:51:41 +05:30
Steve Loughran 769babf470 HADOOP-13735 ITestS3AFileContextStatistics.testStatistics() failing. Contributed by Pieter Reuse 2016-10-20 14:50:44 +01:00
Brahma Reddy Battula f5b080e152 HDFS-11025. TestDiskspaceQuotaUpdate fails in trunk due to Bind exception. Contributed by Yiqun Lin 
(cherry picked from commit 73504b1bdc)
 2016-10-20 10:47:16 +05:30
Arpit Agarwal e9592f14d5 HDFS-10752. Several log refactoring/improvement suggestion in HDFS. Contributed by Hanisha Koneru. 2016-10-19 17:22:23 -07:00
Rohith Sharma K S 34023ca418 YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 19ee185907)
 2016-10-19 17:40:42 +00:00
Xiao Chen d22a6a8b82 HDFS-11009. Add a tool to reconstruct block meta file from CLI. 
(cherry picked from commit bc4a32aea50e86819730312e89315c0244ce64bf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetUtil.java

(cherry picked from commit ad7d3c4db8)
 2016-10-18 22:42:09 -07:00
Xiaoyu Yao 190a53b898 HDFS-10906. Add unit tests for Trash with HDFS encryption zones. Contributed by Hanisha Koneru. 
(cherry picked from commit 0c79d5af74944363f3d04f7e1702411db564bbfd)
 2016-10-18 14:09:03 -07:00
Steve Loughran 1ecbf323ba HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 19:34:07 +01:00
Kai Zheng d26e11f30e HDFS-10920. TestStorageMover#testNoSpaceDisk is failing intermittently. Contributed by Rakesh R 2016-10-18 15:09:25 +06:00
Vinitha Reddy Gankidi ae972dd080 HDFS-10712. TestDataNodeVolumeFailure should pass not null BlockReportContext. Contributed by Vinitha Gankidi. 
(cherry picked from commit 278eeb1056)
 2016-10-17 19:02:29 -07:00
Xiaoyu Yao f8b2d77207 HDFS-10922. Adding additional unit tests for Trash (II). Contributed by Weiwei Yang. 
(cherry picked from commit f1802d0be05ecc0b3248690b6f9efedbc7784112)
 2016-10-17 14:04:58 -07:00
Vinayakumar B 36dad0abca HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B 
This closes #89

(cherry picked from commit 8d29e2451f)
 2016-10-17 14:04:58 -07:00
Andrew Wang 15ff590c37 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 
(cherry picked from commit 987ee51141)
(cherry picked from commit 4ed7cf3b36)
 2016-10-17 13:32:52 -07:00
Allen Wittenauer 9d473b8ddc HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw) 
(cherry picked from commit 7eeca90daa)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/src/site/site.xml

(cherry picked from commit fbdb23d2af)
 2016-10-17 13:32:51 -07:00
Eric Yang b2667441e6 HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)
 2016-10-17 08:12:04 -07:00
Masatake Iwasaki 74782e7e42 HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki. 
(cherry picked from commit a13a607e20)
 2016-10-16 12:48:09 +09:00
Brahma Reddy Battula 1c473898aa HDFS-11003. Expose XmitsInProgress through DataNodeMXBean. Contributed By Brahma Reddy Battula 
(cherry picked from commit 5f4ae85bd8)
 2016-10-15 22:40:57 +05:30
Brahma Reddy Battula 34469cd98d Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop" 
This reverts commit 3574e5692d.
 2016-10-15 22:18:24 +05:30
Akira Ajisaka 65e6a1181c HDFS-11012. Unnecessary INFO logging on DFSClients for InvalidToken. Contributed by Harsh J. 
(cherry picked from commit 5ad037df25)
(cherry picked from commit 35832901e8)
 2016-10-15 22:19:14 +09:00
Eric Yang 3574e5692d HADOOP-13707. Skip authorization for anonymous user to access Hadoop 
web interface in non-secure environment.  (Yuanbo Liu via eyang)
 2016-10-14 22:14:59 -07:00
Vinitha Reddy Gankidi 2304501bcf HDFS-10301. Remove FBR tracking state to fix false zombie storage detection for interleaving block reports. Contributed by Vinitha Gankidi. 
(cherry picked from commit 391ce535a7)
 2016-10-14 18:52:00 -07:00
Lei Xu b9fdbd7107 HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 
(cherry picked from commit 78cb79fa91)
 2016-10-14 15:01:37 -07:00
Mingliang Liu 15b1d522ee HDFS-11008. Change unit test for testing parsing "-source" parameter in Balancer CLI. Contributed by Mingliang Liu 
(cherry picked from commit 76cc84e6d4)
 2016-10-14 14:44:34 -07:00
Kihwal Lee 8d1fbf786b Revert "HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei)" 
This reverts commit f981dd1bca.
 2016-10-14 16:37:51 -05:00
Lei Xu f981dd1bca HDFS-10960. TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove. (Manoj Govindassamy via lei) 
(cherry picked from commit 8c520a27cb)
 2016-10-14 13:44:18 -07:00
Andrew Wang f13b84b4eb HDFS-10883. 's behavior is not consistent in DFS after enabling EZ. Contributed by Yuanbo Liu. 
(cherry picked from commit 0007360c33)
 2016-10-14 11:41:42 -07:00