Commit Graph

3239 Commits

Author SHA1 Message Date
Andrew Wang 99d0b3eb2b HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:22 -07:00
Arpit Agarwal 148bb3e737 HADOOP-13738. DiskChecker should perform some disk IO. 2016-11-01 18:09:12 -07:00
Ravi Prakash 045501a538 HADOOP-13773. Wrong HADOOP_CLIENT_OPTS in hadoop-env on branch-2. Contributed by Fei Hui 2016-11-01 10:49:04 -07:00
Steve Loughran c4ccafdaff HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi. 2016-10-31 20:52:49 +00:00
Wei-Chiu Chuang 9ba283c27d HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
(cherry picked from commit 112f04eb1b)
2016-10-28 15:37:30 -07:00
Jason Lowe 0f224d405f HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
(cherry picked from commit c017171da0)
2016-10-28 15:06:23 +00:00
Brahma Reddy Battula 5e760c89a1 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
(cherry picked from commit 0c837db8a8)
2016-10-27 19:48:21 +05:30
Masatake Iwasaki 7e918637de HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
(cherry picked from commit 0bdd263d82)
2016-10-27 15:54:03 +09:00
Chris Nauroth 082d69ee66 HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
(cherry picked from commit 1f8490a5ba)
2016-10-26 08:57:29 -07:00
Chris Nauroth 67e01f7218 HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
(cherry picked from commit 9cad3e2350)
2016-10-26 08:27:33 -07:00
Xiao Chen 4c5c6c8c44 HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing.
(cherry picked from commit 09ef97dccb)
2016-10-25 09:59:45 -07:00
Chris Nauroth 05d772e297 HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
(cherry picked from commit 309a43925c)
2016-10-25 09:03:11 -07:00
Benoy Antony b913b62aaf HADOOP-12082. Support multiple authentication schemes via AuthenticationFilter. Contributed by Hrishikesh Gadre. 2016-10-25 08:30:02 -07:00
Chris Nauroth 5b7cbb5a3c HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
(cherry picked from commit d8fa1cfa67)
2016-10-24 21:22:46 -07:00
Xiaoyu Yao 48c9064b33 HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
(cherry picked from commit d0a347984d)
2016-10-23 10:59:01 -07:00
Xiaoyu Yao 68d91e0200 Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao."
This reverts commit 0205ad5fa8.
2016-10-23 08:26:01 -07:00
Xiaoyu Yao 0205ad5fa8 HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
(cherry picked from commit be72372248)
2016-10-21 14:25:29 -07:00
Chris Douglas 25f4327f0b HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du
(cherry picked from commit ae8bccd509)
2016-10-21 13:01:08 -07:00
Steve Loughran 385c1daa46 HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-21 19:11:31 +01:00
Brahma Reddy Battula 2ab149f0e4 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
(cherry picked from commit f872c6bc03)
2016-10-21 16:19:18 +05:30
Steve Loughran f0af3dee25 Revert "HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran."
This reverts commit 42f8a1d6eb.
2016-10-20 22:48:26 +01:00
Anu Engineer 1f384b617d HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 2016-10-20 13:40:01 -07:00
Anu Engineer 42f8a1d6eb HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-20 12:47:57 -07:00
Steve Loughran ab36519b6f Revert "HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula"
This reverts commit bf6379fdd2.
2016-10-20 19:32:10 +01:00
Brahma Reddy Battula bf6379fdd2 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
(cherry picked from commit f872c6bc03)
2016-10-20 21:48:23 +05:30
Steve Loughran bc176961e6 HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 19:33:38 +01:00
Akira Ajisaka b2618685fb HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
(cherry picked from commit bedfec0c10)
2016-10-18 15:03:33 +09:00
Andrew Wang 4ed7cf3b36 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
(cherry picked from commit 987ee51141)
2016-10-17 13:32:39 -07:00
Allen Wittenauer fbdb23d2af HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw)
(cherry picked from commit 7eeca90daa)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-project/src/site/site.xml
2016-10-17 13:32:28 -07:00
Eric Yang 7993fb5b81 HADOOP-13707. Skip authorization for anonymous user to access Hadoop
web interface in non-secure environment.  (Yuanbo Liu via eyang)

    (cherry picked from commit dc308e98b9)
    With Addendum patch
2016-10-17 07:57:45 -07:00
Eric Yang a4356bb7a5 HADOOP-13707. Skip authorization for anonymous user to access Hadoop
web interface in non-secure environment.  (Yuanbo Liu via eyang)

    (cherry picked from commit dc308e98b9)
    With Addendum patch
2016-10-16 20:32:48 -07:00
Eric Yang 439422fff9 HADOOP-13707. Skip authorization for anonymous user to access Hadoop
web interface in non-secure environment.  (Yuanbo Liu via eyang)

(cherry picked from commit dc308e98b9)
With Addendum patch
2016-10-15 21:23:21 -07:00
Masatake Iwasaki a13a607e20 HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki. 2016-10-16 12:44:19 +09:00
Brahma Reddy Battula a0eee72053 Revert "HADOOP-13707. Skip authorization for anonymous user to access Hadoop"
This reverts commit dc308e98b9.
2016-10-15 22:13:45 +05:30
Eric Yang dc308e98b9 HADOOP-13707. Skip authorization for anonymous user to access Hadoop
web interface in non-secure environment.  (Yuanbo Liu via eyang)
2016-10-14 22:13:24 -07:00
Xiaoyu Yao 1eb8c0e880 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang.
(cherry picked from commit dbe663d524)
2016-10-13 23:05:58 -07:00
Xiao Chen 562c358a83 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing.
(cherry picked from commit ae51b11f78)
2016-10-13 22:32:25 -07:00
Arpit Agarwal ecd3467f11 HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:12 -07:00
Xiaoyu Yao 874402a295 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
(cherry picked from commit 9097e2efe4)
2016-10-13 10:54:51 -07:00
Andrew Wang f131d61ff8 HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
(cherry picked from commit 12d739a34b)
2016-10-12 15:20:07 -07:00
Kihwal Lee 5305a392c3 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
(cherry picked from commit 85cd06f663)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
2016-10-12 15:22:51 -05:00
Xiao Chen b413dd34b3 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
(cherry picked from commit b84c4891f9)
2016-10-11 17:05:17 -07:00
Wei-Chiu Chuang 56184de510 HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4b32b1420d)
2016-10-11 13:22:25 -07:00
Mingliang Liu 21fcb5726a HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu
(cherry picked from commit 2fb392a587)
2016-10-11 11:18:46 -07:00
Mingliang Liu de30f13a0a HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu 2016-10-10 13:37:00 -07:00
Xiao Chen eebda43ec1 HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya.
(cherry picked from commit fc18c32540ed6a410adb123e1105729e0343b7f5)
2016-10-10 12:51:08 -07:00
Kai Zheng ad0659557b HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang 2016-10-10 11:44:04 +06:00
Xiao Chen b9761f2fc9 HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen.
(cherry picked from commit 2e853be657)
2016-10-07 13:46:45 -07:00
Robert Kanter 7bfa595679 HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
(cherry picked from commit c183b9de8d)
2016-10-07 09:37:17 -07:00
Steve Loughran a6bb21eec4 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 12:47:14 +01:00