4ee3543625
HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel.
2016-06-22 15:45:25 +01:00
b2c596cdda
HADOOP-13287. TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains +. Contributed by Chris Nauroth.
2016-06-21 11:28:52 -07:00
b7c4cf7129
HADOOP-13291. Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented. Contributed by Mingliang Liu.
2016-06-20 16:25:30 -07:00
127d2c7281
HADOOP-13241. document s3a better. Contributed by Steve Loughran.
2016-06-16 11:18:02 -07:00
4aefe119a0
HADOOP-3733. "s3x:" URLs break when Secret Key contains a slash, even if encoded. Contributed by Steve Loughran.
2016-06-16 11:13:35 -07:00
31ffaf76f2
HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory.
2016-06-09 21:00:47 +01:00
656c460c0e
HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth
2016-06-09 17:28:49 +01:00
a3f78d8fa8
HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables. Contributed by Tobin Baker.
2016-06-06 23:42:36 +02:00
c58a59f708
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
2016-06-03 08:55:33 -07:00
16b1cc7af9
HADOOP-13131. Add tests to verify that S3A supports SSE-S3 encryption. Contributed by Steve Loughran.
2016-06-01 14:49:22 -07:00
5870611030
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
2016-06-01 14:18:20 +01:00
39ec1515a2
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
2016-05-21 16:39:31 +01:00
757050ff35
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
2016-05-20 13:52:15 +01:00
c918286b17
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth.
2016-05-20 12:21:59 +01:00
93258459fa
HADOOP-13183. S3A proxy tests fail after httpclient/httpcore upgrade. Contributed by Steve Loughran.
2016-05-19 22:00:21 -07:00
08ea07f1b8
HADOOP-13158 S3AFileSystem#toString might throw NullPointerException due to null cannedACL. (Chris Nauroth via stevel)
2016-05-17 13:19:29 +01:00
dd3a8bed0a
HADOOP-13113 Enable parallel test execution for hadoop-aws. Chris Nauroth via stevel
2016-05-13 10:47:12 +01:00
3c5c57af28
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
2016-05-12 18:27:28 -07:00
ca5613af91
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
...
This reverts commit 6b53802cba
2016-05-12 15:32:45 -07:00
27c4e90efc
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:24:20 +01:00
6b53802cba
Update project version to 3.0.0-alpha1-SNAPSHOT.
2016-05-12 11:05:05 -07:00
3f2816ab5a
HADOOP-13116 Jets3tNativeS3FileSystemContractTest does not run.
2016-05-12 16:35:57 +01:00
def2a6d385
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:57:35 +01:00
27242f211e
HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris Nauroth.
2016-05-10 15:21:06 -07:00
025219b12f
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:37:22 +01:00
19f0f9608e
HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel)
2016-04-22 11:25:03 +01:00
df18b6e984
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel)
2016-04-14 12:44:55 +01:00
b9e3eff62a
HADOOP-12444 Support lazy seek in S3AInputStream. Rajesh Balamohan via stevel
2016-04-09 11:25:31 +01:00
843ee8d59d
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
2016-04-08 13:36:58 -07:00
ce5b4812f0
HADOOP-12753 S3A JUnit tests failing if using HTTP proxy. (Zoran Rajic via stevel)
2016-04-08 17:10:00 +01:00
89c9347511
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. - omitted new S3A subclass
2016-04-04 17:02:04 +01:00
0ecdd4cffa
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse.
2016-04-03 16:40:19 +01:00
256c82fe29
HADOOP-11687. Ignore x-* and response headers when copying an Amazon S3 object. Contributed by Aaron Peterson and harsh.
2016-04-01 14:18:10 +05:30
738155063e
HADOOP-12857. rework hadoop-tools (aw)
2016-03-23 13:46:38 -07:00
d251e55415
HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
2016-02-29 21:59:52 -08:00
8ab7658025
HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
2016-02-18 14:06:38 -08:00
76fab26c5c
HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
2016-02-17 12:19:59 -08:00
29ae258013
HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel)
2016-02-06 15:05:16 +00:00
1acc509b45
HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
2016-01-19 13:57:08 -08:00
126705f67e
HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
2016-01-12 12:19:53 -08:00
2d16f40dab
HADOOP-12689. S3 filesystem operations stopped working correctly
2016-01-05 23:26:03 -08:00
3ae82863f0
HADOOP-12553. [JDK8] Fix javadoc error caused by illegal tag. (aajisaka)
2015-11-08 19:17:57 +09:00
bff7c90a56
HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)
2015-11-05 18:35:15 -08:00
7fe521b1dd
HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu.
2015-09-25 22:33:53 -07:00
6ab2d19f5c
HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu)
2015-08-29 09:59:30 -07:00
d5403747b5
HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu)
2015-08-04 18:51:52 -07:00
2dbc40e608
HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey.
2015-06-05 13:11:01 -07:00
f33efbc827
HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak)
2015-05-08 10:22:11 +05:30
19262d99eb
HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel)
2015-04-23 21:41:51 +01:00
ef9946cd52
HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
2015-03-17 16:09:21 +09:00
Steve Loughran
Chris Nauroth
Jitendra Pandey
Ravi Prakash
Andrew Wang
Harsh J
Allen Wittenauer
Lei Xu
Ravi Prakash
Akira Ajisaka
Lei Xu
Vinayakumar B
Tsuyoshi Ozawa