hadoop/hadoop-tools
Petre Bogdan Stolojan 664075f35d
HADOOP-17198. Support S3 Access Points (#3260)
Add support for S3 Access Points. This provides extra security as it
ensures applications are not working with buckets belong to third parties.

To bind a bucket to an access point, set the access point (ap) ARN,
which must be done for each specific bucket, using the pattern

fs.s3a.bucket.$BUCKET.accesspoint.arn = ARN

* The global/bucket option `fs.s3a.accesspoint.required` to
mandate that buckets must declare their access point.
* This is not compatible with S3Guard.

Consult the documentation for further details.

Contributed by Bogdan Stolojan

(this commit contains the changes to TestArnResource from HADOOP-18068,
 "upgrade AWS SDK to 1.12.132" so that it works with the later SDK.)

Change-Id: I3fac213e52ca6ec1c813effb8496c353964b8e1b
2022-02-04 16:21:35 +00:00
..
hadoop-aliyun Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-archive-logs Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-archives Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-aws HADOOP-17198. Support S3 Access Points (#3260) 2022-02-04 16:21:35 +00:00
hadoop-azure HADOOP-18084. ABFS: Add testfilePath while verifying test contents are read correctly (#3903) 2022-01-19 10:18:05 +00:00
hadoop-azure-datalake Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-datajoin Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-distcp HADOOP-18056. DistCp: Filter duplicates in the source paths. (#3825). Contributed by Ayush Saxena. 2022-01-05 23:53:55 +05:30
hadoop-dynamometer HADOOP-18045. Disable TestDynamometerInfra (#3829) 2021-12-28 13:23:05 +09:00
hadoop-extras Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-fs2img Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-gridmix Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-kafka Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-openstack Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-pipes Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-resourceestimator Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-rumen Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-sls Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-streaming Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-tools-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
pom.xml Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00