hadoop/hadoop-tools/hadoop-aws
Steve Loughran 5f0004e012 HADOOP-17199. S3A Directory Marker HADOOP-13230 backport #2210
This backports the listing-side changes of HADOOP-13230.

With this patch in, this branch of Hadoop is compatible with S3A clients
which do not delete directory markers when files are created underneath.

It does not allow this version to disable marker deletion; if the
fs.s3a.marker.retention option is changed to request this, a message
is printed at INFO and the policy remains at "delete"

The s3guard bucket-info command has been extended to support
probing for marker retention, as has the hasPathCapability method on
S3AFileSystem.

Read the documentation!

Change-Id: I9261cadedb6b64993351611e140c4e3e9cf50d3a
2020-08-28 17:55:18 +01:00
..
dev-support HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions. 2018-03-05 14:06:20 +00:00
src HADOOP-17199. S3A Directory Marker HADOOP-13230 backport #2210 2020-08-28 17:55:18 +01:00
pom.xml Preparing for 3.1.5 development 2020-04-29 11:18:18 +02:00