hadoop/hadoop-tools
Ben Roling a36274d699
HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite.
Contributed by Ben Roling.

S3Guard will now track the etag of uploaded files and, if an S3
bucket is versioned, the object version.

You can then control how to react to a mismatch between the data
in the DynamoDB table and that in the store: warn, fail, or, when
using versions, return the original value.

This adds two new columns to the table: etag and version.
This is transparent to older S3A clients -but when such clients
add/update data to the S3Guard table, they will not add these values.
As a result, the etag/version checks will not work with files uploaded by older clients.

For a consistent experience, upgrade all clients to use the latest hadoop version.
2019-05-19 22:29:54 +01:00
..
hadoop-aliyun HADOOP-16306. AliyunOSS: Remove temporary files when upload small files to OSS. Contributed by wujinhu. 2019-05-14 14:05:39 -07:00
hadoop-archive-logs HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-archives HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-aws HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite. 2019-05-19 22:29:54 +01:00
hadoop-azure HADOOP-16050: s3a SSL connections should use OpenSSL 2019-05-16 08:57:54 -06:00
hadoop-azure-datalake HADOOP-15965. Upgrade to ADLS SDK which has major performance improvement for ingress/egress. 2018-12-20 18:00:05 +00:00
hadoop-datajoin HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-distcp HADOOP-16294: Enable access to input options by DistCp subclasses. 2019-05-16 16:11:12 +02:00
hadoop-extras HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-fs2img HADOOP-16253. Update AssertJ to 3.12.2. 2019-04-16 12:53:52 +09:00
hadoop-gridmix HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-kafka HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki. 2019-01-29 18:29:56 -08:00
hadoop-openstack HDFS-14176. Replace incorrect use of system property user.name. Contributed by Dinesh Chitlangia. 2019-03-20 11:20:45 -07:00
hadoop-pipes Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
hadoop-resourceestimator HADOOP-16232. Fix errors in the checkstyle configration xmls. Contributed by Wanqiang Ji. 2019-04-03 19:35:02 +09:00
hadoop-rumen MAPREDUCE-7130. Rumen crashes trying to handle MRAppMaster recovery events. Contributed by Peter Bacsko 2018-10-09 13:27:03 -05:00
hadoop-sls YARN-999. In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task. Addendum. Contributed by Inigo Goiri. 2019-04-09 14:18:05 -07:00
hadoop-streaming HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); 2019-02-05 11:51:02 +00:00
hadoop-tools-dist Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
pom.xml Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30