hadoop/hadoop-tools
Steve Loughran e1267608ec
HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641)
Cut modtime-based rename recovery as object modification time
is not updated during rename operation.
Applications will have to use etag API of HADOOP-17979
and implement it themselves.

Why not do the HEAD and etag recovery in ABFS client?
Cuts the IO capacity in half so kills job commit performance.
The manifest committer of MAPREDUCE-7341 will do this recovery
and act as the reference implementation of the algorithm.

Contributed by: Steve Loughran

Change-Id: I810054c9fd05041dac552f13d31fb15d7524721b
2021-11-17 11:53:34 +00:00
..
hadoop-aliyun Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-archive-logs Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-archives Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-aws Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-azure HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641) 2021-11-17 11:53:34 +00:00
hadoop-azure-datalake Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-datajoin Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-distcp Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-dynamometer Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-extras Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-fs2img Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-gridmix Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-kafka Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-openstack Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-pipes Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-resourceestimator Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-rumen Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-sls Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-streaming Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
hadoop-tools-dist Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00
pom.xml Preparing for 3.3.3 development 2021-11-16 16:02:34 -08:00