hadoop/hadoop-tools
Steve Loughran 5314f2e7a3 HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641)
Cut modtime-based rename recovery as object modification time
is not updated during rename operation.
Applications will have to use etag API of HADOOP-17979
and implement it themselves.

Why not do the HEAD and etag recovery in ABFS client?
Cuts the IO capacity in half so kills job commit performance.
The manifest committer of MAPREDUCE-7341 will do this recovery
and act as the reference implementation of the algorithm.

Contributed by: Steve Loughran

Change-Id: I810054c9fd05041dac552f13d31fb15d7524721b
2022-01-04 14:27:22 -08:00
..
hadoop-aliyun Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-archive-logs Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-archives Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-aws HADOOP-18026. Fix default value of Magic committer (#3723) 2022-01-04 14:21:00 -08:00
hadoop-azure HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641) 2022-01-04 14:27:22 -08:00
hadoop-azure-datalake Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-datajoin Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-distcp Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-dynamometer Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-extras Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-fs2img Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-gridmix Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-kafka Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-openstack Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-pipes Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-resourceestimator Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-rumen Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-sls Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-streaming Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
hadoop-tools-dist Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00
pom.xml Preparing for 3.3.1 release 2021-11-16 16:07:17 -08:00