hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client
Steve Loughran 7328c34ba5
MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS
This is a mapreduce/spark output committer optimized for
performance and correctness on Azure ADLS Gen 2 storage
(via the abfs connector) and Google Cloud Storage
(via the external gcs connector library).

* It is safe to use with HDFS, however it has not been optimized
for that use.
* It is *not* safe for use with S3, and will fail if an attempt
is made to do so.

Contributed by Steve Loughran

Change-Id: I6f3502e79c578b9fd1a8c1485f826784b5421fca
2022-03-17 11:24:13 +00:00
..
hadoop-mapreduce-client-app HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000) 2022-03-08 17:27:04 +09:00
hadoop-mapreduce-client-common MAPREDUCE-7371. DistributedCache alternative APIs should not use DistributedCache APIs internally (#3855) 2022-01-09 00:18:10 +09:00
hadoop-mapreduce-client-core MAPREDUCE-7341. Add an intermediate manifest committer for Azure and GCS 2022-03-17 11:24:13 +00:00
hadoop-mapreduce-client-hs HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000) 2022-03-08 17:27:04 +09:00
hadoop-mapreduce-client-hs-plugins Preparing for 3.4.0 development 2020-03-29 23:24:25 +05:30
hadoop-mapreduce-client-jobclient HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000) 2022-03-08 17:27:04 +09:00
hadoop-mapreduce-client-nativetask HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions and remove remaining usages (#3712) 2021-11-29 17:37:30 +09:00
hadoop-mapreduce-client-shuffle HADOOP-17959. Replace Guava VisibleForTesting by Hadoop's own annotation in hadoop-cloud-storage-project and hadoop-mapreduce-project modules (#3537) 2021-10-11 16:22:50 +09:00
hadoop-mapreduce-client-uploader HADOOP-17956. Replace all default Charset usage with UTF-8 (#3529) 2021-10-14 13:07:24 +09:00
pom.xml HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (#4000) 2022-03-08 17:27:04 +09:00