Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

HADOOP-17547 Magic committer to downgrade abort in cleanup if list uploads fails with access denied (#3051) 

Contributed by Bogdan Stolojan

Change-Id: I32d6dc4f72087783a3ea12473d11690ac14fe3cb
This commit is contained in:
Petre Bogdan Stolojan 2021-06-12 17:45:12 +01:00 committed by Steve Loughran
parent 52d055a7eb
commit 254d943126
No known key found for this signature in database
GPG Key ID: D22CF846DBB162A0
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/AbstractS3ACommitter.java
View File

@ -832,8 +832,8 @@ public abstract class AbstractS3ACommitter extends PathOutputCommitter
try { try {
pending = ops.listPendingUploadsUnderPath(dest); pending = ops.listPendingUploadsUnderPath(dest);
} catch (IOException e) { } catch (IOException e) {
// raised if the listPendingUploads call failed. // Swallow any errors given this is best effort
maybeIgnore(suppressExceptions, "aborting pending uploads", e); LOG.debug("Failed to list pending uploads under {}", dest, e);
return; return;
} }
if (!pending.isEmpty()) { if (!pending.isEmpty()) {