Adding more logging for s3 RetryableS3OutputStream (#16117)

Adding more logging for s3 RetryableS3OutputStream which would help us determine if the chunk size needs to be adjusted.
This commit is contained in:
Karan Kumar 2024-03-14 11:35:57 +05:30 committed by GitHub
parent dd9bc3749a
commit 5e603ac5ff
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 1 deletions

View File

@ -269,7 +269,12 @@ public class RetryableS3OutputStream extends OutputStream
// Closeables are closed in LIFO order
closer.register(() -> {
// This should be emitted as a metric
LOG.info("Total push time: [%d] ms", pushStopwatch.elapsed(TimeUnit.MILLISECONDS));
LOG.info(
"Pushed total [%d] parts containing [%d] bytes in [%d]ms.",
numChunksPushed,
resultsSize,
pushStopwatch.elapsed(TimeUnit.MILLISECONDS)
);
});
closer.register(() -> org.apache.commons.io.FileUtils.forceDelete(chunkStorePath));