Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Adding more logging for s3 RetryableS3OutputStream (#16117) 

Adding more logging for s3 RetryableS3OutputStream which would help us determine if the chunk size needs to be adjusted.
This commit is contained in:
Karan Kumar 2024-03-14 11:35:57 +05:30 committed by GitHub
parent dd9bc3749a
commit 5e603ac5ff
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
extensions-core/s3-extensions/src/main/java/org/apache/druid/storage/s3/output/RetryableS3OutputStream.java
View File

@ -269,7 +269,12 @@ public class RetryableS3OutputStream extends OutputStream
// Closeables are closed in LIFO order // Closeables are closed in LIFO order
closer.register(() -> { closer.register(() -> {
// This should be emitted as a metric // This should be emitted as a metric
LOG.info("Total push time: [%d] ms", pushStopwatch.elapsed(TimeUnit.MILLISECONDS)); LOG.info(
"Pushed total [%d] parts containing [%d] bytes in [%d]ms.",
numChunksPushed,
resultsSize,
pushStopwatch.elapsed(TimeUnit.MILLISECONDS)
);
}); });
closer.register(() -> org.apache.commons.io.FileUtils.forceDelete(chunkStorePath)); closer.register(() -> org.apache.commons.io.FileUtils.forceDelete(chunkStorePath));