David Taylor 9a36286920
FIX: Open file handles 'just in time' during s3 migration (#28806)
Previously we were opening the file handles, then putting them in a queue for upload. If that queue grows too large, we can hit a maximum open files limit.

This commit opens the file handle 'just in time', so the maximum number of open handles is equal to the upload concurrency (20).
2024-09-09 18:39:26 +01:00
..
2022-04-28 11:51:03 +02:00
2024-08-12 10:41:13 +02:00
2024-06-18 10:47:18 +02:00
2023-02-21 10:30:48 +01:00
2024-07-04 10:58:21 +02:00
2024-09-05 09:58:20 +02:00
2024-08-27 10:54:25 -04:00