OpenSearch/plugins/repository-s3
Tanguy Leroux f753fa2265 HttpHandlers should return correct list of objects (#49283)
This commit fixes the server side logic of "List Objects" operations
of Azure and S3 fixtures. Until today, the fixtures were returning a "
flat" view of stored objects and were not correctly handling the
delimiter parameter. This causes some objects listing to be wrongly
interpreted by the snapshot deletion logic in Elasticsearch which
relies on the ability to list child containers of BlobContainer (#42653)
to correctly delete stale indices.

As a consequence, the blobs were not correctly deleted from the
 emulated storage service and stayed in heap until they got garbage
collected, causing CI failures like #48978.

This commit fixes the server side logic of Azure and S3 fixture when
listing objects so that it now return correct common blob prefixes as
expected by the snapshot deletion process. It also adds an after-test
check to ensure that tests leave the repository empty (besides the
root index files).

Closes #48978
2019-11-20 09:26:42 +01:00
..
config/repository-s3 Fix logging configuration for AwsSdkMetrics logger 2016-10-14 23:44:39 -04:00
licenses Update AWS SDK for repository-s3 plugin to support IAM Roles for Service Accounts (#46969) (#47004) 2019-09-24 17:15:11 +02:00
src HttpHandlers should return correct list of objects (#49283) 2019-11-20 09:26:42 +01:00
build.gradle Add docker-compose fixtures for S3 integration tests (#49107) (#49229) 2019-11-18 05:56:59 -05:00