OpenSearch/test/fixtures/s3-fixture
Armin Braun a5fa86ed97
Improve Stability of Mock APIs (#49518) (#49524)
This commit ensures that even for requests that are known to be empty body
we at least attempt to read one bytes from the request body input stream.
This is done to work around the behavior in `sun.net.httpserver.ServerImpl.Dispatcher#handleEvent`
that will close a TCP/HTTP connection that does not have the `eof` flag (see `sun.net.httpserver.LeftOverInputStream#isEOF`)
set on its input stream. As far as I can tell the only way to set this flag is to do a read when there's no more bytes buffered.
This fixes the numerous connection closing issues because the `ServerImpl` stops closing connections that it thinks
weren't fully drained.

Also, I removed a now redundant drain loop in the Azure handler as well as removed the connection closing in the error handler's
drain action (this shouldn't have an effect but makes things more predictable/easier to reason about IMO).

I would suggest merging this and closing related issue after verifying that this fixes things on CI.

The way to locally reproduce the issues we're seeing in tests is to make the retry timings more aggressive in e.g. the azure tests
and move them to single digit values. This makes the retries happen quickly enough that they run into the async connecting closing
of allegedly non-eof connections by `ServerImpl` and produces the exact kinds of failures we're seeing currently.

Relates #49401, #49429
2019-11-25 10:28:55 +01:00
..
src/main/java/fixture/s3 Improve Stability of Mock APIs (#49518) (#49524) 2019-11-25 10:28:55 +01:00
Dockerfile Add docker-compose fixtures for S3 integration tests (#49107) (#49229) 2019-11-18 05:56:59 -05:00
build.gradle Add docker-compose fixtures for S3 integration tests (#49107) (#49229) 2019-11-18 05:56:59 -05:00
docker-compose.yml Add docker-compose fixtures for S3 integration tests (#49107) (#49229) 2019-11-18 05:56:59 -05:00