OpenSearch/x-pack
Armin Braun 0a254cf223
Serialize Monitoring Bulk Request Compressed (#56410) (#56442)
Even with changes from #48854 we're still seeing significant (as in tens and hundreds of MB)
buffer usage for bulk exports in some cases which destabilizes master nodes.
Since we need to know the serialized length of the bulk body we can't do the serialization
in a streaming manner. (also it's not easily doable with the HTTP client API we're using anyway).
=> let's at least serialize on heap in compressed form and decompress as we're streaming to the
HTTP connection. For small requests this adds negligible overhead but for large requests this reduces
the size of the payload field by about an order of magnitude (empirically determined) which is a massive reduction in size when considering O(100MB) bulk requests.
2020-05-08 23:16:07 +02:00
..
dev-tools
docs [DOCS] Create API key API requires `name` request body param (#56262) 2020-05-06 08:52:45 -04:00
license-tools Support "enterprise" license types (#49474) 2019-12-12 14:37:44 +11:00
plugin Serialize Monitoring Bulk Request Compressed (#56410) (#56442) 2020-05-08 23:16:07 +02:00
qa [Transform] unmute transform upgrade tests (#56296) 2020-05-08 10:48:58 +02:00
snapshot-tool Fix missing SHAs for Jackson 2.10.4 2020-05-06 17:28:24 -04:00
test Upgrade feature aware check usage of ASM to 7.3.1 (#54577) 2020-04-18 10:49:57 -04:00
transport-client [7.x] Re-add origin url information to publish POM files (#55173) 2020-04-14 13:24:15 -07:00
NOTICE.txt
README.md
build.gradle [7.x] Update opensaml dependency (#44972) (#49512) 2019-11-29 00:17:16 +02:00

README.md

Elastic License Functionality

This directory tree contains files subject to the Elastic License. The files subject to the Elastic License are grouped in this directory to clearly separate them from files licensed under the Apache License 2.0.