OpenSearch/x-pack/plugin
Costin Leau f9c15d0fec EQL: Introduce sequencing fetch size (#59063)
The current internal sequence algorithm relies on fetching multiple results and then paginating through the dataset. Depending on the dataset and memory, setting a larger page size can yield better performance at the expense of memory.
This PR makes this behavior explicit by decoupling the fetch size from size, the maximum number of results desired.
As such, use in testing a minimum fetch size which exposed a number of bugs:

Jumping across data across queries causing valid data to be seen as a gap.
Incorrectly resuming searching across pages (again causing data to be discarded).
which have been addressed.

(cherry picked from commit 2f389a7724790d7b0bda67264d6eafcfa8b2116e)
2020-07-06 19:14:26 +03:00
..
analytics Deduplicate Empty InternalAggregations (#58386) (#59032) 2020-07-04 14:02:16 +02:00
async [7.x] EQL: Adds an ability to execute an asynchronous EQL search (#58192) 2020-06-25 14:11:57 -04:00
async-search Deduplicate Empty InternalAggregations (#58386) (#59032) 2020-07-04 14:02:16 +02:00
autoscaling Replace compile configuration usage with api (7.x backport) (#58721) 2020-06-30 15:57:41 +02:00
ccr [7.x] Add include_data_streams flag for authorization (#59008) 2020-07-03 12:58:39 -05:00
core Simplify parser declarations when specialist types are stored in strings (#58996) (#59056) 2020-07-06 13:05:03 +02:00
deprecation [7.x] Add include_data_streams flag for authorization (#59008) 2020-07-03 12:58:39 -05:00
enrich Split license allowed checks into two types (#58704) (#58797) 2020-07-01 07:11:05 -07:00
eql EQL: Introduce sequencing fetch size (#59063) 2020-07-06 19:14:26 +03:00
frozen-indices MappedFieldType should not extend FieldType (#58160) 2020-06-16 16:56:43 +01:00
graph Split license allowed checks into two types (#58704) (#58797) 2020-07-01 07:11:05 -07:00
identity-provider Treat roles as a SortedSet (#58988) 2020-07-03 13:40:58 +10:00
ilm Add data stream timestamp validation via metadata field mapper (#59002) 2020-07-06 11:32:33 +02:00
logstash Remove deprecated usage of testCompile configuration (#57921) (#58083) 2020-06-14 22:30:44 +02:00
mapper-constant-keyword Field capabilities - make `keyword` a family of field types (#58315) (#58483) 2020-06-24 12:32:14 +01:00
mapper-flattened Move MappedFieldType#getSearchAnalyzer and #getSearchQuoteAnalyzer to TextSearchInfo (#58830) 2020-07-01 14:52:14 +01:00
ml [ML] Make Inference processor field_map and inference_config optional (#59010) 2020-07-06 11:35:30 +01:00
monitoring Split license allowed checks into two types (#58704) (#58797) 2020-07-01 07:11:05 -07:00
ql EQL: Obey size request parameter (#59014) 2020-07-06 19:14:25 +03:00
rollup Deduplicate Empty InternalAggregations (#58386) (#59032) 2020-07-04 14:02:16 +02:00
search-business-rules Unify dependency licenses task configuration (#58116) (#58274) 2020-06-18 08:15:50 +02:00
searchable-snapshots Check acknowledged responses in FsSearchableSnapshotsIT (#59021) 2020-07-05 10:50:31 +02:00
security Create API key with TransportBulkAction directly (#59046) (#59060) 2020-07-06 23:32:07 +10:00
spatial Fix GeoHash grid aggregation circuit breaker tests (#58218) (#59001) 2020-07-03 13:46:35 +02:00
sql Update UnresolvedRelationTests 2020-07-06 19:14:25 +03:00
src/test [ML] Make Inference processor field_map and inference_config optional (#59010) 2020-07-06 11:35:30 +01:00
stack [7.x] Add default composable templates for new indexing strategy (#57629) (#58757) 2020-07-01 09:32:32 -06:00
transform Split license allowed checks into two types (#58704) (#58797) 2020-07-01 07:11:05 -07:00
vectors Add text search information to MappedFieldType (#58230) (#58432) 2020-06-23 14:37:26 +01:00
voting-only-node Introduce node.roles setting (#58512) 2020-06-25 14:14:51 -04:00
watcher [7.x] Add default composable templates for new indexing strategy (#57629) (#58757) 2020-07-01 09:32:32 -06:00
wildcard Move MappedFieldType#getSearchAnalyzer and #getSearchQuoteAnalyzer to TextSearchInfo (#58830) 2020-07-01 14:52:14 +01:00
build.gradle Remove deprecated usage of testCompile configuration (#57921) (#58083) 2020-06-14 22:30:44 +02:00