OpenSearch/client
David Roberts b61202b0a8 [ML] Add a limit on line merging in find_file_structure (#42501)
When analysing a semi-structured text file the
find_file_structure endpoint merges lines to form
multi-line messages using the assumption that the
first line in each message contains the timestamp.
However, if the timestamp is misdetected then this
can lead to excessive numbers of lines being merged
to form massive messages.

This commit adds a line_merge_size_limit setting
(default 10000 characters) that halts the analysis
if a message bigger than this is created.  This
prevents significant CPU time being spent subsequently
trying to determine the internal structure of the
huge bogus messages.
2019-06-03 13:45:51 +01:00
..
benchmark [Backport] Replace usages RandomizedTestingTask with built-in Gradle Test (#40978) (#40993) 2019-04-09 11:52:50 -07:00
client-benchmark-noop-api-plugin Cut over SearchResponse and SearchTemplateResponse to Writeable (#41855) 2019-05-22 18:47:54 +02:00
rest Refactor HLRC RequestConverters parameters to be more explicit (#42128) 2019-05-29 17:08:46 -06:00
rest-high-level [ML] Add a limit on line merging in find_file_structure (#42501) 2019-06-03 13:45:51 +01:00
sniffer Upgrade hamcrest to 2.1 (#41464) 2019-04-24 23:40:03 -07:00
test Upgrade hamcrest to 2.1 (#41464) 2019-04-24 23:40:03 -07:00
transport Upgrade hamcrest to 2.1 (#41464) 2019-04-24 23:40:03 -07:00