honeymoose
/
OpenSearch
mirror of https://github.com/honeymoose/OpenSearch.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
OpenSearch/x-pack
History
David Roberts b61202b0a8 [ML] Add a limit on line merging in find_file_structure (#42501) 
When analysing a semi-structured text file the
find_file_structure endpoint merges lines to form
multi-line messages using the assumption that the
first line in each message contains the timestamp.
However, if the timestamp is misdetected then this
can lead to excessive numbers of lines being merged
to form massive messages.

This commit adds a line_merge_size_limit setting
(default 10000 characters) that halts the analysis
if a message bigger than this is created.  This
prevents significant CPU time being spent subsequently
trying to determine the internal structure of the
huge bogus messages.
 		2019-06-03 13:45:51 +01:00
..
dev-tools Build: Merge xpack checkstyle config into core (#33399) 2018-09-05 09:17:02 -04:00
docs TestClusters: Convert docs (#42100) 2019-05-22 14:44:08 +03:00
license-tools Switch mapping/aggregations over to java time (#36363) 2019-01-23 10:40:05 +01:00
plugin [ML] Add a limit on line merging in find_file_structure (#42501) 2019-06-03 13:45:51 +01:00
qa Re-enable token bwc tests (#42727) 2019-05-31 08:03:10 -06:00
test Add an OpenID Connect authentication realm (#40674) (#41178) 2019-04-15 12:41:16 +03:00
transport-client Upgrade hamcrest to 2.1 (#41464) 2019-04-24 23:40:03 -07:00
NOTICE.txt
…
README.md
…
build.gradle Remove Migration Upgrade and Assistance APIs (#40075) 2019-03-18 13:46:56 -06:00

README.md

Elastic License Functionality

This directory tree contains files subject to the Elastic License. The files subject to the Elastic License are grouped in this directory to clearly separate them from files licensed under the Apache License 2.0.