OpenSearch/libs
Jake Landis a370d5eead
[7.x] Ensure Joni warning are logged at debug (#57302) (#57897)
When Joni, the regex engine that powers grok emits a warning it
does so by default to System.err. System.err logs are all bucketed
together in the server log at WARN level. When Joni emits a warning,
it can be extremely verbose, logging a message for each execution
again that pattern. For ingest node that means for every document
that is run that through Grok. Fortunately, Joni provides a call
back hook to push these warnings to a custom location.

This commit implements Joni's callback hook to push the Joni warning
to the Elasticsearch server logger (logger.org.elasticsearch.ingest.common.GrokProcessor)
at debug level. Generally these warning indicate a possible issue with
the regular expression and upon creation of the Grok processor will
do a "test run" of the expression and log the result (if any) at WARN 
level. This WARN level log should only occur on pipeline creation which 
is a much lower frequency then every document. 

Additionally, the documentation is updated with instructions for how
to set the logger to debug level.
2020-06-09 17:06:29 -05:00
..
cli Move publishing configuration to a separate plugin (#56727) 2020-05-14 20:23:07 -07:00
core Include vendored code notices in distribution notice files (#57017) (#57569) 2020-06-04 10:34:24 -07:00
dissect Use task avoidance with forbidden apis (#55034) 2020-04-15 13:27:53 -07:00
geo Move publishing configuration to a separate plugin (#56727) 2020-05-14 20:23:07 -07:00
grok [7.x] Ensure Joni warning are logged at debug (#57302) (#57897) 2020-06-09 17:06:29 -05:00
nio Move publishing configuration to a separate plugin (#56727) 2020-05-14 20:23:07 -07:00
plugin-classloader Use task avoidance with forbidden apis (#55034) 2020-04-15 13:27:53 -07:00
secure-sm Move publishing configuration to a separate plugin (#56727) 2020-05-14 20:23:07 -07:00
ssl-config Include vendored code notices in distribution notice files (#57017) (#57569) 2020-06-04 10:34:24 -07:00
x-content Fix `bool` query behaviour on null value (#56817) 2020-05-26 16:23:40 +02:00
build.gradle Apply 2-space indent to all gradle scripts (#49071) 2019-11-14 11:01:23 +00:00