honeymoose
/
OpenSearch
mirror of https://github.com/honeymoose/OpenSearch.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
OpenSearch/docs/reference
History
Jake Landis a370d5eead
[7.x] Ensure Joni warning are logged at debug (#57302) (#57897) 
When Joni, the regex engine that powers grok emits a warning it
does so by default to System.err. System.err logs are all bucketed
together in the server log at WARN level. When Joni emits a warning,
it can be extremely verbose, logging a message for each execution
again that pattern. For ingest node that means for every document
that is run that through Grok. Fortunately, Joni provides a call
back hook to push these warnings to a custom location.

This commit implements Joni's callback hook to push the Joni warning
to the Elasticsearch server logger (logger.org.elasticsearch.ingest.common.GrokProcessor)
at debug level. Generally these warning indicate a possible issue with
the regular expression and upon creation of the Grok processor will
do a "test run" of the expression and log the result (if any) at WARN 
level. This WARN level log should only occur on pipeline creation which 
is a much lower frequency then every document. 

Additionally, the documentation is updated with instructions for how
to set the logger to debug level.
 		2020-06-09 17:06:29 -05:00
..
aggregations [DOCS] Fix source filtering xrefs (#57720) (#57725) 2020-06-05 09:05:30 -04:00
analysis [DOCS] Reformat `mapping` charfilter (#57818) (#57885) 2020-06-09 12:43:01 -04:00
autoscaling Add get autoscaling policy API (#54762) 2020-04-04 18:04:25 -04:00
cat [7.x][DOCS] Replace docdir attribute with es-repo-dir (#57489) (#57494) 2020-06-01 16:42:53 -07:00
ccr [DOCS] Fix typo in CCR overview docs (#57709) (#57773) 2020-06-05 17:42:49 -04:00
cluster [7.x][DOCS] Replace docdir attribute with es-repo-dir (#57489) (#57494) 2020-06-01 16:42:53 -07:00
commands [DOCS] Extract the cron docs from Watcher docs and add to the API conventions. (#56313) (#56651) 2020-05-12 16:36:18 -07:00
docs [DOCS] Document `doc_as_upsert` does not support ingest pipelines (#57649) (#57783) 2020-06-06 16:10:42 -04:00
eql [DOCS] EQL: Add `dev` admonition to EQL pages (#57531) (#57533) 2020-06-02 11:03:12 -04:00
graph [DOCS] Collapse nested objects in Explore API docs (#55067) 2020-04-13 09:27:03 -04:00
high-availability Small improvements to resilience design docs (#57791) 2020-06-08 13:50:41 +01:00
how-to [7.x][DOCS] Replace docdir attribute with es-repo-dir (#57489) (#57494) 2020-06-01 16:42:53 -07:00
ilm [DOCS] Fix typo in ILM rollover docs (#57856) 2020-06-09 12:15:36 -04:00
images [DOCS] Add token graph concept docs (#53339) 2020-03-19 07:43:18 -04:00
index-modules [DOCS] Relocate `shard allocation` module content (#56535) (#57448) 2020-06-01 13:15:08 -04:00
indices Change default backing index naming scheme 2020-06-09 09:31:34 -05:00
ingest [7.x] Ensure Joni warning are logged at debug (#57302) (#57897) 2020-06-09 17:06:29 -05:00
licensing Remove `_xpack` from license API example (#54698) (#54763) 2020-04-07 09:51:37 +03:00
mapping [DOCS] Fix source filtering xrefs (#57720) (#57725) 2020-06-05 09:05:30 -04:00
migration Revert "Restore xpack.ilm.enabled and xpack.slm.enabled settings (#57383)" 2020-06-04 16:25:05 -04:00
ml [7.x] Make ModelPlotConfig.annotations_enabled default to ModelPlotConfig.enabled if unset (#57808) (#57815) 2020-06-08 17:41:12 +02:00
modules [DOCS] Fix typo in remote-clusters doc (#57820) 2020-06-09 11:28:30 +02:00
monitoring [DOCS] Relocate `shard allocation` module content (#56535) (#57448) 2020-06-01 13:15:08 -04:00
query-dsl fix missing _doc type from geo-shape doc test (#57556) 2020-06-02 13:44:08 -07:00
release-notes [DOCS] Add 7.8 release notes entry for auto create index change (#57582) 2020-06-04 07:36:07 +02:00
rest-api [DOCS] Fix source-related search API params (#57691) (#57889) 2020-06-09 13:01:17 -04:00
rollup [DOCS] Adds collapsible sections to rollup APIs (#54690) 2020-04-02 17:51:16 -07:00
scripting [DOCS] Adds security privileges to _scripts endpoint docs. (#57795) 2020-06-08 14:35:56 +02:00
search [DOCS] Fix source-related search API params (#57691) (#57889) 2020-06-09 13:01:17 -04:00
searchable-snapshots/apis [7.x][DOCS] Replace docdir attribute with es-repo-dir (#57489) (#57494) 2020-06-01 16:42:53 -07:00
settings [ML] add new circuit breaker for inference model caching (#57731) (#57830) 2020-06-08 16:02:48 -04:00
setup [DOCS] Clarifying env variable substitution (#57370) (#57737) 2020-06-05 11:08:03 -04:00
slm [DOCS] Editorial ILM cleanup (#57565) (#57776) 2020-06-05 18:55:51 -07:00
snapshot-restore [DOCS] Fix source filtering xrefs (#57720) (#57725) 2020-06-05 09:05:30 -04:00
sql SQL: Implement TRIM function (#57518) (#57593) 2020-06-03 15:19:48 +02:00
transform [DOCS] Replaces docdir attributes in ML APIs (#57390) (#57467) 2020-06-01 13:46:15 -07:00
upgrade [DOCS] Relocate `shard allocation` module content (#56535) (#57448) 2020-06-01 13:15:08 -04:00
vectors Remove the 'experimental' marking from vector fields. (#49120) 2019-11-18 12:42:46 -08:00
aggregations.asciidoc
…
analysis.asciidoc [DOCS] Reformat `stop` token filter (#53059) 2020-03-03 13:22:52 -05:00
api-conventions.asciidoc [DOCS] Replaces docdir attributes in ML APIs (#57390) (#57467) 2020-06-01 13:46:15 -07:00
async-search.asciidoc [DOCS] add docs for async search (#53675) 2020-03-20 14:46:38 +01:00
cat.asciidoc [Transform] renamed _cat/transform to _cat/transforms (#53743) (#53771) 2020-03-18 19:54:03 -04:00
cluster.asciidoc Password-protected Keystore Feature Branch PR (#51123) (#51510) 2020-01-28 05:32:32 -05:00
data-rollup-transform.asciidoc
…
data-streams.asciidoc Change default backing index naming scheme 2020-06-09 09:31:34 -05:00
docs.asciidoc
…
frozen-indices.asciidoc Add heuristics to compute pre_filter_shard_size when unspecified (#53873) (#54007) 2020-03-24 02:05:15 +01:00
getting-started.asciidoc [DOCS] Switch to standard ESS trial links (#52552) 2020-02-21 12:07:10 -05:00
glossary.asciidoc [DOCS] Remove duplicate `index alias` link in glossary (#56143) 2020-05-05 09:07:19 -04:00
gs-index.asciidoc
…
high-availability.asciidoc [DOCS] Add docs for designing resilient clusters (#47233) (#57743) 2020-06-05 12:08:45 -04:00
how-to.asciidoc [DOCS] Add 'how to' doc about avoiding oversharding (#55480) 2020-04-22 10:44:16 -04:00
index-modules.asciidoc [DOCS] Add search pagination docs (#56785) (#57477) 2020-06-01 16:43:06 -04:00
index.asciidoc [DOCS] Add data stream overview and intro (#57724) 2020-06-05 16:10:03 +02:00
index.x.asciidoc
…
indices.asciidoc [DOCS] Fix chunking in template API docs (#57632) (#57636) 2020-06-03 18:15:39 -07:00
ingest.asciidoc Replace required pipeline with final pipeline (#49470) 2019-11-22 14:37:36 -05:00
intro.asciidoc [7.x][DOCS] Updates ML links (#50387) (#50409) 2019-12-20 10:01:19 -08:00
mapping.asciidoc [7.x][DOCS] Replace docdir attribute with es-repo-dir (#57489) (#57494) 2020-06-01 16:42:53 -07:00
query-dsl.asciidoc Add a cluster setting to disallow expensive queries (#51385) (#52279) 2020-02-12 22:56:14 +01:00
redirects.asciidoc [DOCS] Editorial ILM cleanup (#57565) (#57776) 2020-06-05 18:55:51 -07:00
release-notes.asciidoc [DOCS] Adds ml-cpp PRs to release notes (#57444) 2020-06-01 09:56:32 -07:00
scripting.asciidoc
…
search.asciidoc [DOCS] Add clear scroll API reference docs (#57367) (#57611) 2020-06-03 11:58:16 -04:00
setup.asciidoc [DOCS] Relocate discovery module content (#56611) (#57454) 2020-06-01 14:13:13 -04:00
upgrade.asciidoc [DOCS] Update upgrade docs for 7.8 (#56281) 2020-05-06 11:47:39 -04:00