OpenSearch/x-pack/plugin
Tim Vernum b02b073a57
Increase Size and lower TTL on DLS BitSet Cache (#50953)
The Document Level Security BitSet Cache (see #43669) had a default
configuration of "small size, long lifetime". However, this is not
a very useful default as the cache is most valuable for BitSets that
take a long time to construct, which is (generally speaking) the same
ones that operate over a large number of documents and contain many
bytes.

This commit changes the cache to be "large size, short lifetime" so
that it can hold bitsets representing billions of documents, but
releases memory quickly.

The new defaults are 10% of heap, and 2 hours.

This also adds some logging when a single BitSet exceeds the size of
the cache and when the cache is full.

Backport of: #50535
2020-01-14 18:04:02 +11:00
..
analytics Drop "funny" functions building parsers (#50715) (#50814) 2020-01-09 15:53:03 -05:00
ccr Make some ObjectParsers final (#50471) (#50556) 2020-01-02 10:47:38 -05:00
core Increase Size and lower TTL on DLS BitSet Cache (#50953) 2020-01-14 18:04:02 +11:00
deprecation Apply 2-space indent to all gradle scripts (#49071) 2019-11-14 11:01:23 +00:00
enrich Backport: Fix ingest simulate response document order if processor executes async (#50269) 2019-12-17 12:27:07 +01:00
frozen-indices Use more specific loggers in subclasses of TMNA (#50076) 2019-12-11 15:07:47 +00:00
graph Apply 2-space indent to all gradle scripts (#49071) 2019-11-14 11:01:23 +00:00
ilm [7.x] ILM action to wait for SLM policy execution (#50454) (#50943) 2020-01-14 01:34:33 +01:00
logstash Apply 2-space indent to all gradle scripts (#49071) 2019-11-14 11:01:23 +00:00
mapper-flattened Add telemetry for flattened fields. (#48972) (#49125) 2019-11-18 12:29:42 -08:00
ml [ML][Inference] minor fixes for created_by, and action permission (#50890) (#50911) 2020-01-13 07:59:31 -05:00
monitoring Add max_resource_units to enterprise license (#50910) 2020-01-14 12:37:05 +11:00
rollup Use more specific loggers in subclasses of TMNA (#50076) 2019-12-11 15:07:47 +00:00
search-business-rules Use Void context on parsers where possible (#50573) (#50617) 2020-01-03 13:28:55 -05:00
security Support Client and RoleMapping in custom Realms (#50950) 2020-01-14 15:26:41 +11:00
spatial Geo: Switch generated GeoJson type names to camel case (#50400) 2019-12-20 15:37:22 -05:00
sql SQL: Optimisation fixes for conjunction merges (#50703) (#50933) 2020-01-13 21:51:29 +01:00
src/test Add max_resource_units to enterprise license (#50910) 2020-01-14 12:37:05 +11:00
transform [7.x][ML] Reuse SourceDestValidator for data frame analytics (#50841) (#50850) 2020-01-10 14:24:13 +02:00
vectors Increase the number of vector dims to 2048 (#46895) 2019-11-20 07:47:33 -05:00
voting-only-node Apply 2-space indent to all gradle scripts (#49071) 2019-11-14 11:01:23 +00:00
watcher Wrap triggering of a watch inside an assertBusy(...) invocation 2020-01-09 09:05:20 +01:00
build.gradle Skip enterprise license tests in release build (#50182) 2019-12-16 10:11:21 +11:00