honeymoose
/
OpenSearch
mirror of https://github.com/honeymoose/OpenSearch.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
OpenSearch/docs/reference
History
Jay Modi 2fa6448a15
System index reads in separate threadpool (#60927) 
This commit introduces a new thread pool, `system_read`, which is
intended for use by system indices for all read operations (get and
search). The `system_read` pool is a fixed thread pool with a maximum
number of threads equal to lesser of half of the available processors
or 5. Given the combination of both get and read operations in this
thread pool, the queue size has been set to 2000. The motivation for
this change is to allow system read operations to be serviced in spite
of the number of user searches.

In order to avoid a significant performance hit due to pattern matching
on all search requests, a new metadata flag is added to mark indices
as system or non-system. Previously created system indices will have
flag added to their metadata upon upgrade to a version with this
capability.

Additionally, this change also introduces a new class, `SystemIndices`,
which encapsulates logic around system indices. Currently, the class
provides a method to check if an index is a system index and a method
to find a matching index descriptor given the name of an index.

Relates #50251
Relates #37867
Backport of #57936
 		2020-08-11 12:16:34 -06:00
..
aggregations [7.x] Extensibility for Composite Agg #59648 (#60842) 2020-08-11 09:14:33 -04:00
analysis [DOCS] Add missing lang values to snowball token filter (#60489) (#60692) 2020-08-04 17:46:03 -04:00
autoscaling Autoscaling decider and decision service (#59005) (#60884) 2020-08-10 15:28:52 +02:00
cat [DOCS] Fix outdated twitter reference 2020-08-05 09:29:51 -04:00
ccr [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
cluster [DOCS] Replace `twitter` dataset in docs (#60604) (#60609) 2020-08-03 13:31:19 -04:00
commands [DOCS] Replace `twitter` dataset in docs (#60604) (#60609) 2020-08-03 13:31:19 -04:00
data-streams [DOCS] Update example data stream names (#60783) (#60820) 2020-08-06 09:38:35 -04:00
docs [DOCS] Add soft redirect for sliced scroll (#60699) (#60733) 2020-08-05 09:23:15 -04:00
eql [DOCS] Remove unneeded word in EQL docs 2020-08-11 12:19:08 -04:00
graph [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
high-availability [DOCS] Fixes license management links (#58213) 2020-06-16 16:49:48 -07:00
how-to [DOCS] Remove search request body page (#60972) (#60977) 2020-08-11 13:04:07 -04:00
ilm [7.x] ILM: add force-merge step to searchable snapshots action (#60819) (#60882) 2020-08-10 13:45:11 +01:00
images [DOCS] Update example data stream names (#60783) (#60820) 2020-08-06 09:38:35 -04:00
index-modules [DOCS] Replace `twitter` dataset in docs (#60604) (#60609) 2020-08-03 13:31:19 -04:00
indices [DOCS] Update get data stream API (#60862) 2020-08-10 08:03:17 -05:00
ingest [DOCS] Fix metadata field refs (#60764) (#60769) 2020-08-05 14:04:55 -04:00
licensing [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
mapping Make MetadataFieldMapper extend ParametrizedFieldMapper (#59847) (#60924) 2020-08-11 09:02:28 +01:00
migration [DOCS] Fix metadata field refs (#60764) (#60769) 2020-08-05 14:04:55 -04:00
ml [DOCS] Move script and stored fields content to search fields page (#60826) (#60835) 2020-08-06 13:06:06 -04:00
modules System index reads in separate threadpool (#60927) 2020-08-11 12:16:34 -06:00
monitoring [DOCS] Adds scope to monitoring (#57852) (#60665) 2020-08-04 12:40:11 -07:00
query-dsl [DOCS] Fix metadata field refs (#60764) (#60769) 2020-08-05 14:04:55 -04:00
release-notes [DOCS] Add ml-cpp PRs to 7.9.0 release notes (#60689) 2020-08-05 10:12:11 -07:00
rest-api [DOCS] http -> https, remove outdated plugin docs (#60380) (#60545) 2020-07-31 16:16:31 -04:00
rollup [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
scripting [DOCS] Mention that inline scripts need to be enabled for Kibana (#60633) (#60798) 2020-08-10 13:28:59 -07:00
search [DOCS] Remove search request body page (#60972) (#60977) 2020-08-11 13:04:07 -04:00
searchable-snapshots/apis Adjust searchable snapshot license (#60578) 2020-08-03 13:19:53 +02:00
settings [DOCS] Fix typo in Watcher docs (#60326) (#60388) 2020-07-29 10:15:09 -04:00
setup Deprecate and ignore join timeout (#60872) 2020-08-10 13:57:41 +01:00
slm [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
snapshot-restore [DOCS] Fix typo in take snapshot docs (#60204) (#60383) 2020-07-29 09:16:00 -04:00
sql [DOCS] http -> https, remove outdated plugin docs (#60380) (#60545) 2020-07-31 16:16:31 -04:00
transform [DOCS] Fix security links in machine learning APIs (#60098) (#60152) 2020-07-23 16:43:10 -07:00
upgrade [DOCS] Note remote reindex is not fwd compatible (#60425) (#60454) 2020-07-30 09:23:55 -04:00
vectors [DOCS] Update my-index examples (#60132) (#60248) 2020-07-27 15:58:26 -04:00
aggregations.asciidoc [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
analysis.asciidoc [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
api-conventions.asciidoc [DOCS] Add PUT example to `Date math in index names` (#60908) (#60920) 2020-08-10 12:46:10 -04:00
async-search.asciidoc [DOCS] add docs for async search (#53675) 2020-03-20 14:46:38 +01:00
cat.asciidoc AwaitsFix for #51619 2020-08-06 09:48:35 +01:00
cluster.asciidoc Password-protected Keystore Feature Branch PR (#51123) (#51510) 2020-01-28 05:32:32 -05:00
data-rollup-transform.asciidoc [DOCS] Changes level offset of transform pages (#60066) (#60075) 2020-07-22 11:22:57 -07:00
docs.asciidoc [DOCS] Remove heading offsets for REST APIs (#44568) 2019-07-19 14:36:06 -04:00
frozen-indices.asciidoc [DOCS] Replace `twitter` dataset in docs (#60604) (#60609) 2020-08-03 13:31:19 -04:00
getting-started.asciidoc [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
glossary.asciidoc [DOCS] Refactored index-templates topic. (#59737) (#60165) 2020-07-23 19:48:19 -07:00
gs-index.asciidoc [DOCS] Adding index file for GS "mini book". 2017-07-18 13:44:08 -07:00
high-availability.asciidoc [DOCS] Add docs for designing resilient clusters (#47233) (#57743) 2020-06-05 12:08:45 -04:00
how-to.asciidoc [DOCS] Add 'how to' doc about avoiding oversharding (#55480) 2020-04-22 10:44:16 -04:00
index-modules.asciidoc [DOCS] Move search pagination content to one page (#60515) (#60525) 2020-07-31 12:40:40 -04:00
index.asciidoc [DOCS] Refactor EQL docs (#60700) (#60745) 2020-08-05 11:25:18 -04:00
index.x.asciidoc [DOCS] Removes redundant index.asciidoc files (#30707) 2018-05-18 11:05:40 -07:00
indices.asciidoc [DOCS] Refactored index-templates topic. (#59737) (#60165) 2020-07-23 19:48:19 -07:00
ingest.asciidoc [DOCS] Update my-index examples (#60132) (#60248) 2020-07-27 15:58:26 -04:00
intro.asciidoc [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
links.asciidoc [DOCS] Fix security links in machine learning APIs (#60098) (#60152) 2020-07-23 16:43:10 -07:00
mapping.asciidoc [DOCS] Fix metadata field refs (#60764) (#60769) 2020-08-05 14:04:55 -04:00
query-dsl.asciidoc Search - remove allow-expensive-query checks from wildcard field. (#60273) (#60308) 2020-07-28 17:12:33 +01:00
redirects.asciidoc [DOCS] Remove search request body page (#60972) (#60977) 2020-08-11 13:04:07 -04:00
release-notes.asciidoc [DOCS] Adds ml-cpp PRs to release notes (#59188) 2020-07-07 11:56:40 -07:00
scripting.asciidoc [DOCS] Swap `[float]` for `[discrete]` (#60134) 2020-07-23 12:42:33 -04:00
search.asciidoc [DOCS] Remove search request body page (#60972) (#60977) 2020-08-11 13:04:07 -04:00
setup.asciidoc [DOCS] http -> https, remove outdated plugin docs (#60380) (#60545) 2020-07-31 16:16:31 -04:00
upgrade.asciidoc [7.x] [DOCS] Update upgrade docs and release highlights for 7.9 (#59674) 2020-07-16 15:58:40 -04:00