OpenSearch/docs/reference
Benjamin Trent 297f864884
[ML] relax throttling on expired data cleanup (#56711) (#56895)
Throttling nightly cleanup as much as we do has been over cautious.

Night cleanup should be more lenient in its throttling. We still
keep the same batch size, but now the requests per second scale
with the number of data nodes. If we have more than 5 data nodes,
we don't throttle at all.

Additionally, the API now has `requests_per_second` and `timeout` set.
So users calling the API directly can set the throttling.

This commit also adds a new setting `xpack.ml.nightly_maintenance_requests_per_second`.
This will allow users to adjust throttling of the nightly maintenance.
2020-05-18 08:46:42 -04:00
..
aggregations [DOCS] Sort metric and pipeline agg docs (#56613) (#56846) 2020-05-15 17:15:53 -04:00
analysis [DOCS] Reformat `porter_stem` token filter (#56053) 2020-05-04 10:39:17 -04:00
autoscaling Add get autoscaling policy API (#54762) 2020-04-04 18:04:25 -04:00
cat [DOC] document transform settings and docs_per_second (#56178) 2020-05-11 09:23:49 +02:00
ccr [Docs] Clarify that _ccr/info omits parameters from the response when the follower index is paused. (#55961) 2020-05-12 15:25:08 -07:00
cluster Docs fix node_id spec for secure settings reload API (#55712) 2020-05-05 11:21:02 +03:00
commands [DOCS] Extract the cron docs from Watcher docs and add to the API conventions. (#56313) (#56651) 2020-05-12 16:36:18 -07:00
docs [DOCS] Add document update API link to concurrency control docs (#56481) 2020-05-11 17:37:32 -04:00
eql [DOCS] EQL: Document `case_sensitive` param (#56697) (#56818) 2020-05-15 11:47:19 -04:00
graph [DOCS] Collapse nested objects in Explore API docs (#55067) 2020-04-13 09:27:03 -04:00
high-availability [DOCS] Move snapshot-restore out of modules. (#49618) (#50829) 2020-01-09 16:55:46 -08:00
how-to DOCS: minor formatting (#56263) 2020-05-06 13:41:47 -04:00
ilm [DOCS] Added info about automatic config for Beats & Logstash. (#56317) (#56729) 2020-05-13 19:27:22 -07:00
images [DOCS] Add token graph concept docs (#53339) 2020-03-19 07:43:18 -04:00
index-modules Clarify available processors (#54907) 2020-04-10 08:48:27 -04:00
indices [7.x] Rename endpoint from plural "_data_streams" to singular "_data_stream" (#56825) 2020-05-15 10:27:53 -05:00
ingest [DOCS] Correct `query` datatype in enrich policy definition (#56224) 2020-05-13 08:35:17 -04:00
licensing Remove `_xpack` from license API example (#54698) (#54763) 2020-04-07 09:51:37 +03:00
mapping For constant_keyword, make sure exists query handles missing values. (#55757) 2020-05-04 09:41:52 -07:00
migration Docs: forward port release docs of 7.7.0 (#56706) 2020-05-13 20:08:14 +02:00
ml [ML] relax throttling on expired data cleanup (#56711) (#56895) 2020-05-18 08:46:42 -04:00
modules [DOCS] Correct setting type for `indices.query.bool.max_clause_count` (#56640) 2020-05-12 16:26:18 -04:00
monitoring [DOCS] Add UUID troubleshooting tip for stack monitoring (#55744) 2020-05-11 07:49:34 -07:00
query-dsl [Docs] Fix typo in match-bool-prefix-query doc (#56077) 2020-05-04 14:19:23 +02:00
release-notes Docs: forward port release docs of 7.7.0 (#56706) 2020-05-13 20:08:14 +02:00
rest-api [7.x] [Transform] add support for terms agg in transforms (#56696) (#56809) 2020-05-15 08:08:43 -04:00
rollup [DOCS] Adds collapsible sections to rollup APIs (#54690) 2020-04-02 17:51:16 -07:00
scripting Scripting: Add char position of script errors (#51069) (#51266) 2020-01-21 13:45:59 -07:00
search Add list of defered aggregations to the profiler (backport of #56208) (#56682) 2020-05-13 16:33:22 -04:00
searchable-snapshots/apis Provide repository-level stats for searchable snapshots (#55051) 2020-04-14 14:34:08 +02:00
settings [DOCS] Align with ILM changes. (#55953) (#56455) 2020-05-08 14:22:27 -07:00
setup [7.x] remove the term 'system' from indicies doc (#56367) (#56375) 2020-05-12 14:44:50 -05:00
slm [DOCS] Extract the cron docs from Watcher docs and add to the API conventions. (#56313) (#56651) 2020-05-12 16:36:18 -07:00
snapshot-restore [DOCS] Add clean up snapshot repository API docs (#56519) 2020-05-12 09:54:49 -04:00
sql SQL: Fix JDBC url pattern in docs and error message (#56612) 2020-05-13 12:13:58 +02:00
transform [DOCS] Add throttling based on configuration parameter (#56653) 2020-05-14 08:45:29 -07:00
upgrade [DOCS] Add maintenance releases to upgrade table (#55012) 2020-04-14 11:28:55 -04:00
vectors Remove the 'experimental' marking from vector fields. (#49120) 2019-11-18 12:42:46 -08:00
aggregations.asciidoc
analysis.asciidoc [DOCS] Reformat `stop` token filter (#53059) 2020-03-03 13:22:52 -05:00
api-conventions.asciidoc [DOCS] Extract the cron docs from Watcher docs and add to the API conventions. (#56313) (#56651) 2020-05-12 16:36:18 -07:00
async-search.asciidoc [DOCS] add docs for async search (#53675) 2020-03-20 14:46:38 +01:00
cat.asciidoc [Transform] renamed _cat/transform to _cat/transforms (#53743) (#53771) 2020-03-18 19:54:03 -04:00
cluster.asciidoc Password-protected Keystore Feature Branch PR (#51123) (#51510) 2020-01-28 05:32:32 -05:00
data-rollup-transform.asciidoc [DOCS] Adds transforms to Elasticsearch book (#46846) (#47055) 2019-09-25 08:11:37 -07:00
docs.asciidoc [DOCS] Remove heading offsets for REST APIs (#44568) 2019-07-19 14:36:06 -04:00
frozen-indices.asciidoc Add heuristics to compute pre_filter_shard_size when unspecified (#53873) (#54007) 2020-03-24 02:05:15 +01:00
getting-started.asciidoc [DOCS] Switch to standard ESS trial links (#52552) 2020-02-21 12:07:10 -05:00
glossary.asciidoc [DOCS] Remove duplicate `index alias` link in glossary (#56143) 2020-05-05 09:07:19 -04:00
gs-index.asciidoc
high-availability.asciidoc [DOCS] Remove leveloffset for CCR docs (#46818) 2019-09-18 09:44:43 -04:00
how-to.asciidoc [DOCS] Add 'how to' doc about avoiding oversharding (#55480) 2020-04-22 10:44:16 -04:00
index-modules.asciidoc Deprecate creation of dot-prefixed index names except for hidden and system indices (#49959) 2020-01-28 10:01:16 -07:00
index.asciidoc [DOCS] Remove 'Testing' chapter (#55270) (#55532) 2020-04-21 10:29:58 -04:00
index.x.asciidoc
indices.asciidoc Docs for data stream REST APIs 2020-05-15 09:37:45 -05:00
ingest.asciidoc Replace required pipeline with final pipeline (#49470) 2019-11-22 14:37:36 -05:00
intro.asciidoc [7.x][DOCS] Updates ML links (#50387) (#50409) 2019-12-20 10:01:19 -08:00
mapping.asciidoc Remove the top-level 'mapping type' section. (#54035) 2020-03-23 15:34:23 -07:00
modules.asciidoc Backporting updates to ILM org, overview, & GS (#51898) 2020-02-04 16:45:18 -08:00
query-dsl.asciidoc Add a cluster setting to disallow expensive queries (#51385) (#52279) 2020-02-12 22:56:14 +01:00
redirects.asciidoc Docs for data stream REST APIs 2020-05-15 09:37:45 -05:00
release-notes.asciidoc value_count Aggregation optimization (backport of #54854) (#55076) 2020-04-10 13:16:39 -04:00
scripting.asciidoc [DOCS] Move 'Scripting' section to top-level navigation. (#42939) 2019-06-06 10:46:02 -04:00
search.asciidoc [DOCS] Move async search API docs after search request body API docs (#56244) 2020-05-06 09:03:23 -04:00
setup.asciidoc [DOCS] Align with ILM changes. (#55953) (#56455) 2020-05-08 14:22:27 -07:00
upgrade.asciidoc [DOCS] Update upgrade docs for 7.8 (#56281) 2020-05-06 11:47:39 -04:00