OpenSearch/x-pack/plugin/ml
David Roberts 5f8f91c03b
[ML] Use scaling thread pool and xpack.ml.max_open_jobs cluster-wide dynamic (#39736)
This change does the following:

1. Makes the per-node setting xpack.ml.max_open_jobs
   into a cluster-wide dynamic setting
2. Changes the job node selection to continue to use the
   per-node attributes storing the maximum number of open
   jobs if any node in the cluster is older than 7.1, and
   use the dynamic cluster-wide setting if all nodes are on
   7.1 or later
3. Changes the docs to reflect this
4. Changes the thread pools for native process communication
   from fixed size to scaling, to support the dynamic nature
   of xpack.ml.max_open_jobs
5. Renames the autodetect thread pool to the job comms
   thread pool to make clear that it will be used for other
   types of ML jobs (data frame analytics in particular)

Backport of #39320
2019-03-06 12:29:34 +00:00
..
cpp-snapshot Add cache cleaning task for ML snapshot (#37505) 2019-01-19 16:16:58 -08:00
licenses [ML] Rename log structure to file structure (#33421) 2018-09-06 09:13:08 +01:00
qa [ML] Disable security audit trail in native integ tests suite (#39683) 2019-03-05 12:43:15 +02:00
src [ML] Use scaling thread pool and xpack.ml.max_open_jobs cluster-wide dynamic (#39736) 2019-03-06 12:29:34 +00:00
build.gradle Converting randomized testing to create a separate unitTest task instead of replacing the builtin test task (#36311) 2018-12-19 08:25:20 +02:00