mirror of
https://github.com/honeymoose/OpenSearch.git
synced 2025-03-09 14:34:43 +00:00
5f8f91c03b
This change does the following: 1. Makes the per-node setting xpack.ml.max_open_jobs into a cluster-wide dynamic setting 2. Changes the job node selection to continue to use the per-node attributes storing the maximum number of open jobs if any node in the cluster is older than 7.1, and use the dynamic cluster-wide setting if all nodes are on 7.1 or later 3. Changes the docs to reflect this 4. Changes the thread pools for native process communication from fixed size to scaling, to support the dynamic nature of xpack.ml.max_open_jobs 5. Renames the autodetect thread pool to the job comms thread pool to make clear that it will be used for other types of ML jobs (data frame analytics in particular) Backport of #39320
102 lines
2.5 KiB
Plaintext
102 lines
2.5 KiB
Plaintext
[role="xpack"]
|
|
[testenv="platinum"]
|
|
[[ml-get-datafeed-stats]]
|
|
=== Get {dfeed} statistics API
|
|
++++
|
|
<titleabbrev>Get {dfeed} statistics</titleabbrev>
|
|
++++
|
|
|
|
Retrieves usage information for {dfeeds}.
|
|
|
|
|
|
==== Request
|
|
|
|
|
|
`GET _ml/datafeeds/<feed_id>/_stats` +
|
|
|
|
`GET _ml/datafeeds/<feed_id>,<feed_id>/_stats` +
|
|
|
|
`GET _ml/datafeeds/_stats` +
|
|
|
|
`GET _ml/datafeeds/_all/_stats` +
|
|
|
|
|
|
|
|
==== Description
|
|
|
|
You can get statistics for multiple {dfeeds} in a single API request by using a
|
|
comma-separated list of {dfeeds} or a wildcard expression. You can get
|
|
statistics for all {dfeeds} by using `_all`, by specifying `*` as the
|
|
`<feed_id>`, or by omitting the `<feed_id>`.
|
|
|
|
If the {dfeed} is stopped, the only information you receive is the
|
|
`datafeed_id` and the `state`.
|
|
|
|
IMPORTANT: This API returns a maximum of 10,000 {dfeeds}.
|
|
|
|
==== Path Parameters
|
|
|
|
`feed_id`::
|
|
(string) Identifier for the {dfeed}. It can be a {dfeed} identifier or a
|
|
wildcard expression. If you do not specify one of these options, the API
|
|
returns statistics for all {dfeeds}.
|
|
|
|
|
|
==== Results
|
|
|
|
The API returns the following information:
|
|
|
|
`datafeeds`::
|
|
(array) An array of {dfeed} count objects.
|
|
For more information, see <<ml-datafeed-counts>>.
|
|
|
|
|
|
==== Authorization
|
|
|
|
You must have `monitor_ml`, `monitor`, `manage_ml`, or `manage` cluster
|
|
privileges to use this API. For more information, see
|
|
{xpack-ref}/security-privileges.html[Security Privileges].
|
|
|
|
|
|
==== Examples
|
|
|
|
The following example gets usage information for the
|
|
`datafeed-total-requests` {dfeed}:
|
|
|
|
[source,js]
|
|
--------------------------------------------------
|
|
GET _ml/datafeeds/datafeed-total-requests/_stats
|
|
--------------------------------------------------
|
|
// CONSOLE
|
|
// TEST[skip:setup:server_metrics_startdf]
|
|
|
|
The API returns the following results:
|
|
[source,js]
|
|
----
|
|
{
|
|
"count": 1,
|
|
"datafeeds": [
|
|
{
|
|
"datafeed_id": "datafeed-total-requests",
|
|
"state": "started",
|
|
"node": {
|
|
"id": "2spCyo1pRi2Ajo-j-_dnPX",
|
|
"name": "node-0",
|
|
"ephemeral_id": "hoXMLZB0RWKfR9UPPUCxXX",
|
|
"transport_address": "127.0.0.1:9300",
|
|
"attributes": {
|
|
"ml.machine_memory": "17179869184",
|
|
"ml.max_open_jobs": "20"
|
|
}
|
|
},
|
|
"assignment_explanation": ""
|
|
}
|
|
]
|
|
}
|
|
----
|
|
// TESTRESPONSE[s/"2spCyo1pRi2Ajo-j-_dnPX"/$body.$_path/]
|
|
// TESTRESPONSE[s/"node-0"/$body.$_path/]
|
|
// TESTRESPONSE[s/"hoXMLZB0RWKfR9UPPUCxXX"/$body.$_path/]
|
|
// TESTRESPONSE[s/"127.0.0.1:9300"/$body.$_path/]
|
|
// TESTRESPONSE[s/"17179869184"/$body.datafeeds.0.node.attributes.ml\\.machine_memory/]
|