2013-08-28 19:24:34 -04:00
|
|
|
[[search-validate]]
|
2019-07-19 14:35:36 -04:00
|
|
|
=== Validate API
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
Validates a potentially expensive query without executing it.
|
|
|
|
|
|
|
|
[source,console]
|
|
|
|
--------------------------------------------------
|
|
|
|
GET twitter/_validate/query?q=user:foo
|
|
|
|
--------------------------------------------------
|
|
|
|
// TEST[setup:twitter]
|
|
|
|
|
|
|
|
|
|
|
|
[[search-validate-api-request]]
|
|
|
|
==== {api-request-title}
|
|
|
|
|
|
|
|
`GET /<index>/_validate/<query>`
|
|
|
|
|
|
|
|
|
|
|
|
[[search-validate-api-desc]]
|
|
|
|
==== {api-description-title}
|
|
|
|
|
|
|
|
The validate API allows you to validate a potentially expensive query
|
|
|
|
without executing it. The query can be sent either as a path parameter or in the
|
|
|
|
request body.
|
|
|
|
|
|
|
|
|
|
|
|
[[search-validate-api-path-params]]
|
|
|
|
==== {api-path-parms-title}
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=index]
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=query]
|
|
|
|
|
|
|
|
|
|
|
|
[[search-validate-api-query-params]]
|
|
|
|
==== {api-query-parms-title}
|
|
|
|
|
|
|
|
`all_shards`::
|
|
|
|
(Optional, boolean) If `true`, the validation is executed on all shards
|
|
|
|
instead of one random shard per index. Defaults to `false`.
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=allow-no-indices]
|
2020-02-24 05:57:32 -05:00
|
|
|
+
|
|
|
|
Defaults to `false`.
|
2019-09-18 08:29:48 -04:00
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=analyzer]
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=analyze_wildcard]
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=default_operator]
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=df]
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=expand-wildcards]
|
|
|
|
|
|
|
|
`explain`::
|
|
|
|
(Optional, boolean) If `true`, the response returns detailed information if an
|
2019-12-23 12:38:17 -05:00
|
|
|
error has occurred. Defaults to `false`.
|
2019-09-18 08:29:48 -04:00
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=index-ignore-unavailable]
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=lenient]
|
|
|
|
|
|
|
|
`rewrite`::
|
|
|
|
(Optional, boolean) If `true`, returns a more detailed explanation showing the
|
|
|
|
actual Lucene query that will be executed. Defaults to `false`.
|
|
|
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=search-q]
|
|
|
|
|
|
|
|
|
|
|
|
[[search-validate-api-example]]
|
|
|
|
==== {api-examples-title}
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
2019-01-23 03:46:28 -05:00
|
|
|
PUT twitter/_bulk?refresh
|
2016-05-10 18:29:56 -04:00
|
|
|
{"index":{"_id":1}}
|
|
|
|
{"user" : "kimchy", "post_date" : "2009-11-15T14:12:12", "message" : "trying out Elasticsearch"}
|
|
|
|
{"index":{"_id":2}}
|
|
|
|
{"user" : "kimchi", "post_date" : "2009-11-15T14:12:13", "message" : "My username is similar to @kimchy!"}
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
2019-09-18 08:29:48 -04:00
|
|
|
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2016-05-10 18:29:56 -04:00
|
|
|
When sent a valid query:
|
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2016-05-10 18:29:56 -04:00
|
|
|
--------------------------------------------------
|
|
|
|
GET twitter/_validate/query?q=user:foo
|
|
|
|
--------------------------------------------------
|
2019-09-18 08:29:48 -04:00
|
|
|
// TEST[continued]
|
|
|
|
|
2016-05-10 18:29:56 -04:00
|
|
|
|
|
|
|
The response contains `valid:true`:
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2019-09-06 09:22:08 -04:00
|
|
|
[source,console-result]
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
|
|
|
{"valid":true,"_shards":{"total":1,"successful":1,"failed":0}}
|
|
|
|
--------------------------------------------------
|
2019-09-06 09:22:08 -04:00
|
|
|
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2016-05-10 18:29:56 -04:00
|
|
|
The query may also be sent in the request body:
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
2018-11-16 11:59:04 -05:00
|
|
|
GET twitter/_validate/query
|
2016-05-10 18:29:56 -04:00
|
|
|
{
|
2014-02-13 05:30:13 -05:00
|
|
|
"query" : {
|
2015-09-11 04:35:56 -04:00
|
|
|
"bool" : {
|
|
|
|
"must" : {
|
2014-02-13 05:30:13 -05:00
|
|
|
"query_string" : {
|
|
|
|
"query" : "*:*"
|
|
|
|
}
|
|
|
|
},
|
|
|
|
"filter" : {
|
|
|
|
"term" : { "user" : "kimchy" }
|
2013-08-28 19:24:34 -04:00
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2016-05-10 18:29:56 -04:00
|
|
|
}
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
2019-09-18 08:29:48 -04:00
|
|
|
// TEST[continued]
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2014-02-13 05:30:13 -05:00
|
|
|
NOTE: The query being sent in the body must be nested in a `query` key, same as
|
2014-09-26 15:04:42 -04:00
|
|
|
the <<search-search,search api>> works
|
2014-02-13 05:30:13 -05:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
If the query is invalid, `valid` will be `false`. Here the query is invalid
|
|
|
|
because {es} knows the `post_date` field should be a date due to dynamic
|
|
|
|
mapping, and 'foo' does not correctly parse into a date:
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
2018-11-16 11:59:04 -05:00
|
|
|
GET twitter/_validate/query
|
2016-11-08 18:47:50 -05:00
|
|
|
{
|
|
|
|
"query": {
|
|
|
|
"query_string": {
|
|
|
|
"query": "post_date:foo",
|
|
|
|
"lenient": false
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2016-05-10 18:29:56 -04:00
|
|
|
--------------------------------------------------
|
2019-09-18 08:29:48 -04:00
|
|
|
// TEST[continued]
|
2016-05-10 18:29:56 -04:00
|
|
|
|
2019-09-06 09:22:08 -04:00
|
|
|
[source,console-result]
|
2016-05-10 18:29:56 -04:00
|
|
|
--------------------------------------------------
|
2013-08-28 19:24:34 -04:00
|
|
|
{"valid":false,"_shards":{"total":1,"successful":1,"failed":0}}
|
|
|
|
--------------------------------------------------
|
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
===== The explain parameter
|
|
|
|
|
|
|
|
An `explain` parameter can be specified to get more detailed information about
|
|
|
|
why a query failed:
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2013-08-28 19:24:34 -04:00
|
|
|
--------------------------------------------------
|
2018-11-16 11:59:04 -05:00
|
|
|
GET twitter/_validate/query?explain=true
|
2016-11-08 18:47:50 -05:00
|
|
|
{
|
|
|
|
"query": {
|
|
|
|
"query_string": {
|
|
|
|
"query": "post_date:foo",
|
|
|
|
"lenient": false
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2016-05-10 18:29:56 -04:00
|
|
|
--------------------------------------------------
|
2019-09-18 08:29:48 -04:00
|
|
|
// TEST[continued]
|
|
|
|
|
2016-05-10 18:29:56 -04:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
The API returns the following response:
|
2016-05-10 18:29:56 -04:00
|
|
|
|
2019-09-06 16:09:09 -04:00
|
|
|
[source,console-result]
|
2016-05-10 18:29:56 -04:00
|
|
|
--------------------------------------------------
|
2013-08-28 19:24:34 -04:00
|
|
|
{
|
|
|
|
"valid" : false,
|
|
|
|
"_shards" : {
|
|
|
|
"total" : 1,
|
|
|
|
"successful" : 1,
|
|
|
|
"failed" : 0
|
|
|
|
},
|
|
|
|
"explanations" : [ {
|
|
|
|
"index" : "twitter",
|
|
|
|
"valid" : false,
|
2016-05-10 18:29:56 -04:00
|
|
|
"error" : "twitter/IAEc2nIXSSunQA_suI0MLw] QueryShardException[failed to create query:...failed to parse date field [foo]"
|
2013-08-28 19:24:34 -04:00
|
|
|
} ]
|
|
|
|
}
|
|
|
|
--------------------------------------------------
|
2016-05-10 18:29:56 -04:00
|
|
|
// TESTRESPONSE[s/"error" : "[^\"]+"/"error": "$body.explanations.0.error"/]
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
===== The rewrite parameter
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
When the query is valid, the explanation defaults to the string representation
|
|
|
|
of that query. With `rewrite` set to `true`, the explanation is more detailed
|
|
|
|
showing the actual Lucene query that will be executed.
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2015-03-18 15:28:20 -04:00
|
|
|
--------------------------------------------------
|
2018-11-16 11:59:04 -05:00
|
|
|
GET twitter/_validate/query?rewrite=true
|
2015-03-18 15:28:20 -04:00
|
|
|
{
|
|
|
|
"query": {
|
2017-03-22 17:39:21 -04:00
|
|
|
"more_like_this": {
|
|
|
|
"like": {
|
|
|
|
"_id": "2"
|
|
|
|
},
|
|
|
|
"boost_terms": 1
|
2015-03-18 15:28:20 -04:00
|
|
|
}
|
|
|
|
}
|
2016-05-10 18:29:56 -04:00
|
|
|
}
|
2015-03-18 15:28:20 -04:00
|
|
|
--------------------------------------------------
|
2017-03-22 17:39:21 -04:00
|
|
|
// TEST[skip:the output is randomized depending on which shard we hit]
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
|
|
|
|
The API returns the following response:
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-06 09:22:08 -04:00
|
|
|
[source,console-result]
|
2015-03-18 15:28:20 -04:00
|
|
|
--------------------------------------------------
|
|
|
|
{
|
|
|
|
"valid": true,
|
|
|
|
"_shards": {
|
|
|
|
"total": 1,
|
|
|
|
"successful": 1,
|
|
|
|
"failed": 0
|
|
|
|
},
|
|
|
|
"explanations": [
|
|
|
|
{
|
2016-05-10 18:29:56 -04:00
|
|
|
"index": "twitter",
|
2015-03-18 15:28:20 -04:00
|
|
|
"valid": true,
|
2018-10-22 14:54:04 -04:00
|
|
|
"explanation": "((user:terminator^3.71334 plot:future^2.763601 plot:human^2.8415773 plot:sarah^3.4193945 plot:kyle^3.8244398 plot:cyborg^3.9177752 plot:connor^4.040236 plot:reese^4.7133346 ... )~6) -ConstantScore(_id:2)) #(ConstantScore(_type:_doc))^0.0"
|
2015-03-18 15:28:20 -04:00
|
|
|
}
|
|
|
|
]
|
|
|
|
}
|
|
|
|
--------------------------------------------------
|
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
|
|
|
|
===== Rewrite and all_shards parameters
|
|
|
|
|
2017-03-22 17:39:21 -04:00
|
|
|
By default, the request is executed on a single shard only, which is randomly
|
|
|
|
selected. The detailed explanation of the query may depend on which shard is
|
|
|
|
being hit, and therefore may vary from one request to another. So, in case of
|
|
|
|
query rewrite the `all_shards` parameter should be used to get response from
|
|
|
|
all available shards.
|
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
////
|
|
|
|
[source,console]
|
|
|
|
--------------------------------------------------
|
|
|
|
PUT twitter/_bulk?refresh
|
|
|
|
{"index":{"_id":1}}
|
|
|
|
{"user" : "kimchy", "post_date" : "2009-11-15T14:12:12", "message" : "trying out Elasticsearch"}
|
|
|
|
{"index":{"_id":2}}
|
|
|
|
{"user" : "kimchi", "post_date" : "2009-11-15T14:12:13", "message" : "My username is similar to @kimchy!"}
|
|
|
|
--------------------------------------------------
|
|
|
|
////
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-05 10:11:25 -04:00
|
|
|
[source,console]
|
2015-03-18 15:28:20 -04:00
|
|
|
--------------------------------------------------
|
2018-11-16 11:59:04 -05:00
|
|
|
GET twitter/_validate/query?rewrite=true&all_shards=true
|
2015-03-18 15:28:20 -04:00
|
|
|
{
|
|
|
|
"query": {
|
2017-03-22 17:39:21 -04:00
|
|
|
"match": {
|
|
|
|
"user": {
|
|
|
|
"query": "kimchy",
|
|
|
|
"fuzziness": "auto"
|
|
|
|
}
|
2015-03-18 15:28:20 -04:00
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
--------------------------------------------------
|
2019-09-18 08:29:48 -04:00
|
|
|
// TEST[continued]
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-18 08:29:48 -04:00
|
|
|
The API returns the following response:
|
2015-03-18 15:28:20 -04:00
|
|
|
|
2019-09-06 09:22:08 -04:00
|
|
|
[source,console-result]
|
2015-03-18 15:28:20 -04:00
|
|
|
--------------------------------------------------
|
|
|
|
{
|
2017-03-22 17:39:21 -04:00
|
|
|
"valid": true,
|
|
|
|
"_shards": {
|
2018-05-14 12:22:35 -04:00
|
|
|
"total": 1,
|
|
|
|
"successful": 1,
|
2017-03-22 17:39:21 -04:00
|
|
|
"failed": 0
|
|
|
|
},
|
|
|
|
"explanations": [
|
|
|
|
{
|
|
|
|
"index": "twitter",
|
|
|
|
"shard": 0,
|
|
|
|
"valid": true,
|
2018-05-14 12:22:35 -04:00
|
|
|
"explanation": "(user:kimchi)^0.8333333 user:kimchy"
|
2017-03-22 17:39:21 -04:00
|
|
|
}
|
|
|
|
]
|
2015-03-18 15:28:20 -04:00
|
|
|
}
|
|
|
|
--------------------------------------------------
|