2014-03-24 05:33:13 -04:00
|
|
|
[[search-template]]
|
|
|
|
== Search Template
|
|
|
|
|
2014-03-25 10:24:31 -04:00
|
|
|
The `/_search/template` endpoint allows to use the mustache language to pre render search requests,
|
2014-03-24 05:33:13 -04:00
|
|
|
before they are executed and fill existing templates with template parameters.
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_search/template
|
|
|
|
{
|
2015-05-12 05:37:22 -04:00
|
|
|
"inline" : {
|
2014-03-24 05:33:13 -04:00
|
|
|
"query": { "match" : { "{{my_field}}" : "{{my_value}}" } },
|
2014-03-25 10:24:31 -04:00
|
|
|
"size" : "{{my_size}}"
|
2014-03-24 05:33:13 -04:00
|
|
|
},
|
|
|
|
"params" : {
|
|
|
|
"my_field" : "foo",
|
|
|
|
"my_value" : "bar",
|
|
|
|
"my_size" : 5
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
|
|
|
|
For more information on how Mustache templating and what kind of templating you
|
|
|
|
can do with it check out the http://mustache.github.io/mustache.5.html[online
|
|
|
|
documentation of the mustache project].
|
|
|
|
|
Scripting: add support for fine-grained settings
Allow to on/off scripting based on their source (where they get loaded from), the operation that executes them and their language.
The settings cover the following combinations:
- mode: on, off, sandbox
- source: indexed, dynamic, file
- engine: groovy, expressions, mustache, etc
- operation: update, search, aggs, mapping
The following settings are supported for every engine:
script.engine.groovy.indexed.update: sandbox/on/off
script.engine.groovy.indexed.search: sandbox/on/off
script.engine.groovy.indexed.aggs: sandbox/on/off
script.engine.groovy.indexed.mapping: sandbox/on/off
script.engine.groovy.dynamic.update: sandbox/on/off
script.engine.groovy.dynamic.search: sandbox/on/off
script.engine.groovy.dynamic.aggs: sandbox/on/off
script.engine.groovy.dynamic.mapping: sandbox/on/off
script.engine.groovy.file.update: sandbox/on/off
script.engine.groovy.file.search: sandbox/on/off
script.engine.groovy.file.aggs: sandbox/on/off
script.engine.groovy.file.mapping: sandbox/on/off
For ease of use, the following more generic settings are supported too:
script.indexed: sandbox/on/off
script.dynamic: sandbox/on/off
script.file: sandbox/on/off
script.update: sandbox/on/off
script.search: sandbox/on/off
script.aggs: sandbox/on/off
script.mapping: sandbox/on/off
These will be used to calculate the more specific settings, using the stricter setting of each combination. Operation based settings have precedence over conflicting source based ones.
Note that the `mustache` engine is affected by generic settings applied to any language, while native scripts aren't as they are static by definition.
Also, the previous `script.disable_dynamic` setting can now be deprecated.
Closes #6418
Closes #10116
Closes #10274
2015-03-06 12:38:11 -05:00
|
|
|
NOTE: The mustache language is implemented in elasticsearch as a sandboxed
|
|
|
|
scripting language, hence it obeys settings that may be used to enable or
|
|
|
|
disable scripts per language, source and operation as described in
|
2015-04-09 08:50:11 -04:00
|
|
|
<<enable-dynamic-scripting, scripting docs>>
|
Scripting: add support for fine-grained settings
Allow to on/off scripting based on their source (where they get loaded from), the operation that executes them and their language.
The settings cover the following combinations:
- mode: on, off, sandbox
- source: indexed, dynamic, file
- engine: groovy, expressions, mustache, etc
- operation: update, search, aggs, mapping
The following settings are supported for every engine:
script.engine.groovy.indexed.update: sandbox/on/off
script.engine.groovy.indexed.search: sandbox/on/off
script.engine.groovy.indexed.aggs: sandbox/on/off
script.engine.groovy.indexed.mapping: sandbox/on/off
script.engine.groovy.dynamic.update: sandbox/on/off
script.engine.groovy.dynamic.search: sandbox/on/off
script.engine.groovy.dynamic.aggs: sandbox/on/off
script.engine.groovy.dynamic.mapping: sandbox/on/off
script.engine.groovy.file.update: sandbox/on/off
script.engine.groovy.file.search: sandbox/on/off
script.engine.groovy.file.aggs: sandbox/on/off
script.engine.groovy.file.mapping: sandbox/on/off
For ease of use, the following more generic settings are supported too:
script.indexed: sandbox/on/off
script.dynamic: sandbox/on/off
script.file: sandbox/on/off
script.update: sandbox/on/off
script.search: sandbox/on/off
script.aggs: sandbox/on/off
script.mapping: sandbox/on/off
These will be used to calculate the more specific settings, using the stricter setting of each combination. Operation based settings have precedence over conflicting source based ones.
Note that the `mustache` engine is affected by generic settings applied to any language, while native scripts aren't as they are static by definition.
Also, the previous `script.disable_dynamic` setting can now be deprecated.
Closes #6418
Closes #10116
Closes #10274
2015-03-06 12:38:11 -05:00
|
|
|
|
2014-03-24 05:33:13 -04:00
|
|
|
[float]
|
|
|
|
==== More template examples
|
|
|
|
|
|
|
|
[float]
|
|
|
|
===== Filling in a query string with a single value
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_search/template
|
|
|
|
{
|
2015-05-12 05:37:22 -04:00
|
|
|
"inline": {
|
2014-03-24 05:33:13 -04:00
|
|
|
"query": {
|
|
|
|
"match": {
|
|
|
|
"title": "{{query_string}}"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
},
|
|
|
|
"params": {
|
|
|
|
"query_string": "search for these words"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
[float]
|
|
|
|
===== Passing an array of strings
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_search/template
|
|
|
|
{
|
2015-05-12 05:37:22 -04:00
|
|
|
"inline": {
|
2014-03-24 05:33:13 -04:00
|
|
|
"query": {
|
|
|
|
"terms": {
|
|
|
|
"status": [
|
|
|
|
"{{#status}}",
|
|
|
|
"{{.}}",
|
|
|
|
"{{/status}}"
|
|
|
|
]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
},
|
|
|
|
"params": {
|
|
|
|
"status": [ "pending", "published" ]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
which is rendered as:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
|
|
|
"query": {
|
|
|
|
"terms": {
|
|
|
|
"status": [ "pending", "published" ]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
[float]
|
|
|
|
===== Default values
|
|
|
|
|
|
|
|
A default value is written as `{{var}}{{^var}}default{{/var}}` for instance:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
2015-05-12 05:37:22 -04:00
|
|
|
"inline": {
|
2014-03-24 05:33:13 -04:00
|
|
|
"query": {
|
|
|
|
"range": {
|
|
|
|
"line_no": {
|
|
|
|
"gte": "{{start}}",
|
|
|
|
"lte": "{{end}}{{^end}}20{{/end}}"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
},
|
|
|
|
"params": { ... }
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
When `params` is `{ "start": 10, "end": 15 }` this query would be rendered as:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
|
|
|
"range": {
|
|
|
|
"line_no": {
|
|
|
|
"gte": "10",
|
|
|
|
"lte": "15"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
But when `params` is `{ "start": 10 }` this query would use the default value
|
|
|
|
for `end`:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
|
|
|
"range": {
|
|
|
|
"line_no": {
|
|
|
|
"gte": "10",
|
|
|
|
"lte": "20"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
[float]
|
|
|
|
===== Conditional clauses
|
|
|
|
|
|
|
|
Conditional clauses cannot be expressed using the JSON form of the template.
|
|
|
|
Instead, the template *must* be passed as a string. For instance, let's say
|
|
|
|
we wanted to run a `match` query on the `line` field, and optionally wanted
|
|
|
|
to filter by line numbers, where `start` and `end` are optional.
|
|
|
|
|
|
|
|
The `params` would look like:
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
|
|
|
"params": {
|
|
|
|
"text": "words to search for",
|
|
|
|
"line_no": { <1>
|
|
|
|
"start": 10, <1>
|
|
|
|
"end": 20 <1>
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
<1> All three of these elements are optional.
|
|
|
|
|
|
|
|
We could write the query as:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
2014-10-31 10:27:57 -04:00
|
|
|
"query": {
|
2014-03-24 05:33:13 -04:00
|
|
|
"filtered": {
|
|
|
|
"query": {
|
|
|
|
"match": {
|
|
|
|
"line": "{{text}}" <1>
|
|
|
|
}
|
|
|
|
},
|
|
|
|
"filter": {
|
|
|
|
{{#line_no}} <2>
|
|
|
|
"range": {
|
|
|
|
"line_no": {
|
|
|
|
{{#start}} <3>
|
|
|
|
"gte": "{{start}}" <4>
|
|
|
|
{{#end}},{{/end}} <5>
|
|
|
|
{{/start}} <3>
|
|
|
|
{{#end}} <6>
|
|
|
|
"lte": "{{end}}" <7>
|
2014-10-31 09:39:24 -04:00
|
|
|
{{/end}} <6>
|
2014-03-24 05:33:13 -04:00
|
|
|
}
|
|
|
|
}
|
|
|
|
{{/line_no}} <2>
|
|
|
|
}
|
|
|
|
}
|
2014-10-31 10:27:57 -04:00
|
|
|
}
|
2014-03-24 05:33:13 -04:00
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
<1> Fill in the value of param `text`
|
|
|
|
<2> Include the `range` filter only if `line_no` is specified
|
|
|
|
<3> Include the `gte` clause only if `line_no.start` is specified
|
|
|
|
<4> Fill in the value of param `line_no.start`
|
|
|
|
<5> Add a comma after the `gte` clause only if `line_no.start`
|
|
|
|
AND `line_no.end` are specified
|
|
|
|
<6> Include the `lte` clause only if `line_no.end` is specified
|
|
|
|
<7> Fill in the value of param `line_no.end`
|
|
|
|
|
2014-10-31 10:27:57 -04:00
|
|
|
[NOTE]
|
|
|
|
==================================
|
2014-03-24 05:33:13 -04:00
|
|
|
As written above, this template is not valid JSON because it includes the
|
2014-10-31 10:27:57 -04:00
|
|
|
_section_ markers like `{{#line_no}}`. For this reason, the template should
|
|
|
|
either be stored in a file (see <<pre-registered-templates>>) or, when used
|
|
|
|
via the REST API, should be written as a string:
|
|
|
|
|
2015-07-14 12:14:09 -04:00
|
|
|
[source,js]
|
2014-10-31 10:27:57 -04:00
|
|
|
--------------------
|
2015-05-12 05:37:22 -04:00
|
|
|
"inline": "{\"query\":{\"filtered\":{\"query\":{\"match\":{\"line\":\"{{text}}\"}},\"filter\":{{{#line_no}}\"range\":{\"line_no\":{{{#start}}\"gte\":\"{{start}}\"{{#end}},{{/end}}{{/start}}{{#end}}\"lte\":\"{{end}}\"{{/end}}}}{{/line_no}}}}}}"
|
2014-10-31 10:27:57 -04:00
|
|
|
--------------------
|
|
|
|
|
|
|
|
==================================
|
2014-03-24 05:33:13 -04:00
|
|
|
|
2014-03-25 10:24:31 -04:00
|
|
|
[float]
|
2014-10-31 10:27:57 -04:00
|
|
|
[[pre-registered-templates]]
|
2014-03-25 10:24:31 -04:00
|
|
|
===== Pre-registered template
|
|
|
|
|
|
|
|
You can register search templates by storing it in the `config/scripts` directory, in a file using the `.mustache` extension.
|
|
|
|
In order to execute the stored template, reference it by it's name under the `template` key:
|
|
|
|
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_search/template
|
|
|
|
{
|
2015-05-12 05:37:22 -04:00
|
|
|
"file": "storedTemplate", <1>
|
2014-07-16 05:46:55 -04:00
|
|
|
"params": {
|
|
|
|
"query_string": "search for these words"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
<1> Name of the the query template in `config/scripts/`, i.e., `storedTemplate.mustache`.
|
|
|
|
|
|
|
|
You can also register search templates by storing it in the elasticsearch cluster in a special index named `.scripts`.
|
|
|
|
There are REST APIs to manage these indexed templates.
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
POST /_search/template/<templatename>
|
|
|
|
{
|
|
|
|
"template": {
|
|
|
|
"query": {
|
|
|
|
"match": {
|
|
|
|
"title": "{{query_string}}"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
2014-07-16 06:17:57 -04:00
|
|
|
------------------------------------------
|
2014-07-16 05:46:55 -04:00
|
|
|
|
|
|
|
This template can be retrieved by
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_search/template/<templatename>
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
which is rendered as:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
|
|
|
"template": {
|
|
|
|
"query": {
|
|
|
|
"match": {
|
|
|
|
"title": "{{query_string}}"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
This template can be deleted by
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
DELETE /_search/template/<templatename>
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
To use an indexed template at search time use:
|
|
|
|
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_search/template
|
|
|
|
{
|
2015-05-12 05:37:22 -04:00
|
|
|
"id": "templateName", <1>
|
2014-03-25 10:24:31 -04:00
|
|
|
"params": {
|
|
|
|
"query_string": "search for these words"
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
Scripting: add support for fine-grained settings
Allow to on/off scripting based on their source (where they get loaded from), the operation that executes them and their language.
The settings cover the following combinations:
- mode: on, off, sandbox
- source: indexed, dynamic, file
- engine: groovy, expressions, mustache, etc
- operation: update, search, aggs, mapping
The following settings are supported for every engine:
script.engine.groovy.indexed.update: sandbox/on/off
script.engine.groovy.indexed.search: sandbox/on/off
script.engine.groovy.indexed.aggs: sandbox/on/off
script.engine.groovy.indexed.mapping: sandbox/on/off
script.engine.groovy.dynamic.update: sandbox/on/off
script.engine.groovy.dynamic.search: sandbox/on/off
script.engine.groovy.dynamic.aggs: sandbox/on/off
script.engine.groovy.dynamic.mapping: sandbox/on/off
script.engine.groovy.file.update: sandbox/on/off
script.engine.groovy.file.search: sandbox/on/off
script.engine.groovy.file.aggs: sandbox/on/off
script.engine.groovy.file.mapping: sandbox/on/off
For ease of use, the following more generic settings are supported too:
script.indexed: sandbox/on/off
script.dynamic: sandbox/on/off
script.file: sandbox/on/off
script.update: sandbox/on/off
script.search: sandbox/on/off
script.aggs: sandbox/on/off
script.mapping: sandbox/on/off
These will be used to calculate the more specific settings, using the stricter setting of each combination. Operation based settings have precedence over conflicting source based ones.
Note that the `mustache` engine is affected by generic settings applied to any language, while native scripts aren't as they are static by definition.
Also, the previous `script.disable_dynamic` setting can now be deprecated.
Closes #6418
Closes #10116
Closes #10274
2015-03-06 12:38:11 -05:00
|
|
|
<1> Name of the the query template stored in the `.scripts` index.
|
2015-06-09 03:31:01 -04:00
|
|
|
|
|
|
|
[float]
|
|
|
|
==== Validating templates
|
|
|
|
|
|
|
|
A template can be rendered in a response with given parameters using
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_render/template
|
|
|
|
{
|
|
|
|
"inline": {
|
|
|
|
"query": {
|
|
|
|
"terms": {
|
|
|
|
"status": [
|
|
|
|
"{{#status}}",
|
|
|
|
"{{.}}",
|
|
|
|
"{{/status}}"
|
|
|
|
]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
},
|
|
|
|
"params": {
|
|
|
|
"status": [ "pending", "published" ]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
This call will return the rendered template:
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
{
|
|
|
|
"template_output": {
|
|
|
|
"query": {
|
|
|
|
"terms": {
|
|
|
|
"status": [ <1>
|
|
|
|
"pending",
|
|
|
|
"published"
|
|
|
|
]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
<1> `status` array has been populated with values from the `params` object.
|
|
|
|
|
|
|
|
File and indexed templates can also be rendered by replacing `inline` with
|
|
|
|
`file` or `id` respectively. For example, to render a file template
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_render/template
|
|
|
|
{
|
|
|
|
"file": "my_template",
|
|
|
|
"params": {
|
|
|
|
"status": [ "pending", "published" ]
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|
|
|
|
|
|
|
|
Pre-registered templates can also be rendered using
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
------------------------------------------
|
|
|
|
GET /_render/template/<template_name>
|
|
|
|
{
|
|
|
|
"params": {
|
|
|
|
"...
|
|
|
|
}
|
|
|
|
}
|
|
|
|
------------------------------------------
|