2013-08-28 19:24:34 -04:00
|
|
|
[[query-dsl-mlt-query]]
|
|
|
|
=== More Like This Query
|
|
|
|
|
|
|
|
More like this query find documents that are "like" provided text by
|
|
|
|
running it against one or more fields.
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
--------------------------------------------------
|
|
|
|
{
|
|
|
|
"more_like_this" : {
|
|
|
|
"fields" : ["name.first", "name.last"],
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
"like" : "text like this one",
|
2013-08-28 19:24:34 -04:00
|
|
|
"min_term_freq" : 1,
|
|
|
|
"max_query_terms" : 12
|
|
|
|
}
|
|
|
|
}
|
|
|
|
--------------------------------------------------
|
|
|
|
|
2014-09-15 10:17:49 -04:00
|
|
|
More Like This can find documents that are "like" a set of
|
2014-04-17 11:09:20 -04:00
|
|
|
chosen documents. The syntax to specify one or more documents is similar to
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
the <<docs-multi-get,Multi GET API>>.
|
2014-09-19 08:43:47 -04:00
|
|
|
If only one document is specified, the query behaves the same as the
|
2014-04-17 11:09:20 -04:00
|
|
|
<<search-more-like-this,More Like This API>>.
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
--------------------------------------------------
|
|
|
|
{
|
|
|
|
"more_like_this" : {
|
|
|
|
"fields" : ["name.first", "name.last"],
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
"like" : [
|
2014-04-17 11:09:20 -04:00
|
|
|
{
|
|
|
|
"_index" : "test",
|
|
|
|
"_type" : "type",
|
|
|
|
"_id" : "1"
|
|
|
|
},
|
|
|
|
{
|
|
|
|
"_index" : "test",
|
|
|
|
"_type" : "type",
|
|
|
|
"_id" : "2"
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
},
|
|
|
|
"and also some text like this one!"
|
2014-04-17 11:09:20 -04:00
|
|
|
],
|
|
|
|
"min_term_freq" : 1,
|
|
|
|
"max_query_terms" : 12
|
|
|
|
}
|
|
|
|
}
|
|
|
|
--------------------------------------------------
|
|
|
|
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
Additionally, <<docs-termvectors-artificial-doc,artificial documents>> are also supported.
|
|
|
|
This is useful in order to specify one or more documents not present in the index.
|
2014-09-15 10:17:49 -04:00
|
|
|
|
|
|
|
[source,js]
|
|
|
|
--------------------------------------------------
|
|
|
|
{
|
|
|
|
"more_like_this" : {
|
|
|
|
"fields" : ["name.first", "name.last"],
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
"like" : [
|
2014-09-15 10:17:49 -04:00
|
|
|
{
|
|
|
|
"_index" : "test",
|
|
|
|
"_type" : "type",
|
|
|
|
"doc" : {
|
|
|
|
"name": {
|
|
|
|
"first": "Ben",
|
|
|
|
"last": "Grimm"
|
|
|
|
},
|
|
|
|
"tweet": "You got no idea what I'd... what I'd give to be invisible."
|
|
|
|
}
|
|
|
|
}
|
|
|
|
},
|
|
|
|
{
|
|
|
|
"_index" : "test",
|
|
|
|
"_type" : "type",
|
|
|
|
"_id" : "2"
|
|
|
|
}
|
|
|
|
],
|
|
|
|
"min_term_freq" : 1,
|
|
|
|
"max_query_terms" : 12
|
|
|
|
}
|
|
|
|
}
|
|
|
|
--------------------------------------------------
|
|
|
|
|
2013-08-28 19:24:34 -04:00
|
|
|
`more_like_this` can be shortened to `mlt`.
|
|
|
|
|
2014-05-08 06:21:18 -04:00
|
|
|
Under the hood, `more_like_this` simply creates multiple `should` clauses in a `bool` query of
|
|
|
|
interesting terms extracted from some provided text. The interesting terms are
|
|
|
|
selected with respect to their tf-idf scores. These are controlled by
|
|
|
|
`min_term_freq`, `min_doc_freq`, and `max_doc_freq`. The number of interesting
|
|
|
|
terms is controlled by `max_query_terms`. While the minimum number of clauses
|
|
|
|
that must be satisfied is controlled by `percent_terms_to_match`. The terms
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
are extracted from the text in `like` and analyzed by the analyzer associated
|
2014-05-08 06:21:18 -04:00
|
|
|
with the field, unless specified by `analyzer`. There are other parameters,
|
|
|
|
such as `min_word_length`, `max_word_length` or `stop_words`, to control what
|
|
|
|
terms should be considered as interesting. In order to give more weight to
|
|
|
|
more interesting terms, each boolean clause associated with a term could be
|
|
|
|
boosted by the term tf-idf score times some boosting factor `boost_terms`.
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
When a search for multiple documents is issued, More Like This generates a
|
2014-04-17 11:09:20 -04:00
|
|
|
`more_like_this` query per document field in `fields`. These `fields` are
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
specified as a top level parameter or within each document request.
|
2014-04-17 11:09:20 -04:00
|
|
|
|
2014-08-21 13:29:26 -04:00
|
|
|
IMPORTANT: The fields must be indexed and of type `string`. Additionally, when
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
using `like` with documents, the fields must be either `stored`, store `term_vector`
|
2014-08-21 13:29:26 -04:00
|
|
|
or `_source` must be enabled.
|
|
|
|
|
2013-08-28 19:24:34 -04:00
|
|
|
The `more_like_this` top level parameters include:
|
|
|
|
|
|
|
|
[cols="<,<",options="header",]
|
|
|
|
|=======================================================================
|
|
|
|
|Parameter |Description
|
|
|
|
|`fields` |A list of the fields to run the more like this query against.
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
Defaults to the `_all` field for text and to all possible fields
|
|
|
|
for documents.
|
|
|
|
|
|
|
|
|`like`|coming[1.5.0]
|
|
|
|
Can either be some text, some documents or a combination of all, *required*.
|
|
|
|
A document request follows the same syntax as the
|
|
|
|
<<docs-multi-get,Multi Get API>> or <<docs-multi-termvectors,Multi Term Vectors API>>.
|
|
|
|
In this case, the text is fetched from `fields` unless specified otherwise in each document request.
|
|
|
|
The text is analyzed by the default analyzer at the field, unless overridden by the
|
|
|
|
`per_field_analyzer` parameter of the <<docs-termvectors-per-field-analyzer,Term Vectors API>>.
|
2013-08-28 19:24:34 -04:00
|
|
|
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
|`like_text` |deprecated[1.5.0,Replaced by `like`]
|
|
|
|
The text to find documents like it, *required* if `ids` or `docs` are
|
2014-04-17 11:09:20 -04:00
|
|
|
not specified.
|
|
|
|
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
|`ids` or `docs` |deprecated[1.5.0,Replaced by `like`]
|
|
|
|
A list of documents following the same syntax as the
|
|
|
|
<<docs-multi-get,Multi GET API>> or <<docs-multi-termvectors,Multi termvectors API>>.
|
2014-09-15 10:17:49 -04:00
|
|
|
The text is fetched from `fields` unless specified otherwise in each `doc`.
|
2014-09-19 08:43:47 -04:00
|
|
|
The text is analyzed by the default analyzer at the field, unless specified by the
|
|
|
|
`per_field_analyzer` parameter of the <<docs-termvectors-per-field-analyzer,Term Vectors API>>.
|
2014-04-17 11:09:20 -04:00
|
|
|
|
MLT Query: versatile 'like' parameter
The MLT query has a lot of parameters. For example, a set of documents is
specified with either `like_text`, `ids` or `docs`, with at least one
parameter required. This commit groups all the document specification
parameters under one called `like`. The syntax is described below and could
easily be extended to allow for new means of specifying document input. The
`like_text`, `ids` and `docs` parameters are deprecated.
As a single piece text:
{
"query": {
"more_like_this": {
"like": "some text here"
}
}
}
As a single item:
{
"query": {
"more_like_this": {
"like": {
"_index": "imdb",
"_type": "movies",
"_id": "88247"
}
}
}
}
Or as a mixture of all:
{
"query": {
"more_like_this": {
"like": [
"Some random text ...",
{
"_index": "imdb",
"_type": "movies",
"_id": "88247"
},
{
"_index": "imdb",
"_type": "movies",
"doc": {
"title": "Document with an artificial title!"
}
}
]
}
}
}
Closes #8039
2014-10-08 14:03:05 -04:00
|
|
|
|`include` |When using `like` with document requests, specifies whether the documents should be
|
2014-05-20 10:28:09 -04:00
|
|
|
included from the search. Defaults to `false`.
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2014-09-26 10:30:43 -04:00
|
|
|
|`minimum_should_match`| From the generated query, the number of terms that
|
|
|
|
must match following the <<query-dsl-minimum-should-match,minimum should
|
|
|
|
syntax>>. (Defaults to `"30%"`).
|
2013-08-28 19:24:34 -04:00
|
|
|
|
|
|
|
|`min_term_freq` |The frequency below which terms will be ignored in the
|
|
|
|
source doc. The default frequency is `2`.
|
|
|
|
|
|
|
|
|`max_query_terms` |The maximum number of query terms that will be
|
|
|
|
included in any generated query. Defaults to `25`.
|
|
|
|
|
|
|
|
|`stop_words` |An array of stop words. Any word in this set is
|
|
|
|
considered "uninteresting" and ignored. Even if your Analyzer allows
|
|
|
|
stopwords, you might want to tell the MoreLikeThis code to ignore them,
|
|
|
|
as for the purposes of document similarity it seems reasonable to assume
|
|
|
|
that "a stop word is never interesting".
|
|
|
|
|
|
|
|
|`min_doc_freq` |The frequency at which words will be ignored which do
|
|
|
|
not occur in at least this many docs. Defaults to `5`.
|
|
|
|
|
|
|
|
|`max_doc_freq` |The maximum frequency in which words may still appear.
|
|
|
|
Words that appear in more than this many docs will be ignored. Defaults
|
|
|
|
to unbounded.
|
|
|
|
|
2014-01-02 11:11:20 -05:00
|
|
|
|`min_word_length` |The minimum word length below which words will be
|
|
|
|
ignored. Defaults to `0`.(Old name "min_word_len" is deprecated)
|
2013-08-28 19:24:34 -04:00
|
|
|
|
2014-01-02 11:11:20 -05:00
|
|
|
|`max_word_length` |The maximum word length above which words will be
|
|
|
|
ignored. Defaults to unbounded (`0`). (Old name "max_word_len" is deprecated)
|
2013-08-28 19:24:34 -04:00
|
|
|
|
|
|
|
|`boost_terms` |Sets the boost factor to use when boosting terms.
|
2014-05-02 09:52:29 -04:00
|
|
|
Defaults to deactivated (`0`). Any other value activates boosting with given
|
|
|
|
boost factor.
|
2013-08-28 19:24:34 -04:00
|
|
|
|
|
|
|
|`boost` |Sets the boost value of the query. Defaults to `1.0`.
|
|
|
|
|
2014-07-23 10:58:47 -04:00
|
|
|
|`analyzer` |The analyzer that will be used to analyze the `like text`.
|
|
|
|
Defaults to the analyzer associated with the first field in `fields`.
|
2013-08-28 19:24:34 -04:00
|
|
|
|=======================================================================
|
|
|
|
|