honeymoose/OpenSearch
1
0
Fork 0
mirror of https://github.com/honeymoose/OpenSearch.git synced 2025-04-08 08:18:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
50,092 Commits 7 Branches 6 Tags
Commit Graph

20 Commits

Author SHA1 Message Date
Marios Trivyzas
dac720d7a1
Add a cluster setting to disallow expensive queries (#51385) (#52279) 
Add a new cluster setting `search.allow_expensive_queries` which by
default is `true`. If set to `false`, certain queries that have
usually slow performance cannot be executed and an error message
is returned.

- Queries that need to do linear scans to identify matches:
  - Script queries
- Queries that have a high up-front cost:
  - Fuzzy queries
  - Regexp queries
  - Prefix queries (without index_prefixes enabled
  - Wildcard queries
  - Range queries on text and keyword fields
- Joining queries
  - HasParent queries
  - HasChild queries
  - ParentId queries
  - Nested queries
- Queries on deprecated 6.x geo shapes (using PrefixTree implementation)
- Queries that may have a high per-document cost:
  - Script score queries
  - Percolate queries

Closes: #29050
(cherry picked from commit a8b39ed842c7770bd9275958c9f747502fd9a3ea)
 2020-02-12 22:56:14 +01:00
Orhan Toy
44827e577e [DOCS] Fix missing quote in script-score-query.asciidoc (#50590) 2020-01-03 16:15:45 +01:00
Ryan Ernst
f32692208e
Add explanations to script score queries (#46693) (#47548) 
While function scores using scripts do allow explanations, they are only
creatable with an expert plugin. This commit improves the situation for
the newer script score query by adding the ability to set the
explanation from the script itself.

To set the explanation, a user would check for `explanation != null` to
indicate an explanation is needed, and then call
`explanation.set("some description")`.
 2019-10-03 21:05:05 -07:00
James Rodewig
e253ee6ba6
[DOCS] Change // CONSOLE comments to [source,console] (#46440) (#46494) 2019-09-09 12:35:50 -04:00
James Rodewig
138865a58e [DOCS] Reformat script score query (#45087) 2019-08-01 12:23:35 -04:00
James Rodewig
661f70183e [DOCS] Make Query DSL titles consistent (#43935) 2019-07-18 10:33:10 -04:00
Mayya Sharipova
32cb47b91c Add l1norm and l2norm distances for vectors (#44116) 
Add L1norm - Manhattan distance
Add L2norm - Euclidean distance
relates to #37947
 2019-07-11 14:30:02 -04:00
Mayya Sharipova
37e1ad7062 Forbid empty doc values on vector functions (#43944) 
Currently when a document misses a vector value, vector function
returns 0 as a score for this document. We think this is incorrect
behaviour.
With this change, an error will be thrown if vector functions are
used with docs that are missing vector doc values.
Also VectorScriptDocValues is modified to allow size() function,
which can be used to check if a document has a value for the
vector field.
 2019-07-05 18:09:06 -04:00
Mayya Sharipova
756c42f99f
Add dims parameter to dense_vector mapping (#43444) (#43895) 
Typically, dense vectors of both documents and queries must have the same
number of dimensions. Different number of dimensions among documents
or query vector indicate an error. This PR enforces that all vectors
for the same field have the same number of dimensions. It also enforces
that query vectors have the same number of dimensions.
 2019-07-02 21:14:16 -04:00
Mayya Sharipova
aa6248d4d7
Move dense_vector and sparse_vector to module (#43280) (#43333) 2019-06-18 11:56:04 -04:00
Mayya Sharipova
216c74d10a Add experimental and warnings to vector functions (#42205) 2019-05-21 06:39:05 -04:00
James Rodewig
53702efddd [DOCS] Add anchors for Asciidoctor migration (#41648) 2019-04-30 10:20:17 -04:00
Mayya Sharipova
4127d6889b Remove experimental label froms script_score query (#41572) 2019-04-26 08:51:29 -04:00
Mayya Sharipova
24755209b4 Add randomScore function in script_score query (#40186) 
To make script_score query to have the same features
as function_score query, we need to add randomScore
function.

This function produces different
random scores on different index shards.
It is also able to produce random scores
based on the internal Lucene Document Ids.
 2019-03-28 13:23:47 -04:00
Mayya Sharipova
e80284231d
Backport distance functions vectors (#39330) 
Distance functions for dense and sparse vectors

Backport for #37947, #39313
 2019-02-23 11:52:43 -05:00
Mayya Sharipova
a30ce6a00a
Rename feature, feature_vector and feature_query (#37794) 
Ranaming as follows:
feature -> rank_feature
feature_vector -> rank_features
feature query -> rank_feature query

Ranaming is done to distinguish from other vector types.

Closes #36723
 2019-01-24 19:18:48 -05:00
Mayya Sharipova
fdb66039d4
Change rational to saturation in script_score (#37766) 
This change of the function name is necessary for conformity
with feature queries.

Closes #37714
 2019-01-23 14:28:20 -05:00
Mayya Sharipova
942fc13af5
Use plain text instead of latexmath 
As latexmath is not rendered, using plain text instead

Closes #37718
 2019-01-22 16:49:03 -05:00
Jim Ferenczi
667c06dc83 Add link to script score query in the top level docs (#36416) 
* add link to script score query in the top level docs

* Correct references in script-score-query.asciidoc
 2018-12-19 10:18:53 -05:00
Mayya Sharipova
643bb20137
Add a new query type - ScriptScoreQuery (#34533) 
* Add a new query type - ScriptScoreQuery

script_score query uses script to calculate document scores.
Added as a substitute for function_score with an intentation
to deprecate function_scoreq query.

```http
GET /_search
{
    "query": {
        "script_score" : {
            "query": {
                "match": { "message": "elasticsearch" }
            },
            "script" : {
              "source": "Math.log(2 + doc['likes'].value)"
            },
            "min_score" : 2
        }
    }
}
```

Add several functions to painless to be used inside script_score:

double rational(double, double)
double sigmoid(double, double, double)
double randomNotReproducible() 
double randomReproducible(String, int) 

double decayGeoLinear(String, String, String, double, GeoPoint)
double decayGeoExp(String, String, String, double, GeoPoint)
double decayGeoGauss(String, String, String, double, GeoPoint)

double decayNumericLinear(String, String, String, double, double)
double decayNumericExp(String, String, String, double, double)
double decayNumericGauss(String, String, String, double, double)

double decayDateLinear(String, String, String, double, JodaCompatibleZonedDateTime)
double decayDateExp(String, String, String, double, JodaCompatibleZonedDateTime)
double decayDateGauss(String, String, String, double, JodaCompatibleZonedDateTime)

Date functions only works on dates in  the default format and default time zone
 2018-11-20 16:10:06 -05:00