d71dc205fa
Moving averaging of partial evaluation results to RankedListQualityMetric
...
For the two current metrics Prec@ and reciprocal rank we currently average the
partial results in the transport action. If other metric later need a different
behaviour or want to parametrize this, this operation should be part of the
metric itself, so this change moves it there. Also removing on of the two test
packages, main code is also in one package only.
2016-08-04 10:34:46 +02:00
ac3f2421b1
Merge branch 'origin/feature/rank-eval' into feature/rank-eval_index_type_to_id
2016-08-03 13:50:13 +02:00
0fb7dd9054
Merge pull request #19623 from MaineC/feature/rank-eval
...
Add parsing of type information
2016-08-02 13:50:16 +02:00
869e471f9f
Add missing file
2016-07-28 11:42:05 +02:00
34cbc10128
Add index and type information to rated doc
...
Also add roundtrip testing of the xcontent serialisation of RatedDoc
2016-07-28 11:41:54 +02:00
71c0d59e95
Add option for maximally allowed rank to Reciprocal Rank metric
2016-07-27 16:24:41 +02:00
ad9f060dc7
Use type information in request
...
Adds parsing of type and actually using it in TransportRankEvalAction.
Missing: A good idea how to actually test this in isolation...
2016-07-27 15:49:37 +02:00
2bb5cb83a7
Merge branch 'feature/rank-eval' of github.com:elasticsearch/elasticsearch into feature/rank-eval
2016-07-27 15:46:44 +02:00
ad87bacf91
Add Reciprocal Rank query evaluation metric
...
This adds a second query evaluation metric alongside precision_at. Reciprocal
Rank is defined as 1/rank, where rank is the position of the first relevant
document in the search result. The results are averaged across all queries
across the sample of queries, according to
https://en.wikipedia.org/wiki/Mean_reciprocal_rank
2016-07-27 15:23:05 +02:00
4162582ee8
Adapt to renaming of RestTestCandidate
2016-07-27 11:39:59 +02:00
ccf275af7b
Adapt to introduction of ESClientYamlSuiteTestCase
2016-07-26 16:10:47 +02:00
c8d3098d3e
Move github review comments to TODOs
2016-07-21 15:44:47 +02:00
b730494bfc
Adding rest layer parsing and response rendering
...
Adding parsers for the rest request and the various components within, also
extending the existing rest test and adding rendering of the response.
2016-07-06 15:30:45 +02:00
b38a12ad15
Adapt to new checkstyle constraints
2016-07-05 11:38:19 +02:00
42662fd695
Adapt to changes in master
2016-07-01 15:03:17 +02:00
be19d13d14
Adapting to changes in Plugin api
2016-06-30 16:18:05 +02:00
6d4673fd58
Initial commit for Module to compute metrics on queries
...
This is an initial squashed commit of the work on a new feature for query metrics
proposed in #18798 .
2016-06-30 16:15:08 +02:00
Christoph Büscher
Isabel Drost-Fromm
Isabel Drost-Fromm