Christoph Büscher
fa459f88dd
Add normalization option
...
When switched on, compute the normalized ndcg variant.
2016-08-08 16:37:15 +02:00
Christoph Büscher
87e13ca8bb
Add Discounted Cumulative Gain metric
2016-08-08 16:37:15 +02:00
Isabel Drost-Fromm
b2fa7c4d96
Fix merge errors.
2016-08-08 14:41:58 +02:00
Isabel Drost-Fromm
a6caabb730
Merge branch 'feature/rank-eval' into feature/rank-eval_index_type_to_id
2016-08-08 14:21:19 +02:00
Isabel Drost-Fromm
cfaa62723d
Actually use index/type in addition to docid for comparing hits.
2016-08-08 14:09:27 +02:00
Christoph Büscher
0578a96483
Merge RankEvalResult with Response
...
The current response object only serves as a wrapper around the result object.
This change merges the two classes into one.
2016-08-08 13:29:44 +02:00
Christoph Büscher
438893c0c7
Adapt to changes to how named writables are registered
2016-08-04 13:40:46 +02:00
Christoph Büscher
d71dc205fa
Moving averaging of partial evaluation results to RankedListQualityMetric
...
For the two current metrics Prec@ and reciprocal rank we currently average the
partial results in the transport action. If other metric later need a different
behaviour or want to parametrize this, this operation should be part of the
metric itself, so this change moves it there. Also removing on of the two test
packages, main code is also in one package only.
2016-08-04 10:34:46 +02:00
Isabel Drost-Fromm
ac3f2421b1
Merge branch 'origin/feature/rank-eval' into feature/rank-eval_index_type_to_id
2016-08-03 13:50:13 +02:00
Isabel Drost-Fromm
0fb7dd9054
Merge pull request #19623 from MaineC/feature/rank-eval
...
Add parsing of type information
2016-08-02 13:50:16 +02:00
Isabel Drost-Fromm
869e471f9f
Add missing file
2016-07-28 11:42:05 +02:00
Isabel Drost-Fromm
34cbc10128
Add index and type information to rated doc
...
Also add roundtrip testing of the xcontent serialisation of RatedDoc
2016-07-28 11:41:54 +02:00
Christoph Büscher
71c0d59e95
Add option for maximally allowed rank to Reciprocal Rank metric
2016-07-27 16:24:41 +02:00
Isabel Drost-Fromm
2bb5cb83a7
Merge branch 'feature/rank-eval' of github.com:elasticsearch/elasticsearch into feature/rank-eval
2016-07-27 15:46:44 +02:00
Christoph Büscher
ad87bacf91
Add Reciprocal Rank query evaluation metric
...
This adds a second query evaluation metric alongside precision_at. Reciprocal
Rank is defined as 1/rank, where rank is the position of the first relevant
document in the search result. The results are averaged across all queries
across the sample of queries, according to
https://en.wikipedia.org/wiki/Mean_reciprocal_rank
2016-07-27 15:23:05 +02:00
Christoph Büscher
4162582ee8
Adapt to renaming of RestTestCandidate
2016-07-27 11:39:59 +02:00
Christoph Büscher
ccf275af7b
Adapt to introduction of ESClientYamlSuiteTestCase
2016-07-26 16:10:47 +02:00
Isabel Drost-Fromm
c8d3098d3e
Move github review comments to TODOs
2016-07-21 15:44:47 +02:00
Christoph Büscher
b730494bfc
Adding rest layer parsing and response rendering
...
Adding parsers for the rest request and the various components within, also
extending the existing rest test and adding rendering of the response.
2016-07-06 15:30:45 +02:00
Isabel Drost-Fromm
6d4673fd58
Initial commit for Module to compute metrics on queries
...
This is an initial squashed commit of the work on a new feature for query metrics
proposed in #18798 .
2016-06-30 16:15:08 +02:00
