Commit Graph

123 Commits

Author SHA1 Message Date
Christoph Büscher 87e13ca8bb Add Discounted Cumulative Gain metric 2016-08-08 16:37:15 +02:00
Isabel Drost-Fromm b2fa7c4d96 Fix merge errors. 2016-08-08 14:41:58 +02:00
Isabel Drost-Fromm a6caabb730 Merge branch 'feature/rank-eval' into feature/rank-eval_index_type_to_id 2016-08-08 14:21:19 +02:00
Isabel Drost-Fromm cfaa62723d Actually use index/type in addition to docid for comparing hits. 2016-08-08 14:09:27 +02:00
Christoph Büscher 0578a96483 Merge RankEvalResult with Response
The current response object only serves as a wrapper around the result object.
This change merges the two classes into one.
2016-08-08 13:29:44 +02:00
Christoph Büscher 438893c0c7 Adapt to changes to how named writables are registered 2016-08-04 13:40:46 +02:00
Christoph Büscher d71dc205fa Moving averaging of partial evaluation results to RankedListQualityMetric
For the two current metrics Prec@ and reciprocal rank we currently average the
partial results in the transport action. If other metric later need a different
behaviour or want to parametrize this, this operation should be part of the
metric itself, so this change moves it there. Also removing on of the two test
packages, main code is also in one package only.
2016-08-04 10:34:46 +02:00
Isabel Drost-Fromm ac3f2421b1 Merge branch 'origin/feature/rank-eval' into feature/rank-eval_index_type_to_id 2016-08-03 13:50:13 +02:00
Isabel Drost-Fromm 0fb7dd9054 Merge pull request #19623 from MaineC/feature/rank-eval
Add parsing of type information
2016-08-02 13:50:16 +02:00
Isabel Drost-Fromm 869e471f9f Add missing file 2016-07-28 11:42:05 +02:00
Isabel Drost-Fromm 34cbc10128 Add index and type information to rated doc
Also add roundtrip testing of the xcontent serialisation of RatedDoc
2016-07-28 11:41:54 +02:00
Christoph Büscher 71c0d59e95 Add option for maximally allowed rank to Reciprocal Rank metric 2016-07-27 16:24:41 +02:00
Isabel Drost-Fromm ad9f060dc7 Use type information in request
Adds parsing of type and actually using it in TransportRankEvalAction.

Missing: A good idea how to actually test this in isolation...
2016-07-27 15:49:37 +02:00
Isabel Drost-Fromm 2bb5cb83a7 Merge branch 'feature/rank-eval' of github.com:elasticsearch/elasticsearch into feature/rank-eval 2016-07-27 15:46:44 +02:00
Christoph Büscher ad87bacf91 Add Reciprocal Rank query evaluation metric
This adds a second query evaluation metric alongside precision_at. Reciprocal
Rank is defined as 1/rank, where rank is the position of the first relevant
document in the search result. The results are averaged across all queries
across the sample of queries, according to
https://en.wikipedia.org/wiki/Mean_reciprocal_rank
2016-07-27 15:23:05 +02:00
Christoph Büscher 4162582ee8 Adapt to renaming of RestTestCandidate 2016-07-27 11:39:59 +02:00
Christoph Büscher ccf275af7b Adapt to introduction of ESClientYamlSuiteTestCase 2016-07-26 16:10:47 +02:00
Isabel Drost-Fromm c8d3098d3e Move github review comments to TODOs 2016-07-21 15:44:47 +02:00
Christoph Büscher b730494bfc Adding rest layer parsing and response rendering
Adding parsers for the rest request and the various components within, also
extending the existing rest test and adding rendering of the response.
2016-07-06 15:30:45 +02:00
Christoph Büscher b38a12ad15 Adapt to new checkstyle constraints 2016-07-05 11:38:19 +02:00
Christoph Büscher 42662fd695 Adapt to changes in master 2016-07-01 15:03:17 +02:00
Christoph Büscher be19d13d14 Adapting to changes in Plugin api 2016-06-30 16:18:05 +02:00
Isabel Drost-Fromm 6d4673fd58 Initial commit for Module to compute metrics on queries
This is an initial squashed commit of the work on a new feature for query metrics
proposed in #18798.
2016-06-30 16:15:08 +02:00