5c9cc1d453
Add roundtripping to PrecisionAtN
2016-08-24 14:39:12 +02:00
a2a92b9629
Add roundtrip xcontent test to DiscountedCumulativeGainAt
...
This factors the roundtripping out of RatedDocumentTests. Makes
RankedListQualityMetric and RatedDocument implement FromXContenBuilder
to be able to do the aforementioned refactoring in a generic way. Adds
a roundtrip test to DiscountedCumulativeGainAt.
Open questions:
DiscountedCumulativeGain didn't have a constructor that accepted all possible
parameters as arguments. Added one. I guess we still want to keep the one
that only requires the position argument?
To make roundtripping work I had to change the NAME parameter when generating
XContent for DiscountedCumulativeGainAt - all remaining unit tests seem to be
passing (haven't checked the REST tests yet) - need to figure out why that was
there to begin with.
2016-08-24 14:21:24 +02:00
2f506bfe04
Add toXContent method to classes used in ranking request
2016-08-18 18:14:21 +02:00
2e892185f0
Adapting to introduction of SearchRequestParers on master
2016-08-17 11:54:07 +02:00
1eedb4c033
Resolve missing imports due to changes in master
2016-08-16 11:48:28 +02:00
b7af7c21d1
Adapt to changes in master
2016-08-12 11:03:55 +02:00
cac4961ef4
Fix test failure because of broken RankEvalResponse serialization
...
The introduction of RatedDocumentKey accidentally broke the response
serialization because it cannot be written using writeGenericValue().
2016-08-11 15:42:18 +02:00
a2e6dc2750
Adressing review comments and adding test for failed request
2016-08-11 10:08:40 +02:00
8856565b89
Make RankEvalRequestTests work with transport client
2016-08-11 10:07:09 +02:00
795017ddfa
Adding listeners for search requests that collect results
2016-08-11 10:06:23 +02:00
e71e29b3a0
Using client instead of TransportSearchAction
2016-08-11 10:05:28 +02:00
0be997232a
Add ConstructingObjectParser to RatedDocumentKey
2016-08-09 12:49:07 +02:00
c2bd58e13d
Switch to ConstructingObjectParser
2016-08-09 12:22:44 +02:00
978d5366d2
Merge branch 'feature/rank-eval' into feature/rank-eval_index_type_to_id
2016-08-09 10:54:14 +02:00
fa459f88dd
Add normalization option
...
When switched on, compute the normalized ndcg variant.
2016-08-08 16:37:15 +02:00
87e13ca8bb
Add Discounted Cumulative Gain metric
2016-08-08 16:37:15 +02:00
b2fa7c4d96
Fix merge errors.
2016-08-08 14:41:58 +02:00
a6caabb730
Merge branch 'feature/rank-eval' into feature/rank-eval_index_type_to_id
2016-08-08 14:21:19 +02:00
cfaa62723d
Actually use index/type in addition to docid for comparing hits.
2016-08-08 14:09:27 +02:00
0578a96483
Merge RankEvalResult with Response
...
The current response object only serves as a wrapper around the result object.
This change merges the two classes into one.
2016-08-08 13:29:44 +02:00
438893c0c7
Adapt to changes to how named writables are registered
2016-08-04 13:40:46 +02:00
d71dc205fa
Moving averaging of partial evaluation results to RankedListQualityMetric
...
For the two current metrics Prec@ and reciprocal rank we currently average the
partial results in the transport action. If other metric later need a different
behaviour or want to parametrize this, this operation should be part of the
metric itself, so this change moves it there. Also removing on of the two test
packages, main code is also in one package only.
2016-08-04 10:34:46 +02:00
ac3f2421b1
Merge branch 'origin/feature/rank-eval' into feature/rank-eval_index_type_to_id
2016-08-03 13:50:13 +02:00
0fb7dd9054
Merge pull request #19623 from MaineC/feature/rank-eval
...
Add parsing of type information
2016-08-02 13:50:16 +02:00
869e471f9f
Add missing file
2016-07-28 11:42:05 +02:00
34cbc10128
Add index and type information to rated doc
...
Also add roundtrip testing of the xcontent serialisation of RatedDoc
2016-07-28 11:41:54 +02:00
71c0d59e95
Add option for maximally allowed rank to Reciprocal Rank metric
2016-07-27 16:24:41 +02:00
ad9f060dc7
Use type information in request
...
Adds parsing of type and actually using it in TransportRankEvalAction.
Missing: A good idea how to actually test this in isolation...
2016-07-27 15:49:37 +02:00
2bb5cb83a7
Merge branch 'feature/rank-eval' of github.com:elasticsearch/elasticsearch into feature/rank-eval
2016-07-27 15:46:44 +02:00
ad87bacf91
Add Reciprocal Rank query evaluation metric
...
This adds a second query evaluation metric alongside precision_at. Reciprocal
Rank is defined as 1/rank, where rank is the position of the first relevant
document in the search result. The results are averaged across all queries
across the sample of queries, according to
https://en.wikipedia.org/wiki/Mean_reciprocal_rank
2016-07-27 15:23:05 +02:00
4162582ee8
Adapt to renaming of RestTestCandidate
2016-07-27 11:39:59 +02:00
ccf275af7b
Adapt to introduction of ESClientYamlSuiteTestCase
2016-07-26 16:10:47 +02:00
c8d3098d3e
Move github review comments to TODOs
2016-07-21 15:44:47 +02:00
b730494bfc
Adding rest layer parsing and response rendering
...
Adding parsers for the rest request and the various components within, also
extending the existing rest test and adding rendering of the response.
2016-07-06 15:30:45 +02:00
b38a12ad15
Adapt to new checkstyle constraints
2016-07-05 11:38:19 +02:00
42662fd695
Adapt to changes in master
2016-07-01 15:03:17 +02:00
be19d13d14
Adapting to changes in Plugin api
2016-06-30 16:18:05 +02:00
6d4673fd58
Initial commit for Module to compute metrics on queries
...
This is an initial squashed commit of the work on a new feature for query metrics
proposed in #18798 .
2016-06-30 16:15:08 +02:00
Isabel Drost-Fromm
Christoph Büscher
Isabel Drost-Fromm