OpenSearch/modules
Christoph Büscher 4ae4ac08d5
Add Expected Reciprocal Rank metric (#31891)
This change adds Expected Reciprocal Rank (ERR) as a ranking evaluation metric
as descriped in:

Chapelle, O., Metlzer, D., Zhang, Y., & Grinspan, P. (2009).
Expected reciprocal rank for graded relevance.
Proceeding of the 18th ACM Conference on Information and Knowledge Management.
https://doi.org/10.1145/1645953.1646033

ERR is an extension of the classical reciprocal rank to the graded relevance
case and assumes a cascade browsing model. It quantifies the usefulness of a
document at rank `i` conditioned on the degree of relevance of the items at ranks
less than `i`. ERR seems to be gain traction as an alternative to (n)DCG, so it
seems like a good metric to support. Also ERR seems to be the default optimization
metric used for training in RankLib, a widely used learning to rank library.

Relates to #29653
2018-07-12 15:50:58 +02:00
..
aggs-matrix-stats Add support for switching distribution for all integration tests (#30874) 2018-06-26 06:49:03 -07:00
analysis-common Add support for switching distribution for all integration tests (#30874) 2018-06-26 06:49:03 -07:00
ingest-common Tests: Remove use of joda time in some tests (#31922) 2018-07-12 09:55:17 +02:00
lang-expression Add support for switching distribution for all integration tests (#30874) 2018-06-26 06:49:03 -07:00
lang-mustache Reduce more raw types warnings (#31780) 2018-07-05 15:38:06 +02:00
lang-painless Handle missing values in painless (#30975) 2018-07-09 11:59:49 -04:00
mapper-extras Remove all unused imports and fix CRLF (#31207) 2018-06-11 15:12:12 +02:00
parent-join has_parent builder: exception message/param fix (#31182) 2018-06-30 11:17:37 -07:00
percolator Reduce more raw types warnings (#31780) 2018-07-05 15:38:06 +02:00
rank-eval Add Expected Reciprocal Rank metric (#31891) 2018-07-12 15:50:58 +02:00
reindex Switch reindex tests to new style requests (#31941) 2018-07-11 14:42:55 -04:00
repository-url Switch url repository rest tests to new style requests (#31944) 2018-07-11 14:52:45 -04:00
transport-netty4 Detach Transport from TransportService (#31727) 2018-07-04 11:32:35 +02:00
build.gradle Painless: Add spi jar that will be published for extending whitelists (#28302) 2018-01-18 19:16:26 -08:00