Commit Graph

5133 Commits

Author SHA1 Message Date
Martijn van Groningen 4724725681 Made a clear distinction in the rest api between percolating a provided document and percolating an existing document. The latter is now a separate api. 2013-07-30 10:25:42 +02:00
Martijn van Groningen ef847da2cd Lowered the default size of the percolate thread pool 2013-07-30 09:48:05 +02:00
Martijn van Groningen 7ccc968a9f Moved node level classes classes out of the index.percolator package into toplevel percolator package. 2013-07-29 17:40:07 +02:00
Martijn van Groningen 3f6877ec2b Rewrote the percolate existing doc api.
The percolate existing doc feature now reuses the get request instead of having a separate request body.
Relates to #3380
2013-07-29 17:32:26 +02:00
Martijn van Groningen a9dd3c9756 Added version support to mget and get apis, that only will perform the get operation if the version of the document to be fetched matches with the provided version.
Both get and mget apis now support the following additional parameters: `version` and `version_type`.

Closes #3404
2013-07-29 15:53:12 +02:00
Luca Cavanna 3b2a9fc86b completed renaming of MetaDataStateIndexService to MetaDataIndexStateService 2013-07-29 15:46:50 +02:00
Luca Cavanna 8eed6cdcae Renamed MetaDataStateIndexService to MetaDataIndexStateService for consistency 2013-07-29 15:12:09 +02:00
Luca Cavanna 105d4bab5f Updated test to reflect added acknowledgement from all nodes in open/close index api
If it's acknowledged all the other nodes already hold the latest cluster state, thus we can search on the closed index and be sure we get an error back
2013-07-29 15:12:08 +02:00
Luca Cavanna c23c5d2494 Added support for acknowledgement from other nodes in open/close index api
The open/close index api now waits for an acknowledgement from all the other nodes before returning its response, till the timeout (configurable, default 10 secs) expires. The returned acknowledged flag reflects whether the cluster state change was acknowledged by all the nodes or the timeout expired before.

Closes #3400
2013-07-29 15:12:08 +02:00
Boaz Leskes e0e6a58357 FuzzLikeThis*QueryBuilder and MoreLikeThis*QueryBuilder do not send failOnUnsupportedField if not explicitly specified.
Closes #3402 , a better solution to #3374
2013-07-29 15:02:42 +02:00
Shay Banon 7fd54acd66 remove our own version of highlighting boundary scanner
the bug that we fixed in it was already pushed to the lucene version
2013-07-29 13:36:21 +02:00
Shay Banon fadb0c8f32 cleanup unused classes (not needed with Lucene 4.4) 2013-07-29 12:58:09 +02:00
Shay Banon 2c2cc844dc cleanup deprecations / warnings 2013-07-29 01:55:41 +02:00
Shay Banon 4e66658aac cleanup
- remove Digest/Hex, only used in test, directly use MD5 there
- don't use Closeables and use IOUtils
- remove duplicate Classes usage and unused LongsLAB
2013-07-29 01:29:58 +02:00
Shay Banon a1197de6af remove unused class 2013-07-29 01:08:08 +02:00
Shay Banon 94c8834dd3 remove RandomStringGenerator, using random strings from randomized testing 2013-07-29 01:06:09 +02:00
Shay Banon d2842a936e use BigDoubleList on all cases of geo point field data
same with other field data implementations, prefer to use the paged list compared to single long array in all cases
2013-07-29 00:20:37 +02:00
Shay Banon e4ad92203f remove RamUsage and use Lucene one 2013-07-29 00:02:42 +02:00
Shay Banon 22085cab0b wait till connection callback have executed on setup 2013-07-28 22:50:46 +02:00
Shay Banon 7590f9f8a5 move char array caching to streams 2013-07-28 22:43:35 +02:00
Shay Banon da3b4a3bf0 don't use guava ordering sorted copy, since it does 2 copies (instead of 1)
simply use regular toArray and sort on it (we do need to copy it)
2013-07-28 20:09:14 +02:00
Shay Banon 69c9a2dca1 improve test to be more descriptive when it fails 2013-07-28 19:36:02 +02:00
Shay Banon 29cf346f13 improve test
the test checks that even though some shards might not be active, search will still work
2013-07-28 15:23:41 +02:00
Shay Banon c30fa15ddf randomize ports on specific transport and disco tests 2013-07-28 14:45:52 +02:00
Shay Banon 28a4ac01e4 fix transport support for versioning
when starting the request/response cycle, we should use the lowest version out of the current node version, and the target node version to serialize the request, and put it in the header. this will allow to support both backward and forward comp.
in addition, have Version as an injected value to different services, to make different versions more easily testable, compared to using Version#CURRENT
2013-07-27 22:14:04 +02:00
Nik Everett 6b8123d726 Don't allow unallocated indexes to be closed.
Closes #3313
2013-07-26 16:08:18 -04:00
Shay Banon 976152b23e enable sys out check + remove unused code 2013-07-26 18:57:21 +02:00
Shay Banon 8ac77b6119 cleanup signatures file 2013-07-26 18:32:51 +02:00
Martijn van Groningen ebad9e57d4 Added support for percolating an existing document.
The percolate an existing document feature executes an internal get operation to get the source of the document to percolate.

All options for percolating an existing document:
* `id` - The id of the document to percolate.
* `type` - The type of the document to percolate.
* `index` - The index to fetch the document to percolate from.
* `routing` - The routing value to use to retrieve the document to percolate.
* `preference` - Which shard to prefer (defaults to `_local`).
* `version` - Enables a version check. If the fetched document's version isn't equal to the specified version then the request fails with a version conflict and the percolation request is aborted.

All the option can be specified inside the `get` body part or via query string arguments.
Internally the percolate api will issue a get request for fetching the`_source` of the document to percolate.

For this feature to work the `_source` for documents to percolate need to be stored.

Closes #3380
2013-07-26 16:39:17 +02:00
Shay Banon cc5998bf6d pass the codec to fix index
its not used in Lucene fix index implementation, but just in case, pass it because we can (tm).
2013-07-26 15:36:30 +02:00
Martijn van Groningen 8fa54b59fb Only check if ttl purger has deleted the docs when the delete count in indexing stats has been increased. 2013-07-26 14:06:59 +02:00
Shay Banon 3d0382b562 better handling of failures in transport to catch assertions
move wrapping the stream into the try block, even though its unlikely they will throw a failure, better be safe...
2013-07-26 12:27:55 +02:00
Cédric HOURCADE 5022c4659c Add a "score_mode" parameter to rescoring query.
Default value is "total", possible values are: "max", "min", "avg",
"multiply" and "total".

- "total": the final score of a document is the sum of the original
  query score with the rescore query score.
- "max": only the highest score count.
- "min": only the lowest score is kept (if the document doesn't match
  the rescore query, the original query score is used).
- "avg": average of both scores
- "multiply": product of both scores

Closes #3258
2013-07-26 12:10:01 +02:00
Shay Banon 29d337c44b better handling of failures in transport to catch assertions
make sure we also catch assertions (well Throwable) in our transport layer and properly log or callback the exception handler in that case
2013-07-26 12:00:52 +02:00
Simon Willnauer 68ce3eff04 Fixed test that relied on internal document ordering.
Lucene might internally tie-break on low level doc-Ids which
can change depending on merges etc. and test timings. No test should
rely on the actual order if scores are identical.
2013-07-26 10:39:50 +02:00
Shay Banon 861e33ee3d fix test to use correct store setting 2013-07-25 20:31:16 +02:00
Simon Willnauer 3268f57125 Math is as hard as Concurrency 2013-07-25 18:36:15 +02:00
Shay Banon 0e303840e8 0.90.3 uses lucene 44 2013-07-25 18:34:02 +02:00
Luca Cavanna cb32841d9a Added regression tests for #3381 2013-07-25 18:30:49 +02:00
Martijn van Groningen bb43636190 break out if there no more liveIds. This can happen if another thread emptied the liveIds. 2013-07-25 18:18:41 +02:00
Martijn van Groningen 60f095bb72 Can't share XContentBuilder across threads. 2013-07-25 18:01:38 +02:00
Luca Cavanna 1a352756e0 Fixed hang when submitting mappings and no changes are made
Added missing listener call before return

Closes #3381
2013-07-25 16:20:56 +02:00
Simon Willnauer bd466fe39d Add facility to index in random order
Tests are more reproducible if documents are indexed in random order
with random flushes/refreshes etc. in order to catch corner cases
where doc Ids are used for tie-breaking and tests rely on a certain
order.
2013-07-25 15:17:08 +02:00
Simon Willnauer eaa6bebe54 Fix CustomScoreSearchTest that assumed a certain order of doc IDs with equal score 2013-07-25 13:04:23 +02:00
Simon Willnauer 02ca879f5d Generate consistent random settings across nodes
IndexGatewayTests rely on that all nodes have the same type of
storage to pass consistently. Random configs should be the same for all
nodes in the cluster.
2013-07-25 09:35:46 +02:00
Lukas Vlcek 4f0080b206 Expose recursion level for Hunspell token filter. Closes #3369 2013-07-25 09:17:31 +02:00
Simon Willnauer 6101cbf2bf Fix test that assumed a certain order of doc IDs with equal score
If the score is equal in Lucene the order of the result depends on the
actual global doc ID such that due to background merges or concurrency
these test can return different result set orders.
2013-07-25 08:14:20 +02:00
Shay Banon 50a835d38b Mapping: Allow to update/merge the dynamic flag
Allow to update / merge in the dynamic flag on object or the root object mapper, meaning that it can be changed dynamically using the update mapping API.
closes #3384
2013-07-24 22:57:08 +02:00
Shay Banon 993fad4c33 process internal refresh/update mapping events per index
this allows us to only create the index (if needed) for the exact duration it is needed, and not across processing of all the events
2013-07-24 21:34:33 +02:00
Martijn van Groningen 426c2867d9 Fixed testConcurrentAddingAndRemovingWhilePercolating test 2013-07-24 20:49:07 +02:00