Commit Graph

1170 Commits

Author SHA1 Message Date
Martijn van Groningen 1ce10dfb06 Fixed issue where parent & child queries can fail if a segment doesn't have documents with the targeted type or associated parent type
Closes #2537
2013-01-11 16:06:14 +01:00
Martijn van Groningen 43aabe88e8 Fixed document already exists error when concurrently sending update request with upsert using the same id.
Closes #2530
2013-01-10 14:25:44 +01:00
Shay Banon 6f7253c524 Comments are not allowed in mapping
checked jackson, there won't be an overhead in enabling comments. Added, with the caveat that when used with mappings, and calling "get mapping", the comments will not be returned
closes #1394
2013-01-07 04:21:41 +01:00
Shay Banon 2c4b9d9ba2 cleanup queryHint since its not was never used
preference ended up as the way to control routing
2013-01-07 04:02:45 +01:00
Shay Banon bcdda811ef add read/write optional text 2013-01-07 02:54:22 +01:00
Shay Banon 0e5287f1f2 Binary Mapped Fields: Allow to not store them by default, and return BytesReference
fixes #2523
also, fix another point of normalization of the result for get API
2013-01-05 01:50:46 +01:00
Shay Banon 4b9fcdb900 noramalize the value even when getting it from source
we need to in order to properly handle bytes, and normalize Integer to Long for example for consistency, the fact that mappers now handle different Objtes help here
2013-01-04 23:55:34 +01:00
Shay Banon fe38cecabd return the string for date types if passed for search 2013-01-04 23:31:49 +01:00
Shay Banon bf4c442509 add refresh before calling count 2013-01-04 08:38:00 +01:00
Shay Banon 70f1e2c987 remove problematic timeout test
the timeout feature, even if set to 0, might still mean we get an ack back...
2013-01-04 08:19:01 +01:00
Shay Banon e70cf1849b check on sourceRef, so it won't convert to bytes without needing to 2013-01-04 07:47:26 +01:00
Igor Motov d73a6663b7 Changing non-nested object mapping to nested should fail
Fixes #2518
2013-01-03 18:18:40 -05:00
uboness dc25939b7c fixed hunspell test to clean up properly, this time, for realz 2013-01-03 22:54:37 +01:00
uboness 86f55b3a45 fixed hunspell test to clean up properly 2013-01-03 22:12:36 +01:00
Martijn van Groningen 7cf80aca99 Changed how the stored values of numeric fields are stored in the index. Before numeric values were stored in binary representation, now the values in numeric representation. 2013-01-03 21:34:53 +01:00
Shay Banon 0032b334c5 add simple way to get the index creation version when building a mapper 2013-01-03 19:06:19 +01:00
uboness 9f60dc7578 Support for root logger level runtime update
Closes: #2517
2013-01-03 01:23:40 +01:00
uboness 6c4108b38a Support for hunspell token filter
Closes: #646

- Introduced HunspellService which holds a repository of hunspell dictionaries
- It is possible to register a dictionary via a plugin or by placing the dictionary files on the file system
2013-01-02 03:51:26 +01:00
Shay Banon 720feca3c5 optimize search hit to use Text for type and id
this will reduce serialization string overheads, and faster xcontent(json) generation
2012-12-31 00:13:15 -08:00
Shay Banon 120b766f0a cleanup 2012-12-30 17:39:19 -08:00
Shay Banon 4a5b147634 remove unused method 2012-12-30 17:37:46 -08:00
Shay Banon 22077d1c5f move regex to use Object as paramater as well 2012-12-30 17:36:48 -08:00
Shay Banon f8a08a46ac cleanup more calls to Term with String value 2012-12-30 17:31:13 -08:00
Shay Banon 1c93c8dfb8 cleanup unused term factory 2012-12-30 16:55:22 -08:00
Shay Banon 7f0034d42f fix thread pool stats largest 2012-12-30 01:57:18 -08:00
Shay Banon b6f766af3f backport lucene 4.1 terms filter and use it where applicable 2012-12-29 10:39:53 -08:00
Shay Banon b08e8fb76c add explicit termsFilter in mapper, and use that in terms filter
This also enabled support for terms filter on _id field for example
2012-12-29 01:06:32 -08:00
Shay Banon 2655c2aa58 fix index xcontent flag with id 2012-12-29 00:46:35 -08:00
Shay Banon 9a8d558e51 use object parser value for queries that support it 2012-12-29 00:14:46 -08:00
Shay Banon fd5719b232 support multiple values when mappers construct queries
this will allow us to optimize parsing using actual values (numbers/bytes)
2012-12-28 23:38:43 -08:00
Shay Banon 01ba287164 more mapper simplification, reduce the value methods 2012-12-28 20:33:10 -08:00
Shay Banon e02015c641 Use FieldType and not deprecated Field construction 2012-12-28 14:27:09 -08:00
Shay Banon 64a01c28c3 rename fieldQuery/fieldFilter to termQuery/termFilter in mappers 2012-12-28 13:48:48 -08:00
Shay Banon 12239169b1 add 0.20.3 2012-12-27 14:30:40 -08:00
Shay Banon 7fb98769a6 add a sleep to make sure settings are applied 2012-12-27 14:16:30 -08:00
Igor Motov b7ff23ff93 Update settings: Allow to dynamically update thread pool settings
Closes #2509
2012-12-27 09:39:27 -05:00
Shay Banon 6ef0e4ddda fix type to types 2012-12-26 16:31:55 -08:00
Shay Banon 660d0ceba9 cleanup 2012-12-26 16:18:57 -08:00
Simon Willnauer 750c30f0b8 allow index and type to be specified as arrays in MultiSearchRequest 2012-12-26 16:18:17 -08:00
Dave Brosius 6342beeeb0 fix copy/paste bug where null stopWords is passed causing an NPE 2012-12-26 16:16:37 -08:00
Shay Banon ef55e4feec fix failed tests due to wrapping failures with mapping parsing exception 2012-12-26 15:59:07 -08:00
Shay Banon 7a0404ac35 optimize filtered query with match_all filter
simply just use the query in that case, and don't add the filter overhead
2012-12-26 15:47:53 -08:00
Shay Banon 8a17222ff2 match_all filter with empty array (instead of obj) fires exception when used with facets
fixes #2493
2012-12-26 15:35:30 -08:00
Shay Banon 2a57e7cd4b ShardSearchFailure handling of exception does not take actual into account for status
fixes #2495
2012-12-26 15:00:49 -08:00
Shay Banon 2f4b759df7 Allow highlighting on wildcard fields.. ie, comment_*
closes #2396
2012-12-26 15:00:31 -08:00
Shay Banon 4b69846ba2 cleanup 2012-12-26 14:21:04 -08:00
Simon Willnauer 90bd82ac50 Pass topScorer=false to sub-scorers if a scorer is wrapped. Wrapped BooleanQuery can return collect-only scorers. See #2505 2012-12-26 14:20:14 -08:00
Shay Banon 2449049a84 Plugins Installer: Allow to download plugins from download.elasticsearch.org
closes #2507.
2012-12-26 14:16:35 -08:00
Martijn van Groningen c93babed42 Minor changes to the parent / child benchmark. 2012-12-24 22:12:10 +01:00
Martijn van Groningen c6aaefa27f Improved explain support for nested query.
Closes #2503
2012-12-24 13:40:20 +01:00
Martijn van Groningen d57d89937f Added scoring support to `has_child` and `has_parent` queries.
Added score support to `has_child` and `has_parent` queries. Both queries support a score_type option. The has_child support the same options as the top_children query and the none option which is the default and yields the current behaviour. The has_parent query support the score type options: score and none. The latter is the default and yields the current behaviour.

If the score_type is set to a value other than none then the has_parent query map the matched parent score into the related children documents. The has_child query then map the matched children documents into the related parent document. The score_type on both queries defines how the children documents scores are mapped in the parent documents. Both queries are executed in two phases. First phase collects the parent uid values of matching documents with an aggregated score per parent uid value. In the second phase either child or parent typed documents are emitted as hit that have the same parent uid value as found during the first phase. The score computed in the first phase will be used as score.

Closes #2502
2012-12-24 11:39:43 +01:00
Shay Banon bb9c7172b0 add mappings even on failure to parse
since we add them internally to the compound mappers, we need to publish the fact, otherwise, for example, the codec won't find the relevant one based on the global mapper service
2012-12-24 00:04:29 -08:00
Igor Motov fcdc36977c Fix failure message serialization in MultiSearchResponse
Fixes #2498
2012-12-21 19:26:48 -05:00
Martijn van Groningen 08b026d060 Fixed `top_children` query failure with dfs_query* search types.
Fixed error with the top_children query when `DFS_QUERY_*` is used as search_type and wraps a query that gets rewritten (E.g wildcard query).

Closes #2501
2012-12-21 18:08:44 +01:00
Martijn van Groningen c17755d164 Removed unused code. 2012-12-21 16:54:14 +01:00
Martijn van Groningen 694989141b Fixed AOBE when using `top_children` in a must not clause.
Closes #2500
2012-12-21 16:47:03 +01:00
Martijn van Groningen 826a6ab02a Improved XBooleanFilter by adding drive logic for bit based filter impl and adding unit test, which tests all possible XBooleanFilter options. 2012-12-19 22:43:47 +01:00
Shay Banon 14678a91ab nested path to be represented as bytes as well as string 2012-12-18 15:39:13 -08:00
Shay Banon 2950799243 fix creating uid to bytes 2012-12-18 14:39:25 -08:00
Shay Banon ac253178bd more cleanup in mappings 2012-12-18 13:28:36 -08:00
Shay Banon 1867ef5084 simplify toXContent generation of field mappers 2012-12-18 13:00:47 -08:00
Shay Banon f3dbe9224a rename analyzed to tokenized to match field type 2012-12-18 11:34:41 -08:00
Shay Banon b9c5f0472c indexedTerm to return bytes
part of the effort to reduce conversion from string to types
2012-12-18 10:58:03 -08:00
Shay Banon 1cb531f000 remove unused code 2012-12-18 10:26:52 -08:00
Shay Banon e41def7a59 remove unused code 2012-12-18 10:22:37 -08:00
Shay Banon f01ce61f71 parse to bytes 2012-12-18 10:20:55 -08:00
Martijn van Groningen afd998c482 Improved the size computation in StringFieldData#computeSizeInBytes() 2012-12-18 09:51:01 +01:00
Martijn van Groningen ddea22771e Fixed mlt api bug related to custom routing value.
If the a routing value isn't id based, the get part of the mlt request couldn't retrieve the document for the second part of the mlt request and a 500 code is returned instead. This fix addresses this issue.

Closes #2489
2012-12-17 11:00:30 +01:00
uboness 8b74c42099 Support for RegexpQuery & RegexpFilter
- Added "regexp" query type (based on Lucene 4 RegexpQuery)
- Added "regexp" filter type
- Fixed a bug in IdFieldMapper where prefixQuery on a single type would be redundantly wrapped in a boolean query
2012-12-16 23:24:18 +01:00
Shay Banon 5a6004a168 First indexing of a dynamic boolean field can cause it not to be indexed correctly
fixes #2487
2012-12-15 19:04:10 -08:00
Igor Motov c8285739d2 Correctly parse *:* query into matchAllDocsQuery
Fixes #2486
2012-12-14 14:36:20 -08:00
Martijn van Groningen 148dc3c013 Added Lucene 4.1 todo 2012-12-14 16:08:37 +01:00
Shay Banon c65d5a77c4 reuse non analyzed token stream for string types
so heavyweight token stream won't be created each time
2012-12-12 22:53:48 -08:00
Shay Banon fc35fd8a29 improve fields iteration trying to find customer valued analyzer 2012-12-12 22:08:54 -08:00
Shay Banon 36fd76b826 don't call toLowerCase on each bulk item 2012-12-12 21:56:23 -08:00
Shay Banon 32bf7607c7 optimize boolean filter to use bits driven by result bitset 2012-12-12 20:12:51 -08:00
Shay Banon 4778d5c2eb optimize boolean filter for one clause case 2012-12-12 16:32:22 -08:00
Shay Banon 8d0d288a1c add 0.20 versions 2012-12-08 01:37:21 +01:00
Alex Lambert 635438e7d1 restore deleted plugin path modification 2012-12-08 01:15:17 +01:00
Shay Banon e021904250 use the 0.20.0 version 2012-12-07 23:15:44 +01:00
Shay Banon 4dec14d5da Wildcard query on non existent field matches all documents
fixes #2461
2012-12-07 19:37:26 +01:00
Martijn van Groningen ea9a4d70cf lucene 4: Removed the usage of Document & Field when retrieving stored fields. 2012-12-06 18:18:52 +01:00
Igor Motov d947dfde2b Add support for ignoring settings in system properties.
An elasticsearch node can be instructed to ignore settings specified in system properties by setting config.ignore_system_properties setting to true.
2012-12-06 09:37:36 -05:00
Martijn van Groningen 591a76bd88 Changed es version from string to class Version. 2012-12-06 15:37:03 +01:00
Martijn van Groningen 966fdfdfb8 Changed es version from string to class Version 2012-12-06 15:35:30 +01:00
Martijn van Groningen 22f99e848f Expose es version in node info api.
Closes #2466
2012-12-06 15:22:44 +01:00
Martijn van Groningen f72d5c1907 Expose fragmenter option for plain / normal highlighter.
Closes #2465
2012-12-06 14:59:42 +01:00
Shay Banon c2f8ee105b add a marker CachedFilter
this allows to easily and globally check if we cache a filter or not, all filter caching uses this marker interface
2012-12-06 10:13:47 +01:00
Shay Banon 2786e29a10 expose filter strategy in filtered query 2012-12-06 02:20:09 +01:00
Shay Banon c22b521800 fix properly handling acceptDocs in filters
our idea is to apply it on the "filtered/constant" level, and not on compound filters, so we won't apply it multiple times. The solution is conservative a bit now, we can further optimize it in the future, for example, not to wrap it when no caching is done within the filter chain
2012-12-06 01:55:16 +01:00
Shay Banon 5a226cde8e add 0.19.13 2012-12-04 15:41:38 +01:00
Shay Banon c36638d159 not delete filter improvements
- don't check no null for liveDocs, since we know they are not null with the check for hasDeletion
- improve iteration over liveDocs vs. innerSet, prefer to iterate over the faster one
2012-12-04 02:00:36 +01:00
Martijn van Groningen 6cfd938dce Fixed unable to highlight on all multi-valued field values.
Closes #2384
2012-12-03 12:39:18 +01:00
Shay Banon f17ad829ac remove snappy support
relates to #2459
2012-12-03 12:30:13 +01:00
Shay Banon 677e6ce4ef Deprecate Shared Gateway
closes #2458
2012-12-03 11:44:17 +01:00
Shay Banon a2a8553faf Indexing Slow Log
closes #2457
2012-12-03 10:21:59 +01:00
Shay Banon b4f85ee422 no need to check for log levels
we already do that when we log, and those are set to TRACE most times for slow log (since logging is based on thresholds)
2012-12-02 22:03:51 +01:00
Shay Banon a274d9386f Add types and stats to search slow log
closes #2455
2012-12-02 22:01:17 +01:00
Igor Motov 6021515567 The relevancy score in explanation should match the actual score in custom_filters_query
Fixes #2441
2012-11-27 10:13:16 -08:00
Shay Banon 69ef822da6 cleanup docsets
- remove the DocSet abstraction, and use Bits where we can by getting it from DocIdSet
- better handling of acceptDocs, though still need to properly apply them when caching is involved
2012-11-27 10:04:21 -08:00