Commit Graph

399 Commits

Author SHA1 Message Date
kimchy d5759efed7 allow for concurrent flushing while indexing 2011-05-19 19:29:02 +03:00
Igor Motov 671b48e007 Fix possible false matches with multiple percolators. 2011-05-16 18:04:03 +03:00
kimchy 2c0bb9199a Search: Optimize (perf) execution of global facets, closes #889. 2011-04-28 17:20:31 +03:00
kimchy db04649271 Search request intermittent failures with has_child query/filter, closes #875. 2011-04-21 17:54:01 +03:00
Lukáš Vlček adc3dc0e99 Fix for highlighting when number_of_fragments is set to 0 and term_vector is not set, closes #873 2011-04-21 14:55:21 +02:00
Lukáš Vlček add6db352d Added test for the highlighting using the source field. (This test probably dropped out in one of previous commits) 2011-04-21 11:55:35 +02:00
kimchy af39f07213 Mapping: By default, don't index _id, closes #868. 2011-04-20 02:49:14 +03:00
kimchy 3b21759bec Better support with _type is marked as not indexed, allowing to filter by type, closes #866. 2011-04-20 01:31:38 +03:00
kimchy c3f3c268c8 Query DSL: Add ids query and filter to fetch docs by ids (do not require _id field to be indexed), closes #865. 2011-04-20 00:30:30 +03:00
Lukáš Vlček be2a456cc0 improve test: check hits length and zero failures 2011-04-19 21:49:08 +02:00
kimchy c2ee6dd120 improve gateway recovery and applying indices, also improve speed of index creation 2011-04-17 18:39:00 +03:00
kimchy 4eddaec8ba change defaults in stress test 2011-04-16 16:57:17 +03:00
kimchy 2cc4a286f8 small refactor 2011-04-16 03:23:47 +03:00
kimchy 8fa8a72175 add refresh before verifying in the test 2011-04-16 03:20:52 +03:00
kimchy 5ab0ec4911 add a concurrent indexing stress test 2011-04-16 03:15:13 +03:00
kimchy 7c38f20056 Query DSL: Geo Distance Range filter, closes #856. 2011-04-14 20:20:18 +03:00
kimchy 8eab5ec528 experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load) 2011-04-09 20:21:23 +03:00
kimchy c934f04b0c remove weak caching of filters and stick with only caching when needed / flagged / defaulted 2011-04-09 02:47:31 +03:00
kimchy 16a046f686 rename termsstats java facet builder to termsStatsFacet 2011-04-07 14:30:12 +03:00
kimchy 7231e08f7c also test terms facet with execution hint of map 2011-04-07 13:32:35 +03:00
kimchy 8c50a65699 Percolator doesn't work correctly after index recreation, closes #837. 2011-04-06 21:00:49 +03:00
kimchy 6317483fe3 add total count to terms stats and compute mean properly, also better use caching 2011-04-06 15:50:09 +03:00
kimchy 35be46df71 Bug: Sort on a column of type 'short' throws an exception, closes #835. 2011-04-06 02:25:56 +03:00
kimchy 4721f9aa69 fix cache recycling logic to make sure we don't override our own data in facets 2011-04-05 23:25:39 +03:00
kimchy 6f827731d6 normalize to/from properly in bounded histogram 2011-04-05 15:10:55 +03:00
kimchy 9b8eceb229 Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834. 2011-04-05 13:53:19 +03:00
kimchy 79939222e4 Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832. 2011-04-05 00:42:46 +03:00
kimchy 8d1e9dbd3c Histogram Facet: Add min/max stats when providing value field / script, closes #830. 2011-04-04 23:48:54 +03:00
kimchy 46088b9f8a Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829. 2011-04-04 21:30:46 +03:00
kimchy 105d60ac9c Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824. 2011-04-04 17:44:38 +03:00
kimchy 4e4495ff1d Upgrade to Lucene 3.1, closes #825. 2011-04-04 12:54:15 +03:00
kimchy e4cbdfa05b Terms Facet: Performance improvements, closes #822. 2011-04-01 16:30:45 +03:00
kimchy 2a032f8718 add remote many indices creation test 2011-03-29 17:17:54 +02:00
kimchy 508d1d40fb Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809. 2011-03-29 13:05:36 +02:00
kimchy 49f79f54d2 log when search failure happen when scanning 2011-03-28 18:17:36 +02:00
kimchy f00664621f more scan tests to try and recreate the context missing failure, no luck yet... 2011-03-28 17:21:59 +02:00
kimchy 64a89eb0e4 add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers 2011-03-28 14:21:49 +02:00
kimchy d2e61af9ee maintain total hits across scan scroll requests 2011-03-20 00:19:26 +02:00
kimchy 70fc8d9af0 Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793. 2011-03-19 00:24:20 +02:00
kimchy 09fbc919b8 "exclude" functionality missing for terms facet on numeric fields, closes #789. 2011-03-18 11:08:11 +02:00
kimchy 923fcf239c Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790. 2011-03-18 10:49:28 +02:00
kimchy 25124b084b Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787. 2011-03-17 22:01:22 +02:00
kimchy 96d06d6dc8 Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781. 2011-03-15 21:22:46 +02:00
kimchy 1bcd3b67ee Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769. 2011-03-14 11:30:01 +02:00
kimchy 700a2a9577 Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772. 2011-03-13 02:29:05 +02:00
kimchy bdb0fd23e9 Versioning: Add a new version_type parameter, with a new type - `external`, closes #776. 2011-03-12 20:41:55 +02:00
kimchy faefc772a4 Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736. 2011-03-02 05:11:02 +02:00
kimchy bb1668c2b7 count date histo using the wrong counts aggregator to return results when using time based setting interval 2011-03-02 03:13:25 +02:00
kimchy 6097365738 eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729. 2011-03-01 00:49:41 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24199a3394 add simple unicast disco test on hte node level 2011-02-28 21:43:31 +02:00
kimchy 3b967040da Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725. 2011-02-27 01:06:50 +02:00
kimchy fdef88debb Bulk API: Improve memory usage when executing large bulk requests, closes #724. 2011-02-26 23:46:22 +02:00
kimchy a0fd47159e improve internal scan handling, by using count type for the first scan 2011-02-24 01:04:49 +02:00
kimchy ee9beda398 Search: Add search_type for `count` to return count but still support facets, closes #718. 2011-02-24 00:29:42 +02:00
kimchy f7100c0698 Improve from hits pagination (duplicates), closes #717. 2011-02-23 22:57:44 +02:00
kimchy 6b7192e744 add from/to test without sorting on single shard 2011-02-23 21:41:31 +02:00
kimchy 8371920a89 add min/max to terms stats facet 2011-02-23 20:36:12 +02:00
kimchy 58dbf6d5ca fix terms facet TOTAL comparator to also do secondary sort when totals are equal 2011-02-23 00:55:40 +02:00
kimchy 06850f8673 add another test to scan 2011-02-22 21:01:11 +02:00
kimchy 953fcbc58c Get API: Allow to provide a script as a field, closes #708. 2011-02-22 02:28:19 +02:00
kimchy 818f3b4d75 Search: Add search type `scan` allowing to efficiently scan large result set, closes #707. 2011-02-22 00:11:31 +02:00
kimchy 352cb74f96 Search: Terms Stats Facet, closes #705. 2011-02-19 23:37:04 +02:00
kimchy 585c310aa4 add edge histogram test 2011-02-18 07:35:33 +02:00
kimchy fb90392040 add status based test 2011-02-17 01:28:54 +02:00
kimchy 6ffd60dfb5 change var name to better reflect the fact that its data and not work 2011-02-17 01:07:05 +02:00
kimchy 9ae9ab9553 add flush to search 1 stress test 2011-02-10 16:47:43 +02:00
kimchy 4bcedde011 don't require to provide the type of the doc in the doc element in percolator request, also, change the REST endpoint for percolator to include the type, basically: {index}/{type}/_percolate 2011-02-08 22:24:44 +02:00
kimchy 3062d5b86c nice usage of versioning parse element 2011-02-08 17:50:28 +02:00
kimchy ac8646deb7 Search: By default, don't return the version per hit, unless `version` is set to `true`, closes #676. 2011-02-08 17:48:13 +02:00
kimchy b8c644cab5 ip mapping no longer enabled 2011-02-08 11:24:14 +02:00
kimchy 4319e3cb05 add a test to fetch just an array element (which has no mapping) 2011-02-07 20:24:15 +02:00
kimchy 904bee12bc Search: Failure when sorting on `short` type, closes #665. 2011-02-02 17:55:21 +02:00
kimchy 4ed82023ce another embedded test for query and fetch on a single shard 2011-02-02 14:04:24 +02:00
kimchy 0bce34cb5a optimize single shard search (or search result) by not doing another round of sorting 2011-02-02 13:52:34 +02:00
kimchy c86551d9b5 move master node tests to cluster package, and force it to use zen disco always 2011-02-02 11:15:12 +02:00
kimchy d2a3f5142f improve the order of shutdown of top level components in node, close indices first and applying cluster changes, also, improve atomicity of closing of indices and shards 2011-02-01 23:10:15 +02:00
kimchy 8927e1dee4 Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663. 2011-02-01 13:41:58 +02:00
kimchy cc6f65f8b8 Search: When sorting, allow to pass `track_scores` and set it to `true` to get scores/max_score back, closes #662. 2011-02-01 12:38:46 +02:00
kimchy f8b5628db9 have rolling restart stress test create incremental ids 2011-01-31 21:41:46 +02:00
kimchy cebdae5707 refactor script execution handling to improve performance, also introduce specific search script executor 2011-01-31 16:08:06 +02:00
kimchy 5d39cc93dd refresh for test 2011-01-31 15:51:39 +02:00
kimchy e516051ea5 Search: When fetching _parent, only the _id should be returned, and not type#id, closes #658. 2011-01-30 21:16:45 +02:00
kimchy 5b4846b0b6 Translog Flushing: Improve logic, flush not just by operations in the translog, closes #656. 2011-01-30 17:41:22 +02:00
kimchy 94c632b79b Java Client - Allow to set facets in binary format, closes #442. 2011-01-30 15:53:10 +02:00
kimchy 0b09fd0806 Facets: Remove redundant data returned as part of facet response (for example, the field name being faceted), closes #655. 2011-01-29 20:44:58 +02:00
kimchy 332c4cfa53 use bloom filter to reduce seeks when needing to load version 2011-01-29 03:55:00 +02:00
kimchy 00fa7c95fb improve test time 2011-01-26 23:04:10 +02:00
kimchy 5ecb847a3a improve test time 2011-01-26 22:59:35 +02:00
kimchy 6c21c30f31 Index Merge: Improve internal (segment) merging by not initiating it on doc operations, closes #653. 2011-01-26 22:39:40 +02:00
kimchy 5a4686aee5 Search: Allow to pass a search filter, applying only on the query (and not on facets for example), closes #650. 2011-01-26 12:55:30 +02:00
kimchy 00aad4c123 rename tests 2011-01-25 14:40:04 +02:00
kimchy 95dc08fa3b refactor search tests into separate packages 2011-01-24 16:06:28 +02:00
kimchy 95b6184135 Terms Facets: Allow to get `all_terms` back (possibly with count 0), closes #647. 2011-01-23 16:09:18 +02:00
kimchy ce4f09c2b1 Strict dynamic setting: Refuse to index a document with fields not present in the mapping definition, closes #643. 2011-01-22 01:08:41 +02:00
kimchy b1d13febbf Percolate on Index and Bulk, closes #636. 2011-01-19 16:45:45 +02:00
kimchy 574c455203 Terms Facet: Add option include counts where term is missing, closes #632. 2011-01-18 21:51:16 +02:00
kimchy a4c2087511 initial not recovered block on node init, and remove it as usual (once node is initialized / recovered) 2011-01-18 14:08:45 +02:00
kimchy b4e5a542f3 internal refactoring/simplification in percolator 2011-01-17 13:57:32 +02:00
kimchy 38d10d19bc Add `prefer_local` flag to analyze and percolate request, closes #625. 2011-01-14 01:01:37 +02:00