Igor Motov
573114a446
Add an ability to define and store filter for aliases.
...
This commit only adds an ability to store filter source. The stored filters are not yet used to filter search results.
2011-05-19 19:33:41 +03:00
kimchy
d5759efed7
allow for concurrent flushing while indexing
2011-05-19 19:29:02 +03:00
kimchy
1911368feb
store the translog id in the commit point data of a lucene commit point. work done towards better concurrency on flush operation
2011-05-19 18:04:22 +03:00
kimchy
0d63fd68a8
fix division by zero error
2011-05-19 13:54:12 +03:00
kimchy
3b5c133c71
Filter Cache: `soft` filter cache can cause bad memory behavior, closes #946 .
2011-05-19 13:12:47 +03:00
kimchy
ebd95b7eb8
change internal fs translog to be less blocking, and easier to refactor later for better flush concurrency
2011-05-19 11:39:18 +03:00
kimchy
ed8d6bbcd3
fix refresh logic after the change to not do it under write lock
2011-05-19 00:36:07 +03:00
kimchy
229c03e33f
Analysis: Phonetic filter to support `cologne` encoder, closes #942 .
2011-05-18 13:43:10 +03:00
kimchy
44595c06c6
improve custom name resolver logic to allow more options for control
2011-05-18 12:37:16 +03:00
kimchy
3f62c96951
Upgrade to jackson 1.8.1, closes #941 .
2011-05-18 12:11:07 +03:00
Igor Motov
b4b92a8e7f
Move alias metadata from settings to a separate data structure
2011-05-17 23:41:33 +03:00
kimchy
bcc3c6dd63
remove unused logger.
2011-05-17 16:57:22 +03:00
kimchy
cc0a6ed690
Search: Empty facets element causes search failures, closes #938 .
2011-05-17 16:15:45 +03:00
kimchy
af222dc75c
Analysis: Regression (0.16.1), Camel cased filters / tokenizers failed to load in custom analyzer, closes #937 .
2011-05-17 14:20:32 +03:00
kimchy
518488b0b2
auto_expand_replicas: [0-auto] can cause data loss when nodes are removed, closes #934 .
...
This is caused because of a race condition between when to handle the removed node and move a replica to a primary mode, and when to remove the replica because of the 0-auto setting.
2011-05-17 01:41:05 +03:00
kimchy
c9aca9c6de
upgrade to guava 09
2011-05-16 22:56:10 +03:00
kimchy
ff09c19ae6
reuse exists collector
2011-05-16 18:08:04 +03:00
Igor Motov
671b48e007
Fix possible false matches with multiple percolators.
2011-05-16 18:04:03 +03:00
kimchy
30df0d8324
wrong type returned by date_histogram, closes #932 .
2011-05-15 17:13:05 +03:00
kimchy
c823355014
Deleting and recreating a new index with dynamic mapping can cause type failures, closes #931 .
2011-05-15 12:52:17 +03:00
kimchy
cb691ef54b
add toString to SearchRequestBuilder
2011-05-14 14:52:36 +03:00
kimchy
603d462d4a
improve flush concurrency by refreshing outside of the write lock
2011-05-14 00:49:17 +03:00
kimchy
c5305a0545
Analysis: Add elision token filter, closes #930 .
2011-05-13 15:11:19 +03:00
kimchy
f02f63cf75
Mapping: dynamic templates of object type do not initialize some mapping data structures (like analyzers lookup), closes #929 .
2011-05-13 14:52:09 +03:00
kimchy
d61ba5c189
nicer javadoc
2011-05-13 13:58:56 +03:00
kimchy
b531cf03e4
more javadoc
2011-05-13 13:56:20 +03:00
kimchy
e4aee9cfbc
check for early exit on max expansions on multi suffix terms with prefix, and handle no terms provided
2011-05-13 13:17:24 +03:00
kimchy
f659ecc88b
Analysis: Pattern Tokenizer, closes #928 .
2011-05-13 01:22:22 +03:00
kimchy
03c0a05935
Merge branch 'master' of github.com:elasticsearch/elasticsearch
2011-05-12 00:42:08 +03:00
Igor Motov
bc6d9c19e8
Fix double counts when count is executed on two aliases pointing to the same index
2011-05-12 00:29:17 +03:00
Lukáš Vlček
6fe1416173
Fixing Javadoc
2011-05-11 23:08:26 +02:00
kimchy
aa9730834f
Phonetic Filter : Double Metaphone, partial implementation (not using the secondary code), closes #924 .
2011-05-11 22:51:11 +03:00
kimchy
133305da44
Simplified Disable Flush operation, closes #906 .
2011-05-11 19:12:50 +03:00
kimchy
176f359e8b
Possible failure when using TransportClient (with sniffing), closes #923 .
2011-05-11 01:59:14 +03:00
kimchy
8c1171a6ef
Mapping: Document's Field level boosting, closes #920 .
2011-05-10 23:27:38 +03:00
kimchy
15d8f0b1ac
Analysis: Synonym Token Filter, closes #900 .
2011-05-10 22:37:33 +03:00
kimchy
1b686d3c2b
Analysis: All analysis components that accept stopwords to allow to load stopwords from a file, closes #919 .
2011-05-09 14:13:20 +03:00
kimchy
563ad625c0
Analysis: Word Delimiter Token Filter, closes #918 .
2011-05-09 02:48:11 +03:00
kimchy
465036655f
Query DSL: Text Queries (boolean, phrase, and phrase_prefix), closes #917 .
2011-05-08 21:42:25 +03:00
kimchy
e66c78ad64
format
2011-05-07 15:04:52 +03:00
kimchy
1565e10d06
allow to set fuzzy factor when merging
2011-05-07 14:56:07 +03:00
kimchy
c05df433c6
optimize term creation (reduce interning)
2011-05-07 12:53:24 +03:00
kimchy
7cccacbcfa
guard in boolean filter from null doc id sets and iterators
2011-05-06 23:10:21 +03:00
kimchy
3894472f49
Analysis: Stop words config to allow for automatic _lang_ expansion, closes #909 .
2011-05-06 01:03:44 +03:00
kimchy
9ab671ed51
fix stop words
2011-05-06 00:46:07 +03:00
kimchy
7f5318e217
fix stop words for spanish analyzer
2011-05-06 00:41:32 +03:00
kimchy
85eae8b3f5
Analysis: Expose light and minimal language token filters, closes #908 .
2011-05-05 23:45:59 +03:00
kimchy
0f78100b97
Query DSL: Fuzzy query support for numeric / date types, closes #907 .
2011-05-05 16:36:06 +03:00
kimchy
dffb11bdbf
Query DSL: Fuzzy Query - add max_expansions, closes #905 .
2011-05-05 13:46:19 +03:00
kimchy
d3076945ac
Week Interval on Date Histogram Facet
2011-05-05 01:01:29 +03:00
kimchy
3000dc78fa
Failure when applying failed shards during local gateway allocation, closes #903 .
2011-05-04 20:49:51 +03:00
kimchy
015e46930d
Possible failure to start a river after cluster restart, closes #902 .
2011-05-04 20:27:07 +03:00
Igor Motov
0386317aba
Remove unnecessary aliasAndIndexToIndex map
2011-05-04 09:50:51 +03:00
kimchy
2b9bdc3796
wrong usage of initial lower/upper bound double aggregators
2011-05-03 16:33:52 +03:00
kimchy
1d2f95857d
Sort missing wrongly sorts negative values, closes #772 .
2011-05-03 16:16:30 +03:00
kimchy
98dbb46b3c
make sure we close the parser even if it failed to parse a search request
2011-04-30 00:10:24 +03:00
kimchy
4558816bcf
make sure we close the parser even if it failed to parse a search request
2011-04-30 00:09:36 +03:00
kimchy
fcdd2ba11c
And/Or Filter: Possible failure when inner filter does not match any docs, closes #892 .
2011-04-29 21:45:00 +03:00
kimchy
887ac1fce6
Search: Optimize (perf) execution of global facets, closes #889 .
2011-04-28 19:32:13 +03:00
kimchy
2c0bb9199a
Search: Optimize (perf) execution of global facets, closes #889 .
2011-04-28 17:20:31 +03:00
kimchy
0ab8d1f414
Search API: filter element should not be applied to global facets, closes #888 .
2011-04-28 16:16:50 +03:00
kimchy
19448d7775
include_in_all not overridable in objects, closes #883 .
2011-04-28 15:44:25 +03:00
kimchy
5c8fe598a6
Scripting - mvel: Fix thread safety misuse when compiling scripts, first go it so use ParserConfiguration, second is a fix in mvel itself, relates to #886 .
2011-04-27 00:38:51 +03:00
kimchy
6ecbef463f
Create Index API: Better logic to wait for ack for indices being created on nodes, closes #879 .
2011-04-27 00:24:27 +03:00
kimchy
6ace8ba0d8
Query DSL: Allow to set boost on has_child query, closes #884 .
2011-04-26 20:40:21 +03:00
kimchy
f3e032315f
(Small) optimization to has_child filter, closes #880 .
2011-04-25 17:37:56 +03:00
kimchy
49ac30801e
more cache cleaning
2011-04-25 00:16:42 +03:00
kimchy
23c17d7101
improved close logic on index query parser
2011-04-24 23:42:59 +03:00
kimchy
013c4e9fa4
improved cleaning of cached parser context
2011-04-24 23:34:59 +03:00
kimchy
990f371580
better cached streams logic
2011-04-24 23:28:35 +03:00
kimchy
9b262a7363
clean teh lzf buffer recycler
2011-04-24 22:48:38 +03:00
kimchy
1e5dc09848
Unexpected failure to create a shard can lead to data loss if it has no replicas, closes #878 .
2011-04-23 13:29:14 +03:00
kimchy
3b07f77f3d
clean indices when created just for mapping processing
2011-04-22 16:34:54 +03:00
kimchy
65e05538f0
refresh changed mapping in cluster metadata, this will happen when upgrading from 0.15 to 0.16
2011-04-22 16:07:18 +03:00
kimchy
0319972d77
change logging level to debug
2011-04-22 04:43:23 +03:00
kimchy
6ed2624772
fix wrong closing of possible null mappings in geo point mapping
2011-04-22 04:29:47 +03:00
kimchy
d517c3dfef
upgrade to jackson 1.8.0
2011-04-22 03:45:56 +03:00
kimchy
e171596a6f
default replacement char to delimiter char
2011-04-22 03:20:34 +03:00
kimchy
1f89fb26aa
upgrade to mvel 2.1.beta2 (not to be confused with Beta2 :) )
2011-04-22 02:33:39 +03:00
kimchy
d8d47abcba
no need to cache filters again when handling named filters
2011-04-22 00:37:20 +03:00
Igor Motov
4c295a28d5
Don't attempt to load camelCased version of the package name.
...
It's unlikely that a package would have a camelCased name and an attempt to load a class with wrong case is causing NoClassDefFoundError instead of ClassNotFoundException on non case-sensitive file systems.
2011-04-21 21:39:17 +03:00
kimchy
db04649271
Search request intermittent failures with has_child query/filter, closes #875 .
2011-04-21 17:54:01 +03:00
Lukáš Vlček
adc3dc0e99
Fix for highlighting when number_of_fragments is set to 0 and term_vector is not set, closes #873
2011-04-21 14:55:21 +02:00
kimchy
dedbedbb77
Update Settings: Allow to dynamically set filter cache settings, closes #874 .
2011-04-21 14:40:57 +03:00
Lukáš Vlček
add6db352d
Added test for the highlighting using the source field. (This test probably dropped out in one of previous commits)
2011-04-21 11:55:35 +02:00
kimchy
568dec6b5a
Simplify Filter Cache Eviction Settings, closes #871 .
2011-04-21 02:05:05 +03:00
kimchy
90b88fe4b7
add TODO optimizations comments
2011-04-21 01:57:28 +03:00
kimchy
9c606c7b1d
better caching of LZF streamns
2011-04-20 13:37:30 +03:00
kimchy
f5dbcb2fa4
Failure to recover a shard might cause loosing translog data (especially with no replicas), closes #869 .
2011-04-20 04:52:47 +03:00
kimchy
3c233347b8
make sure we keep order in mappings when recovering so there won't be reparsing of the mappings on nodes (introduced with faster recovery work done on gateway)
2011-04-20 03:42:51 +03:00
kimchy
af39f07213
Mapping: By default, don't index _id, closes #868 .
2011-04-20 02:49:14 +03:00
kimchy
3b21759bec
Better support with _type is marked as not indexed, allowing to filter by type, closes #866 .
2011-04-20 01:31:38 +03:00
kimchy
c3f3c268c8
Query DSL: Add ids query and filter to fetch docs by ids (do not require _id field to be indexed), closes #865 .
2011-04-20 00:30:30 +03:00
Lukáš Vlček
be2a456cc0
improve test: check hits length and zero failures
2011-04-19 21:49:08 +02:00
kimchy
8e027b3baf
properly handle cases where filter returns null docIdSet with and/or/not filters
2011-04-19 21:28:08 +03:00
kimchy
5cc943c7db
remove some field caching logic, does not seem to do much perf wise, and simplifies back the code
2011-04-19 17:07:32 +03:00
kimchy
56c9783cb3
remove using field cache when indexing string fields for now
2011-04-19 16:16:31 +03:00
kimchy
f8ff42d397
log when failing to process doc after index operation
2011-04-19 16:13:26 +03:00
kimchy
79ebcc31c5
double check that there are mappings before trying to call the post process method
2011-04-19 16:10:51 +03:00
kimchy
32127c4d73
register the future with teh listener when deleting an index, so it can be canceled
2011-04-19 15:25:02 +03:00
kimchy
e40499f35f
small improvement to bulk indexing to not allocated ops if no percolation is done
2011-04-19 13:53:21 +03:00
kimchy
3b82b013d5
eagerly reroute shards when opening an index
2011-04-19 12:56:08 +03:00
kimchy
ffc8c3b68a
Weird error message on syntax error, closes #864 .
2011-04-19 12:23:29 +03:00
kimchy
d29754121c
don't log a versioning conflict failure, even in DEBUG level
2011-04-19 12:17:11 +03:00
kimchy
b94fab34eb
Mapping: Allow to set index to `no` for _id and _type, closes #863 .
2011-04-17 21:06:46 +03:00
kimchy
c4be4975d6
better message
2011-04-17 19:00:45 +03:00
kimchy
c2ee6dd120
improve gateway recovery and applying indices, also improve speed of index creation
2011-04-17 18:39:00 +03:00
kimchy
287dc862e0
more options on stress test
2011-04-17 10:14:49 +03:00
kimchy
166493f9d5
properly clean mapper data, and cache some mapping structures
2011-04-17 09:52:29 +03:00
kimchy
efb3e97ce4
don't return any id when doesn't exists
2011-04-17 06:21:39 +03:00
kimchy
fb35b1c993
clean guice caches after creating injectors so it will take less memory
2011-04-17 05:16:34 +03:00
kimchy
343c80b100
shard tokenizers, token filters, char filters across indices / shards
2011-04-17 03:55:33 +03:00
kimchy
067b8379d5
internal cluster name
2011-04-17 01:45:02 +03:00
kimchy
4907ce4fec
intern logger names
2011-04-17 01:20:24 +03:00
kimchy
c51b481cc9
revert back to guice 2
2011-04-17 00:58:00 +03:00
kimchy
73e7ea4663
allow to control index indexing concurrency (pretty much internal)
2011-04-16 22:55:12 +03:00
kimchy
e8306ac2c8
improve local gateway allocation by caching the started shards when possible and not asking the nodes for it
2011-04-16 22:33:45 +03:00
kimchy
658594fa70
improve gateway initial recovery time by creating the indices, and only after all have been created, do the rerouting
2011-04-16 18:23:48 +03:00
kimchy
763f986a30
Versioning: Better handling of deletes - time based eviction, closes #862 .
2011-04-16 17:26:31 +03:00
kimchy
4eddaec8ba
change defaults in stress test
2011-04-16 16:57:17 +03:00
kimchy
a1796c3408
add an estimated time thread and use it where we don't need exact time
2011-04-16 16:57:02 +03:00
kimchy
2cc4a286f8
small refactor
2011-04-16 03:23:47 +03:00
kimchy
8fa8a72175
add refresh before verifying in the test
2011-04-16 03:20:52 +03:00
kimchy
9927fd4cdd
fix none bloom cache to proper name
2011-04-16 03:15:43 +03:00
kimchy
5ab0ec4911
add a concurrent indexing stress test
2011-04-16 03:15:13 +03:00
kimchy
9c85500246
change additionalSettings to use Settings
2011-04-16 01:20:27 +03:00
Igor Motov
785fb11f2a
Allow plugins to provide additional settings.
2011-04-16 01:17:23 +03:00
kimchy
bba7179eeb
automatically clean indices that no longer exists in the metadata, this can happen if we delete a closed index, or when a node joins a cluster, that no longer has those indices
2011-04-14 21:15:55 +03:00
kimchy
897587f981
Allow to delete a closed index, closes #859 .
2011-04-14 20:51:20 +03:00
kimchy
7c38f20056
Query DSL: Geo Distance Range filter, closes #856 .
2011-04-14 20:20:18 +03:00
kimchy
7874291c0e
fix wrong initialization of mem evictions counter
2011-04-14 19:13:14 +03:00
kimchy
1e84c439e5
Shard Allocation: Closed indices are not properly taken into account when rebalancing, closes #858 .
2011-04-14 15:00:54 +03:00
kimchy
7550fc570e
Query DSL: Allow to directly wrap a query with a constant_score query, closes #857 .
2011-04-14 14:19:24 +03:00
kimchy
e5c1ab0ca6
add another reroute method to do no assignment but still elect new primaries on failed nodes
2011-04-14 13:43:01 +03:00
kimchy
25eba4b60d
Unicast Discovery: Concurrently connect to nodes to improve cases where some listed nodes are not up, closes #855 .
2011-04-14 02:27:59 +03:00
kimchy
3b72d63035
EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854 .
2011-04-14 02:13:27 +03:00
kimchy
853ade7297
Upgrade to jackson 1.7.6 (fixes that long field name smile bug)
2011-04-14 01:36:19 +03:00
kimchy
65fde3e71e
only remove shards if they have been started on all other nodes
2011-04-14 01:12:37 +03:00
kimchy
22b5e7ded8
Local Gateway: Listed active shards on each node does apply index deletion, closes #853 .
2011-04-13 16:15:26 +03:00
kimchy
41af86dd7e
internal option ot pretty print state
2011-04-13 16:04:18 +03:00
kimchy
b80324db08
only serialize the cluster state ones when publishing it to multiple nodes
2011-04-13 15:36:28 +03:00
kimchy
e9bc7f7d95
River: Failure to reallocate river to another node on rivers node failure, closes #850 .
2011-04-12 21:52:02 +03:00
kimchy
e8503c1455
Better handling when a shard hits OOM, closes #848 .
2011-04-11 21:10:56 +03:00
kimchy
decb5fa898
Optimize API: Don't execute concurrent optimize operations (shard level) on the same node, closes #846 .
2011-04-10 23:12:00 +03:00
kimchy
7d8726a5e8
Better handling of shard failures, closes #845 .
2011-04-10 21:59:59 +03:00
kimchy
8eab5ec528
experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load)
2011-04-09 20:21:23 +03:00
kimchy
b658fba22e
allow to copy openbitset into a sliced one
2011-04-09 14:33:16 +03:00
kimchy
991683efa6
remove clearUnreferenced from caches, no longer need it
2011-04-09 14:20:18 +03:00
kimchy
49e2f55abd
actually register the eviction listener with soft / resident filter cache
2011-04-09 14:11:42 +03:00
kimchy
c934f04b0c
remove weak caching of filters and stick with only caching when needed / flagged / defaulted
2011-04-09 02:47:31 +03:00
kimchy
b71513a072
JMX: Don't use node id and name as part of the jmx registration, use static org.elasticsearch, closes #843 .
2011-04-08 18:49:40 +03:00
kimchy
388f4febba
add more terms stats bench
2011-04-07 20:41:20 +03:00
kimchy
93372868a2
fix error when trying to delete all indices and none exists
2011-04-07 20:08:53 +03:00
kimchy
ca01dc7a09
Network Settings: Allow to explicitly set ipv4 and ipv4 when using _networkInterface_ notation, closes #841 .
2011-04-07 20:01:52 +03:00
kimchy
1fdef91fc2
Allow to search across indices and types even if some types do not exists on some indices, closes #839 .
2011-04-07 16:00:18 +03:00
kimchy
4603d10501
faster handling of a case where each doc has multi valued values for different facets, also, don't take into account missing value values (and in the future, we can also count those per bucket if needed)
2011-04-07 15:04:54 +03:00
kimchy
b479bc58f9
faster handling of a case where each doc has multi valued values fields in histogram facet
2011-04-07 14:52:25 +03:00
kimchy
7fcf82af80
faster handling of a case where each doc has multi valued values fields in terms stats
2011-04-07 14:44:34 +03:00
kimchy
16a046f686
rename termsstats java facet builder to termsStatsFacet
2011-04-07 14:30:12 +03:00
kimchy
7decb701d9
nicer bench of terms facet
2011-04-07 14:16:21 +03:00
kimchy
7231e08f7c
also test terms facet with execution hint of map
2011-04-07 13:32:35 +03:00
kimchy
c0879c2055
add bench on nano time
2011-04-06 22:50:36 +03:00
kimchy
08f594c3a0
Get Mapping API: when asking for a mapping of a single index and single type, don't wrap the mapping with the index name, closes #838 .
2011-04-06 22:12:34 +03:00
kimchy
8c50a65699
Percolator doesn't work correctly after index recreation, closes #837 .
2011-04-06 21:00:49 +03:00
kimchy
6317483fe3
add total count to terms stats and compute mean properly, also better use caching
2011-04-06 15:50:09 +03:00
kimchy
35be46df71
Bug: Sort on a column of type 'short' throws an exception, closes #835 .
2011-04-06 02:25:56 +03:00
kimchy
4721f9aa69
fix cache recycling logic to make sure we don't override our own data in facets
2011-04-05 23:25:39 +03:00
kimchy
f0de086479
for some reason the copyright header got reformatted
2011-04-05 15:42:12 +03:00
kimchy
6f827731d6
normalize to/from properly in bounded histogram
2011-04-05 15:10:55 +03:00
kimchy
1428abf2b7
Upgrade to jackson 1.7.5
2011-04-05 14:15:48 +03:00
kimchy
9b8eceb229
Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834 .
2011-04-05 13:53:19 +03:00
kimchy
14def814fa
fix typo
2011-04-05 12:07:46 +03:00
kimchy
d845a306fa
fill sentinal proeprly when its not in cache
2011-04-05 03:09:33 +03:00
kimchy
a89aeb3a6d
add JVM mem to node info API
2011-04-05 01:46:09 +03:00
kimchy
83b728a384
rename some histogram collectors
2011-04-05 01:32:36 +03:00
kimchy
cea8c5fefa
Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833 .
2011-04-05 00:52:58 +03:00
kimchy
79939222e4
Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832 .
2011-04-05 00:42:46 +03:00
kimchy
90a339ad5e
Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831 .
2011-04-05 00:17:07 +03:00
kimchy
8d1e9dbd3c
Histogram Facet: Add min/max stats when providing value field / script, closes #830 .
2011-04-04 23:48:54 +03:00
kimchy
46088b9f8a
Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829 .
2011-04-04 21:30:46 +03:00
kimchy
58c606d6d9
break field data value iterator into two callback types, one with support for missing, and one without
2011-04-04 19:53:09 +03:00
kimchy
c9838d5c75
use cache recycler for count histo and data histo facets
2011-04-04 19:44:46 +03:00
kimchy
105d60ac9c
Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824 .
2011-04-04 17:44:38 +03:00
kimchy
5d6e84f206
Upgrade Lucene 3.1: Analyzers, closes #826 .
2011-04-04 14:36:13 +03:00
kimchy
4e4495ff1d
Upgrade to Lucene 3.1, closes #825 .
2011-04-04 12:54:15 +03:00
kimchy
db1dcaded3
Concurrent calls to refresh might result in "dangling" searchers, closes #823 .
2011-04-01 22:43:48 +03:00
kimchy
1280512097
also support regex pattern matching with ordinals
2011-04-01 16:54:37 +03:00
kimchy
e4cbdfa05b
Terms Facet: Performance improvements, closes #822 .
2011-04-01 16:30:45 +03:00
kimchy
fb8a389380
more bench work
2011-03-31 18:25:23 +02:00
kimchy
44d4474f95
anoter small bench
2011-03-31 17:48:57 +02:00
kimchy
a0cddf0745
small improvement to stats facet computing min/max
2011-03-31 17:41:21 +02:00
kimchy
3ff35d42b5
Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821 .
2011-03-31 17:03:37 +02:00
kimchy
09d3b882f0
more small bench
2011-03-31 02:30:17 +02:00
kimchy
74838fe1aa
Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820 .
2011-03-31 01:09:03 +02:00
kimchy
14d98a7319
Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819 .
2011-03-31 01:04:09 +02:00
kimchy
f90b4e6fee
some more micro bench support
2011-03-30 23:32:33 +02:00
kimchy
ae0eed937b
update to the new lzf compression (0.7)
2011-03-30 20:43:20 +02:00
kimchy
2dd5094d37
Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817 .
2011-03-30 15:43:56 +02:00
kimchy
7ce7fb33e5
Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816 .
2011-03-30 15:40:11 +02:00
kimchy
8a5dd90885
HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815 .
2011-03-30 14:46:39 +02:00
kimchy
eafe686013
warm up with compression bench
2011-03-30 13:52:52 +02:00
kimchy
fdbccf28b0
Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814 .
2011-03-30 12:56:53 +02:00
kimchy
9bb0bcf4e3
add logging when trying to obtain node lock
2011-03-29 21:34:15 +02:00
kimchy
0069d5a75d
add adler to checksum, faster and is good enough with length check for our use case
2011-03-29 21:27:18 +02:00
kimchy
a1be2bbf20
add adler to checksum tests
2011-03-29 18:17:09 +02:00
kimchy
3138269573
Indices Status API: Add refresh stats, closes #811 .
2011-03-29 17:54:00 +02:00
kimchy
2a032f8718
add remote many indices creation test
2011-03-29 17:17:54 +02:00
kimchy
0e6bbf3f85
call shard refresh API and not directly the engine one
2011-03-29 17:17:39 +02:00
kimchy
ff8dc2673f
Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810 .
2011-03-29 13:50:25 +02:00
kimchy
508d1d40fb
Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809 .
2011-03-29 13:05:36 +02:00
kimchy
95e36a073a
move index/delete refresh to happen outside of the engine
2011-03-29 01:28:37 +02:00
kimchy
53935f078a
optimize array list creation with exact size
2011-03-28 21:50:39 +02:00
kimchy
49f79f54d2
log when search failure happen when scanning
2011-03-28 18:17:36 +02:00
kimchy
f00664621f
more scan tests to try and recreate the context missing failure, no luck yet...
2011-03-28 17:21:59 +02:00
kimchy
e0d8094f3d
clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block
2011-03-28 17:20:07 +02:00
kimchy
953a99c75c
fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered
2011-03-28 16:08:01 +02:00
kimchy
64a89eb0e4
add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers
2011-03-28 14:21:49 +02:00
kimchy
af419cc636
upgrade to guice 3.0
2011-03-27 19:31:51 +02:00
kimchy
b28461dd0e
compress cluster state when publishing it
2011-03-24 01:12:36 +02:00
kimchy
992becf013
add value_script as an option to terms stats
2011-03-24 01:03:17 +02:00
kimchy
f20c6ec9cf
check if index service is null, and don't load percolators in this case
2011-03-24 00:40:21 +02:00
kimchy
36edcef640
compress metadata stored in gateway
2011-03-24 00:38:16 +02:00
kimchy
4f27fa3f45
add the version to the jvm info, and, warn if running using the client vm
2011-03-23 18:06:29 +02:00
kimchy
20593fb966
Mapping: Add _size field mapping, indexing the original source size, closes #804 .
2011-03-23 17:37:40 +02:00
kimchy
b2d7cd78b7
don't clean up indices if there is a block disabling persistence
2011-03-22 18:41:29 +02:00
kimchy
8c9000c54c
Extend stats API to include filter's cache count and eviction count, closes #802 .
2011-03-22 13:30:14 +02:00
kimchy
e759b4c971
Add option to expire filter's cache based on access time, closes #803 .
2011-03-22 13:14:31 +02:00
kimchy
0d150e6918
Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801 .
2011-03-22 01:29:41 +02:00
kimchy
9f44c93a25
make sure to log failures in search when reducing results
2011-03-22 01:05:54 +02:00
kimchy
61034f5c86
Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800 .
2011-03-21 18:10:13 +02:00
kimchy
8f8fb89c4e
Update Settings: Allow to control `index.auto_expand_replicas`, closes #799 .
2011-03-21 16:18:03 +02:00
kimchy
2f1aba962c
add the exception as well to the logging
2011-03-21 14:36:56 +02:00
kimchy
6c241f3de8
protected against a wrong format in the index.auto_expand_replicas setting
2011-03-21 14:36:28 +02:00
kimchy
d2e61af9ee
maintain total hits across scan scroll requests
2011-03-20 00:19:26 +02:00
kimchy
52c750fc42
internal support for custom attributes in scroll id
2011-03-19 21:51:18 +02:00
kimchy
f3160b71bb
can't check on token value, since it might be valid, so, handle the null token case better
2011-03-19 21:34:31 +02:00
kimchy
c19a93da89
countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index
2011-03-19 21:28:17 +02:00
kimchy
fb7fbc8c83
NPE when the JSON to index doesn't match the mapping's expectations, closes #795 .
2011-03-19 20:42:50 +02:00
kimchy
70fc8d9af0
Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793 .
2011-03-19 00:24:20 +02:00
kimchy
bd3f490d60
Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791 .
2011-03-18 20:44:59 +02:00
kimchy
09fbc919b8
"exclude" functionality missing for terms facet on numeric fields, closes #789 .
2011-03-18 11:08:11 +02:00
kimchy
923fcf239c
Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790 .
2011-03-18 10:49:28 +02:00
kimchy
616b3dcb18
shard the default analyzer (standard) on the node level
2011-03-18 01:35:29 +02:00
kimchy
25124b084b
Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787 .
2011-03-17 22:01:22 +02:00
kimchy
96d06d6dc8
Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781 .
2011-03-15 21:22:46 +02:00
kimchy
0291ab1d8d
sync version when getting the state from master
2011-03-15 14:15:16 +02:00
kimchy
1bcd3b67ee
Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769 .
2011-03-14 11:30:01 +02:00
kimchy
3192654e80
add iterator based on specific index
2011-03-13 19:51:21 +02:00
kimchy
96dfdcf97c
Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778 .
2011-03-13 11:43:30 +02:00
kimchy
700a2a9577
Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772 .
2011-03-13 02:29:05 +02:00
kimchy
7c04ef6cbc
use byte value
2011-03-13 00:51:12 +02:00
kimchy
09006f17c3
Support true|false for the 'store' parameter in mappings, closes #775 .
2011-03-13 00:41:58 +02:00
kimchy
6d108e77f1
handle whitespace text on search fields query string parameter to be treated as no fields
2011-03-13 00:37:25 +02:00
kimchy
aff8a4407f
better exception message
2011-03-13 00:31:21 +02:00
kimchy
bdb0fd23e9
Versioning: Add a new version_type parameter, with a new type - `external`, closes #776 .
2011-03-12 20:41:55 +02:00
kimchy
7bab5270fc
add a comment on max shard buffer size
2011-03-12 17:17:02 +02:00
kimchy
73dec5d63f
Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773 .
2011-03-12 17:03:04 +02:00
kimchy
19052a3538
Add another flag to gateway if it even requires snapshot, so we don't try and snapshot on shutdown for none/local gateway (even though its a no op)
2011-03-11 15:20:16 +02:00
kimchy
3e624bf9e0
better failure when trying to obtain a native lock on the node data location, and reduce the tries from 100 to 50.
2011-03-11 15:05:22 +02:00
kimchy
e1c86b86e5
add simplified ways to create XContentBuilder that will output to OutputStream using XContentFactory
2011-03-10 16:00:19 +02:00
kimchy
0df3dfd72b
add the ability to set source and extra source on the SearchRequestBuilder
2011-03-09 21:55:46 +02:00
kimchy
80a797fc4f
Update Settings: Allow to dynamically update `index.translog` settings, closes #765 .
2011-03-09 14:17:34 +02:00
kimchy
c2a0e0b767
Mapper: Using `dynamic_template` can result in warning of parsed and original source difference (resulting in excessive mapping parsing), closes #764 .
2011-03-09 11:36:51 +02:00
kimchy
f694b9dfd8
Percolator: Failures when using docs where fields repeat, such as arrays, closes #763 .
2011-03-09 11:31:05 +02:00
kimchy
ad0d681b6d
Update Settings: Allow to dynamically change `index.term_index_interval` and `index.term_index_divisor, closes #762 .
2011-03-09 07:36:18 +02:00
kimchy
353d2cb21f
Mvel Script: add more random options, and optimize random, closes #759 .
2011-03-08 22:24:22 +02:00
kimchy
016e5bce04
Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758 .
2011-03-08 21:53:33 +02:00
kimchy
77cf3e1924
small refactor in index settings, allowing for future dynamic changes to it
2011-03-08 11:12:40 +02:00
kimchy
e709a0bde4
Logging: Add merge level logging, closes #755 .
2011-03-08 08:20:48 +02:00
kimchy
9e2143f343
add a warning for types not to include dots (can't really throw a failure because of it since it will break backward)
2011-03-07 19:17:39 +02:00
kimchy
4bdae621f9
Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752 .
2011-03-07 13:09:07 +02:00
kimchy
1242cf59f6
upgrade to guice 3 rc3
2011-03-07 06:52:55 +02:00
kimchy
cb912de255
ignore engine closed exception as well
2011-03-05 10:46:00 +02:00
kimchy
f0825414d3
upgrade to jackson 1.7.4
2011-03-05 10:45:20 +02:00
kimchy
bc882182ab
change scripts to start the ElasticSearch main class (a wrapper around Bootstrap) just so the process name will look nicely on jps
2011-03-04 20:14:22 +02:00
kimchy
c097735196
improve async merge process, don't spawn a thread unless a merge is really needed, and add an optimized "maybeMerge" operation
2011-03-04 20:05:52 +02:00
kimchy
20ed540fe7
don't block node master node startup if recover_after_time is set and nodes settings are not met (we already handle it with the not recovered state)
2011-03-04 05:11:28 +02:00
kimchy
4b92928c77
Internal: Improve checksum process by bulk writing them into a single file instead of checksum file per index file, closes #747 .
2011-03-04 04:22:47 +02:00
kimchy
b629d36d8b
add a merge thread pool that only does async merges (optimize), so it can be controlled by itself
2011-03-04 01:04:59 +02:00
kimchy
06ad13f373
no need to call maybe merge as part of flush, we do it async anyhow
2011-03-04 00:56:34 +02:00
kimchy
607ada75a6
optimize the index status response
2011-03-04 00:55:39 +02:00
kimchy
41ddcdca93
Node Stats API: Change the structure of the response (more structured), closes #746 .
2011-03-04 00:26:47 +02:00
kimchy
f901429aaa
Node Stats API: Change the structure of the response (more structured), closes #746 .
2011-03-04 00:20:05 +02:00
kimchy
682ad7e2fc
Indices Status / Node Stats: Add (Lucene) index merge stats, closes #745 .
2011-03-03 23:53:28 +02:00
kimchy
2909060af8
Query DSL: flt_field does not allow to set min_similarity and prefix_length, closes #744 .
2011-03-03 04:17:02 +02:00
kimchy
78c6f951a3
All Field: All field cane fail to analyze input data (rare cases), closes #743 .
2011-03-03 02:59:27 +02:00
kimchy
68c1dd771c
upgrade to mvel 2.1 beta2
2011-03-02 22:37:36 +02:00
kimchy
4631df9d01
Delete API: Allow to set _parent on it (will simply set the routing value), closes #742 .
2011-03-02 22:14:49 +02:00
kimchy
655cbb9440
improve failure when disabling dynamic creating of types, and trying to index into a non existing type
2011-03-02 20:42:43 +02:00
kimchy
faefc772a4
Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736 .
2011-03-02 05:11:02 +02:00
kimchy
bb1668c2b7
count date histo using the wrong counts aggregator to return results when using time based setting interval
2011-03-02 03:13:25 +02:00
kimchy
3361a9365b
since we now take all#enabled into account when checking for include_in_all, there is no need to set it on every mapper
2011-03-02 03:01:01 +02:00
kimchy
185cd68045
really fix time format interval for date_histogram now
2011-03-02 00:39:18 +02:00
kimchy
1d240aaff6
prefix inside a dis_max / bool query broken, closes #732 .
2011-03-02 00:36:30 +02:00
kimchy
ce862da8f4
add tests for boosted wildcard and prefix queries
2011-03-02 00:26:49 +02:00
kimchy
9560451896
optimize query facet to extract filter from constant_score queries automatically
2011-03-02 00:18:26 +02:00
kimchy
60b423b741
Don't "double" cache a facet filter / query facet, closes #734 .
2011-03-01 22:14:36 +02:00
kimchy
0e30ad90f5
support 'w' as suffix for time format
2011-03-01 20:16:18 +02:00
kimchy
0183516221
better failure message
2011-03-01 05:34:21 +02:00
kimchy
e639ffbc93
Search: Allow to use has_child filter in facets, closes #730 .
2011-03-01 04:45:25 +02:00
kimchy
6097365738
eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729 .
2011-03-01 00:49:41 +02:00
kimchy
9d81d01c93
only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging)
2011-03-01 00:26:03 +02:00
kimchy
0662f65fda
log warning when failing to list started shards on other nodes when doing local gateway allocation
2011-03-01 00:25:03 +02:00
kimchy
906ec57f20
Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728 .
2011-02-28 22:43:48 +02:00
kimchy
3bac33e69e
don't use AfterTest / BeforeTest in any tests
2011-02-28 22:28:55 +02:00
kimchy
24199a3394
add simple unicast disco test on hte node level
2011-02-28 21:43:31 +02:00
kimchy
47a6065805
Date Histogram Facet: NPE if using "1w" interval, closes #727 .
2011-02-28 20:31:02 +02:00
kimchy
d395c0a844
better failure message when failing to find a type mapping for a document loaded from the index
2011-02-28 20:21:47 +02:00
kimchy
3b967040da
Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725 .
2011-02-27 01:06:50 +02:00
kimchy
fdef88debb
Bulk API: Improve memory usage when executing large bulk requests, closes #724 .
2011-02-26 23:46:22 +02:00
kimchy
3cda177b9b
Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723 .
2011-02-26 22:25:26 +02:00
kimchy
4634ca5cb8
Mapping: When _all is disabled, optimize to not gather all entries, closes #722 .
2011-02-26 04:16:03 +02:00
kimchy
608c5a838d
Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721 .
2011-02-25 03:54:18 +02:00
kimchy
ecc1a3cd8c
Acknowledge problem for put mapping with multiple indices or all indices, closes #720 .
2011-02-24 21:17:24 +02:00
kimchy
4def1f4b8e
upgrade to google guava r08
2011-02-24 08:49:38 +02:00
kimchy
8a03ca1114
Search: Allow to filter out docs based on a minimum score, closes #719 .
2011-02-24 06:55:16 +02:00
kimchy
a0fd47159e
improve internal scan handling, by using count type for the first scan
2011-02-24 01:04:49 +02:00
kimchy
ee9beda398
Search: Add search_type for `count` to return count but still support facets, closes #718 .
2011-02-24 00:29:42 +02:00
kimchy
f7100c0698
Improve from hits pagination (duplicates), closes #717 .
2011-02-23 22:57:44 +02:00
kimchy
6b7192e744
add from/to test without sorting on single shard
2011-02-23 21:41:31 +02:00
kimchy
5082ad6d11
Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716 .
2011-02-23 21:17:09 +02:00
kimchy
8371920a89
add min/max to terms stats facet
2011-02-23 20:36:12 +02:00
kimchy
be1b46061e
add filter and scope parameters when creating terms stats facet
2011-02-23 19:37:20 +02:00
kimchy
8617e3b0e3
enhance memory usage when doing reduce on histogram facets
2011-02-23 05:55:23 +02:00
kimchy
9cccfc3bd3
improve terms stats facet internal data structure and sorting
2011-02-23 05:04:45 +02:00
kimchy
2845cbefaa
move to mvel 2.1.beta1 (versioning changed from 2.1.rc1)
2011-02-23 02:32:56 +02:00
kimchy
1a48007174
Single node cluster comes up as red with local gateway, closes #714 .
2011-02-23 01:21:17 +02:00
kimchy
58dbf6d5ca
fix terms facet TOTAL comparator to also do secondary sort when totals are equal
2011-02-23 00:55:40 +02:00
kimchy
c6f58321e4
Node Stats: Add number of docs per node, closes #713 .
2011-02-22 22:27:12 +02:00
kimchy
45ec2c6e21
Allow to register custom rivers under a custom type name (And not full class names), closes #712 .
2011-02-22 22:13:31 +02:00
kimchy
06850f8673
add another test to scan
2011-02-22 21:01:11 +02:00
kimchy
7dda421cfa
River not recovered when using single node after shutdown, closes #711 .
2011-02-22 20:38:52 +02:00
kimchy
953fcbc58c
Get API: Allow to provide a script as a field, closes #708 .
2011-02-22 02:28:19 +02:00
kimchy
818f3b4d75
Search: Add search type `scan` allowing to efficiently scan large result set, closes #707 .
2011-02-22 00:11:31 +02:00
kimchy
65ca857027
Add `http` and `transport` simplified host settings, closes #706 .
2011-02-21 19:51:18 +02:00
kimchy
be372bee7d
ignore a case where we can't find an index trying to apply shards, it gets deleted on us
2011-02-20 02:04:44 +02:00
Benoit Sigoure
fcdd103345
Simplify some error-handling logic a bit.
2011-02-20 00:45:25 +02:00
kimchy
d76f12a9f3
return 0 as prefix / suffix content length for utf8 response
2011-02-20 00:18:48 +02:00
kimchy
352cb74f96
Search: Terms Stats Facet, closes #705 .
2011-02-19 23:37:04 +02:00
kimchy
745614f53d
notify listener on failure
2011-02-19 23:19:02 +02:00
kimchy
d3ba8bd487
use parsing field to check for order
2011-02-19 01:41:48 +02:00
kimchy
d7a02fb28f
Handle cluster join request on a non IO thread, closes #702 .
2011-02-18 23:46:15 +02:00
kimchy
9ac048c68c
add "same" thread pool type (really, just for testing)
2011-02-18 07:59:14 +02:00
kimchy
585c310aa4
add edge histogram test
2011-02-18 07:35:33 +02:00
kimchy
d8bec39b73
more support for wares
2011-02-18 05:03:46 +02:00
kimchy
8d867dc24c
explicitly set the cat under which jdk logging is logged
2011-02-18 05:00:08 +02:00
kimchy
60578aef4d
add name as another setting to set on snowball, not just language
2011-02-17 22:22:34 +02:00
kimchy
c67912e259
reset stream when getting all stream so it can be reused
2011-02-17 19:25:23 +02:00
kimchy
9ca8165f3b
Cluster Shutdown API: On full/_all shutdown, shutdown only data/master nodes, not client nodes, closes #697 .
2011-02-17 03:33:34 +02:00
kimchy
245d241a5c
handle any exception on first phase
2011-02-17 02:06:59 +02:00