60b423b741
Don't "double" cache a facet filter / query facet, closes #734 .
2011-03-01 22:14:36 +02:00
0e30ad90f5
support 'w' as suffix for time format
2011-03-01 20:16:18 +02:00
0183516221
better failure message
2011-03-01 05:34:21 +02:00
e639ffbc93
Search: Allow to use has_child filter in facets, closes #730 .
2011-03-01 04:45:25 +02:00
6097365738
eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729 .
2011-03-01 00:49:41 +02:00
9d81d01c93
only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging)
2011-03-01 00:26:03 +02:00
0662f65fda
log warning when failing to list started shards on other nodes when doing local gateway allocation
2011-03-01 00:25:03 +02:00
906ec57f20
Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728 .
2011-02-28 22:43:48 +02:00
3bac33e69e
don't use AfterTest / BeforeTest in any tests
2011-02-28 22:28:55 +02:00
24199a3394
add simple unicast disco test on hte node level
2011-02-28 21:43:31 +02:00
47a6065805
Date Histogram Facet: NPE if using "1w" interval, closes #727 .
2011-02-28 20:31:02 +02:00
d395c0a844
better failure message when failing to find a type mapping for a document loaded from the index
2011-02-28 20:21:47 +02:00
3b967040da
Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725 .
2011-02-27 01:06:50 +02:00
fdef88debb
Bulk API: Improve memory usage when executing large bulk requests, closes #724 .
2011-02-26 23:46:22 +02:00
3cda177b9b
Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723 .
2011-02-26 22:25:26 +02:00
4634ca5cb8
Mapping: When _all is disabled, optimize to not gather all entries, closes #722 .
2011-02-26 04:16:03 +02:00
608c5a838d
Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721 .
2011-02-25 03:54:18 +02:00
ecc1a3cd8c
Acknowledge problem for put mapping with multiple indices or all indices, closes #720 .
2011-02-24 21:17:24 +02:00
4def1f4b8e
upgrade to google guava r08
2011-02-24 08:49:38 +02:00
8a03ca1114
Search: Allow to filter out docs based on a minimum score, closes #719 .
2011-02-24 06:55:16 +02:00
a0fd47159e
improve internal scan handling, by using count type for the first scan
2011-02-24 01:04:49 +02:00
ee9beda398
Search: Add search_type for `count` to return count but still support facets, closes #718 .
2011-02-24 00:29:42 +02:00
f7100c0698
Improve from hits pagination (duplicates), closes #717 .
2011-02-23 22:57:44 +02:00
6b7192e744
add from/to test without sorting on single shard
2011-02-23 21:41:31 +02:00
5082ad6d11
Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716 .
2011-02-23 21:17:09 +02:00
8371920a89
add min/max to terms stats facet
2011-02-23 20:36:12 +02:00
be1b46061e
add filter and scope parameters when creating terms stats facet
2011-02-23 19:37:20 +02:00
8617e3b0e3
enhance memory usage when doing reduce on histogram facets
2011-02-23 05:55:23 +02:00
9cccfc3bd3
improve terms stats facet internal data structure and sorting
2011-02-23 05:04:45 +02:00
2845cbefaa
move to mvel 2.1.beta1 (versioning changed from 2.1.rc1)
2011-02-23 02:32:56 +02:00
1a48007174
Single node cluster comes up as red with local gateway, closes #714 .
2011-02-23 01:21:17 +02:00
58dbf6d5ca
fix terms facet TOTAL comparator to also do secondary sort when totals are equal
2011-02-23 00:55:40 +02:00
c6f58321e4
Node Stats: Add number of docs per node, closes #713 .
2011-02-22 22:27:12 +02:00
45ec2c6e21
Allow to register custom rivers under a custom type name (And not full class names), closes #712 .
2011-02-22 22:13:31 +02:00
06850f8673
add another test to scan
2011-02-22 21:01:11 +02:00
7dda421cfa
River not recovered when using single node after shutdown, closes #711 .
2011-02-22 20:38:52 +02:00
953fcbc58c
Get API: Allow to provide a script as a field, closes #708 .
2011-02-22 02:28:19 +02:00
818f3b4d75
Search: Add search type `scan` allowing to efficiently scan large result set, closes #707 .
2011-02-22 00:11:31 +02:00
65ca857027
Add `http` and `transport` simplified host settings, closes #706 .
2011-02-21 19:51:18 +02:00
be372bee7d
ignore a case where we can't find an index trying to apply shards, it gets deleted on us
2011-02-20 02:04:44 +02:00
fcdd103345
Simplify some error-handling logic a bit.
2011-02-20 00:45:25 +02:00
d76f12a9f3
return 0 as prefix / suffix content length for utf8 response
2011-02-20 00:18:48 +02:00
352cb74f96
Search: Terms Stats Facet, closes #705 .
2011-02-19 23:37:04 +02:00
745614f53d
notify listener on failure
2011-02-19 23:19:02 +02:00
d3ba8bd487
use parsing field to check for order
2011-02-19 01:41:48 +02:00
d7a02fb28f
Handle cluster join request on a non IO thread, closes #702 .
2011-02-18 23:46:15 +02:00
9ac048c68c
add "same" thread pool type (really, just for testing)
2011-02-18 07:59:14 +02:00
585c310aa4
add edge histogram test
2011-02-18 07:35:33 +02:00
d8bec39b73
more support for wares
2011-02-18 05:03:46 +02:00
8d867dc24c
explicitly set the cat under which jdk logging is logged
2011-02-18 05:00:08 +02:00
60578aef4d
add name as another setting to set on snowball, not just language
2011-02-17 22:22:34 +02:00
c67912e259
reset stream when getting all stream so it can be reused
2011-02-17 19:25:23 +02:00
9ca8165f3b
Cluster Shutdown API: On full/_all shutdown, shutdown only data/master nodes, not client nodes, closes #697 .
2011-02-17 03:33:34 +02:00
245d241a5c
handle any exception on first phase
2011-02-17 02:06:59 +02:00
09d650fae7
Index Status: Peer recovery does not compute the index size correctly to report the full size, closes #695 .
2011-02-17 01:43:56 +02:00
fb90392040
add status based test
2011-02-17 01:28:54 +02:00
6ffd60dfb5
change var name to better reflect the fact that its data and not work
2011-02-17 01:07:05 +02:00
3c9dafe67b
better reason for disco state change
2011-02-16 23:30:40 +02:00
bc504d6c08
add simple netty benchmark
2011-02-16 08:17:31 +02:00
2f5dd85bd5
change handlers from CHM to volatile Immutable Map
2011-02-16 05:24:29 +02:00
3679efa840
default management TP to max at 20
2011-02-16 02:44:48 +02:00
087f5d6bea
fix scheduling to actually schedule the correct runnable
2011-02-16 02:44:24 +02:00
d1d3f8c4ca
REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690 .
2011-02-16 01:41:01 +02:00
12a33e6a91
Add new Access-Control-Allow-Headers value into http response header, closes #688
2011-02-15 23:53:53 +02:00
442ce9daaa
ignore closed exception when async loading bloom filters
2011-02-15 23:23:49 +02:00
f14305e95c
upgrade to jackson 1.7.3
2011-02-15 20:57:13 +02:00
36efde8c1d
simplify threaded listener invocation by wrapping the listener with a threaded listener and not check in each action for it
2011-02-15 07:52:24 +02:00
3ed848a495
ThreadPool: Refactor into several pools, with configurable types per pool, closes #687 .
2011-02-15 07:00:24 +02:00
1b5cdb181a
Query: boosting query, closes #683 .
2011-02-11 19:59:15 +02:00
65197ba39d
don't return null highlighted fields if no highlighting was done
2011-02-11 18:31:09 +02:00
d054c8c14e
use cached thread pool to do cluster state gateway snapshotting
2011-02-11 03:14:13 +02:00
e63e5f232c
only actually fork to another thread if a flush is really needed
2011-02-11 02:35:02 +02:00
fc88cccfb4
only fork a refresh if it actually needs to be refreshed
2011-02-11 02:27:29 +02:00
7c4d574a32
only call refresh if its needed, so we check outside of the readLock when async refreshing
2011-02-11 01:53:48 +02:00
df4f4f056a
protected against a possible null for lastGC in the previous collection
2011-02-11 01:48:23 +02:00
260aab21fd
filtered collector should set the next reader on the wrapped collector
2011-02-11 00:34:20 +02:00
44b06bee3b
open indexing searcher lazily when indexing, and not when flushing
2011-02-10 20:31:01 +02:00
7bbf69b194
Added support to define rest actions in plugins
2011-02-10 19:00:17 +02:00
35c339f5f3
Removed empty fragments in highlight results
2011-02-10 19:00:17 +02:00
5ea58a3387
Don't fail search if highlight field is missing for a specific type. Close #682
2011-02-10 19:00:17 +02:00
a3af51a1d9
add fixed thread pool module so one can create it
2011-02-10 17:42:34 +02:00
2e12e5b279
make optimize default parameters constants
2011-02-10 16:48:05 +02:00
9ae9ab9553
add flush to search 1 stress test
2011-02-10 16:47:43 +02:00
57108c8575
REST API: Failure to index docs that have their ids URL encoded and contain `/`, closes #681 .
2011-02-10 03:18:01 +02:00
89ac4d108a
make forkjoin an option in fixed thread pool
2011-02-10 00:05:08 +02:00
30510a8320
add forkjoin TP
2011-02-09 23:47:38 +02:00
5e96d3d93d
add fixed thread pool (mainly for internal testing for now)
2011-02-09 23:47:13 +02:00
5047f4aa6f
fix wrong parsing of of version / explain causing NPE on search
2011-02-09 22:56:52 +02:00
2b8a6742dd
move transport benchmark to the micro bench
2011-02-09 22:50:44 +02:00
b26d86293f
terms facet on an IP field returns terms as numbers, not IPs, closes #678 .
2011-02-09 21:37:42 +02:00
d35f397608
remove timer service
2011-02-09 19:01:05 +02:00
9f2afeb4ca
move to use scheduled TP and not timer service
2011-02-09 17:21:16 +02:00
27d6c71d5b
move to use scheduled TP and not timer service
2011-02-09 16:47:04 +02:00
ccb30d42e9
move to use a single thread for the scheduled tasks, forking where need to another TP
2011-02-09 16:25:09 +02:00
f6dced3750
upgrade to netty 3.2.4
2011-02-09 02:07:02 +02:00
d442f33d0b
more api cleaning
2011-02-09 00:37:27 +02:00
f7aee2a423
clean thread pool interface
2011-02-09 00:30:21 +02:00
f09a66bf12
upgrade to latest jsr166y code
2011-02-09 00:26:09 +02:00
ff044c1882
Add safeJsonBuilder and safeSmileBuilder for cases where the builder needs to be used outside the scope of directly passing it to an API
2011-02-08 23:41:20 +02:00
9c011d5b79
improve get perf by using bloom filter to fetch the doc
2011-02-08 23:40:49 +02:00
7a8995e6a8
add max_size to bloom filter, defaults to 500m
2011-02-08 23:02:29 +02:00
1db2d993cb
have a 500 million docs cap on the creation of a bloom filter
2011-02-08 22:57:50 +02:00
4bcedde011
don't require to provide the type of the doc in the doc element in percolator request, also, change the REST endpoint for percolator to include the type, basically: {index}/{type}/_percolate
2011-02-08 22:24:44 +02:00
3062d5b86c
nice usage of versioning parse element
2011-02-08 17:50:28 +02:00
ac8646deb7
Search: By default, don't return the version per hit, unless `version` is set to `true`, closes #676 .
2011-02-08 17:48:13 +02:00
18ff92662e
bulk request does not refresh on shard replicas
2011-02-08 15:03:03 +02:00
4084db378d
more eager refresh logic, execute a refresh even if one is on going so no operations are missed
2011-02-08 12:52:45 +02:00
37b1415b57
Improve error when creating a percolator with no query, closes #669 .
2011-02-08 11:57:07 +02:00
da9f4992e0
flush with full=true is broken: this IndexWriter is closed, closes #670 .
2011-02-08 11:50:23 +02:00
059936fc84
make custom CMS static
2011-02-08 11:41:08 +02:00
43a95de9db
dynamic flag on object type should lower case itself when serialized back to its json representation
2011-02-08 11:38:02 +02:00
b8c644cab5
ip mapping no longer enabled
2011-02-08 11:24:14 +02:00
490ddc5d1d
ip mapping no longer enabled
2011-02-08 11:08:50 +02:00
f319625cb5
Adding Analysis.getWordList method which retrieves list of words from setting or file specified by setting.
2011-02-08 11:02:18 +02:00
c95544141b
Adding a decompounding token filter.
2011-02-08 11:02:18 +02:00
a663b7ced9
default snowball token filter to English (similar to the analyzer)
2011-02-08 01:38:09 +02:00
689b20a518
Mapping: Disable automatic ip type detection on new fields, closes #674 .
2011-02-08 01:14:34 +02:00
4319e3cb05
add a test to fetch just an array element (which has no mapping)
2011-02-07 20:24:15 +02:00
f0a8bf3783
remove monitoring dead locks
2011-02-06 23:37:38 +02:00
3dc3206e0f
don't use time estimator to wakeup a thread each time
2011-02-06 23:33:11 +02:00
02a2ebb84b
add geo_bbox as an alias to geo bounding box
2011-02-06 21:58:49 +02:00
151e24c5bd
upgrade to jackson 1.7.2
2011-02-03 23:36:55 +02:00
1f68d7eabf
when introducing a new type or new fields as part of an index request, wait (with a cap) until they are introduced on to the cluster before returning from the index request
2011-02-03 22:55:16 +02:00
28dbbaa3fa
allow to set an internal source builder on search request builder
2011-02-03 22:54:31 +02:00
00cba66eb8
move to use mvel 2.1.RC1
2011-02-03 11:29:24 +02:00
5fe2615ba7
Index Status: Add primary store size to include only primary shards store sizes, also move index store and translog into their own elements, closes #666 .
2011-02-03 00:50:24 +02:00
13869239b0
better help on -url for plugin command
2011-02-02 17:56:57 +02:00
904bee12bc
Search: Failure when sorting on `short` type, closes #665 .
2011-02-02 17:55:21 +02:00
95ea6153a7
no need for thread pool to notify listeners
2011-02-02 16:16:29 +02:00
da17be34c1
if no shards are allocated for a deleted index, then no need to wait for a response
2011-02-02 15:28:48 +02:00
4ed82023ce
another embedded test for query and fetch on a single shard
2011-02-02 14:04:24 +02:00
0bce34cb5a
optimize single shard search (or search result) by not doing another round of sorting
2011-02-02 13:52:34 +02:00
8c196d8b84
better logging, and disable strange failure in thread locals test when run with gradle (for now)
2011-02-02 12:15:18 +02:00
3f62b9ea96
check for trace logging
2011-02-02 11:25:13 +02:00
c86551d9b5
move master node tests to cluster package, and force it to use zen disco always
2011-02-02 11:15:12 +02:00
d2a3f5142f
improve the order of shutdown of top level components in node, close indices first and applying cluster changes, also, improve atomicity of closing of indices and shards
2011-02-01 23:10:15 +02:00
eb1db1140b
better to close the channels on another thread as well, just to be safe
2011-02-01 23:08:52 +02:00
8587f16119
make sure to call releaseExternalResources on another thread to make sure its not called from a netty IO handler
2011-02-01 22:16:09 +02:00
237e936884
if action is performing the operation, return true to indicate it
2011-02-01 17:00:59 +02:00
8927e1dee4
Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663 .
2011-02-01 13:41:58 +02:00
cc6f65f8b8
Search: When sorting, allow to pass `track_scores` and set it to `true` to get scores/max_score back, closes #662 .
2011-02-01 12:38:46 +02:00
5da14a7ed1
Geo: All geo components that accept an array of [lat, lon] to change to do [lon, lat] to conform with GeoJSON, closes #661 .
2011-02-01 01:39:01 +02:00
f8b5628db9
have rolling restart stress test create incremental ids
2011-01-31 21:41:46 +02:00
c7add5f377
upgrade to mvel 2.1 snapshot to gain performance improvements
2011-01-31 21:41:23 +02:00
54c770bcc9
improve hash wheel timer
2011-01-31 16:26:17 +02:00
cebdae5707
refactor script execution handling to improve performance, also introduce specific search script executor
2011-01-31 16:08:06 +02:00
5d39cc93dd
refresh for test
2011-01-31 15:51:39 +02:00
04c2a2a543
move ngram to the default processor
2011-01-31 11:52:02 +02:00
e85f9c276f
only allow _score to be used, and remove score from custom_score scripts
2011-01-31 02:19:41 +02:00
bdb87c7a62
refactor a bit search script execution
2011-01-31 01:29:30 +02:00
919143f6b6
don't break if no document mapper exists
2011-01-31 00:00:24 +02:00
e516051ea5
Search: When fetching _parent, only the _id should be returned, and not type#id, closes #658 .
2011-01-30 21:16:45 +02:00
8b9ec890c3
Thread Pool: Increase the keep alive time of threads from 60 seconds to 60 minutes, closes #657 .
2011-01-30 20:34:34 +02:00
5b4846b0b6
Translog Flushing: Improve logic, flush not just by operations in the translog, closes #656 .
2011-01-30 17:41:22 +02:00
8884b575c1
more doc
2011-01-30 16:30:17 +02:00
94c632b79b
Java Client - Allow to set facets in binary format, closes #442 .
2011-01-30 15:53:10 +02:00
e5db3175fb
add explicit internal methods for getting doc fields
2011-01-30 00:34:50 +02:00
ad4bb464e8
upgraded to new trove, major upgrade, better perf, but damn, 2mb larger in size...
2011-01-30 00:05:56 +02:00
0b09fd0806
Facets: Remove redundant data returned as part of facet response (for example, the field name being faceted), closes #655 .
2011-01-29 20:44:58 +02:00
7fa5b0cb57
only add highlighted fragments that have a score > 0 (when ending up using the default highlighter)
2011-01-29 15:29:25 +02:00
2d94087f90
explicitly set optimize parameters when doing async merge
2011-01-29 04:11:56 +02:00
4a27671d0c
moe internal stats on translog
2011-01-29 04:04:58 +02:00
332c4cfa53
use bloom filter to reduce seeks when needing to load version
2011-01-29 03:55:00 +02:00
ead4d600be
add a test for term docs version deletes
2011-01-27 00:00:29 +02:00
30f54fe23e
change default async interval to 1 second, to do merges (if needed) more often
2011-01-26 23:29:24 +02:00
00fa7c95fb
improve test time
2011-01-26 23:04:10 +02:00
5ecb847a3a
improve test time
2011-01-26 22:59:35 +02:00
24d5a758f0
fix thread name
2011-01-26 22:43:02 +02:00
c7e73e4558
tookInMillis is not serialized over network for bulk response
2011-01-26 22:41:41 +02:00
6c21c30f31
Index Merge: Improve internal (segment) merging by not initiating it on doc operations, closes #653 .
2011-01-26 22:39:40 +02:00
e1d56ea467
call maybeMerge outside of writeLock to reduce work done under writeLock
2011-01-26 17:16:32 +02:00
5a4686aee5
Search: Allow to pass a search filter, applying only on the query (and not on facets for example), closes #650 .
2011-01-26 12:55:30 +02:00
10ff150bb8
don't log index missing exception when trying to optimize single shard search request
2011-01-25 18:29:28 +02:00
00aad4c123
rename tests
2011-01-25 14:40:04 +02:00
a5e02d559f
optimize single index conversion from alias to concrete index
2011-01-24 21:25:20 +02:00
95dc08fa3b
refactor search tests into separate packages
2011-01-24 16:06:28 +02:00
256f1d3611
add a test for collector ordering
2011-01-24 13:58:09 +02:00
9735d3e6d7
don't establish a connection between two client nodes
2011-01-24 13:34:43 +02:00
9d75849362
better shutdown of sockets
2011-01-24 13:15:57 +02:00
3537de4530
don't have the constructor private
2011-01-23 21:07:04 +02:00
95b6184135
Terms Facets: Allow to get `all_terms` back (possibly with count 0), closes #647 .
2011-01-23 16:09:18 +02:00
85ee6eaf10
add logging on which state file failed to load
2011-01-23 02:59:42 +02:00
ce4f09c2b1
Strict dynamic setting: Refuse to index a document with fields not present in the mapping definition, closes #643 .
2011-01-22 01:08:41 +02:00
3907c8c680
add a test for custom type class name in token filter factory
2011-01-21 02:07:02 +02:00
9801ddeb0d
Analysis: Add phonetic token filter (metaphone, soundex, ...), closes #644 .
2011-01-21 01:57:16 +02:00
5316cd1931
should be debug logging, not warn
2011-01-20 17:38:24 +02:00
545d8f35df
No cluster name filtering when sniffing is not enabled, closes #637 .
2011-01-20 17:28:45 +02:00
9ff8006d37
have compilation and javadoc use UTF8 encoding
2011-01-20 14:24:12 +02:00
034a66263a
Analysis: Add stemming to czech analyzer, closes #642 .
2011-01-20 13:30:48 +02:00
e0fa15a365
added Czech Stemmer, closes #635
2011-01-20 12:34:51 +02:00
04f8b55686
ES hangs connection when parent is not specified in bulk index, closes #641 .
2011-01-20 12:28:55 +02:00
b4467c7d1f
use caching scorer when there are multiple collectors, so if they call score as well, it will not be computed again
2011-01-19 22:59:28 +02:00
7359f7983f
handle rest HEAD on / path
2011-01-19 21:56:53 +02:00
b1d13febbf
Percolate on Index and Bulk, closes #636 .
2011-01-19 16:45:45 +02:00
2eb8278a80
better logging when not allocating a shard due to required number of existing shards
2011-01-19 00:30:56 +02:00
574c455203
Terms Facet: Add option include counts where term is missing, closes #632 .
2011-01-18 21:51:16 +02:00
e4a6e99f69
improve handling when not to persist current state to gateway based on blocks and have a block indicate if it also blocks state persistence
2011-01-18 15:28:55 +02:00
87d5a92edb
move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations
2011-01-18 14:38:10 +02:00
a4c2087511
initial not recovered block on node init, and remove it as usual (once node is initialized / recovered)
2011-01-18 14:08:45 +02:00
4750ccdc1c
move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well
2011-01-17 19:45:37 +02:00
ba725f8986
fix a (rare) case where search will fail due to failed serialization
2011-01-17 14:37:36 +02:00
b4e5a542f3
internal refactoring/simplification in percolator
2011-01-17 13:57:32 +02:00
f2bd2c7bbd
protect against a case when string field data value is null
2011-01-17 12:39:11 +02:00
89d31bbfde
properly print debug statement when nodes based operations fail
2011-01-17 12:38:08 +02:00
f55fa4223e
improve loading queries by adding all of them in batch to the executor
2011-01-17 11:11:13 +02:00
20c77a2ac5
clear the percolator reader from the cache explicitly
2011-01-17 10:11:14 +02:00
1f289df128
more append benchmark
2011-01-16 12:47:54 +02:00
285afe8053
add refresh interval to os/process/network info api which represents the refresh interval of their respective stats
2011-01-16 12:33:23 +02:00
c0e2e14c36
fix javadoc
2011-01-15 02:15:36 +02:00
998f5f4188
add lt(Object) to range filter builder
2011-01-15 02:15:29 +02:00
771e028e54
simple fs bench test
2011-01-15 02:14:10 +02:00
2381f668f8
wait for mappings to be created on other nodes before returning from the put mapping request
2011-01-15 02:13:57 +02:00
f8b1d1eebd
add explicit type missing exception when trying to search on a type that is not registered
2011-01-14 17:53:45 +02:00
a8be99b7e0
Node Stats: Process / Network / Os should only refresh every 5 seconds (refresh_interval to set it), closes #626 .
2011-01-14 16:00:55 +02:00
38d10d19bc
Add `prefer_local` flag to analyze and percolate request, closes #625 .
2011-01-14 01:01:37 +02:00
ff347858c5
properly report teh files and size recovered when doing primary local gateway recovery
2011-01-13 23:59:35 +02:00
7fc04a4ab6
make sure to close the term docs when loading version
2011-01-13 22:49:56 +02:00
ad236d19ee
add logging if failing to execute on a node
2011-01-13 16:51:06 +02:00
180d225016
Percolator, closes #624 .
2011-01-13 16:20:31 +02:00
2d180eb28a
upgrade to sigar 1.6.4
2011-01-13 16:02:35 +02:00
577135db97
upgrade jackson to 1.7.1
2011-01-13 15:50:58 +02:00
7213539d72
factor out exists collector
2011-01-12 20:51:19 +02:00
f8b1a8e38b
add internal event when an index shard is started
2011-01-12 20:47:35 +02:00
5e27e3fca4
support reader as well
2011-01-12 17:11:23 +02:00
85b6a982d4
A setting to auto expand the number of replicas of an index (based on data nodes), closes #623 .
2011-01-12 16:27:36 +02:00
f5a9f2d948
If the cluster does not contain any indices then index templates do not survive cluster restart, closes #617 .
2011-01-11 23:38:46 +02:00
a0a714e6a5
Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621 .
2011-01-11 22:03:44 +02:00
93dec72e43
optimize a filtered query with match_all query into a constant score that just wraps the filter
2011-01-11 19:17:17 +02:00
6130ac2ee7
optimize query facet in case the query is a filtered query with match_all query to use just the filter
2011-01-11 18:49:05 +02:00
ba9a12e201
Mapper: Add `byte` type (8bit signed), closes #620 .
2011-01-11 16:01:10 +02:00
38ea07cfbe
fix field data cache setting: used under index.cache.field.type, available values: resident, soft, weak
2011-01-11 06:33:24 +02:00
a5432ba7ce
limit the number of addresses to try and connect to when doing unicast discovery with just the host and not the port to 5
2011-01-11 00:53:53 +02:00
90d005a330
add trace logging to unicast discovery
2011-01-10 23:30:46 +02:00
50cdf2920f
Make ToXContent return a builder
2011-01-10 22:11:12 +02:00
89314f29a7
improve multi value field cache handling both in terms of memory usage and GC behavior
2011-01-10 20:58:31 +02:00
233ed1f8c6
improve multi value field cache handling both in terms of memory usage and GC behavior
2011-01-10 20:18:12 +02:00
cb8ceb1a39
upgrade to guice 3.0 rc2
2011-01-10 17:49:39 +02:00
d4246da7b3
/_open is not recovering indices correctly, closes #615 .
2011-01-09 23:31:10 +02:00
d650705a03
refresh param to bulk not working, closes #614 .
2011-01-09 22:06:51 +02:00
373af6b1e0
use fs channel to write to file to improve speed of adding to translog
2011-01-09 20:53:40 +02:00
5c08271e74
improve numeric stream analysis performance
2011-01-09 19:35:24 +02:00
3c3d01347e
improve all stream analysis performance
2011-01-09 02:51:41 +02:00
8de7beadc8
Highlighting: Sometimes highlighting returns empty fragments even thought there should be, closes #613 .
2011-01-08 03:19:49 +02:00
7364159d69
NPE for when passing null date to content builder, closes #610 .
2011-01-07 23:28:57 +02:00
286a6fac76
upgrade to jackson 1.7, also fix (really unused case) of getting compressed smile stored through REST with smile context type
2011-01-07 16:35:52 +02:00
b9be6d9ea7
Geo-distance in scripts (like custom_score), closes #607 .
2011-01-07 15:22:11 +02:00
8b8bad7572
build on aferreira improvements to handle empty parameters with no =, and improve component decoding logic
2011-01-07 14:34:34 +02:00
2d81acbbf2
Adding test for edge cases of RestUtils.decodeQueryString()
...
When writing tests for the fix of decodeQueryString() to
handle gracefully edge cases like:
&a
&a&b
it arises the question of what behavior is desirable
for these pathological cases (vs the regular p=v pairs).
This change just skips them which is consonant
to the preexisting code.
To be thorough, we add tests for a bunch of edge cases, like:
QUERY PARSED PARAMS
? {}
?& {}
?= { "": "" }
?a {}
?p=v&a { "p": "v" }
?p=v&a&p1=v1 { "p": "v", "p1": "v1" }
?a&b {}
2011-01-07 14:13:26 +02:00
154dcf007e
Make RestUtils.decodeQueryString() more robust in edge cases
...
The code of decodeQueryString() had some trouble with weird URLs:
(1) an input like "uri?param&p=v" causes an exception to be thrown
(2) an input like "uri?param1¶m2" causes an infinite loop
This could be verified against an ES server with requests like
curl -XGET localhost:9200/test/_analyze?t&text=this+is+a+test
# the exception stack trace shows up in logs
curl -XGET localhost:9200/test/_analyze?t1&t2&text=this+is+a+test
# never returns, never ends
This change fixes these issues.
2011-01-07 14:13:25 +02:00
edb075b611
Minor changes to RestUtils.decodeQueryString() tests
...
Testing
RestUtils.decodeQueryString("something", "something".indexOf('?') + 1, params);
is not really checking decoding of an empty query.
Instead, it is testing decoding of "something"
as a query (because "something.index('?')+1" evaluates to 0).
The parameter map is left empty because
"malformed" pairs like "something" are currently skipped.
Instead, this change modify this test to check the edge cases:
+ fromIndex >= queryString.length()
+ fromIndex < 0
2011-01-07 14:13:25 +02:00
fe0f9ebc9d
make lucene document creation allowed to be indexed twice
2011-01-07 14:09:39 +02:00
c7cb353956
fix serialization of count request
2011-01-06 20:44:36 +02:00
6a0a9ff374
parse query with offset
2011-01-06 16:13:15 +02:00
b9e808f755
improve version loading by going directly to the relevant reader
2011-01-06 11:50:16 +02:00
26c5f6c482
Allow ./bin/plugin to install plugins from the local filesystem / custom url, closes #595 .
2011-01-06 10:46:42 +02:00
cc5978393b
with the new stemmer analyzer, don't break when there is no language stopwords, but just create it without stopwords
2011-01-06 09:53:56 +02:00
4a45df88c6
Add Snowball stemmer as analyzer and filter
2011-01-06 09:40:49 +02:00
66d63055df
Add to node stats the number of times field cache was evicted due to memory constraints, closes #603 .
2011-01-05 22:37:15 +02:00
754b0d7a0f
Add `resident` field cache type, closes #602 .
2011-01-05 21:23:47 +02:00
0954df0623
change the default interval for gc checks to 1 second
2011-01-05 20:40:52 +02:00
31231531e1
Highlighting: The result of highlighting for a hit can contain data from another document, closes #600 .
2011-01-05 15:45:46 +02:00
6258915205
Bulk API: Add how long the bulk API took (in milliseconds) to the response, closes #599 .
2011-01-05 14:12:45 +02:00
29b308005a
try to be more predictable when doing pagination (still can return duplicates when going to different shards) by sorting on the shards results based on the shard id first
2011-01-04 23:42:44 +02:00
0faa05b3f2
add more integration versioning tests
2011-01-04 18:09:46 +02:00
9423378f27
add heavy concurrent updates to same doc, and make sure it has the same data on all replicas
2011-01-04 17:44:33 +02:00
45c1ab06b3
Versioning, closes #594 .
2011-01-04 04:04:30 +02:00
9335b3a9e6
Search: Add a `timed_out` element indicating if the search request timed out, closes #592 .
2011-01-03 15:25:24 +02:00
ff6d7254fe
optimize query parsing to use single field parser when executing on single field
2011-01-03 15:14:28 +02:00
2c8c6aa22a
add a uid scan benchmark to check perf
2011-01-03 14:34:38 +02:00
dc17d10b81
small refactor
2011-01-03 13:32:09 +02:00
5e029865a8
Des.config=/path/to/config/file doesn't replace $ES_HOME/elasticsearch.conf, just appends to it, closes #588 .
2011-01-03 12:53:50 +02:00
ccdbbef276
don't send leave request when the master node is null
2011-01-03 12:01:33 +02:00
d2a70b21cd
key (which is time) can be negative as well
2011-01-02 22:03:52 +02:00
07d361816e
Search: Date Histogram Facet, closes #591 .
2011-01-02 15:07:45 +02:00
d523104b91
add some sanity tests with joda for date time manipulation
2011-01-01 23:48:25 +02:00
b7b775228e
add some sanity tests with joda for date time manipulation
2011-01-01 23:40:46 +02:00
aec720218d
Histogram Facet: Improve perf / memory by defaulting to just providing counts with no totals, closes #587 .
2011-01-01 17:27:55 +02:00
45b93e2781
add histogram facet benchmark
2011-01-01 16:33:18 +02:00
e6b4834768
Highlighting: Allow to highlight on fields without term vectors, closes #585 .
2010-12-31 18:57:26 +02:00
7c959e7ec3
Master based operations (create index, delete index) to automatically retry on retryable cluster blocks (like recovery from gateway)
2010-12-31 14:09:45 +02:00
a92dbc537a
those two should not be final...
2010-12-31 00:23:04 +02:00
fd593acafe
make every static field final (immutable)
2010-12-31 00:22:31 +02:00
6b672e29f5
Remove infinite loop typo
2010-12-31 00:01:45 +02:00
82298d890c
Terms Facet: Performance and memory improvements when faceting numeric fields, closes #583 .
2010-12-30 19:45:36 +02:00
019359a896
add more scanning options on the field data cache
2010-12-30 17:08:32 +02:00
6c8b06c967
clean unused method
2010-12-30 16:45:12 +02:00
8e8a3a894f
upgrade testing framework jars, improve build scripts to share the testing jars
2010-12-30 16:08:38 +02:00
fea93b7fea
Delete By Query: Types are not serialized over network, causing them to be ignored, closes #580 .
2010-12-30 14:43:08 +02:00
789e1a343f
failing to load plugins, return an empty map
2010-12-30 13:16:09 +02:00
2e46add991
remove debugging dead code
2010-12-30 13:14:49 +02:00
51277a9486
no need to check for shard if tis null, we know its not
2010-12-30 13:12:08 +02:00
c4646a2b55
use close helper method to close streams
2010-12-30 13:11:20 +02:00
76d042f3c5
explicitly pass null values to methods where applicable
2010-12-30 13:09:11 +02:00
5a45e9c8bd
close stream if file not found (though a stream is not really opened in this case...)
2010-12-30 12:30:50 +02:00
20b6e0bdde
close stream if file not found (though a stream is not really opened in this case...)
2010-12-30 12:30:33 +02:00
4f8b4b405c
though not really needed (working on in memory byte array), close the stream opened
2010-12-30 12:27:46 +02:00
ed996c3e85
Non-data master nodes and non-master data nodes fail to store data, closes #579 .
2010-12-30 12:10:40 +02:00
e3322836b5
make settings prefix simpler and not bail when not prefixed with org.elasticsearch, allow to provide settings prefix for analyzer provider
2010-12-29 19:12:38 +02:00
f73a5e62d3
improve error message
2010-12-29 18:55:37 +02:00
c7fca8f0e0
refactor terms facet into string terms facets, paving the way for optimized ones for numeric values
2010-12-29 18:34:08 +02:00
e764f41341
await closing sockets on shutdown
2010-12-29 12:49:37 +02:00
f993c4b72b
start refactoring of facets to make them more pluggable
2010-12-29 12:49:02 +02:00
c8bfa455ad
REST Create Index: Not taking JSON index settings into account unless wrapped in settings.
2010-12-29 12:10:51 +02:00
d8aef57baa
add filter_cache_size to node stats
2010-12-28 16:57:55 +02:00
f908a73ec6
allow to construct transport client with settings builder
2010-12-27 20:11:28 +02:00
a84e0a49b7
change scope to _score
2010-12-27 19:19:17 +02:00
d73a459f1e
when parent mapping is set, fix setting routing to required
2010-12-27 18:41:28 +02:00
d560ceabe4
use high transport type when sending the cluster state
2010-12-27 16:50:55 +02:00
4245eb7395
add node level field cache size to node stats api
2010-12-26 12:18:15 +02:00
5dcba8a38c
revert back a stupid bug in setting compress to true always introduced in the last commit
2010-12-26 12:05:22 +02:00
49deb80d03
when compression is enabled, use the compressed byte buffer to write it to the translog (less data to write), and handle recovery by being able to parse also compressed source
2010-12-24 01:09:15 +02:00
f2eae5b605
Memory Index Store: Separate to two buffer size types, and fix bugs, closes #577 .
2010-12-23 23:21:32 +02:00
22fa91efa0
add reconnection code between nodes that are not masters
2010-12-23 17:26:55 +02:00
f6afc01fe5
add reconnection code between nodes that are not masters
2010-12-23 17:26:32 +02:00
ff5990daec
listener should be threaded
2010-12-23 17:24:23 +02:00
de7dd3c070
default to try and connect after network disconnection with fault detection
2010-12-23 16:51:09 +02:00
e313379ed5
only force shutdown on cached threadpool if its not the same as the execture service
2010-12-23 16:13:05 +02:00
42e8567477
interrupt joining the cluster thread if shutting down
2010-12-23 16:11:43 +02:00
5f25ae4f2f
check if the scheduled thread pool is not terminated when trying to terminate it
2010-12-23 15:18:22 +02:00
9f72a8d68b
use cached thread pool for notifying on disconnections
2010-12-23 14:22:40 +02:00
6dcc04b59c
Transport: Increase the default transport.tcp.connect_timeout from 1s to 30s, also add `network.tcp.connect_timeout` to conform with other common network settings, closes #576 .
2010-12-23 14:20:11 +02:00
5c338b7af2
add message to connect transport failure exception
2010-12-23 13:05:39 +02:00
5a58ed4274
when replacing a mapping, clear the aggregated mapping information and then readd it
2010-12-23 11:32:16 +02:00
473c2fa8f4
add reason for state change logging in index shard, add debug logging on ignore recovery in when handling cluster change in indices cluster
2010-12-23 10:56:37 +02:00
5ac42f2a4f
Excessive mapping parsing when cluster state changes, closes #575 .
2010-12-23 09:53:05 +02:00
f869951364
rename type method on MapperService to the more descriptive documentMapperWithAutoCreate
2010-12-23 08:43:17 +02:00
e0b2b4b4a6
add a warn when not using the custom FieldCache with eager reader based eviction
2010-12-23 07:58:43 +02:00
800b7f39bd
add toString to CompressedString to show when logging it
2010-12-23 07:45:04 +02:00
3b30930460
improve logging when trying to delete unallocated shard, check first if deleting is required, and only then delete it
2010-12-23 07:37:49 +02:00
ac73334c87
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:59 +02:00
bb0d7190e9
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:31 +02:00
1ee24ce60f
add an option to provide an OutputStream to a builder, allowing to generate directly into a stream provided by the user
2010-12-22 13:26:29 +02:00
eef3a95fa6
move the query parser cache to be index level and not node level
2010-12-22 12:31:30 +02:00
33339ae4b1
improve concurrency control in filter caching, reuse one if it was created already under concurrent request
2010-12-22 10:42:38 +02:00
d283c158d2
optimize for the more common case of single value facets when loading values
2010-12-22 09:04:35 +02:00
59ee8493ce
use public terms filter in all places
2010-12-21 23:43:05 +02:00
a1df3c637c
improve logic of when to load fields from source, only if they actually have mappings, otherwise, ignore them (as was the previous behavior)
2010-12-21 13:02:15 +02:00
3035254885
Search API: Allow to pass `&fields=` without any fields to cause only id and type to be returned, closes #572 .
2010-12-21 12:01:51 +02:00
a96b294de0
add multicast socket to execption message
2010-12-20 20:07:51 +02:00
efc95dc00a
Java Search API: Passing a the query as json fails, closes #568 .
2010-12-20 11:31:09 +02:00
789073639d
fix transport client compilation problem, the client cluster service was not used and removed
2010-12-19 05:50:07 +02:00
8dfc3acba0
when using dates in scripts, initialize the dates (DateTime) with UTC
2010-12-19 05:01:59 +02:00
96a2950ab5
Disable calling mlockall by default, can be enabled by setting bootstrap.mlockall to `true`, closes #567 .
2010-12-19 02:30:48 +02:00
415bb5d7f3
Java TransportClient: By default, don't sniff other nodes and use addresses provided as is, closes #565 .
2010-12-17 19:31:28 +02:00
005c6d9124
allow to set term index divisor
2010-12-16 21:56:59 +02:00
ff0eeb3d1a
improve getting setting as array, automatically support comma delimited values under the exact setting
2010-12-16 05:02:24 +02:00
f827b7cff5
fix settings
2010-12-16 00:48:26 +02:00
d6bab1a892
Tcp Transport: Connection pool between nodes and different connection types, closes #564 .
2010-12-15 20:11:10 +02:00
085066ed19
set, by default, the send and receive buffers to 32k on tcp
2010-12-15 05:54:09 +02:00
36be13ffb3
bring back the file chunk size in recovery to 100kb from 500kb
2010-12-15 01:28:21 +02:00
b6277ac14d
increase netty worker count to default to the updated value netty defaults to
2010-12-15 01:16:00 +02:00
bb178c9c1a
cleanup
2010-12-13 21:30:26 +02:00
d0eed79175
add log message on hte concurrent streams used
2010-12-13 00:08:57 +02:00
ceb7b90740
Recovery: Allow to control `concurrent_streams` (per node) during recovery
2010-12-13 00:03:04 +02:00
1c5477d4ed
Improve local node recovery process, removing using a block as indication for an index not being recovered. Moving to shard replication group level allocation (with the ability to distinguish between api based creation or recovery based creation). This also allows for throttling based control on initial local gateway based shard allocation.
2010-12-12 22:46:27 +02:00
bc04243a2b
Search Fields: If a field is not stored, automatically extract it from _source (without the need for _source prefix), closes #562 .
2010-12-12 05:00:24 +02:00
216b2ab912
Highlighting: Automatically use the field values extracted from _source if not stored explicitly in the mapping, closes #561 .
2010-12-12 04:40:25 +02:00
fe3f5d45de
remove global settings from the settings conf, a relic that is no longer needed...
2010-12-12 02:37:36 +02:00
dddca692b8
add search hit phase, which operates on a hit, and have all relevant hit phases implement and use it
2010-12-12 02:01:13 +02:00
be4b2e2de6
externalize script search lookup into a generalized lookup that can be used outside of scripts
2010-12-12 01:01:56 +02:00
a914865c45
Close API might cause index data to be wiped, closes #560 .
2010-12-10 22:19:45 +02:00
bc2dc9465a
add to the receive timeout exception the request id that it timed out on
2010-12-10 12:40:39 +02:00
2a7f964ca2
Geo search fails to find some docs when wrapping over IDL, closes #559 .
2010-12-10 08:39:10 +02:00
9d2fe162fa
better log message
2010-12-10 00:17:55 +02:00
3f6ed7e1de
improve update mapping on master, if we end up with the same mappings as the one the cluster state has, no need for a new cluster state...
2010-12-10 00:17:10 +02:00
167d35807c
Add terms/in query, alias terms filter to be in filter as well, closes #557 .
2010-12-09 07:25:05 +02:00
0828f18738
better child bench
2010-12-09 06:11:06 +02:00
e1495ff8be
add scrolling update test
2010-12-08 20:56:09 +02:00
34f3f3f79e
Aliased analyzers cause index deletion / cleanup failure, closes #555 .
2010-12-08 19:30:38 +02:00
f5a8c3881f
add debug logging on failed bug items executions
2010-12-08 01:21:21 +02:00
54437c1bd3
Parent / Child Support, closes #553 .
2010-12-08 00:16:05 +02:00
1a8017d17e
upgrade to jackson 1.6.3
2010-12-07 09:14:13 +02:00
22c27e4ff8
correct field name
2010-12-05 00:02:53 +02:00
d3cae103d5
wait for green status in test
2010-12-04 23:57:44 +02:00
d659bd0479
upgrade to jackson 1.6.2
2010-12-04 00:46:57 +02:00
a90684aaa5
Upgrade to Lucene 3.0.3, closes #549 .
2010-12-03 20:43:51 +02:00
d9610ed0a1
Search API: Optimize single shard search to `QUERY_AND_FETCH` from any other search type, closes #547 .
2010-12-01 03:59:03 +02:00
3ea19a514b
Index Setting: Add `index.refresh_interval` to simplify setting instead of "index.engine.robin.refresh_interval` (still works), closes #546 .
2010-12-01 03:38:41 +02:00
2b039bd0b0
change the default chunk size when recovering from the default 100kb to 500kb.
2010-11-29 14:33:49 +02:00
c0945831e8
Search Scroll API: Allow to provide the scroll id as the body of the scroll request, closes #545 .
2010-11-29 13:59:30 +02:00
103221e58a
remove the timed out message, can be misleading
2010-11-29 02:55:23 +02:00
84f97e96a5
Scrolling issues, fix releasing search context eagerly, they should not be released when scrolling, closes #136 .
2010-11-29 02:05:45 +02:00
6d9576c217
Reduce the number of concurrent recoveries per node to 2 from number_of_processors, closes #543 .
2010-11-28 16:35:39 +02:00
a222de1dbf
internal change to scope based collectors
2010-11-28 14:57:17 +02:00
8285ffe221
encode scroll id with base64 in url safe manner
2010-11-28 02:23:38 +02:00
cfa8c9aa79
Index / Index Template: Allow to define `_default_` mapping, closes #542 .
2010-11-27 23:30:18 +02:00
526f28f479
Create Index API: Allow to provide mappings. closes #541 .
2010-11-27 00:28:18 +02:00
151715dc2f
also merge lists
2010-11-27 00:05:11 +02:00
577f06fd43
add indices API to groovy client
2010-11-26 22:19:57 +02:00
73e5eb9e14
clean compile warnings
2010-11-26 16:03:25 +02:00
6dab568a4b
Index Templates, closes #540 .
2010-11-26 15:53:04 +02:00
ebd6316db9
Index templates, closes #540 .
2010-11-26 15:45:18 +02:00
d150ac2da4
Search API: Add how long the search took (in milliseconds), closes #536 .
2010-11-24 13:27:32 +02:00
51273587de
Bulk API: Add refresh flag, closes #535 .
2010-11-24 00:58:48 +02:00
4a3e5b6348
Query Cache: Invalidate the query cache when mappings change, closes #532 .
2010-11-23 15:26:19 +02:00
9479ac636e
Delete Mapping API: Wrongly deleting existing mapping information, closes #531 .
2010-11-23 14:56:03 +02:00
3b2b901db0
improve error handling, we can't always parse the source to a stirng
2010-11-23 00:41:53 +02:00
db1f7e09f3
Support date and ip types for `numeric_range` filter, closes #530 .
2010-11-22 16:17:51 +02:00
b4113d57d3
Analyze API: An API to analyzer custom text based on an optional analyzer, closes #529 .
2010-11-21 17:33:35 +02:00
8689e5cf16
more cleaning of shards iterators
2010-11-21 14:49:57 +02:00
kimchy
Benoit Sigoure
Lukáš Vlček
Alberto Paro
Edward Dale
Adriano Ferreira
harryf
Tim Dysinger