49ac30801e
more cache cleaning
2011-04-25 00:16:42 +03:00
23c17d7101
improved close logic on index query parser
2011-04-24 23:42:59 +03:00
013c4e9fa4
improved cleaning of cached parser context
2011-04-24 23:34:59 +03:00
990f371580
better cached streams logic
2011-04-24 23:28:35 +03:00
9b262a7363
clean teh lzf buffer recycler
2011-04-24 22:48:38 +03:00
1e5dc09848
Unexpected failure to create a shard can lead to data loss if it has no replicas, closes #878 .
2011-04-23 13:29:14 +03:00
3b07f77f3d
clean indices when created just for mapping processing
2011-04-22 16:34:54 +03:00
65e05538f0
refresh changed mapping in cluster metadata, this will happen when upgrading from 0.15 to 0.16
2011-04-22 16:07:18 +03:00
0319972d77
change logging level to debug
2011-04-22 04:43:23 +03:00
6ed2624772
fix wrong closing of possible null mappings in geo point mapping
2011-04-22 04:29:47 +03:00
d517c3dfef
upgrade to jackson 1.8.0
2011-04-22 03:45:56 +03:00
e171596a6f
default replacement char to delimiter char
2011-04-22 03:20:34 +03:00
1f89fb26aa
upgrade to mvel 2.1.beta2 (not to be confused with Beta2 :) )
2011-04-22 02:33:39 +03:00
d8d47abcba
no need to cache filters again when handling named filters
2011-04-22 00:37:20 +03:00
4c295a28d5
Don't attempt to load camelCased version of the package name.
...
It's unlikely that a package would have a camelCased name and an attempt to load a class with wrong case is causing NoClassDefFoundError instead of ClassNotFoundException on non case-sensitive file systems.
2011-04-21 21:39:17 +03:00
db04649271
Search request intermittent failures with has_child query/filter, closes #875 .
2011-04-21 17:54:01 +03:00
adc3dc0e99
Fix for highlighting when number_of_fragments is set to 0 and term_vector is not set, closes #873
2011-04-21 14:55:21 +02:00
dedbedbb77
Update Settings: Allow to dynamically set filter cache settings, closes #874 .
2011-04-21 14:40:57 +03:00
add6db352d
Added test for the highlighting using the source field. (This test probably dropped out in one of previous commits)
2011-04-21 11:55:35 +02:00
568dec6b5a
Simplify Filter Cache Eviction Settings, closes #871 .
2011-04-21 02:05:05 +03:00
90b88fe4b7
add TODO optimizations comments
2011-04-21 01:57:28 +03:00
9c606c7b1d
better caching of LZF streamns
2011-04-20 13:37:30 +03:00
f5dbcb2fa4
Failure to recover a shard might cause loosing translog data (especially with no replicas), closes #869 .
2011-04-20 04:52:47 +03:00
3c233347b8
make sure we keep order in mappings when recovering so there won't be reparsing of the mappings on nodes (introduced with faster recovery work done on gateway)
2011-04-20 03:42:51 +03:00
af39f07213
Mapping: By default, don't index _id, closes #868 .
2011-04-20 02:49:14 +03:00
3b21759bec
Better support with _type is marked as not indexed, allowing to filter by type, closes #866 .
2011-04-20 01:31:38 +03:00
c3f3c268c8
Query DSL: Add ids query and filter to fetch docs by ids (do not require _id field to be indexed), closes #865 .
2011-04-20 00:30:30 +03:00
be2a456cc0
improve test: check hits length and zero failures
2011-04-19 21:49:08 +02:00
8e027b3baf
properly handle cases where filter returns null docIdSet with and/or/not filters
2011-04-19 21:28:08 +03:00
5cc943c7db
remove some field caching logic, does not seem to do much perf wise, and simplifies back the code
2011-04-19 17:07:32 +03:00
56c9783cb3
remove using field cache when indexing string fields for now
2011-04-19 16:16:31 +03:00
f8ff42d397
log when failing to process doc after index operation
2011-04-19 16:13:26 +03:00
79ebcc31c5
double check that there are mappings before trying to call the post process method
2011-04-19 16:10:51 +03:00
32127c4d73
register the future with teh listener when deleting an index, so it can be canceled
2011-04-19 15:25:02 +03:00
e40499f35f
small improvement to bulk indexing to not allocated ops if no percolation is done
2011-04-19 13:53:21 +03:00
3b82b013d5
eagerly reroute shards when opening an index
2011-04-19 12:56:08 +03:00
ffc8c3b68a
Weird error message on syntax error, closes #864 .
2011-04-19 12:23:29 +03:00
d29754121c
don't log a versioning conflict failure, even in DEBUG level
2011-04-19 12:17:11 +03:00
b94fab34eb
Mapping: Allow to set index to `no` for _id and _type, closes #863 .
2011-04-17 21:06:46 +03:00
c4be4975d6
better message
2011-04-17 19:00:45 +03:00
c2ee6dd120
improve gateway recovery and applying indices, also improve speed of index creation
2011-04-17 18:39:00 +03:00
287dc862e0
more options on stress test
2011-04-17 10:14:49 +03:00
166493f9d5
properly clean mapper data, and cache some mapping structures
2011-04-17 09:52:29 +03:00
efb3e97ce4
don't return any id when doesn't exists
2011-04-17 06:21:39 +03:00
fb35b1c993
clean guice caches after creating injectors so it will take less memory
2011-04-17 05:16:34 +03:00
343c80b100
shard tokenizers, token filters, char filters across indices / shards
2011-04-17 03:55:33 +03:00
067b8379d5
internal cluster name
2011-04-17 01:45:02 +03:00
4907ce4fec
intern logger names
2011-04-17 01:20:24 +03:00
c51b481cc9
revert back to guice 2
2011-04-17 00:58:00 +03:00
73e7ea4663
allow to control index indexing concurrency (pretty much internal)
2011-04-16 22:55:12 +03:00
e8306ac2c8
improve local gateway allocation by caching the started shards when possible and not asking the nodes for it
2011-04-16 22:33:45 +03:00
658594fa70
improve gateway initial recovery time by creating the indices, and only after all have been created, do the rerouting
2011-04-16 18:23:48 +03:00
763f986a30
Versioning: Better handling of deletes - time based eviction, closes #862 .
2011-04-16 17:26:31 +03:00
4eddaec8ba
change defaults in stress test
2011-04-16 16:57:17 +03:00
a1796c3408
add an estimated time thread and use it where we don't need exact time
2011-04-16 16:57:02 +03:00
2cc4a286f8
small refactor
2011-04-16 03:23:47 +03:00
8fa8a72175
add refresh before verifying in the test
2011-04-16 03:20:52 +03:00
9927fd4cdd
fix none bloom cache to proper name
2011-04-16 03:15:43 +03:00
5ab0ec4911
add a concurrent indexing stress test
2011-04-16 03:15:13 +03:00
9c85500246
change additionalSettings to use Settings
2011-04-16 01:20:27 +03:00
785fb11f2a
Allow plugins to provide additional settings.
2011-04-16 01:17:23 +03:00
bba7179eeb
automatically clean indices that no longer exists in the metadata, this can happen if we delete a closed index, or when a node joins a cluster, that no longer has those indices
2011-04-14 21:15:55 +03:00
897587f981
Allow to delete a closed index, closes #859 .
2011-04-14 20:51:20 +03:00
7c38f20056
Query DSL: Geo Distance Range filter, closes #856 .
2011-04-14 20:20:18 +03:00
7874291c0e
fix wrong initialization of mem evictions counter
2011-04-14 19:13:14 +03:00
1e84c439e5
Shard Allocation: Closed indices are not properly taken into account when rebalancing, closes #858 .
2011-04-14 15:00:54 +03:00
7550fc570e
Query DSL: Allow to directly wrap a query with a constant_score query, closes #857 .
2011-04-14 14:19:24 +03:00
e5c1ab0ca6
add another reroute method to do no assignment but still elect new primaries on failed nodes
2011-04-14 13:43:01 +03:00
25eba4b60d
Unicast Discovery: Concurrently connect to nodes to improve cases where some listed nodes are not up, closes #855 .
2011-04-14 02:27:59 +03:00
3b72d63035
EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854 .
2011-04-14 02:13:27 +03:00
853ade7297
Upgrade to jackson 1.7.6 (fixes that long field name smile bug)
2011-04-14 01:36:19 +03:00
65fde3e71e
only remove shards if they have been started on all other nodes
2011-04-14 01:12:37 +03:00
22b5e7ded8
Local Gateway: Listed active shards on each node does apply index deletion, closes #853 .
2011-04-13 16:15:26 +03:00
41af86dd7e
internal option ot pretty print state
2011-04-13 16:04:18 +03:00
b80324db08
only serialize the cluster state ones when publishing it to multiple nodes
2011-04-13 15:36:28 +03:00
e9bc7f7d95
River: Failure to reallocate river to another node on rivers node failure, closes #850 .
2011-04-12 21:52:02 +03:00
e8503c1455
Better handling when a shard hits OOM, closes #848 .
2011-04-11 21:10:56 +03:00
decb5fa898
Optimize API: Don't execute concurrent optimize operations (shard level) on the same node, closes #846 .
2011-04-10 23:12:00 +03:00
7d8726a5e8
Better handling of shard failures, closes #845 .
2011-04-10 21:59:59 +03:00
8eab5ec528
experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load)
2011-04-09 20:21:23 +03:00
b658fba22e
allow to copy openbitset into a sliced one
2011-04-09 14:33:16 +03:00
991683efa6
remove clearUnreferenced from caches, no longer need it
2011-04-09 14:20:18 +03:00
49e2f55abd
actually register the eviction listener with soft / resident filter cache
2011-04-09 14:11:42 +03:00
c934f04b0c
remove weak caching of filters and stick with only caching when needed / flagged / defaulted
2011-04-09 02:47:31 +03:00
b71513a072
JMX: Don't use node id and name as part of the jmx registration, use static org.elasticsearch, closes #843 .
2011-04-08 18:49:40 +03:00
388f4febba
add more terms stats bench
2011-04-07 20:41:20 +03:00
93372868a2
fix error when trying to delete all indices and none exists
2011-04-07 20:08:53 +03:00
ca01dc7a09
Network Settings: Allow to explicitly set ipv4 and ipv4 when using _networkInterface_ notation, closes #841 .
2011-04-07 20:01:52 +03:00
1fdef91fc2
Allow to search across indices and types even if some types do not exists on some indices, closes #839 .
2011-04-07 16:00:18 +03:00
4603d10501
faster handling of a case where each doc has multi valued values for different facets, also, don't take into account missing value values (and in the future, we can also count those per bucket if needed)
2011-04-07 15:04:54 +03:00
b479bc58f9
faster handling of a case where each doc has multi valued values fields in histogram facet
2011-04-07 14:52:25 +03:00
7fcf82af80
faster handling of a case where each doc has multi valued values fields in terms stats
2011-04-07 14:44:34 +03:00
16a046f686
rename termsstats java facet builder to termsStatsFacet
2011-04-07 14:30:12 +03:00
7decb701d9
nicer bench of terms facet
2011-04-07 14:16:21 +03:00
7231e08f7c
also test terms facet with execution hint of map
2011-04-07 13:32:35 +03:00
c0879c2055
add bench on nano time
2011-04-06 22:50:36 +03:00
08f594c3a0
Get Mapping API: when asking for a mapping of a single index and single type, don't wrap the mapping with the index name, closes #838 .
2011-04-06 22:12:34 +03:00
8c50a65699
Percolator doesn't work correctly after index recreation, closes #837 .
2011-04-06 21:00:49 +03:00
6317483fe3
add total count to terms stats and compute mean properly, also better use caching
2011-04-06 15:50:09 +03:00
35be46df71
Bug: Sort on a column of type 'short' throws an exception, closes #835 .
2011-04-06 02:25:56 +03:00
4721f9aa69
fix cache recycling logic to make sure we don't override our own data in facets
2011-04-05 23:25:39 +03:00
f0de086479
for some reason the copyright header got reformatted
2011-04-05 15:42:12 +03:00
6f827731d6
normalize to/from properly in bounded histogram
2011-04-05 15:10:55 +03:00
1428abf2b7
Upgrade to jackson 1.7.5
2011-04-05 14:15:48 +03:00
9b8eceb229
Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834 .
2011-04-05 13:53:19 +03:00
14def814fa
fix typo
2011-04-05 12:07:46 +03:00
d845a306fa
fill sentinal proeprly when its not in cache
2011-04-05 03:09:33 +03:00
a89aeb3a6d
add JVM mem to node info API
2011-04-05 01:46:09 +03:00
83b728a384
rename some histogram collectors
2011-04-05 01:32:36 +03:00
cea8c5fefa
Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833 .
2011-04-05 00:52:58 +03:00
79939222e4
Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832 .
2011-04-05 00:42:46 +03:00
90a339ad5e
Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831 .
2011-04-05 00:17:07 +03:00
8d1e9dbd3c
Histogram Facet: Add min/max stats when providing value field / script, closes #830 .
2011-04-04 23:48:54 +03:00
46088b9f8a
Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829 .
2011-04-04 21:30:46 +03:00
58c606d6d9
break field data value iterator into two callback types, one with support for missing, and one without
2011-04-04 19:53:09 +03:00
c9838d5c75
use cache recycler for count histo and data histo facets
2011-04-04 19:44:46 +03:00
105d60ac9c
Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824 .
2011-04-04 17:44:38 +03:00
5d6e84f206
Upgrade Lucene 3.1: Analyzers, closes #826 .
2011-04-04 14:36:13 +03:00
4e4495ff1d
Upgrade to Lucene 3.1, closes #825 .
2011-04-04 12:54:15 +03:00
db1dcaded3
Concurrent calls to refresh might result in "dangling" searchers, closes #823 .
2011-04-01 22:43:48 +03:00
1280512097
also support regex pattern matching with ordinals
2011-04-01 16:54:37 +03:00
e4cbdfa05b
Terms Facet: Performance improvements, closes #822 .
2011-04-01 16:30:45 +03:00
fb8a389380
more bench work
2011-03-31 18:25:23 +02:00
44d4474f95
anoter small bench
2011-03-31 17:48:57 +02:00
a0cddf0745
small improvement to stats facet computing min/max
2011-03-31 17:41:21 +02:00
3ff35d42b5
Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821 .
2011-03-31 17:03:37 +02:00
09d3b882f0
more small bench
2011-03-31 02:30:17 +02:00
74838fe1aa
Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820 .
2011-03-31 01:09:03 +02:00
14d98a7319
Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819 .
2011-03-31 01:04:09 +02:00
f90b4e6fee
some more micro bench support
2011-03-30 23:32:33 +02:00
ae0eed937b
update to the new lzf compression (0.7)
2011-03-30 20:43:20 +02:00
2dd5094d37
Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817 .
2011-03-30 15:43:56 +02:00
7ce7fb33e5
Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816 .
2011-03-30 15:40:11 +02:00
8a5dd90885
HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815 .
2011-03-30 14:46:39 +02:00
eafe686013
warm up with compression bench
2011-03-30 13:52:52 +02:00
fdbccf28b0
Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814 .
2011-03-30 12:56:53 +02:00
9bb0bcf4e3
add logging when trying to obtain node lock
2011-03-29 21:34:15 +02:00
0069d5a75d
add adler to checksum, faster and is good enough with length check for our use case
2011-03-29 21:27:18 +02:00
a1be2bbf20
add adler to checksum tests
2011-03-29 18:17:09 +02:00
3138269573
Indices Status API: Add refresh stats, closes #811 .
2011-03-29 17:54:00 +02:00
2a032f8718
add remote many indices creation test
2011-03-29 17:17:54 +02:00
0e6bbf3f85
call shard refresh API and not directly the engine one
2011-03-29 17:17:39 +02:00
ff8dc2673f
Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810 .
2011-03-29 13:50:25 +02:00
508d1d40fb
Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809 .
2011-03-29 13:05:36 +02:00
95e36a073a
move index/delete refresh to happen outside of the engine
2011-03-29 01:28:37 +02:00
53935f078a
optimize array list creation with exact size
2011-03-28 21:50:39 +02:00
49f79f54d2
log when search failure happen when scanning
2011-03-28 18:17:36 +02:00
f00664621f
more scan tests to try and recreate the context missing failure, no luck yet...
2011-03-28 17:21:59 +02:00
e0d8094f3d
clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block
2011-03-28 17:20:07 +02:00
953a99c75c
fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered
2011-03-28 16:08:01 +02:00
kimchy
Igor Motov
Lukáš Vlček