3b07f77f3d
clean indices when created just for mapping processing
2011-04-22 16:34:54 +03:00
65e05538f0
refresh changed mapping in cluster metadata, this will happen when upgrading from 0.15 to 0.16
2011-04-22 16:07:18 +03:00
0319972d77
change logging level to debug
2011-04-22 04:43:23 +03:00
6ed2624772
fix wrong closing of possible null mappings in geo point mapping
2011-04-22 04:29:47 +03:00
d517c3dfef
upgrade to jackson 1.8.0
2011-04-22 03:45:56 +03:00
e171596a6f
default replacement char to delimiter char
2011-04-22 03:20:34 +03:00
1f89fb26aa
upgrade to mvel 2.1.beta2 (not to be confused with Beta2 :) )
2011-04-22 02:33:39 +03:00
d8d47abcba
no need to cache filters again when handling named filters
2011-04-22 00:37:20 +03:00
4c295a28d5
Don't attempt to load camelCased version of the package name.
...
It's unlikely that a package would have a camelCased name and an attempt to load a class with wrong case is causing NoClassDefFoundError instead of ClassNotFoundException on non case-sensitive file systems.
2011-04-21 21:39:17 +03:00
db04649271
Search request intermittent failures with has_child query/filter, closes #875 .
2011-04-21 17:54:01 +03:00
adc3dc0e99
Fix for highlighting when number_of_fragments is set to 0 and term_vector is not set, closes #873
2011-04-21 14:55:21 +02:00
dedbedbb77
Update Settings: Allow to dynamically set filter cache settings, closes #874 .
2011-04-21 14:40:57 +03:00
add6db352d
Added test for the highlighting using the source field. (This test probably dropped out in one of previous commits)
2011-04-21 11:55:35 +02:00
568dec6b5a
Simplify Filter Cache Eviction Settings, closes #871 .
2011-04-21 02:05:05 +03:00
90b88fe4b7
add TODO optimizations comments
2011-04-21 01:57:28 +03:00
9c606c7b1d
better caching of LZF streamns
2011-04-20 13:37:30 +03:00
f5dbcb2fa4
Failure to recover a shard might cause loosing translog data (especially with no replicas), closes #869 .
2011-04-20 04:52:47 +03:00
3c233347b8
make sure we keep order in mappings when recovering so there won't be reparsing of the mappings on nodes (introduced with faster recovery work done on gateway)
2011-04-20 03:42:51 +03:00
af39f07213
Mapping: By default, don't index _id, closes #868 .
2011-04-20 02:49:14 +03:00
3b21759bec
Better support with _type is marked as not indexed, allowing to filter by type, closes #866 .
2011-04-20 01:31:38 +03:00
c3f3c268c8
Query DSL: Add ids query and filter to fetch docs by ids (do not require _id field to be indexed), closes #865 .
2011-04-20 00:30:30 +03:00
be2a456cc0
improve test: check hits length and zero failures
2011-04-19 21:49:08 +02:00
8e027b3baf
properly handle cases where filter returns null docIdSet with and/or/not filters
2011-04-19 21:28:08 +03:00
5cc943c7db
remove some field caching logic, does not seem to do much perf wise, and simplifies back the code
2011-04-19 17:07:32 +03:00
56c9783cb3
remove using field cache when indexing string fields for now
2011-04-19 16:16:31 +03:00
f8ff42d397
log when failing to process doc after index operation
2011-04-19 16:13:26 +03:00
79ebcc31c5
double check that there are mappings before trying to call the post process method
2011-04-19 16:10:51 +03:00
32127c4d73
register the future with teh listener when deleting an index, so it can be canceled
2011-04-19 15:25:02 +03:00
e40499f35f
small improvement to bulk indexing to not allocated ops if no percolation is done
2011-04-19 13:53:21 +03:00
3b82b013d5
eagerly reroute shards when opening an index
2011-04-19 12:56:08 +03:00
ffc8c3b68a
Weird error message on syntax error, closes #864 .
2011-04-19 12:23:29 +03:00
d29754121c
don't log a versioning conflict failure, even in DEBUG level
2011-04-19 12:17:11 +03:00
b94fab34eb
Mapping: Allow to set index to `no` for _id and _type, closes #863 .
2011-04-17 21:06:46 +03:00
c4be4975d6
better message
2011-04-17 19:00:45 +03:00
c2ee6dd120
improve gateway recovery and applying indices, also improve speed of index creation
2011-04-17 18:39:00 +03:00
287dc862e0
more options on stress test
2011-04-17 10:14:49 +03:00
166493f9d5
properly clean mapper data, and cache some mapping structures
2011-04-17 09:52:29 +03:00
efb3e97ce4
don't return any id when doesn't exists
2011-04-17 06:21:39 +03:00
fb35b1c993
clean guice caches after creating injectors so it will take less memory
2011-04-17 05:16:34 +03:00
343c80b100
shard tokenizers, token filters, char filters across indices / shards
2011-04-17 03:55:33 +03:00
067b8379d5
internal cluster name
2011-04-17 01:45:02 +03:00
4907ce4fec
intern logger names
2011-04-17 01:20:24 +03:00
c51b481cc9
revert back to guice 2
2011-04-17 00:58:00 +03:00
73e7ea4663
allow to control index indexing concurrency (pretty much internal)
2011-04-16 22:55:12 +03:00
e8306ac2c8
improve local gateway allocation by caching the started shards when possible and not asking the nodes for it
2011-04-16 22:33:45 +03:00
658594fa70
improve gateway initial recovery time by creating the indices, and only after all have been created, do the rerouting
2011-04-16 18:23:48 +03:00
763f986a30
Versioning: Better handling of deletes - time based eviction, closes #862 .
2011-04-16 17:26:31 +03:00
4eddaec8ba
change defaults in stress test
2011-04-16 16:57:17 +03:00
a1796c3408
add an estimated time thread and use it where we don't need exact time
2011-04-16 16:57:02 +03:00
2cc4a286f8
small refactor
2011-04-16 03:23:47 +03:00
8fa8a72175
add refresh before verifying in the test
2011-04-16 03:20:52 +03:00
9927fd4cdd
fix none bloom cache to proper name
2011-04-16 03:15:43 +03:00
5ab0ec4911
add a concurrent indexing stress test
2011-04-16 03:15:13 +03:00
9c85500246
change additionalSettings to use Settings
2011-04-16 01:20:27 +03:00
785fb11f2a
Allow plugins to provide additional settings.
2011-04-16 01:17:23 +03:00
bba7179eeb
automatically clean indices that no longer exists in the metadata, this can happen if we delete a closed index, or when a node joins a cluster, that no longer has those indices
2011-04-14 21:15:55 +03:00
897587f981
Allow to delete a closed index, closes #859 .
2011-04-14 20:51:20 +03:00
7c38f20056
Query DSL: Geo Distance Range filter, closes #856 .
2011-04-14 20:20:18 +03:00
7874291c0e
fix wrong initialization of mem evictions counter
2011-04-14 19:13:14 +03:00
1e84c439e5
Shard Allocation: Closed indices are not properly taken into account when rebalancing, closes #858 .
2011-04-14 15:00:54 +03:00
7550fc570e
Query DSL: Allow to directly wrap a query with a constant_score query, closes #857 .
2011-04-14 14:19:24 +03:00
e5c1ab0ca6
add another reroute method to do no assignment but still elect new primaries on failed nodes
2011-04-14 13:43:01 +03:00
25eba4b60d
Unicast Discovery: Concurrently connect to nodes to improve cases where some listed nodes are not up, closes #855 .
2011-04-14 02:27:59 +03:00
3b72d63035
EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854 .
2011-04-14 02:13:27 +03:00
853ade7297
Upgrade to jackson 1.7.6 (fixes that long field name smile bug)
2011-04-14 01:36:19 +03:00
65fde3e71e
only remove shards if they have been started on all other nodes
2011-04-14 01:12:37 +03:00
22b5e7ded8
Local Gateway: Listed active shards on each node does apply index deletion, closes #853 .
2011-04-13 16:15:26 +03:00
41af86dd7e
internal option ot pretty print state
2011-04-13 16:04:18 +03:00
b80324db08
only serialize the cluster state ones when publishing it to multiple nodes
2011-04-13 15:36:28 +03:00
e9bc7f7d95
River: Failure to reallocate river to another node on rivers node failure, closes #850 .
2011-04-12 21:52:02 +03:00
e8503c1455
Better handling when a shard hits OOM, closes #848 .
2011-04-11 21:10:56 +03:00
decb5fa898
Optimize API: Don't execute concurrent optimize operations (shard level) on the same node, closes #846 .
2011-04-10 23:12:00 +03:00
7d8726a5e8
Better handling of shard failures, closes #845 .
2011-04-10 21:59:59 +03:00
8eab5ec528
experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load)
2011-04-09 20:21:23 +03:00
b658fba22e
allow to copy openbitset into a sliced one
2011-04-09 14:33:16 +03:00
991683efa6
remove clearUnreferenced from caches, no longer need it
2011-04-09 14:20:18 +03:00
49e2f55abd
actually register the eviction listener with soft / resident filter cache
2011-04-09 14:11:42 +03:00
c934f04b0c
remove weak caching of filters and stick with only caching when needed / flagged / defaulted
2011-04-09 02:47:31 +03:00
b71513a072
JMX: Don't use node id and name as part of the jmx registration, use static org.elasticsearch, closes #843 .
2011-04-08 18:49:40 +03:00
388f4febba
add more terms stats bench
2011-04-07 20:41:20 +03:00
93372868a2
fix error when trying to delete all indices and none exists
2011-04-07 20:08:53 +03:00
ca01dc7a09
Network Settings: Allow to explicitly set ipv4 and ipv4 when using _networkInterface_ notation, closes #841 .
2011-04-07 20:01:52 +03:00
1fdef91fc2
Allow to search across indices and types even if some types do not exists on some indices, closes #839 .
2011-04-07 16:00:18 +03:00
4603d10501
faster handling of a case where each doc has multi valued values for different facets, also, don't take into account missing value values (and in the future, we can also count those per bucket if needed)
2011-04-07 15:04:54 +03:00
b479bc58f9
faster handling of a case where each doc has multi valued values fields in histogram facet
2011-04-07 14:52:25 +03:00
7fcf82af80
faster handling of a case where each doc has multi valued values fields in terms stats
2011-04-07 14:44:34 +03:00
16a046f686
rename termsstats java facet builder to termsStatsFacet
2011-04-07 14:30:12 +03:00
7decb701d9
nicer bench of terms facet
2011-04-07 14:16:21 +03:00
7231e08f7c
also test terms facet with execution hint of map
2011-04-07 13:32:35 +03:00
c0879c2055
add bench on nano time
2011-04-06 22:50:36 +03:00
08f594c3a0
Get Mapping API: when asking for a mapping of a single index and single type, don't wrap the mapping with the index name, closes #838 .
2011-04-06 22:12:34 +03:00
8c50a65699
Percolator doesn't work correctly after index recreation, closes #837 .
2011-04-06 21:00:49 +03:00
6317483fe3
add total count to terms stats and compute mean properly, also better use caching
2011-04-06 15:50:09 +03:00
35be46df71
Bug: Sort on a column of type 'short' throws an exception, closes #835 .
2011-04-06 02:25:56 +03:00
4721f9aa69
fix cache recycling logic to make sure we don't override our own data in facets
2011-04-05 23:25:39 +03:00
f0de086479
for some reason the copyright header got reformatted
2011-04-05 15:42:12 +03:00
6f827731d6
normalize to/from properly in bounded histogram
2011-04-05 15:10:55 +03:00
1428abf2b7
Upgrade to jackson 1.7.5
2011-04-05 14:15:48 +03:00
9b8eceb229
Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834 .
2011-04-05 13:53:19 +03:00
14def814fa
fix typo
2011-04-05 12:07:46 +03:00
d845a306fa
fill sentinal proeprly when its not in cache
2011-04-05 03:09:33 +03:00
a89aeb3a6d
add JVM mem to node info API
2011-04-05 01:46:09 +03:00
83b728a384
rename some histogram collectors
2011-04-05 01:32:36 +03:00
cea8c5fefa
Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833 .
2011-04-05 00:52:58 +03:00
79939222e4
Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832 .
2011-04-05 00:42:46 +03:00
90a339ad5e
Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831 .
2011-04-05 00:17:07 +03:00
8d1e9dbd3c
Histogram Facet: Add min/max stats when providing value field / script, closes #830 .
2011-04-04 23:48:54 +03:00
46088b9f8a
Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829 .
2011-04-04 21:30:46 +03:00
58c606d6d9
break field data value iterator into two callback types, one with support for missing, and one without
2011-04-04 19:53:09 +03:00
c9838d5c75
use cache recycler for count histo and data histo facets
2011-04-04 19:44:46 +03:00
105d60ac9c
Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824 .
2011-04-04 17:44:38 +03:00
5d6e84f206
Upgrade Lucene 3.1: Analyzers, closes #826 .
2011-04-04 14:36:13 +03:00
4e4495ff1d
Upgrade to Lucene 3.1, closes #825 .
2011-04-04 12:54:15 +03:00
db1dcaded3
Concurrent calls to refresh might result in "dangling" searchers, closes #823 .
2011-04-01 22:43:48 +03:00
1280512097
also support regex pattern matching with ordinals
2011-04-01 16:54:37 +03:00
e4cbdfa05b
Terms Facet: Performance improvements, closes #822 .
2011-04-01 16:30:45 +03:00
fb8a389380
more bench work
2011-03-31 18:25:23 +02:00
44d4474f95
anoter small bench
2011-03-31 17:48:57 +02:00
a0cddf0745
small improvement to stats facet computing min/max
2011-03-31 17:41:21 +02:00
3ff35d42b5
Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821 .
2011-03-31 17:03:37 +02:00
09d3b882f0
more small bench
2011-03-31 02:30:17 +02:00
74838fe1aa
Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820 .
2011-03-31 01:09:03 +02:00
14d98a7319
Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819 .
2011-03-31 01:04:09 +02:00
f90b4e6fee
some more micro bench support
2011-03-30 23:32:33 +02:00
ae0eed937b
update to the new lzf compression (0.7)
2011-03-30 20:43:20 +02:00
2dd5094d37
Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817 .
2011-03-30 15:43:56 +02:00
7ce7fb33e5
Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816 .
2011-03-30 15:40:11 +02:00
8a5dd90885
HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815 .
2011-03-30 14:46:39 +02:00
eafe686013
warm up with compression bench
2011-03-30 13:52:52 +02:00
fdbccf28b0
Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814 .
2011-03-30 12:56:53 +02:00
9bb0bcf4e3
add logging when trying to obtain node lock
2011-03-29 21:34:15 +02:00
0069d5a75d
add adler to checksum, faster and is good enough with length check for our use case
2011-03-29 21:27:18 +02:00
a1be2bbf20
add adler to checksum tests
2011-03-29 18:17:09 +02:00
3138269573
Indices Status API: Add refresh stats, closes #811 .
2011-03-29 17:54:00 +02:00
2a032f8718
add remote many indices creation test
2011-03-29 17:17:54 +02:00
0e6bbf3f85
call shard refresh API and not directly the engine one
2011-03-29 17:17:39 +02:00
ff8dc2673f
Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810 .
2011-03-29 13:50:25 +02:00
508d1d40fb
Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809 .
2011-03-29 13:05:36 +02:00
95e36a073a
move index/delete refresh to happen outside of the engine
2011-03-29 01:28:37 +02:00
53935f078a
optimize array list creation with exact size
2011-03-28 21:50:39 +02:00
49f79f54d2
log when search failure happen when scanning
2011-03-28 18:17:36 +02:00
f00664621f
more scan tests to try and recreate the context missing failure, no luck yet...
2011-03-28 17:21:59 +02:00
e0d8094f3d
clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block
2011-03-28 17:20:07 +02:00
953a99c75c
fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered
2011-03-28 16:08:01 +02:00
64a89eb0e4
add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers
2011-03-28 14:21:49 +02:00
af419cc636
upgrade to guice 3.0
2011-03-27 19:31:51 +02:00
b28461dd0e
compress cluster state when publishing it
2011-03-24 01:12:36 +02:00
992becf013
add value_script as an option to terms stats
2011-03-24 01:03:17 +02:00
f20c6ec9cf
check if index service is null, and don't load percolators in this case
2011-03-24 00:40:21 +02:00
36edcef640
compress metadata stored in gateway
2011-03-24 00:38:16 +02:00
4f27fa3f45
add the version to the jvm info, and, warn if running using the client vm
2011-03-23 18:06:29 +02:00
20593fb966
Mapping: Add _size field mapping, indexing the original source size, closes #804 .
2011-03-23 17:37:40 +02:00
b2d7cd78b7
don't clean up indices if there is a block disabling persistence
2011-03-22 18:41:29 +02:00
8c9000c54c
Extend stats API to include filter's cache count and eviction count, closes #802 .
2011-03-22 13:30:14 +02:00
e759b4c971
Add option to expire filter's cache based on access time, closes #803 .
2011-03-22 13:14:31 +02:00
0d150e6918
Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801 .
2011-03-22 01:29:41 +02:00
9f44c93a25
make sure to log failures in search when reducing results
2011-03-22 01:05:54 +02:00
61034f5c86
Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800 .
2011-03-21 18:10:13 +02:00
8f8fb89c4e
Update Settings: Allow to control `index.auto_expand_replicas`, closes #799 .
2011-03-21 16:18:03 +02:00
2f1aba962c
add the exception as well to the logging
2011-03-21 14:36:56 +02:00
6c241f3de8
protected against a wrong format in the index.auto_expand_replicas setting
2011-03-21 14:36:28 +02:00
d2e61af9ee
maintain total hits across scan scroll requests
2011-03-20 00:19:26 +02:00
52c750fc42
internal support for custom attributes in scroll id
2011-03-19 21:51:18 +02:00
f3160b71bb
can't check on token value, since it might be valid, so, handle the null token case better
2011-03-19 21:34:31 +02:00
c19a93da89
countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index
2011-03-19 21:28:17 +02:00
fb7fbc8c83
NPE when the JSON to index doesn't match the mapping's expectations, closes #795 .
2011-03-19 20:42:50 +02:00
70fc8d9af0
Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793 .
2011-03-19 00:24:20 +02:00
bd3f490d60
Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791 .
2011-03-18 20:44:59 +02:00
09fbc919b8
"exclude" functionality missing for terms facet on numeric fields, closes #789 .
2011-03-18 11:08:11 +02:00
923fcf239c
Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790 .
2011-03-18 10:49:28 +02:00
616b3dcb18
shard the default analyzer (standard) on the node level
2011-03-18 01:35:29 +02:00
25124b084b
Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787 .
2011-03-17 22:01:22 +02:00
96d06d6dc8
Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781 .
2011-03-15 21:22:46 +02:00
0291ab1d8d
sync version when getting the state from master
2011-03-15 14:15:16 +02:00
1bcd3b67ee
Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769 .
2011-03-14 11:30:01 +02:00
3192654e80
add iterator based on specific index
2011-03-13 19:51:21 +02:00
96dfdcf97c
Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778 .
2011-03-13 11:43:30 +02:00
700a2a9577
Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772 .
2011-03-13 02:29:05 +02:00
7c04ef6cbc
use byte value
2011-03-13 00:51:12 +02:00
09006f17c3
Support true|false for the 'store' parameter in mappings, closes #775 .
2011-03-13 00:41:58 +02:00
6d108e77f1
handle whitespace text on search fields query string parameter to be treated as no fields
2011-03-13 00:37:25 +02:00
aff8a4407f
better exception message
2011-03-13 00:31:21 +02:00
bdb0fd23e9
Versioning: Add a new version_type parameter, with a new type - `external`, closes #776 .
2011-03-12 20:41:55 +02:00
7bab5270fc
add a comment on max shard buffer size
2011-03-12 17:17:02 +02:00
73dec5d63f
Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773 .
2011-03-12 17:03:04 +02:00
19052a3538
Add another flag to gateway if it even requires snapshot, so we don't try and snapshot on shutdown for none/local gateway (even though its a no op)
2011-03-11 15:20:16 +02:00
3e624bf9e0
better failure when trying to obtain a native lock on the node data location, and reduce the tries from 100 to 50.
2011-03-11 15:05:22 +02:00
e1c86b86e5
add simplified ways to create XContentBuilder that will output to OutputStream using XContentFactory
2011-03-10 16:00:19 +02:00
0df3dfd72b
add the ability to set source and extra source on the SearchRequestBuilder
2011-03-09 21:55:46 +02:00
80a797fc4f
Update Settings: Allow to dynamically update `index.translog` settings, closes #765 .
2011-03-09 14:17:34 +02:00
c2a0e0b767
Mapper: Using `dynamic_template` can result in warning of parsed and original source difference (resulting in excessive mapping parsing), closes #764 .
2011-03-09 11:36:51 +02:00
f694b9dfd8
Percolator: Failures when using docs where fields repeat, such as arrays, closes #763 .
2011-03-09 11:31:05 +02:00
ad0d681b6d
Update Settings: Allow to dynamically change `index.term_index_interval` and `index.term_index_divisor, closes #762 .
2011-03-09 07:36:18 +02:00
353d2cb21f
Mvel Script: add more random options, and optimize random, closes #759 .
2011-03-08 22:24:22 +02:00
016e5bce04
Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758 .
2011-03-08 21:53:33 +02:00
77cf3e1924
small refactor in index settings, allowing for future dynamic changes to it
2011-03-08 11:12:40 +02:00
e709a0bde4
Logging: Add merge level logging, closes #755 .
2011-03-08 08:20:48 +02:00
9e2143f343
add a warning for types not to include dots (can't really throw a failure because of it since it will break backward)
2011-03-07 19:17:39 +02:00
4bdae621f9
Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752 .
2011-03-07 13:09:07 +02:00
1242cf59f6
upgrade to guice 3 rc3
2011-03-07 06:52:55 +02:00
kimchy
Igor Motov
Lukáš Vlček