kimchy
|
287dc862e0
|
more options on stress test
|
2011-04-17 10:14:49 +03:00 |
|
kimchy
|
166493f9d5
|
properly clean mapper data, and cache some mapping structures
|
2011-04-17 09:52:29 +03:00 |
|
kimchy
|
efb3e97ce4
|
don't return any id when doesn't exists
|
2011-04-17 06:21:39 +03:00 |
|
kimchy
|
fb35b1c993
|
clean guice caches after creating injectors so it will take less memory
|
2011-04-17 05:16:34 +03:00 |
|
kimchy
|
343c80b100
|
shard tokenizers, token filters, char filters across indices / shards
|
2011-04-17 03:55:33 +03:00 |
|
kimchy
|
067b8379d5
|
internal cluster name
|
2011-04-17 01:45:02 +03:00 |
|
kimchy
|
4907ce4fec
|
intern logger names
|
2011-04-17 01:20:24 +03:00 |
|
kimchy
|
c51b481cc9
|
revert back to guice 2
|
2011-04-17 00:58:00 +03:00 |
|
kimchy
|
73e7ea4663
|
allow to control index indexing concurrency (pretty much internal)
|
2011-04-16 22:55:12 +03:00 |
|
kimchy
|
e8306ac2c8
|
improve local gateway allocation by caching the started shards when possible and not asking the nodes for it
|
2011-04-16 22:33:45 +03:00 |
|
kimchy
|
658594fa70
|
improve gateway initial recovery time by creating the indices, and only after all have been created, do the rerouting
|
2011-04-16 18:23:48 +03:00 |
|
kimchy
|
763f986a30
|
Versioning: Better handling of deletes - time based eviction, closes #862.
|
2011-04-16 17:26:31 +03:00 |
|
kimchy
|
4eddaec8ba
|
change defaults in stress test
|
2011-04-16 16:57:17 +03:00 |
|
kimchy
|
a1796c3408
|
add an estimated time thread and use it where we don't need exact time
|
2011-04-16 16:57:02 +03:00 |
|
kimchy
|
2cc4a286f8
|
small refactor
|
2011-04-16 03:23:47 +03:00 |
|
kimchy
|
8fa8a72175
|
add refresh before verifying in the test
|
2011-04-16 03:20:52 +03:00 |
|
kimchy
|
9927fd4cdd
|
fix none bloom cache to proper name
|
2011-04-16 03:15:43 +03:00 |
|
kimchy
|
5ab0ec4911
|
add a concurrent indexing stress test
|
2011-04-16 03:15:13 +03:00 |
|
kimchy
|
9c85500246
|
change additionalSettings to use Settings
|
2011-04-16 01:20:27 +03:00 |
Igor Motov
|
785fb11f2a
|
Allow plugins to provide additional settings.
|
2011-04-16 01:17:23 +03:00 |
|
kimchy
|
bba7179eeb
|
automatically clean indices that no longer exists in the metadata, this can happen if we delete a closed index, or when a node joins a cluster, that no longer has those indices
|
2011-04-14 21:15:55 +03:00 |
|
kimchy
|
897587f981
|
Allow to delete a closed index, closes #859.
|
2011-04-14 20:51:20 +03:00 |
|
kimchy
|
7c38f20056
|
Query DSL: Geo Distance Range filter, closes #856.
|
2011-04-14 20:20:18 +03:00 |
|
kimchy
|
7874291c0e
|
fix wrong initialization of mem evictions counter
|
2011-04-14 19:13:14 +03:00 |
|
kimchy
|
1e84c439e5
|
Shard Allocation: Closed indices are not properly taken into account when rebalancing, closes #858.
|
2011-04-14 15:00:54 +03:00 |
|
kimchy
|
7550fc570e
|
Query DSL: Allow to directly wrap a query with a constant_score query, closes #857.
|
2011-04-14 14:19:24 +03:00 |
|
kimchy
|
e5c1ab0ca6
|
add another reroute method to do no assignment but still elect new primaries on failed nodes
|
2011-04-14 13:43:01 +03:00 |
|
kimchy
|
25eba4b60d
|
Unicast Discovery: Concurrently connect to nodes to improve cases where some listed nodes are not up, closes #855.
|
2011-04-14 02:27:59 +03:00 |
|
kimchy
|
3b72d63035
|
EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854.
|
2011-04-14 02:13:27 +03:00 |
|
kimchy
|
853ade7297
|
Upgrade to jackson 1.7.6 (fixes that long field name smile bug)
|
2011-04-14 01:36:19 +03:00 |
|
kimchy
|
65fde3e71e
|
only remove shards if they have been started on all other nodes
|
2011-04-14 01:12:37 +03:00 |
|
kimchy
|
22b5e7ded8
|
Local Gateway: Listed active shards on each node does apply index deletion, closes #853.
|
2011-04-13 16:15:26 +03:00 |
|
kimchy
|
41af86dd7e
|
internal option ot pretty print state
|
2011-04-13 16:04:18 +03:00 |
|
kimchy
|
b80324db08
|
only serialize the cluster state ones when publishing it to multiple nodes
|
2011-04-13 15:36:28 +03:00 |
|
kimchy
|
e9bc7f7d95
|
River: Failure to reallocate river to another node on rivers node failure, closes #850.
|
2011-04-12 21:52:02 +03:00 |
|
kimchy
|
e8503c1455
|
Better handling when a shard hits OOM, closes #848.
|
2011-04-11 21:10:56 +03:00 |
|
kimchy
|
decb5fa898
|
Optimize API: Don't execute concurrent optimize operations (shard level) on the same node, closes #846.
|
2011-04-10 23:12:00 +03:00 |
|
kimchy
|
7d8726a5e8
|
Better handling of shard failures, closes #845.
|
2011-04-10 21:59:59 +03:00 |
|
kimchy
|
8eab5ec528
|
experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load)
|
2011-04-09 20:21:23 +03:00 |
|
kimchy
|
b658fba22e
|
allow to copy openbitset into a sliced one
|
2011-04-09 14:33:16 +03:00 |
|
kimchy
|
991683efa6
|
remove clearUnreferenced from caches, no longer need it
|
2011-04-09 14:20:18 +03:00 |
|
kimchy
|
49e2f55abd
|
actually register the eviction listener with soft / resident filter cache
|
2011-04-09 14:11:42 +03:00 |
|
kimchy
|
c934f04b0c
|
remove weak caching of filters and stick with only caching when needed / flagged / defaulted
|
2011-04-09 02:47:31 +03:00 |
|
kimchy
|
b71513a072
|
JMX: Don't use node id and name as part of the jmx registration, use static org.elasticsearch, closes #843.
|
2011-04-08 18:49:40 +03:00 |
|
kimchy
|
388f4febba
|
add more terms stats bench
|
2011-04-07 20:41:20 +03:00 |
|
kimchy
|
93372868a2
|
fix error when trying to delete all indices and none exists
|
2011-04-07 20:08:53 +03:00 |
|
kimchy
|
ca01dc7a09
|
Network Settings: Allow to explicitly set ipv4 and ipv4 when using _networkInterface_ notation, closes #841.
|
2011-04-07 20:01:52 +03:00 |
|
kimchy
|
1fdef91fc2
|
Allow to search across indices and types even if some types do not exists on some indices, closes #839.
|
2011-04-07 16:00:18 +03:00 |
|
kimchy
|
4603d10501
|
faster handling of a case where each doc has multi valued values for different facets, also, don't take into account missing value values (and in the future, we can also count those per bucket if needed)
|
2011-04-07 15:04:54 +03:00 |
|
kimchy
|
b479bc58f9
|
faster handling of a case where each doc has multi valued values fields in histogram facet
|
2011-04-07 14:52:25 +03:00 |
|
kimchy
|
7fcf82af80
|
faster handling of a case where each doc has multi valued values fields in terms stats
|
2011-04-07 14:44:34 +03:00 |
|
kimchy
|
16a046f686
|
rename termsstats java facet builder to termsStatsFacet
|
2011-04-07 14:30:12 +03:00 |
|
kimchy
|
7decb701d9
|
nicer bench of terms facet
|
2011-04-07 14:16:21 +03:00 |
|
kimchy
|
7231e08f7c
|
also test terms facet with execution hint of map
|
2011-04-07 13:32:35 +03:00 |
|
kimchy
|
c0879c2055
|
add bench on nano time
|
2011-04-06 22:50:36 +03:00 |
|
kimchy
|
08f594c3a0
|
Get Mapping API: when asking for a mapping of a single index and single type, don't wrap the mapping with the index name, closes #838.
|
2011-04-06 22:12:34 +03:00 |
|
kimchy
|
8c50a65699
|
Percolator doesn't work correctly after index recreation, closes #837.
|
2011-04-06 21:00:49 +03:00 |
|
kimchy
|
6317483fe3
|
add total count to terms stats and compute mean properly, also better use caching
|
2011-04-06 15:50:09 +03:00 |
|
kimchy
|
35be46df71
|
Bug: Sort on a column of type 'short' throws an exception, closes #835.
|
2011-04-06 02:25:56 +03:00 |
|
kimchy
|
4721f9aa69
|
fix cache recycling logic to make sure we don't override our own data in facets
|
2011-04-05 23:25:39 +03:00 |
|
kimchy
|
f0de086479
|
for some reason the copyright header got reformatted
|
2011-04-05 15:42:12 +03:00 |
|
kimchy
|
6f827731d6
|
normalize to/from properly in bounded histogram
|
2011-04-05 15:10:55 +03:00 |
|
kimchy
|
1428abf2b7
|
Upgrade to jackson 1.7.5
|
2011-04-05 14:15:48 +03:00 |
|
kimchy
|
9b8eceb229
|
Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834.
|
2011-04-05 13:53:19 +03:00 |
|
kimchy
|
14def814fa
|
fix typo
|
2011-04-05 12:07:46 +03:00 |
|
kimchy
|
d845a306fa
|
fill sentinal proeprly when its not in cache
|
2011-04-05 03:09:33 +03:00 |
|
kimchy
|
a89aeb3a6d
|
add JVM mem to node info API
|
2011-04-05 01:46:09 +03:00 |
|
kimchy
|
83b728a384
|
rename some histogram collectors
|
2011-04-05 01:32:36 +03:00 |
|
kimchy
|
cea8c5fefa
|
Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833.
|
2011-04-05 00:52:58 +03:00 |
|
kimchy
|
79939222e4
|
Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832.
|
2011-04-05 00:42:46 +03:00 |
|
kimchy
|
90a339ad5e
|
Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831.
|
2011-04-05 00:17:07 +03:00 |
|
kimchy
|
8d1e9dbd3c
|
Histogram Facet: Add min/max stats when providing value field / script, closes #830.
|
2011-04-04 23:48:54 +03:00 |
|
kimchy
|
46088b9f8a
|
Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829.
|
2011-04-04 21:30:46 +03:00 |
|
kimchy
|
58c606d6d9
|
break field data value iterator into two callback types, one with support for missing, and one without
|
2011-04-04 19:53:09 +03:00 |
|
kimchy
|
c9838d5c75
|
use cache recycler for count histo and data histo facets
|
2011-04-04 19:44:46 +03:00 |
|
kimchy
|
105d60ac9c
|
Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824.
|
2011-04-04 17:44:38 +03:00 |
|
kimchy
|
5d6e84f206
|
Upgrade Lucene 3.1: Analyzers, closes #826.
|
2011-04-04 14:36:13 +03:00 |
|
kimchy
|
4e4495ff1d
|
Upgrade to Lucene 3.1, closes #825.
|
2011-04-04 12:54:15 +03:00 |
|
kimchy
|
db1dcaded3
|
Concurrent calls to refresh might result in "dangling" searchers, closes #823.
|
2011-04-01 22:43:48 +03:00 |
|
kimchy
|
1280512097
|
also support regex pattern matching with ordinals
|
2011-04-01 16:54:37 +03:00 |
|
kimchy
|
e4cbdfa05b
|
Terms Facet: Performance improvements, closes #822.
|
2011-04-01 16:30:45 +03:00 |
|
kimchy
|
fb8a389380
|
more bench work
|
2011-03-31 18:25:23 +02:00 |
|
kimchy
|
44d4474f95
|
anoter small bench
|
2011-03-31 17:48:57 +02:00 |
|
kimchy
|
a0cddf0745
|
small improvement to stats facet computing min/max
|
2011-03-31 17:41:21 +02:00 |
|
kimchy
|
3ff35d42b5
|
Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821.
|
2011-03-31 17:03:37 +02:00 |
|
kimchy
|
09d3b882f0
|
more small bench
|
2011-03-31 02:30:17 +02:00 |
|
kimchy
|
74838fe1aa
|
Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820.
|
2011-03-31 01:09:03 +02:00 |
|
kimchy
|
14d98a7319
|
Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819.
|
2011-03-31 01:04:09 +02:00 |
|
kimchy
|
f90b4e6fee
|
some more micro bench support
|
2011-03-30 23:32:33 +02:00 |
|
kimchy
|
ae0eed937b
|
update to the new lzf compression (0.7)
|
2011-03-30 20:43:20 +02:00 |
|
kimchy
|
2dd5094d37
|
Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817.
|
2011-03-30 15:43:56 +02:00 |
|
kimchy
|
7ce7fb33e5
|
Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816.
|
2011-03-30 15:40:11 +02:00 |
|
kimchy
|
8a5dd90885
|
HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815.
|
2011-03-30 14:46:39 +02:00 |
|
kimchy
|
eafe686013
|
warm up with compression bench
|
2011-03-30 13:52:52 +02:00 |
|
kimchy
|
fdbccf28b0
|
Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814.
|
2011-03-30 12:56:53 +02:00 |
|
kimchy
|
9bb0bcf4e3
|
add logging when trying to obtain node lock
|
2011-03-29 21:34:15 +02:00 |
|
kimchy
|
0069d5a75d
|
add adler to checksum, faster and is good enough with length check for our use case
|
2011-03-29 21:27:18 +02:00 |
|
kimchy
|
a1be2bbf20
|
add adler to checksum tests
|
2011-03-29 18:17:09 +02:00 |
|
kimchy
|
3138269573
|
Indices Status API: Add refresh stats, closes #811.
|
2011-03-29 17:54:00 +02:00 |
|
kimchy
|
2a032f8718
|
add remote many indices creation test
|
2011-03-29 17:17:54 +02:00 |
|
kimchy
|
0e6bbf3f85
|
call shard refresh API and not directly the engine one
|
2011-03-29 17:17:39 +02:00 |
|
kimchy
|
ff8dc2673f
|
Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810.
|
2011-03-29 13:50:25 +02:00 |
|
kimchy
|
508d1d40fb
|
Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809.
|
2011-03-29 13:05:36 +02:00 |
|
kimchy
|
95e36a073a
|
move index/delete refresh to happen outside of the engine
|
2011-03-29 01:28:37 +02:00 |
|
kimchy
|
53935f078a
|
optimize array list creation with exact size
|
2011-03-28 21:50:39 +02:00 |
|
kimchy
|
49f79f54d2
|
log when search failure happen when scanning
|
2011-03-28 18:17:36 +02:00 |
|
kimchy
|
f00664621f
|
more scan tests to try and recreate the context missing failure, no luck yet...
|
2011-03-28 17:21:59 +02:00 |
|
kimchy
|
e0d8094f3d
|
clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block
|
2011-03-28 17:20:07 +02:00 |
|
kimchy
|
953a99c75c
|
fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered
|
2011-03-28 16:08:01 +02:00 |
|
kimchy
|
64a89eb0e4
|
add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers
|
2011-03-28 14:21:49 +02:00 |
|
kimchy
|
af419cc636
|
upgrade to guice 3.0
|
2011-03-27 19:31:51 +02:00 |
|
kimchy
|
b28461dd0e
|
compress cluster state when publishing it
|
2011-03-24 01:12:36 +02:00 |
|
kimchy
|
992becf013
|
add value_script as an option to terms stats
|
2011-03-24 01:03:17 +02:00 |
|
kimchy
|
f20c6ec9cf
|
check if index service is null, and don't load percolators in this case
|
2011-03-24 00:40:21 +02:00 |
|
kimchy
|
36edcef640
|
compress metadata stored in gateway
|
2011-03-24 00:38:16 +02:00 |
|
kimchy
|
4f27fa3f45
|
add the version to the jvm info, and, warn if running using the client vm
|
2011-03-23 18:06:29 +02:00 |
|
kimchy
|
20593fb966
|
Mapping: Add _size field mapping, indexing the original source size, closes #804.
|
2011-03-23 17:37:40 +02:00 |
|
kimchy
|
b2d7cd78b7
|
don't clean up indices if there is a block disabling persistence
|
2011-03-22 18:41:29 +02:00 |
|
kimchy
|
8c9000c54c
|
Extend stats API to include filter's cache count and eviction count, closes #802.
|
2011-03-22 13:30:14 +02:00 |
|
kimchy
|
e759b4c971
|
Add option to expire filter's cache based on access time, closes #803.
|
2011-03-22 13:14:31 +02:00 |
|
kimchy
|
0d150e6918
|
Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801.
|
2011-03-22 01:29:41 +02:00 |
|
kimchy
|
9f44c93a25
|
make sure to log failures in search when reducing results
|
2011-03-22 01:05:54 +02:00 |
|
kimchy
|
61034f5c86
|
Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800.
|
2011-03-21 18:10:13 +02:00 |
|
kimchy
|
8f8fb89c4e
|
Update Settings: Allow to control `index.auto_expand_replicas`, closes #799.
|
2011-03-21 16:18:03 +02:00 |
|
kimchy
|
2f1aba962c
|
add the exception as well to the logging
|
2011-03-21 14:36:56 +02:00 |
|
kimchy
|
6c241f3de8
|
protected against a wrong format in the index.auto_expand_replicas setting
|
2011-03-21 14:36:28 +02:00 |
|
kimchy
|
d2e61af9ee
|
maintain total hits across scan scroll requests
|
2011-03-20 00:19:26 +02:00 |
|
kimchy
|
52c750fc42
|
internal support for custom attributes in scroll id
|
2011-03-19 21:51:18 +02:00 |
|
kimchy
|
f3160b71bb
|
can't check on token value, since it might be valid, so, handle the null token case better
|
2011-03-19 21:34:31 +02:00 |
|
kimchy
|
c19a93da89
|
countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index
|
2011-03-19 21:28:17 +02:00 |
|
kimchy
|
fb7fbc8c83
|
NPE when the JSON to index doesn't match the mapping's expectations, closes #795.
|
2011-03-19 20:42:50 +02:00 |
|
kimchy
|
70fc8d9af0
|
Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793.
|
2011-03-19 00:24:20 +02:00 |
|
kimchy
|
bd3f490d60
|
Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791.
|
2011-03-18 20:44:59 +02:00 |
|
kimchy
|
09fbc919b8
|
"exclude" functionality missing for terms facet on numeric fields, closes #789.
|
2011-03-18 11:08:11 +02:00 |
|
kimchy
|
923fcf239c
|
Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790.
|
2011-03-18 10:49:28 +02:00 |
|
kimchy
|
616b3dcb18
|
shard the default analyzer (standard) on the node level
|
2011-03-18 01:35:29 +02:00 |
|
kimchy
|
25124b084b
|
Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787.
|
2011-03-17 22:01:22 +02:00 |
|
kimchy
|
96d06d6dc8
|
Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781.
|
2011-03-15 21:22:46 +02:00 |
|
kimchy
|
0291ab1d8d
|
sync version when getting the state from master
|
2011-03-15 14:15:16 +02:00 |
|
kimchy
|
1bcd3b67ee
|
Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769.
|
2011-03-14 11:30:01 +02:00 |
|
kimchy
|
3192654e80
|
add iterator based on specific index
|
2011-03-13 19:51:21 +02:00 |
|
kimchy
|
96dfdcf97c
|
Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778.
|
2011-03-13 11:43:30 +02:00 |
|
kimchy
|
700a2a9577
|
Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772.
|
2011-03-13 02:29:05 +02:00 |
|
kimchy
|
7c04ef6cbc
|
use byte value
|
2011-03-13 00:51:12 +02:00 |
|
kimchy
|
09006f17c3
|
Support true|false for the 'store' parameter in mappings, closes #775.
|
2011-03-13 00:41:58 +02:00 |
|
kimchy
|
6d108e77f1
|
handle whitespace text on search fields query string parameter to be treated as no fields
|
2011-03-13 00:37:25 +02:00 |
|
kimchy
|
aff8a4407f
|
better exception message
|
2011-03-13 00:31:21 +02:00 |
|
kimchy
|
bdb0fd23e9
|
Versioning: Add a new version_type parameter, with a new type - `external`, closes #776.
|
2011-03-12 20:41:55 +02:00 |
|
kimchy
|
7bab5270fc
|
add a comment on max shard buffer size
|
2011-03-12 17:17:02 +02:00 |
|
kimchy
|
73dec5d63f
|
Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773.
|
2011-03-12 17:03:04 +02:00 |