kimchy
4721f9aa69
fix cache recycling logic to make sure we don't override our own data in facets
2011-04-05 23:25:39 +03:00
kimchy
f0de086479
for some reason the copyright header got reformatted
2011-04-05 15:42:12 +03:00
kimchy
6f827731d6
normalize to/from properly in bounded histogram
2011-04-05 15:10:55 +03:00
kimchy
1428abf2b7
Upgrade to jackson 1.7.5
2011-04-05 14:15:48 +03:00
kimchy
9b8eceb229
Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834 .
2011-04-05 13:53:19 +03:00
kimchy
14def814fa
fix typo
2011-04-05 12:07:46 +03:00
kimchy
d845a306fa
fill sentinal proeprly when its not in cache
2011-04-05 03:09:33 +03:00
kimchy
a89aeb3a6d
add JVM mem to node info API
2011-04-05 01:46:09 +03:00
kimchy
83b728a384
rename some histogram collectors
2011-04-05 01:32:36 +03:00
kimchy
cea8c5fefa
Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833 .
2011-04-05 00:52:58 +03:00
kimchy
79939222e4
Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832 .
2011-04-05 00:42:46 +03:00
kimchy
90a339ad5e
Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831 .
2011-04-05 00:17:07 +03:00
kimchy
8d1e9dbd3c
Histogram Facet: Add min/max stats when providing value field / script, closes #830 .
2011-04-04 23:48:54 +03:00
kimchy
46088b9f8a
Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829 .
2011-04-04 21:30:46 +03:00
kimchy
58c606d6d9
break field data value iterator into two callback types, one with support for missing, and one without
2011-04-04 19:53:09 +03:00
kimchy
c9838d5c75
use cache recycler for count histo and data histo facets
2011-04-04 19:44:46 +03:00
kimchy
105d60ac9c
Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824 .
2011-04-04 17:44:38 +03:00
kimchy
5d6e84f206
Upgrade Lucene 3.1: Analyzers, closes #826 .
2011-04-04 14:36:13 +03:00
kimchy
4e4495ff1d
Upgrade to Lucene 3.1, closes #825 .
2011-04-04 12:54:15 +03:00
kimchy
db1dcaded3
Concurrent calls to refresh might result in "dangling" searchers, closes #823 .
2011-04-01 22:43:48 +03:00
kimchy
1280512097
also support regex pattern matching with ordinals
2011-04-01 16:54:37 +03:00
kimchy
e4cbdfa05b
Terms Facet: Performance improvements, closes #822 .
2011-04-01 16:30:45 +03:00
kimchy
fb8a389380
more bench work
2011-03-31 18:25:23 +02:00
kimchy
44d4474f95
anoter small bench
2011-03-31 17:48:57 +02:00
kimchy
a0cddf0745
small improvement to stats facet computing min/max
2011-03-31 17:41:21 +02:00
kimchy
3ff35d42b5
Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821 .
2011-03-31 17:03:37 +02:00
kimchy
09d3b882f0
more small bench
2011-03-31 02:30:17 +02:00
kimchy
74838fe1aa
Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820 .
2011-03-31 01:09:03 +02:00
kimchy
14d98a7319
Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819 .
2011-03-31 01:04:09 +02:00
kimchy
f90b4e6fee
some more micro bench support
2011-03-30 23:32:33 +02:00
kimchy
ae0eed937b
update to the new lzf compression (0.7)
2011-03-30 20:43:20 +02:00
kimchy
2dd5094d37
Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817 .
2011-03-30 15:43:56 +02:00
kimchy
7ce7fb33e5
Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816 .
2011-03-30 15:40:11 +02:00
kimchy
8a5dd90885
HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815 .
2011-03-30 14:46:39 +02:00
kimchy
eafe686013
warm up with compression bench
2011-03-30 13:52:52 +02:00
kimchy
fdbccf28b0
Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814 .
2011-03-30 12:56:53 +02:00
kimchy
9bb0bcf4e3
add logging when trying to obtain node lock
2011-03-29 21:34:15 +02:00
kimchy
0069d5a75d
add adler to checksum, faster and is good enough with length check for our use case
2011-03-29 21:27:18 +02:00
kimchy
a1be2bbf20
add adler to checksum tests
2011-03-29 18:17:09 +02:00
kimchy
3138269573
Indices Status API: Add refresh stats, closes #811 .
2011-03-29 17:54:00 +02:00
kimchy
2a032f8718
add remote many indices creation test
2011-03-29 17:17:54 +02:00
kimchy
0e6bbf3f85
call shard refresh API and not directly the engine one
2011-03-29 17:17:39 +02:00
kimchy
ff8dc2673f
Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810 .
2011-03-29 13:50:25 +02:00
kimchy
508d1d40fb
Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809 .
2011-03-29 13:05:36 +02:00
kimchy
95e36a073a
move index/delete refresh to happen outside of the engine
2011-03-29 01:28:37 +02:00
kimchy
53935f078a
optimize array list creation with exact size
2011-03-28 21:50:39 +02:00
kimchy
49f79f54d2
log when search failure happen when scanning
2011-03-28 18:17:36 +02:00
kimchy
f00664621f
more scan tests to try and recreate the context missing failure, no luck yet...
2011-03-28 17:21:59 +02:00
kimchy
e0d8094f3d
clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block
2011-03-28 17:20:07 +02:00
kimchy
953a99c75c
fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered
2011-03-28 16:08:01 +02:00
kimchy
64a89eb0e4
add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers
2011-03-28 14:21:49 +02:00
kimchy
af419cc636
upgrade to guice 3.0
2011-03-27 19:31:51 +02:00
kimchy
b28461dd0e
compress cluster state when publishing it
2011-03-24 01:12:36 +02:00
kimchy
992becf013
add value_script as an option to terms stats
2011-03-24 01:03:17 +02:00
kimchy
f20c6ec9cf
check if index service is null, and don't load percolators in this case
2011-03-24 00:40:21 +02:00
kimchy
36edcef640
compress metadata stored in gateway
2011-03-24 00:38:16 +02:00
kimchy
4f27fa3f45
add the version to the jvm info, and, warn if running using the client vm
2011-03-23 18:06:29 +02:00
kimchy
20593fb966
Mapping: Add _size field mapping, indexing the original source size, closes #804 .
2011-03-23 17:37:40 +02:00
kimchy
b2d7cd78b7
don't clean up indices if there is a block disabling persistence
2011-03-22 18:41:29 +02:00
kimchy
8c9000c54c
Extend stats API to include filter's cache count and eviction count, closes #802 .
2011-03-22 13:30:14 +02:00
kimchy
e759b4c971
Add option to expire filter's cache based on access time, closes #803 .
2011-03-22 13:14:31 +02:00
kimchy
0d150e6918
Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801 .
2011-03-22 01:29:41 +02:00
kimchy
9f44c93a25
make sure to log failures in search when reducing results
2011-03-22 01:05:54 +02:00
kimchy
61034f5c86
Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800 .
2011-03-21 18:10:13 +02:00
kimchy
8f8fb89c4e
Update Settings: Allow to control `index.auto_expand_replicas`, closes #799 .
2011-03-21 16:18:03 +02:00
kimchy
2f1aba962c
add the exception as well to the logging
2011-03-21 14:36:56 +02:00
kimchy
6c241f3de8
protected against a wrong format in the index.auto_expand_replicas setting
2011-03-21 14:36:28 +02:00
kimchy
d2e61af9ee
maintain total hits across scan scroll requests
2011-03-20 00:19:26 +02:00
kimchy
52c750fc42
internal support for custom attributes in scroll id
2011-03-19 21:51:18 +02:00
kimchy
f3160b71bb
can't check on token value, since it might be valid, so, handle the null token case better
2011-03-19 21:34:31 +02:00
kimchy
c19a93da89
countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index
2011-03-19 21:28:17 +02:00
kimchy
fb7fbc8c83
NPE when the JSON to index doesn't match the mapping's expectations, closes #795 .
2011-03-19 20:42:50 +02:00
kimchy
70fc8d9af0
Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793 .
2011-03-19 00:24:20 +02:00
kimchy
bd3f490d60
Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791 .
2011-03-18 20:44:59 +02:00
kimchy
09fbc919b8
"exclude" functionality missing for terms facet on numeric fields, closes #789 .
2011-03-18 11:08:11 +02:00
kimchy
923fcf239c
Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790 .
2011-03-18 10:49:28 +02:00
kimchy
616b3dcb18
shard the default analyzer (standard) on the node level
2011-03-18 01:35:29 +02:00
kimchy
25124b084b
Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787 .
2011-03-17 22:01:22 +02:00
kimchy
96d06d6dc8
Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781 .
2011-03-15 21:22:46 +02:00
kimchy
0291ab1d8d
sync version when getting the state from master
2011-03-15 14:15:16 +02:00
kimchy
1bcd3b67ee
Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769 .
2011-03-14 11:30:01 +02:00
kimchy
3192654e80
add iterator based on specific index
2011-03-13 19:51:21 +02:00
kimchy
96dfdcf97c
Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778 .
2011-03-13 11:43:30 +02:00
kimchy
700a2a9577
Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772 .
2011-03-13 02:29:05 +02:00
kimchy
7c04ef6cbc
use byte value
2011-03-13 00:51:12 +02:00
kimchy
09006f17c3
Support true|false for the 'store' parameter in mappings, closes #775 .
2011-03-13 00:41:58 +02:00
kimchy
6d108e77f1
handle whitespace text on search fields query string parameter to be treated as no fields
2011-03-13 00:37:25 +02:00
kimchy
aff8a4407f
better exception message
2011-03-13 00:31:21 +02:00
kimchy
bdb0fd23e9
Versioning: Add a new version_type parameter, with a new type - `external`, closes #776 .
2011-03-12 20:41:55 +02:00
kimchy
7bab5270fc
add a comment on max shard buffer size
2011-03-12 17:17:02 +02:00
kimchy
73dec5d63f
Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773 .
2011-03-12 17:03:04 +02:00
kimchy
19052a3538
Add another flag to gateway if it even requires snapshot, so we don't try and snapshot on shutdown for none/local gateway (even though its a no op)
2011-03-11 15:20:16 +02:00
kimchy
3e624bf9e0
better failure when trying to obtain a native lock on the node data location, and reduce the tries from 100 to 50.
2011-03-11 15:05:22 +02:00
kimchy
e1c86b86e5
add simplified ways to create XContentBuilder that will output to OutputStream using XContentFactory
2011-03-10 16:00:19 +02:00
kimchy
0df3dfd72b
add the ability to set source and extra source on the SearchRequestBuilder
2011-03-09 21:55:46 +02:00
kimchy
80a797fc4f
Update Settings: Allow to dynamically update `index.translog` settings, closes #765 .
2011-03-09 14:17:34 +02:00
kimchy
c2a0e0b767
Mapper: Using `dynamic_template` can result in warning of parsed and original source difference (resulting in excessive mapping parsing), closes #764 .
2011-03-09 11:36:51 +02:00
kimchy
f694b9dfd8
Percolator: Failures when using docs where fields repeat, such as arrays, closes #763 .
2011-03-09 11:31:05 +02:00
kimchy
ad0d681b6d
Update Settings: Allow to dynamically change `index.term_index_interval` and `index.term_index_divisor, closes #762 .
2011-03-09 07:36:18 +02:00
kimchy
353d2cb21f
Mvel Script: add more random options, and optimize random, closes #759 .
2011-03-08 22:24:22 +02:00
kimchy
016e5bce04
Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758 .
2011-03-08 21:53:33 +02:00
kimchy
77cf3e1924
small refactor in index settings, allowing for future dynamic changes to it
2011-03-08 11:12:40 +02:00
kimchy
e709a0bde4
Logging: Add merge level logging, closes #755 .
2011-03-08 08:20:48 +02:00
kimchy
9e2143f343
add a warning for types not to include dots (can't really throw a failure because of it since it will break backward)
2011-03-07 19:17:39 +02:00
kimchy
4bdae621f9
Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752 .
2011-03-07 13:09:07 +02:00
kimchy
1242cf59f6
upgrade to guice 3 rc3
2011-03-07 06:52:55 +02:00
kimchy
cb912de255
ignore engine closed exception as well
2011-03-05 10:46:00 +02:00
kimchy
f0825414d3
upgrade to jackson 1.7.4
2011-03-05 10:45:20 +02:00
kimchy
bc882182ab
change scripts to start the ElasticSearch main class (a wrapper around Bootstrap) just so the process name will look nicely on jps
2011-03-04 20:14:22 +02:00
kimchy
c097735196
improve async merge process, don't spawn a thread unless a merge is really needed, and add an optimized "maybeMerge" operation
2011-03-04 20:05:52 +02:00
kimchy
20ed540fe7
don't block node master node startup if recover_after_time is set and nodes settings are not met (we already handle it with the not recovered state)
2011-03-04 05:11:28 +02:00
kimchy
4b92928c77
Internal: Improve checksum process by bulk writing them into a single file instead of checksum file per index file, closes #747 .
2011-03-04 04:22:47 +02:00
kimchy
b629d36d8b
add a merge thread pool that only does async merges (optimize), so it can be controlled by itself
2011-03-04 01:04:59 +02:00
kimchy
06ad13f373
no need to call maybe merge as part of flush, we do it async anyhow
2011-03-04 00:56:34 +02:00
kimchy
607ada75a6
optimize the index status response
2011-03-04 00:55:39 +02:00
kimchy
41ddcdca93
Node Stats API: Change the structure of the response (more structured), closes #746 .
2011-03-04 00:26:47 +02:00
kimchy
f901429aaa
Node Stats API: Change the structure of the response (more structured), closes #746 .
2011-03-04 00:20:05 +02:00
kimchy
682ad7e2fc
Indices Status / Node Stats: Add (Lucene) index merge stats, closes #745 .
2011-03-03 23:53:28 +02:00
kimchy
2909060af8
Query DSL: flt_field does not allow to set min_similarity and prefix_length, closes #744 .
2011-03-03 04:17:02 +02:00
kimchy
78c6f951a3
All Field: All field cane fail to analyze input data (rare cases), closes #743 .
2011-03-03 02:59:27 +02:00
kimchy
68c1dd771c
upgrade to mvel 2.1 beta2
2011-03-02 22:37:36 +02:00
kimchy
4631df9d01
Delete API: Allow to set _parent on it (will simply set the routing value), closes #742 .
2011-03-02 22:14:49 +02:00
kimchy
655cbb9440
improve failure when disabling dynamic creating of types, and trying to index into a non existing type
2011-03-02 20:42:43 +02:00
kimchy
faefc772a4
Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736 .
2011-03-02 05:11:02 +02:00
kimchy
bb1668c2b7
count date histo using the wrong counts aggregator to return results when using time based setting interval
2011-03-02 03:13:25 +02:00
kimchy
3361a9365b
since we now take all#enabled into account when checking for include_in_all, there is no need to set it on every mapper
2011-03-02 03:01:01 +02:00
kimchy
185cd68045
really fix time format interval for date_histogram now
2011-03-02 00:39:18 +02:00
kimchy
1d240aaff6
prefix inside a dis_max / bool query broken, closes #732 .
2011-03-02 00:36:30 +02:00
kimchy
ce862da8f4
add tests for boosted wildcard and prefix queries
2011-03-02 00:26:49 +02:00
kimchy
9560451896
optimize query facet to extract filter from constant_score queries automatically
2011-03-02 00:18:26 +02:00
kimchy
60b423b741
Don't "double" cache a facet filter / query facet, closes #734 .
2011-03-01 22:14:36 +02:00
kimchy
0e30ad90f5
support 'w' as suffix for time format
2011-03-01 20:16:18 +02:00
kimchy
0183516221
better failure message
2011-03-01 05:34:21 +02:00
kimchy
e639ffbc93
Search: Allow to use has_child filter in facets, closes #730 .
2011-03-01 04:45:25 +02:00
kimchy
6097365738
eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729 .
2011-03-01 00:49:41 +02:00
kimchy
9d81d01c93
only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging)
2011-03-01 00:26:03 +02:00
kimchy
0662f65fda
log warning when failing to list started shards on other nodes when doing local gateway allocation
2011-03-01 00:25:03 +02:00
kimchy
906ec57f20
Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728 .
2011-02-28 22:43:48 +02:00
kimchy
3bac33e69e
don't use AfterTest / BeforeTest in any tests
2011-02-28 22:28:55 +02:00
kimchy
24199a3394
add simple unicast disco test on hte node level
2011-02-28 21:43:31 +02:00
kimchy
47a6065805
Date Histogram Facet: NPE if using "1w" interval, closes #727 .
2011-02-28 20:31:02 +02:00
kimchy
d395c0a844
better failure message when failing to find a type mapping for a document loaded from the index
2011-02-28 20:21:47 +02:00
kimchy
3b967040da
Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725 .
2011-02-27 01:06:50 +02:00
kimchy
fdef88debb
Bulk API: Improve memory usage when executing large bulk requests, closes #724 .
2011-02-26 23:46:22 +02:00
kimchy
3cda177b9b
Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723 .
2011-02-26 22:25:26 +02:00
kimchy
4634ca5cb8
Mapping: When _all is disabled, optimize to not gather all entries, closes #722 .
2011-02-26 04:16:03 +02:00
kimchy
608c5a838d
Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721 .
2011-02-25 03:54:18 +02:00
kimchy
ecc1a3cd8c
Acknowledge problem for put mapping with multiple indices or all indices, closes #720 .
2011-02-24 21:17:24 +02:00
kimchy
4def1f4b8e
upgrade to google guava r08
2011-02-24 08:49:38 +02:00
kimchy
8a03ca1114
Search: Allow to filter out docs based on a minimum score, closes #719 .
2011-02-24 06:55:16 +02:00
kimchy
a0fd47159e
improve internal scan handling, by using count type for the first scan
2011-02-24 01:04:49 +02:00
kimchy
ee9beda398
Search: Add search_type for `count` to return count but still support facets, closes #718 .
2011-02-24 00:29:42 +02:00
kimchy
f7100c0698
Improve from hits pagination (duplicates), closes #717 .
2011-02-23 22:57:44 +02:00
kimchy
6b7192e744
add from/to test without sorting on single shard
2011-02-23 21:41:31 +02:00
kimchy
5082ad6d11
Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716 .
2011-02-23 21:17:09 +02:00
kimchy
8371920a89
add min/max to terms stats facet
2011-02-23 20:36:12 +02:00
kimchy
be1b46061e
add filter and scope parameters when creating terms stats facet
2011-02-23 19:37:20 +02:00
kimchy
8617e3b0e3
enhance memory usage when doing reduce on histogram facets
2011-02-23 05:55:23 +02:00
kimchy
9cccfc3bd3
improve terms stats facet internal data structure and sorting
2011-02-23 05:04:45 +02:00
kimchy
2845cbefaa
move to mvel 2.1.beta1 (versioning changed from 2.1.rc1)
2011-02-23 02:32:56 +02:00
kimchy
1a48007174
Single node cluster comes up as red with local gateway, closes #714 .
2011-02-23 01:21:17 +02:00
kimchy
58dbf6d5ca
fix terms facet TOTAL comparator to also do secondary sort when totals are equal
2011-02-23 00:55:40 +02:00
kimchy
c6f58321e4
Node Stats: Add number of docs per node, closes #713 .
2011-02-22 22:27:12 +02:00
kimchy
45ec2c6e21
Allow to register custom rivers under a custom type name (And not full class names), closes #712 .
2011-02-22 22:13:31 +02:00
kimchy
06850f8673
add another test to scan
2011-02-22 21:01:11 +02:00
kimchy
7dda421cfa
River not recovered when using single node after shutdown, closes #711 .
2011-02-22 20:38:52 +02:00
kimchy
953fcbc58c
Get API: Allow to provide a script as a field, closes #708 .
2011-02-22 02:28:19 +02:00
kimchy
818f3b4d75
Search: Add search type `scan` allowing to efficiently scan large result set, closes #707 .
2011-02-22 00:11:31 +02:00
kimchy
65ca857027
Add `http` and `transport` simplified host settings, closes #706 .
2011-02-21 19:51:18 +02:00
kimchy
be372bee7d
ignore a case where we can't find an index trying to apply shards, it gets deleted on us
2011-02-20 02:04:44 +02:00
Benoit Sigoure
fcdd103345
Simplify some error-handling logic a bit.
2011-02-20 00:45:25 +02:00
kimchy
d76f12a9f3
return 0 as prefix / suffix content length for utf8 response
2011-02-20 00:18:48 +02:00
kimchy
352cb74f96
Search: Terms Stats Facet, closes #705 .
2011-02-19 23:37:04 +02:00
kimchy
745614f53d
notify listener on failure
2011-02-19 23:19:02 +02:00
kimchy
d3ba8bd487
use parsing field to check for order
2011-02-19 01:41:48 +02:00
kimchy
d7a02fb28f
Handle cluster join request on a non IO thread, closes #702 .
2011-02-18 23:46:15 +02:00
kimchy
9ac048c68c
add "same" thread pool type (really, just for testing)
2011-02-18 07:59:14 +02:00
kimchy
585c310aa4
add edge histogram test
2011-02-18 07:35:33 +02:00
kimchy
d8bec39b73
more support for wares
2011-02-18 05:03:46 +02:00
kimchy
8d867dc24c
explicitly set the cat under which jdk logging is logged
2011-02-18 05:00:08 +02:00
kimchy
60578aef4d
add name as another setting to set on snowball, not just language
2011-02-17 22:22:34 +02:00
kimchy
c67912e259
reset stream when getting all stream so it can be reused
2011-02-17 19:25:23 +02:00
kimchy
9ca8165f3b
Cluster Shutdown API: On full/_all shutdown, shutdown only data/master nodes, not client nodes, closes #697 .
2011-02-17 03:33:34 +02:00
kimchy
245d241a5c
handle any exception on first phase
2011-02-17 02:06:59 +02:00
kimchy
09d650fae7
Index Status: Peer recovery does not compute the index size correctly to report the full size, closes #695 .
2011-02-17 01:43:56 +02:00
kimchy
fb90392040
add status based test
2011-02-17 01:28:54 +02:00
kimchy
6ffd60dfb5
change var name to better reflect the fact that its data and not work
2011-02-17 01:07:05 +02:00
kimchy
3c9dafe67b
better reason for disco state change
2011-02-16 23:30:40 +02:00
kimchy
bc504d6c08
add simple netty benchmark
2011-02-16 08:17:31 +02:00
kimchy
2f5dd85bd5
change handlers from CHM to volatile Immutable Map
2011-02-16 05:24:29 +02:00
kimchy
3679efa840
default management TP to max at 20
2011-02-16 02:44:48 +02:00
kimchy
087f5d6bea
fix scheduling to actually schedule the correct runnable
2011-02-16 02:44:24 +02:00
kimchy
d1d3f8c4ca
REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690 .
2011-02-16 01:41:01 +02:00
Lukáš Vlček
12a33e6a91
Add new Access-Control-Allow-Headers value into http response header, closes #688
2011-02-15 23:53:53 +02:00
kimchy
442ce9daaa
ignore closed exception when async loading bloom filters
2011-02-15 23:23:49 +02:00
kimchy
f14305e95c
upgrade to jackson 1.7.3
2011-02-15 20:57:13 +02:00
kimchy
36efde8c1d
simplify threaded listener invocation by wrapping the listener with a threaded listener and not check in each action for it
2011-02-15 07:52:24 +02:00
kimchy
3ed848a495
ThreadPool: Refactor into several pools, with configurable types per pool, closes #687 .
2011-02-15 07:00:24 +02:00
kimchy
1b5cdb181a
Query: boosting query, closes #683 .
2011-02-11 19:59:15 +02:00
kimchy
65197ba39d
don't return null highlighted fields if no highlighting was done
2011-02-11 18:31:09 +02:00
kimchy
d054c8c14e
use cached thread pool to do cluster state gateway snapshotting
2011-02-11 03:14:13 +02:00
kimchy
e63e5f232c
only actually fork to another thread if a flush is really needed
2011-02-11 02:35:02 +02:00
kimchy
fc88cccfb4
only fork a refresh if it actually needs to be refreshed
2011-02-11 02:27:29 +02:00
kimchy
7c4d574a32
only call refresh if its needed, so we check outside of the readLock when async refreshing
2011-02-11 01:53:48 +02:00
kimchy
df4f4f056a
protected against a possible null for lastGC in the previous collection
2011-02-11 01:48:23 +02:00
kimchy
260aab21fd
filtered collector should set the next reader on the wrapped collector
2011-02-11 00:34:20 +02:00
kimchy
44b06bee3b
open indexing searcher lazily when indexing, and not when flushing
2011-02-10 20:31:01 +02:00
Alberto Paro
7bbf69b194
Added support to define rest actions in plugins
2011-02-10 19:00:17 +02:00
Alberto Paro
35c339f5f3
Removed empty fragments in highlight results
2011-02-10 19:00:17 +02:00
Alberto Paro
5ea58a3387
Don't fail search if highlight field is missing for a specific type. Close #682
2011-02-10 19:00:17 +02:00
kimchy
a3af51a1d9
add fixed thread pool module so one can create it
2011-02-10 17:42:34 +02:00
kimchy
2e12e5b279
make optimize default parameters constants
2011-02-10 16:48:05 +02:00
kimchy
9ae9ab9553
add flush to search 1 stress test
2011-02-10 16:47:43 +02:00
kimchy
57108c8575
REST API: Failure to index docs that have their ids URL encoded and contain `/`, closes #681 .
2011-02-10 03:18:01 +02:00
kimchy
89ac4d108a
make forkjoin an option in fixed thread pool
2011-02-10 00:05:08 +02:00
kimchy
30510a8320
add forkjoin TP
2011-02-09 23:47:38 +02:00
kimchy
5e96d3d93d
add fixed thread pool (mainly for internal testing for now)
2011-02-09 23:47:13 +02:00
kimchy
5047f4aa6f
fix wrong parsing of of version / explain causing NPE on search
2011-02-09 22:56:52 +02:00
kimchy
2b8a6742dd
move transport benchmark to the micro bench
2011-02-09 22:50:44 +02:00
kimchy
b26d86293f
terms facet on an IP field returns terms as numbers, not IPs, closes #678 .
2011-02-09 21:37:42 +02:00
kimchy
d35f397608
remove timer service
2011-02-09 19:01:05 +02:00
kimchy
9f2afeb4ca
move to use scheduled TP and not timer service
2011-02-09 17:21:16 +02:00
kimchy
27d6c71d5b
move to use scheduled TP and not timer service
2011-02-09 16:47:04 +02:00
kimchy
ccb30d42e9
move to use a single thread for the scheduled tasks, forking where need to another TP
2011-02-09 16:25:09 +02:00
kimchy
f6dced3750
upgrade to netty 3.2.4
2011-02-09 02:07:02 +02:00
kimchy
d442f33d0b
more api cleaning
2011-02-09 00:37:27 +02:00
kimchy
f7aee2a423
clean thread pool interface
2011-02-09 00:30:21 +02:00
kimchy
f09a66bf12
upgrade to latest jsr166y code
2011-02-09 00:26:09 +02:00
kimchy
ff044c1882
Add safeJsonBuilder and safeSmileBuilder for cases where the builder needs to be used outside the scope of directly passing it to an API
2011-02-08 23:41:20 +02:00
kimchy
9c011d5b79
improve get perf by using bloom filter to fetch the doc
2011-02-08 23:40:49 +02:00
kimchy
7a8995e6a8
add max_size to bloom filter, defaults to 500m
2011-02-08 23:02:29 +02:00
kimchy
1db2d993cb
have a 500 million docs cap on the creation of a bloom filter
2011-02-08 22:57:50 +02:00
kimchy
4bcedde011
don't require to provide the type of the doc in the doc element in percolator request, also, change the REST endpoint for percolator to include the type, basically: {index}/{type}/_percolate
2011-02-08 22:24:44 +02:00
kimchy
3062d5b86c
nice usage of versioning parse element
2011-02-08 17:50:28 +02:00
kimchy
ac8646deb7
Search: By default, don't return the version per hit, unless `version` is set to `true`, closes #676 .
2011-02-08 17:48:13 +02:00
kimchy
18ff92662e
bulk request does not refresh on shard replicas
2011-02-08 15:03:03 +02:00
kimchy
4084db378d
more eager refresh logic, execute a refresh even if one is on going so no operations are missed
2011-02-08 12:52:45 +02:00
kimchy
37b1415b57
Improve error when creating a percolator with no query, closes #669 .
2011-02-08 11:57:07 +02:00
kimchy
da9f4992e0
flush with full=true is broken: this IndexWriter is closed, closes #670 .
2011-02-08 11:50:23 +02:00
kimchy
059936fc84
make custom CMS static
2011-02-08 11:41:08 +02:00
kimchy
43a95de9db
dynamic flag on object type should lower case itself when serialized back to its json representation
2011-02-08 11:38:02 +02:00
kimchy
b8c644cab5
ip mapping no longer enabled
2011-02-08 11:24:14 +02:00
kimchy
490ddc5d1d
ip mapping no longer enabled
2011-02-08 11:08:50 +02:00
Edward Dale
f319625cb5
Adding Analysis.getWordList method which retrieves list of words from setting or file specified by setting.
2011-02-08 11:02:18 +02:00
Edward Dale
c95544141b
Adding a decompounding token filter.
2011-02-08 11:02:18 +02:00
kimchy
a663b7ced9
default snowball token filter to English (similar to the analyzer)
2011-02-08 01:38:09 +02:00
kimchy
689b20a518
Mapping: Disable automatic ip type detection on new fields, closes #674 .
2011-02-08 01:14:34 +02:00
kimchy
4319e3cb05
add a test to fetch just an array element (which has no mapping)
2011-02-07 20:24:15 +02:00
kimchy
f0a8bf3783
remove monitoring dead locks
2011-02-06 23:37:38 +02:00
kimchy
3dc3206e0f
don't use time estimator to wakeup a thread each time
2011-02-06 23:33:11 +02:00
kimchy
02a2ebb84b
add geo_bbox as an alias to geo bounding box
2011-02-06 21:58:49 +02:00
kimchy
151e24c5bd
upgrade to jackson 1.7.2
2011-02-03 23:36:55 +02:00
kimchy
1f68d7eabf
when introducing a new type or new fields as part of an index request, wait (with a cap) until they are introduced on to the cluster before returning from the index request
2011-02-03 22:55:16 +02:00
kimchy
28dbbaa3fa
allow to set an internal source builder on search request builder
2011-02-03 22:54:31 +02:00
kimchy
00cba66eb8
move to use mvel 2.1.RC1
2011-02-03 11:29:24 +02:00
kimchy
5fe2615ba7
Index Status: Add primary store size to include only primary shards store sizes, also move index store and translog into their own elements, closes #666 .
2011-02-03 00:50:24 +02:00
kimchy
13869239b0
better help on -url for plugin command
2011-02-02 17:56:57 +02:00
kimchy
904bee12bc
Search: Failure when sorting on `short` type, closes #665 .
2011-02-02 17:55:21 +02:00
kimchy
95ea6153a7
no need for thread pool to notify listeners
2011-02-02 16:16:29 +02:00
kimchy
da17be34c1
if no shards are allocated for a deleted index, then no need to wait for a response
2011-02-02 15:28:48 +02:00
kimchy
4ed82023ce
another embedded test for query and fetch on a single shard
2011-02-02 14:04:24 +02:00
kimchy
0bce34cb5a
optimize single shard search (or search result) by not doing another round of sorting
2011-02-02 13:52:34 +02:00
kimchy
8c196d8b84
better logging, and disable strange failure in thread locals test when run with gradle (for now)
2011-02-02 12:15:18 +02:00
kimchy
3f62b9ea96
check for trace logging
2011-02-02 11:25:13 +02:00
kimchy
c86551d9b5
move master node tests to cluster package, and force it to use zen disco always
2011-02-02 11:15:12 +02:00
kimchy
d2a3f5142f
improve the order of shutdown of top level components in node, close indices first and applying cluster changes, also, improve atomicity of closing of indices and shards
2011-02-01 23:10:15 +02:00
kimchy
eb1db1140b
better to close the channels on another thread as well, just to be safe
2011-02-01 23:08:52 +02:00
kimchy
8587f16119
make sure to call releaseExternalResources on another thread to make sure its not called from a netty IO handler
2011-02-01 22:16:09 +02:00
kimchy
237e936884
if action is performing the operation, return true to indicate it
2011-02-01 17:00:59 +02:00
kimchy
8927e1dee4
Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663 .
2011-02-01 13:41:58 +02:00
kimchy
cc6f65f8b8
Search: When sorting, allow to pass `track_scores` and set it to `true` to get scores/max_score back, closes #662 .
2011-02-01 12:38:46 +02:00
kimchy
5da14a7ed1
Geo: All geo components that accept an array of [lat, lon] to change to do [lon, lat] to conform with GeoJSON, closes #661 .
2011-02-01 01:39:01 +02:00
kimchy
f8b5628db9
have rolling restart stress test create incremental ids
2011-01-31 21:41:46 +02:00
kimchy
c7add5f377
upgrade to mvel 2.1 snapshot to gain performance improvements
2011-01-31 21:41:23 +02:00
kimchy
54c770bcc9
improve hash wheel timer
2011-01-31 16:26:17 +02:00
kimchy
cebdae5707
refactor script execution handling to improve performance, also introduce specific search script executor
2011-01-31 16:08:06 +02:00
kimchy
5d39cc93dd
refresh for test
2011-01-31 15:51:39 +02:00
kimchy
04c2a2a543
move ngram to the default processor
2011-01-31 11:52:02 +02:00
kimchy
e85f9c276f
only allow _score to be used, and remove score from custom_score scripts
2011-01-31 02:19:41 +02:00
kimchy
bdb87c7a62
refactor a bit search script execution
2011-01-31 01:29:30 +02:00
kimchy
919143f6b6
don't break if no document mapper exists
2011-01-31 00:00:24 +02:00
kimchy
e516051ea5
Search: When fetching _parent, only the _id should be returned, and not type#id, closes #658 .
2011-01-30 21:16:45 +02:00
kimchy
8b9ec890c3
Thread Pool: Increase the keep alive time of threads from 60 seconds to 60 minutes, closes #657 .
2011-01-30 20:34:34 +02:00
kimchy
5b4846b0b6
Translog Flushing: Improve logic, flush not just by operations in the translog, closes #656 .
2011-01-30 17:41:22 +02:00
kimchy
8884b575c1
more doc
2011-01-30 16:30:17 +02:00
kimchy
94c632b79b
Java Client - Allow to set facets in binary format, closes #442 .
2011-01-30 15:53:10 +02:00
kimchy
e5db3175fb
add explicit internal methods for getting doc fields
2011-01-30 00:34:50 +02:00
kimchy
ad4bb464e8
upgraded to new trove, major upgrade, better perf, but damn, 2mb larger in size...
2011-01-30 00:05:56 +02:00
kimchy
0b09fd0806
Facets: Remove redundant data returned as part of facet response (for example, the field name being faceted), closes #655 .
2011-01-29 20:44:58 +02:00
kimchy
7fa5b0cb57
only add highlighted fragments that have a score > 0 (when ending up using the default highlighter)
2011-01-29 15:29:25 +02:00
kimchy
2d94087f90
explicitly set optimize parameters when doing async merge
2011-01-29 04:11:56 +02:00
kimchy
4a27671d0c
moe internal stats on translog
2011-01-29 04:04:58 +02:00
kimchy
332c4cfa53
use bloom filter to reduce seeks when needing to load version
2011-01-29 03:55:00 +02:00
kimchy
ead4d600be
add a test for term docs version deletes
2011-01-27 00:00:29 +02:00
kimchy
30f54fe23e
change default async interval to 1 second, to do merges (if needed) more often
2011-01-26 23:29:24 +02:00
kimchy
00fa7c95fb
improve test time
2011-01-26 23:04:10 +02:00
kimchy
5ecb847a3a
improve test time
2011-01-26 22:59:35 +02:00
kimchy
24d5a758f0
fix thread name
2011-01-26 22:43:02 +02:00
kimchy
c7e73e4558
tookInMillis is not serialized over network for bulk response
2011-01-26 22:41:41 +02:00
kimchy
6c21c30f31
Index Merge: Improve internal (segment) merging by not initiating it on doc operations, closes #653 .
2011-01-26 22:39:40 +02:00
kimchy
e1d56ea467
call maybeMerge outside of writeLock to reduce work done under writeLock
2011-01-26 17:16:32 +02:00
kimchy
5a4686aee5
Search: Allow to pass a search filter, applying only on the query (and not on facets for example), closes #650 .
2011-01-26 12:55:30 +02:00
kimchy
10ff150bb8
don't log index missing exception when trying to optimize single shard search request
2011-01-25 18:29:28 +02:00
kimchy
00aad4c123
rename tests
2011-01-25 14:40:04 +02:00
kimchy
a5e02d559f
optimize single index conversion from alias to concrete index
2011-01-24 21:25:20 +02:00
kimchy
95dc08fa3b
refactor search tests into separate packages
2011-01-24 16:06:28 +02:00
kimchy
256f1d3611
add a test for collector ordering
2011-01-24 13:58:09 +02:00
kimchy
9735d3e6d7
don't establish a connection between two client nodes
2011-01-24 13:34:43 +02:00
kimchy
9d75849362
better shutdown of sockets
2011-01-24 13:15:57 +02:00
kimchy
3537de4530
don't have the constructor private
2011-01-23 21:07:04 +02:00
kimchy
95b6184135
Terms Facets: Allow to get `all_terms` back (possibly with count 0), closes #647 .
2011-01-23 16:09:18 +02:00
kimchy
85ee6eaf10
add logging on which state file failed to load
2011-01-23 02:59:42 +02:00
kimchy
ce4f09c2b1
Strict dynamic setting: Refuse to index a document with fields not present in the mapping definition, closes #643 .
2011-01-22 01:08:41 +02:00
kimchy
3907c8c680
add a test for custom type class name in token filter factory
2011-01-21 02:07:02 +02:00
kimchy
9801ddeb0d
Analysis: Add phonetic token filter (metaphone, soundex, ...), closes #644 .
2011-01-21 01:57:16 +02:00
kimchy
5316cd1931
should be debug logging, not warn
2011-01-20 17:38:24 +02:00
kimchy
545d8f35df
No cluster name filtering when sniffing is not enabled, closes #637 .
2011-01-20 17:28:45 +02:00
kimchy
9ff8006d37
have compilation and javadoc use UTF8 encoding
2011-01-20 14:24:12 +02:00
kimchy
034a66263a
Analysis: Add stemming to czech analyzer, closes #642 .
2011-01-20 13:30:48 +02:00
Lukáš Vlček
e0fa15a365
added Czech Stemmer, closes #635
2011-01-20 12:34:51 +02:00
kimchy
04f8b55686
ES hangs connection when parent is not specified in bulk index, closes #641 .
2011-01-20 12:28:55 +02:00
kimchy
b4467c7d1f
use caching scorer when there are multiple collectors, so if they call score as well, it will not be computed again
2011-01-19 22:59:28 +02:00
kimchy
7359f7983f
handle rest HEAD on / path
2011-01-19 21:56:53 +02:00
kimchy
b1d13febbf
Percolate on Index and Bulk, closes #636 .
2011-01-19 16:45:45 +02:00
kimchy
2eb8278a80
better logging when not allocating a shard due to required number of existing shards
2011-01-19 00:30:56 +02:00
kimchy
574c455203
Terms Facet: Add option include counts where term is missing, closes #632 .
2011-01-18 21:51:16 +02:00
kimchy
e4a6e99f69
improve handling when not to persist current state to gateway based on blocks and have a block indicate if it also blocks state persistence
2011-01-18 15:28:55 +02:00
kimchy
87d5a92edb
move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations
2011-01-18 14:38:10 +02:00
kimchy
a4c2087511
initial not recovered block on node init, and remove it as usual (once node is initialized / recovered)
2011-01-18 14:08:45 +02:00
kimchy
4750ccdc1c
move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well
2011-01-17 19:45:37 +02:00
kimchy
ba725f8986
fix a (rare) case where search will fail due to failed serialization
2011-01-17 14:37:36 +02:00
kimchy
b4e5a542f3
internal refactoring/simplification in percolator
2011-01-17 13:57:32 +02:00
kimchy
f2bd2c7bbd
protect against a case when string field data value is null
2011-01-17 12:39:11 +02:00
kimchy
89d31bbfde
properly print debug statement when nodes based operations fail
2011-01-17 12:38:08 +02:00
kimchy
f55fa4223e
improve loading queries by adding all of them in batch to the executor
2011-01-17 11:11:13 +02:00
kimchy
20c77a2ac5
clear the percolator reader from the cache explicitly
2011-01-17 10:11:14 +02:00
kimchy
1f289df128
more append benchmark
2011-01-16 12:47:54 +02:00
kimchy
285afe8053
add refresh interval to os/process/network info api which represents the refresh interval of their respective stats
2011-01-16 12:33:23 +02:00
kimchy
c0e2e14c36
fix javadoc
2011-01-15 02:15:36 +02:00
kimchy
998f5f4188
add lt(Object) to range filter builder
2011-01-15 02:15:29 +02:00
kimchy
771e028e54
simple fs bench test
2011-01-15 02:14:10 +02:00
kimchy
2381f668f8
wait for mappings to be created on other nodes before returning from the put mapping request
2011-01-15 02:13:57 +02:00
kimchy
f8b1d1eebd
add explicit type missing exception when trying to search on a type that is not registered
2011-01-14 17:53:45 +02:00
kimchy
a8be99b7e0
Node Stats: Process / Network / Os should only refresh every 5 seconds (refresh_interval to set it), closes #626 .
2011-01-14 16:00:55 +02:00
kimchy
38d10d19bc
Add `prefer_local` flag to analyze and percolate request, closes #625 .
2011-01-14 01:01:37 +02:00
kimchy
ff347858c5
properly report teh files and size recovered when doing primary local gateway recovery
2011-01-13 23:59:35 +02:00
kimchy
7fc04a4ab6
make sure to close the term docs when loading version
2011-01-13 22:49:56 +02:00
kimchy
ad236d19ee
add logging if failing to execute on a node
2011-01-13 16:51:06 +02:00
kimchy
180d225016
Percolator, closes #624 .
2011-01-13 16:20:31 +02:00
kimchy
2d180eb28a
upgrade to sigar 1.6.4
2011-01-13 16:02:35 +02:00
kimchy
577135db97
upgrade jackson to 1.7.1
2011-01-13 15:50:58 +02:00
kimchy
7213539d72
factor out exists collector
2011-01-12 20:51:19 +02:00
kimchy
f8b1a8e38b
add internal event when an index shard is started
2011-01-12 20:47:35 +02:00
kimchy
5e27e3fca4
support reader as well
2011-01-12 17:11:23 +02:00
kimchy
85b6a982d4
A setting to auto expand the number of replicas of an index (based on data nodes), closes #623 .
2011-01-12 16:27:36 +02:00
kimchy
f5a9f2d948
If the cluster does not contain any indices then index templates do not survive cluster restart, closes #617 .
2011-01-11 23:38:46 +02:00
kimchy
a0a714e6a5
Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621 .
2011-01-11 22:03:44 +02:00
kimchy
93dec72e43
optimize a filtered query with match_all query into a constant score that just wraps the filter
2011-01-11 19:17:17 +02:00
kimchy
6130ac2ee7
optimize query facet in case the query is a filtered query with match_all query to use just the filter
2011-01-11 18:49:05 +02:00
kimchy
ba9a12e201
Mapper: Add `byte` type (8bit signed), closes #620 .
2011-01-11 16:01:10 +02:00
kimchy
38ea07cfbe
fix field data cache setting: used under index.cache.field.type, available values: resident, soft, weak
2011-01-11 06:33:24 +02:00
kimchy
a5432ba7ce
limit the number of addresses to try and connect to when doing unicast discovery with just the host and not the port to 5
2011-01-11 00:53:53 +02:00
kimchy
90d005a330
add trace logging to unicast discovery
2011-01-10 23:30:46 +02:00
kimchy
50cdf2920f
Make ToXContent return a builder
2011-01-10 22:11:12 +02:00
kimchy
89314f29a7
improve multi value field cache handling both in terms of memory usage and GC behavior
2011-01-10 20:58:31 +02:00
kimchy
233ed1f8c6
improve multi value field cache handling both in terms of memory usage and GC behavior
2011-01-10 20:18:12 +02:00
kimchy
cb8ceb1a39
upgrade to guice 3.0 rc2
2011-01-10 17:49:39 +02:00
kimchy
d4246da7b3
/_open is not recovering indices correctly, closes #615 .
2011-01-09 23:31:10 +02:00
kimchy
d650705a03
refresh param to bulk not working, closes #614 .
2011-01-09 22:06:51 +02:00
kimchy
373af6b1e0
use fs channel to write to file to improve speed of adding to translog
2011-01-09 20:53:40 +02:00
kimchy
5c08271e74
improve numeric stream analysis performance
2011-01-09 19:35:24 +02:00
kimchy
3c3d01347e
improve all stream analysis performance
2011-01-09 02:51:41 +02:00
kimchy
8de7beadc8
Highlighting: Sometimes highlighting returns empty fragments even thought there should be, closes #613 .
2011-01-08 03:19:49 +02:00
kimchy
7364159d69
NPE for when passing null date to content builder, closes #610 .
2011-01-07 23:28:57 +02:00
kimchy
286a6fac76
upgrade to jackson 1.7, also fix (really unused case) of getting compressed smile stored through REST with smile context type
2011-01-07 16:35:52 +02:00
kimchy
b9be6d9ea7
Geo-distance in scripts (like custom_score), closes #607 .
2011-01-07 15:22:11 +02:00
kimchy
8b8bad7572
build on aferreira improvements to handle empty parameters with no =, and improve component decoding logic
2011-01-07 14:34:34 +02:00
Adriano Ferreira
2d81acbbf2
Adding test for edge cases of RestUtils.decodeQueryString()
...
When writing tests for the fix of decodeQueryString() to
handle gracefully edge cases like:
&a
&a&b
it arises the question of what behavior is desirable
for these pathological cases (vs the regular p=v pairs).
This change just skips them which is consonant
to the preexisting code.
To be thorough, we add tests for a bunch of edge cases, like:
QUERY PARSED PARAMS
? {}
?& {}
?= { "": "" }
?a {}
?p=v&a { "p": "v" }
?p=v&a&p1=v1 { "p": "v", "p1": "v1" }
?a&b {}
2011-01-07 14:13:26 +02:00
Adriano Ferreira
154dcf007e
Make RestUtils.decodeQueryString() more robust in edge cases
...
The code of decodeQueryString() had some trouble with weird URLs:
(1) an input like "uri?param&p=v" causes an exception to be thrown
(2) an input like "uri?param1¶m2" causes an infinite loop
This could be verified against an ES server with requests like
curl -XGET localhost:9200/test/_analyze?t&text=this+is+a+test
# the exception stack trace shows up in logs
curl -XGET localhost:9200/test/_analyze?t1&t2&text=this+is+a+test
# never returns, never ends
This change fixes these issues.
2011-01-07 14:13:25 +02:00
Adriano Ferreira
edb075b611
Minor changes to RestUtils.decodeQueryString() tests
...
Testing
RestUtils.decodeQueryString("something", "something".indexOf('?') + 1, params);
is not really checking decoding of an empty query.
Instead, it is testing decoding of "something"
as a query (because "something.index('?')+1" evaluates to 0).
The parameter map is left empty because
"malformed" pairs like "something" are currently skipped.
Instead, this change modify this test to check the edge cases:
+ fromIndex >= queryString.length()
+ fromIndex < 0
2011-01-07 14:13:25 +02:00
kimchy
fe0f9ebc9d
make lucene document creation allowed to be indexed twice
2011-01-07 14:09:39 +02:00
kimchy
c7cb353956
fix serialization of count request
2011-01-06 20:44:36 +02:00
kimchy
6a0a9ff374
parse query with offset
2011-01-06 16:13:15 +02:00
kimchy
b9e808f755
improve version loading by going directly to the relevant reader
2011-01-06 11:50:16 +02:00
kimchy
26c5f6c482
Allow ./bin/plugin to install plugins from the local filesystem / custom url, closes #595 .
2011-01-06 10:46:42 +02:00
kimchy
cc5978393b
with the new stemmer analyzer, don't break when there is no language stopwords, but just create it without stopwords
2011-01-06 09:53:56 +02:00
harryf
4a45df88c6
Add Snowball stemmer as analyzer and filter
2011-01-06 09:40:49 +02:00
kimchy
66d63055df
Add to node stats the number of times field cache was evicted due to memory constraints, closes #603 .
2011-01-05 22:37:15 +02:00
kimchy
754b0d7a0f
Add `resident` field cache type, closes #602 .
2011-01-05 21:23:47 +02:00
kimchy
0954df0623
change the default interval for gc checks to 1 second
2011-01-05 20:40:52 +02:00
kimchy
31231531e1
Highlighting: The result of highlighting for a hit can contain data from another document, closes #600 .
2011-01-05 15:45:46 +02:00
kimchy
6258915205
Bulk API: Add how long the bulk API took (in milliseconds) to the response, closes #599 .
2011-01-05 14:12:45 +02:00
kimchy
29b308005a
try to be more predictable when doing pagination (still can return duplicates when going to different shards) by sorting on the shards results based on the shard id first
2011-01-04 23:42:44 +02:00
kimchy
0faa05b3f2
add more integration versioning tests
2011-01-04 18:09:46 +02:00
kimchy
9423378f27
add heavy concurrent updates to same doc, and make sure it has the same data on all replicas
2011-01-04 17:44:33 +02:00
kimchy
45c1ab06b3
Versioning, closes #594 .
2011-01-04 04:04:30 +02:00
kimchy
9335b3a9e6
Search: Add a `timed_out` element indicating if the search request timed out, closes #592 .
2011-01-03 15:25:24 +02:00
kimchy
ff6d7254fe
optimize query parsing to use single field parser when executing on single field
2011-01-03 15:14:28 +02:00
kimchy
2c8c6aa22a
add a uid scan benchmark to check perf
2011-01-03 14:34:38 +02:00
kimchy
dc17d10b81
small refactor
2011-01-03 13:32:09 +02:00
kimchy
5e029865a8
Des.config=/path/to/config/file doesn't replace $ES_HOME/elasticsearch.conf, just appends to it, closes #588 .
2011-01-03 12:53:50 +02:00
kimchy
ccdbbef276
don't send leave request when the master node is null
2011-01-03 12:01:33 +02:00
kimchy
d2a70b21cd
key (which is time) can be negative as well
2011-01-02 22:03:52 +02:00
kimchy
07d361816e
Search: Date Histogram Facet, closes #591 .
2011-01-02 15:07:45 +02:00
kimchy
d523104b91
add some sanity tests with joda for date time manipulation
2011-01-01 23:48:25 +02:00
kimchy
b7b775228e
add some sanity tests with joda for date time manipulation
2011-01-01 23:40:46 +02:00
kimchy
aec720218d
Histogram Facet: Improve perf / memory by defaulting to just providing counts with no totals, closes #587 .
2011-01-01 17:27:55 +02:00
kimchy
45b93e2781
add histogram facet benchmark
2011-01-01 16:33:18 +02:00
kimchy
e6b4834768
Highlighting: Allow to highlight on fields without term vectors, closes #585 .
2010-12-31 18:57:26 +02:00
kimchy
7c959e7ec3
Master based operations (create index, delete index) to automatically retry on retryable cluster blocks (like recovery from gateway)
2010-12-31 14:09:45 +02:00
kimchy
a92dbc537a
those two should not be final...
2010-12-31 00:23:04 +02:00
Tim Dysinger
fd593acafe
make every static field final (immutable)
2010-12-31 00:22:31 +02:00
Tim Dysinger
6b672e29f5
Remove infinite loop typo
2010-12-31 00:01:45 +02:00
kimchy
82298d890c
Terms Facet: Performance and memory improvements when faceting numeric fields, closes #583 .
2010-12-30 19:45:36 +02:00
kimchy
019359a896
add more scanning options on the field data cache
2010-12-30 17:08:32 +02:00
kimchy
6c8b06c967
clean unused method
2010-12-30 16:45:12 +02:00
kimchy
8e8a3a894f
upgrade testing framework jars, improve build scripts to share the testing jars
2010-12-30 16:08:38 +02:00
kimchy
fea93b7fea
Delete By Query: Types are not serialized over network, causing them to be ignored, closes #580 .
2010-12-30 14:43:08 +02:00
kimchy
789e1a343f
failing to load plugins, return an empty map
2010-12-30 13:16:09 +02:00
kimchy
2e46add991
remove debugging dead code
2010-12-30 13:14:49 +02:00
kimchy
51277a9486
no need to check for shard if tis null, we know its not
2010-12-30 13:12:08 +02:00
kimchy
c4646a2b55
use close helper method to close streams
2010-12-30 13:11:20 +02:00
kimchy
76d042f3c5
explicitly pass null values to methods where applicable
2010-12-30 13:09:11 +02:00
kimchy
5a45e9c8bd
close stream if file not found (though a stream is not really opened in this case...)
2010-12-30 12:30:50 +02:00
kimchy
20b6e0bdde
close stream if file not found (though a stream is not really opened in this case...)
2010-12-30 12:30:33 +02:00
kimchy
4f8b4b405c
though not really needed (working on in memory byte array), close the stream opened
2010-12-30 12:27:46 +02:00
kimchy
ed996c3e85
Non-data master nodes and non-master data nodes fail to store data, closes #579 .
2010-12-30 12:10:40 +02:00
kimchy
e3322836b5
make settings prefix simpler and not bail when not prefixed with org.elasticsearch, allow to provide settings prefix for analyzer provider
2010-12-29 19:12:38 +02:00
kimchy
f73a5e62d3
improve error message
2010-12-29 18:55:37 +02:00
kimchy
c7fca8f0e0
refactor terms facet into string terms facets, paving the way for optimized ones for numeric values
2010-12-29 18:34:08 +02:00
kimchy
e764f41341
await closing sockets on shutdown
2010-12-29 12:49:37 +02:00
kimchy
f993c4b72b
start refactoring of facets to make them more pluggable
2010-12-29 12:49:02 +02:00
kimchy
c8bfa455ad
REST Create Index: Not taking JSON index settings into account unless wrapped in settings.
2010-12-29 12:10:51 +02:00
kimchy
d8aef57baa
add filter_cache_size to node stats
2010-12-28 16:57:55 +02:00
kimchy
f908a73ec6
allow to construct transport client with settings builder
2010-12-27 20:11:28 +02:00
kimchy
a84e0a49b7
change scope to _score
2010-12-27 19:19:17 +02:00
kimchy
d73a459f1e
when parent mapping is set, fix setting routing to required
2010-12-27 18:41:28 +02:00
kimchy
d560ceabe4
use high transport type when sending the cluster state
2010-12-27 16:50:55 +02:00
kimchy
4245eb7395
add node level field cache size to node stats api
2010-12-26 12:18:15 +02:00
kimchy
5dcba8a38c
revert back a stupid bug in setting compress to true always introduced in the last commit
2010-12-26 12:05:22 +02:00
kimchy
49deb80d03
when compression is enabled, use the compressed byte buffer to write it to the translog (less data to write), and handle recovery by being able to parse also compressed source
2010-12-24 01:09:15 +02:00
kimchy
f2eae5b605
Memory Index Store: Separate to two buffer size types, and fix bugs, closes #577 .
2010-12-23 23:21:32 +02:00
kimchy
22fa91efa0
add reconnection code between nodes that are not masters
2010-12-23 17:26:55 +02:00
kimchy
f6afc01fe5
add reconnection code between nodes that are not masters
2010-12-23 17:26:32 +02:00
kimchy
ff5990daec
listener should be threaded
2010-12-23 17:24:23 +02:00
kimchy
de7dd3c070
default to try and connect after network disconnection with fault detection
2010-12-23 16:51:09 +02:00
kimchy
e313379ed5
only force shutdown on cached threadpool if its not the same as the execture service
2010-12-23 16:13:05 +02:00
kimchy
42e8567477
interrupt joining the cluster thread if shutting down
2010-12-23 16:11:43 +02:00
kimchy
5f25ae4f2f
check if the scheduled thread pool is not terminated when trying to terminate it
2010-12-23 15:18:22 +02:00
kimchy
9f72a8d68b
use cached thread pool for notifying on disconnections
2010-12-23 14:22:40 +02:00
kimchy
6dcc04b59c
Transport: Increase the default transport.tcp.connect_timeout from 1s to 30s, also add `network.tcp.connect_timeout` to conform with other common network settings, closes #576 .
2010-12-23 14:20:11 +02:00
kimchy
5c338b7af2
add message to connect transport failure exception
2010-12-23 13:05:39 +02:00
kimchy
5a58ed4274
when replacing a mapping, clear the aggregated mapping information and then readd it
2010-12-23 11:32:16 +02:00
kimchy
473c2fa8f4
add reason for state change logging in index shard, add debug logging on ignore recovery in when handling cluster change in indices cluster
2010-12-23 10:56:37 +02:00
kimchy
5ac42f2a4f
Excessive mapping parsing when cluster state changes, closes #575 .
2010-12-23 09:53:05 +02:00
kimchy
f869951364
rename type method on MapperService to the more descriptive documentMapperWithAutoCreate
2010-12-23 08:43:17 +02:00
kimchy
e0b2b4b4a6
add a warn when not using the custom FieldCache with eager reader based eviction
2010-12-23 07:58:43 +02:00
kimchy
800b7f39bd
add toString to CompressedString to show when logging it
2010-12-23 07:45:04 +02:00
kimchy
3b30930460
improve logging when trying to delete unallocated shard, check first if deleting is required, and only then delete it
2010-12-23 07:37:49 +02:00
kimchy
ac73334c87
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:59 +02:00
kimchy
bb0d7190e9
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:31 +02:00
kimchy
1ee24ce60f
add an option to provide an OutputStream to a builder, allowing to generate directly into a stream provided by the user
2010-12-22 13:26:29 +02:00
kimchy
eef3a95fa6
move the query parser cache to be index level and not node level
2010-12-22 12:31:30 +02:00
kimchy
33339ae4b1
improve concurrency control in filter caching, reuse one if it was created already under concurrent request
2010-12-22 10:42:38 +02:00
kimchy
d283c158d2
optimize for the more common case of single value facets when loading values
2010-12-22 09:04:35 +02:00
kimchy
59ee8493ce
use public terms filter in all places
2010-12-21 23:43:05 +02:00
kimchy
a1df3c637c
improve logic of when to load fields from source, only if they actually have mappings, otherwise, ignore them (as was the previous behavior)
2010-12-21 13:02:15 +02:00
kimchy
3035254885
Search API: Allow to pass `&fields=` without any fields to cause only id and type to be returned, closes #572 .
2010-12-21 12:01:51 +02:00
kimchy
a96b294de0
add multicast socket to execption message
2010-12-20 20:07:51 +02:00
kimchy
efc95dc00a
Java Search API: Passing a the query as json fails, closes #568 .
2010-12-20 11:31:09 +02:00
kimchy
789073639d
fix transport client compilation problem, the client cluster service was not used and removed
2010-12-19 05:50:07 +02:00
kimchy
8dfc3acba0
when using dates in scripts, initialize the dates (DateTime) with UTC
2010-12-19 05:01:59 +02:00
kimchy
96a2950ab5
Disable calling mlockall by default, can be enabled by setting bootstrap.mlockall to `true`, closes #567 .
2010-12-19 02:30:48 +02:00
kimchy
415bb5d7f3
Java TransportClient: By default, don't sniff other nodes and use addresses provided as is, closes #565 .
2010-12-17 19:31:28 +02:00
kimchy
005c6d9124
allow to set term index divisor
2010-12-16 21:56:59 +02:00
kimchy
ff0eeb3d1a
improve getting setting as array, automatically support comma delimited values under the exact setting
2010-12-16 05:02:24 +02:00
kimchy
f827b7cff5
fix settings
2010-12-16 00:48:26 +02:00
kimchy
d6bab1a892
Tcp Transport: Connection pool between nodes and different connection types, closes #564 .
2010-12-15 20:11:10 +02:00
kimchy
085066ed19
set, by default, the send and receive buffers to 32k on tcp
2010-12-15 05:54:09 +02:00
kimchy
36be13ffb3
bring back the file chunk size in recovery to 100kb from 500kb
2010-12-15 01:28:21 +02:00
kimchy
b6277ac14d
increase netty worker count to default to the updated value netty defaults to
2010-12-15 01:16:00 +02:00
kimchy
bb178c9c1a
cleanup
2010-12-13 21:30:26 +02:00
kimchy
d0eed79175
add log message on hte concurrent streams used
2010-12-13 00:08:57 +02:00
kimchy
ceb7b90740
Recovery: Allow to control `concurrent_streams` (per node) during recovery
2010-12-13 00:03:04 +02:00
kimchy
1c5477d4ed
Improve local node recovery process, removing using a block as indication for an index not being recovered. Moving to shard replication group level allocation (with the ability to distinguish between api based creation or recovery based creation). This also allows for throttling based control on initial local gateway based shard allocation.
2010-12-12 22:46:27 +02:00
kimchy
bc04243a2b
Search Fields: If a field is not stored, automatically extract it from _source (without the need for _source prefix), closes #562 .
2010-12-12 05:00:24 +02:00
kimchy
216b2ab912
Highlighting: Automatically use the field values extracted from _source if not stored explicitly in the mapping, closes #561 .
2010-12-12 04:40:25 +02:00
kimchy
fe3f5d45de
remove global settings from the settings conf, a relic that is no longer needed...
2010-12-12 02:37:36 +02:00
kimchy
dddca692b8
add search hit phase, which operates on a hit, and have all relevant hit phases implement and use it
2010-12-12 02:01:13 +02:00
kimchy
be4b2e2de6
externalize script search lookup into a generalized lookup that can be used outside of scripts
2010-12-12 01:01:56 +02:00
kimchy
a914865c45
Close API might cause index data to be wiped, closes #560 .
2010-12-10 22:19:45 +02:00
kimchy
bc2dc9465a
add to the receive timeout exception the request id that it timed out on
2010-12-10 12:40:39 +02:00
kimchy
2a7f964ca2
Geo search fails to find some docs when wrapping over IDL, closes #559 .
2010-12-10 08:39:10 +02:00
kimchy
9d2fe162fa
better log message
2010-12-10 00:17:55 +02:00
kimchy
3f6ed7e1de
improve update mapping on master, if we end up with the same mappings as the one the cluster state has, no need for a new cluster state...
2010-12-10 00:17:10 +02:00
kimchy
167d35807c
Add terms/in query, alias terms filter to be in filter as well, closes #557 .
2010-12-09 07:25:05 +02:00
kimchy
0828f18738
better child bench
2010-12-09 06:11:06 +02:00
kimchy
e1495ff8be
add scrolling update test
2010-12-08 20:56:09 +02:00
kimchy
34f3f3f79e
Aliased analyzers cause index deletion / cleanup failure, closes #555 .
2010-12-08 19:30:38 +02:00
kimchy
f5a8c3881f
add debug logging on failed bug items executions
2010-12-08 01:21:21 +02:00
kimchy
54437c1bd3
Parent / Child Support, closes #553 .
2010-12-08 00:16:05 +02:00
kimchy
1a8017d17e
upgrade to jackson 1.6.3
2010-12-07 09:14:13 +02:00
kimchy
22c27e4ff8
correct field name
2010-12-05 00:02:53 +02:00
kimchy
d3cae103d5
wait for green status in test
2010-12-04 23:57:44 +02:00
kimchy
d659bd0479
upgrade to jackson 1.6.2
2010-12-04 00:46:57 +02:00
kimchy
a90684aaa5
Upgrade to Lucene 3.0.3, closes #549 .
2010-12-03 20:43:51 +02:00
kimchy
d9610ed0a1
Search API: Optimize single shard search to `QUERY_AND_FETCH` from any other search type, closes #547 .
2010-12-01 03:59:03 +02:00
kimchy
3ea19a514b
Index Setting: Add `index.refresh_interval` to simplify setting instead of "index.engine.robin.refresh_interval` (still works), closes #546 .
2010-12-01 03:38:41 +02:00
kimchy
2b039bd0b0
change the default chunk size when recovering from the default 100kb to 500kb.
2010-11-29 14:33:49 +02:00
kimchy
c0945831e8
Search Scroll API: Allow to provide the scroll id as the body of the scroll request, closes #545 .
2010-11-29 13:59:30 +02:00
kimchy
103221e58a
remove the timed out message, can be misleading
2010-11-29 02:55:23 +02:00
kimchy
84f97e96a5
Scrolling issues, fix releasing search context eagerly, they should not be released when scrolling, closes #136 .
2010-11-29 02:05:45 +02:00
kimchy
6d9576c217
Reduce the number of concurrent recoveries per node to 2 from number_of_processors, closes #543 .
2010-11-28 16:35:39 +02:00
kimchy
a222de1dbf
internal change to scope based collectors
2010-11-28 14:57:17 +02:00
kimchy
8285ffe221
encode scroll id with base64 in url safe manner
2010-11-28 02:23:38 +02:00
kimchy
cfa8c9aa79
Index / Index Template: Allow to define `_default_` mapping, closes #542 .
2010-11-27 23:30:18 +02:00
kimchy
526f28f479
Create Index API: Allow to provide mappings. closes #541 .
2010-11-27 00:28:18 +02:00
kimchy
151715dc2f
also merge lists
2010-11-27 00:05:11 +02:00
kimchy
577f06fd43
add indices API to groovy client
2010-11-26 22:19:57 +02:00
kimchy
73e5eb9e14
clean compile warnings
2010-11-26 16:03:25 +02:00
kimchy
6dab568a4b
Index Templates, closes #540 .
2010-11-26 15:53:04 +02:00
kimchy
ebd6316db9
Index templates, closes #540 .
2010-11-26 15:45:18 +02:00
kimchy
d150ac2da4
Search API: Add how long the search took (in milliseconds), closes #536 .
2010-11-24 13:27:32 +02:00
kimchy
51273587de
Bulk API: Add refresh flag, closes #535 .
2010-11-24 00:58:48 +02:00
kimchy
4a3e5b6348
Query Cache: Invalidate the query cache when mappings change, closes #532 .
2010-11-23 15:26:19 +02:00
kimchy
9479ac636e
Delete Mapping API: Wrongly deleting existing mapping information, closes #531 .
2010-11-23 14:56:03 +02:00
kimchy
3b2b901db0
improve error handling, we can't always parse the source to a stirng
2010-11-23 00:41:53 +02:00
kimchy
db1f7e09f3
Support date and ip types for `numeric_range` filter, closes #530 .
2010-11-22 16:17:51 +02:00
kimchy
b4113d57d3
Analyze API: An API to analyzer custom text based on an optional analyzer, closes #529 .
2010-11-21 17:33:35 +02:00
kimchy
8689e5cf16
more cleaning of shards iterators
2010-11-21 14:49:57 +02:00
kimchy
e183fbd6ad
add shards iterator that can iterate over unrelated list of shards
2010-11-21 14:27:22 +02:00
kimchy
7db5e63ab7
rename shardsIt to shardIt
2010-11-21 13:54:44 +02:00
kimchy
a74465000d
rename single operation base support to single shard operation
2010-11-21 13:26:36 +02:00
kimchy
c40eaaae38
serializing get result should use the same construct as search hit fields
2010-11-20 18:38:43 +02:00
kimchy
58ecc4f77f
cleanup single operation action support
2010-11-20 18:23:13 +02:00
kimchy
03f66b0c45
log4j syslog appender don't load, closes #527 .
2010-11-19 22:08:18 +02:00
kimchy
1560e05e01
upgrade to mvel 2.0.19
2010-11-19 21:40:12 +02:00
kimchy
fdb98b1dcb
Highlighting bug where fragments are broken when number_of_fragments is 0, closes #479 .
2010-11-18 20:52:51 +02:00
kimchy
d1ef445632
clean thread local vars eagerly
2010-11-18 20:22:42 +02:00
kimchy
16ed69daa3
add routing to delete by query rest endpoint
2010-11-18 13:46:45 +02:00
kimchy
cf4f6decc4
add a test for overloaded method of builder and List
2010-11-18 02:25:22 +02:00
kimchy
282a7a5162
Add non inspection checks
2010-11-18 02:05:32 +02:00
kimchy
44775c2aa8
Routing: Allow to define `path` on the `_routing` mapping, to automatically extract the routing from it, closes #524 .
2010-11-17 17:05:51 +02:00
kimchy
4e75f3de4a
republish the cluster state if a node exists in the cluster
2010-11-17 11:33:33 +02:00
kimchy
0172eaea89
add broadcasting when no routing and its marked as required to bulk delete as well
2010-11-16 18:53:32 +02:00
kimchy
619efea940
Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522 .
2010-11-16 18:31:43 +02:00
kimchy
a04d8ec5ad
Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522 .
2010-11-16 18:31:08 +02:00
kimchy
2483a37db5
fix comparator implementation in histogram facet
2010-11-16 15:30:27 +02:00
kimchy
e7fdea8858
fix underscore casing to transform Name to name, and not _name
2010-11-16 15:16:54 +02:00
kimchy
02981f6101
Routing: Allow to specify on the `_routing` mapping that its required, and fail index operations that do not provide one, closes #520 .
2010-11-16 15:10:41 +02:00