151e24c5bd
upgrade to jackson 1.7.2
2011-02-03 23:36:55 +02:00
1f68d7eabf
when introducing a new type or new fields as part of an index request, wait (with a cap) until they are introduced on to the cluster before returning from the index request
2011-02-03 22:55:16 +02:00
28dbbaa3fa
allow to set an internal source builder on search request builder
2011-02-03 22:54:31 +02:00
00cba66eb8
move to use mvel 2.1.RC1
2011-02-03 11:29:24 +02:00
5fe2615ba7
Index Status: Add primary store size to include only primary shards store sizes, also move index store and translog into their own elements, closes #666 .
2011-02-03 00:50:24 +02:00
13869239b0
better help on -url for plugin command
2011-02-02 17:56:57 +02:00
904bee12bc
Search: Failure when sorting on `short` type, closes #665 .
2011-02-02 17:55:21 +02:00
95ea6153a7
no need for thread pool to notify listeners
2011-02-02 16:16:29 +02:00
da17be34c1
if no shards are allocated for a deleted index, then no need to wait for a response
2011-02-02 15:28:48 +02:00
4ed82023ce
another embedded test for query and fetch on a single shard
2011-02-02 14:04:24 +02:00
0bce34cb5a
optimize single shard search (or search result) by not doing another round of sorting
2011-02-02 13:52:34 +02:00
8c196d8b84
better logging, and disable strange failure in thread locals test when run with gradle (for now)
2011-02-02 12:15:18 +02:00
3f62b9ea96
check for trace logging
2011-02-02 11:25:13 +02:00
c86551d9b5
move master node tests to cluster package, and force it to use zen disco always
2011-02-02 11:15:12 +02:00
d2a3f5142f
improve the order of shutdown of top level components in node, close indices first and applying cluster changes, also, improve atomicity of closing of indices and shards
2011-02-01 23:10:15 +02:00
eb1db1140b
better to close the channels on another thread as well, just to be safe
2011-02-01 23:08:52 +02:00
8587f16119
make sure to call releaseExternalResources on another thread to make sure its not called from a netty IO handler
2011-02-01 22:16:09 +02:00
237e936884
if action is performing the operation, return true to indicate it
2011-02-01 17:00:59 +02:00
8927e1dee4
Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663 .
2011-02-01 13:41:58 +02:00
cc6f65f8b8
Search: When sorting, allow to pass `track_scores` and set it to `true` to get scores/max_score back, closes #662 .
2011-02-01 12:38:46 +02:00
5da14a7ed1
Geo: All geo components that accept an array of [lat, lon] to change to do [lon, lat] to conform with GeoJSON, closes #661 .
2011-02-01 01:39:01 +02:00
f8b5628db9
have rolling restart stress test create incremental ids
2011-01-31 21:41:46 +02:00
c7add5f377
upgrade to mvel 2.1 snapshot to gain performance improvements
2011-01-31 21:41:23 +02:00
54c770bcc9
improve hash wheel timer
2011-01-31 16:26:17 +02:00
cebdae5707
refactor script execution handling to improve performance, also introduce specific search script executor
2011-01-31 16:08:06 +02:00
5d39cc93dd
refresh for test
2011-01-31 15:51:39 +02:00
04c2a2a543
move ngram to the default processor
2011-01-31 11:52:02 +02:00
e85f9c276f
only allow _score to be used, and remove score from custom_score scripts
2011-01-31 02:19:41 +02:00
bdb87c7a62
refactor a bit search script execution
2011-01-31 01:29:30 +02:00
919143f6b6
don't break if no document mapper exists
2011-01-31 00:00:24 +02:00
e516051ea5
Search: When fetching _parent, only the _id should be returned, and not type#id, closes #658 .
2011-01-30 21:16:45 +02:00
8b9ec890c3
Thread Pool: Increase the keep alive time of threads from 60 seconds to 60 minutes, closes #657 .
2011-01-30 20:34:34 +02:00
5b4846b0b6
Translog Flushing: Improve logic, flush not just by operations in the translog, closes #656 .
2011-01-30 17:41:22 +02:00
8884b575c1
more doc
2011-01-30 16:30:17 +02:00
94c632b79b
Java Client - Allow to set facets in binary format, closes #442 .
2011-01-30 15:53:10 +02:00
e5db3175fb
add explicit internal methods for getting doc fields
2011-01-30 00:34:50 +02:00
ad4bb464e8
upgraded to new trove, major upgrade, better perf, but damn, 2mb larger in size...
2011-01-30 00:05:56 +02:00
0b09fd0806
Facets: Remove redundant data returned as part of facet response (for example, the field name being faceted), closes #655 .
2011-01-29 20:44:58 +02:00
7fa5b0cb57
only add highlighted fragments that have a score > 0 (when ending up using the default highlighter)
2011-01-29 15:29:25 +02:00
2d94087f90
explicitly set optimize parameters when doing async merge
2011-01-29 04:11:56 +02:00
4a27671d0c
moe internal stats on translog
2011-01-29 04:04:58 +02:00
332c4cfa53
use bloom filter to reduce seeks when needing to load version
2011-01-29 03:55:00 +02:00
ead4d600be
add a test for term docs version deletes
2011-01-27 00:00:29 +02:00
30f54fe23e
change default async interval to 1 second, to do merges (if needed) more often
2011-01-26 23:29:24 +02:00
00fa7c95fb
improve test time
2011-01-26 23:04:10 +02:00
5ecb847a3a
improve test time
2011-01-26 22:59:35 +02:00
24d5a758f0
fix thread name
2011-01-26 22:43:02 +02:00
c7e73e4558
tookInMillis is not serialized over network for bulk response
2011-01-26 22:41:41 +02:00
6c21c30f31
Index Merge: Improve internal (segment) merging by not initiating it on doc operations, closes #653 .
2011-01-26 22:39:40 +02:00
e1d56ea467
call maybeMerge outside of writeLock to reduce work done under writeLock
2011-01-26 17:16:32 +02:00
5a4686aee5
Search: Allow to pass a search filter, applying only on the query (and not on facets for example), closes #650 .
2011-01-26 12:55:30 +02:00
10ff150bb8
don't log index missing exception when trying to optimize single shard search request
2011-01-25 18:29:28 +02:00
00aad4c123
rename tests
2011-01-25 14:40:04 +02:00
a5e02d559f
optimize single index conversion from alias to concrete index
2011-01-24 21:25:20 +02:00
95dc08fa3b
refactor search tests into separate packages
2011-01-24 16:06:28 +02:00
256f1d3611
add a test for collector ordering
2011-01-24 13:58:09 +02:00
9735d3e6d7
don't establish a connection between two client nodes
2011-01-24 13:34:43 +02:00
9d75849362
better shutdown of sockets
2011-01-24 13:15:57 +02:00
3537de4530
don't have the constructor private
2011-01-23 21:07:04 +02:00
95b6184135
Terms Facets: Allow to get `all_terms` back (possibly with count 0), closes #647 .
2011-01-23 16:09:18 +02:00
85ee6eaf10
add logging on which state file failed to load
2011-01-23 02:59:42 +02:00
ce4f09c2b1
Strict dynamic setting: Refuse to index a document with fields not present in the mapping definition, closes #643 .
2011-01-22 01:08:41 +02:00
3907c8c680
add a test for custom type class name in token filter factory
2011-01-21 02:07:02 +02:00
9801ddeb0d
Analysis: Add phonetic token filter (metaphone, soundex, ...), closes #644 .
2011-01-21 01:57:16 +02:00
5316cd1931
should be debug logging, not warn
2011-01-20 17:38:24 +02:00
545d8f35df
No cluster name filtering when sniffing is not enabled, closes #637 .
2011-01-20 17:28:45 +02:00
9ff8006d37
have compilation and javadoc use UTF8 encoding
2011-01-20 14:24:12 +02:00
034a66263a
Analysis: Add stemming to czech analyzer, closes #642 .
2011-01-20 13:30:48 +02:00
e0fa15a365
added Czech Stemmer, closes #635
2011-01-20 12:34:51 +02:00
04f8b55686
ES hangs connection when parent is not specified in bulk index, closes #641 .
2011-01-20 12:28:55 +02:00
b4467c7d1f
use caching scorer when there are multiple collectors, so if they call score as well, it will not be computed again
2011-01-19 22:59:28 +02:00
7359f7983f
handle rest HEAD on / path
2011-01-19 21:56:53 +02:00
b1d13febbf
Percolate on Index and Bulk, closes #636 .
2011-01-19 16:45:45 +02:00
2eb8278a80
better logging when not allocating a shard due to required number of existing shards
2011-01-19 00:30:56 +02:00
574c455203
Terms Facet: Add option include counts where term is missing, closes #632 .
2011-01-18 21:51:16 +02:00
e4a6e99f69
improve handling when not to persist current state to gateway based on blocks and have a block indicate if it also blocks state persistence
2011-01-18 15:28:55 +02:00
87d5a92edb
move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations
2011-01-18 14:38:10 +02:00
a4c2087511
initial not recovered block on node init, and remove it as usual (once node is initialized / recovered)
2011-01-18 14:08:45 +02:00
4750ccdc1c
move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well
2011-01-17 19:45:37 +02:00
ba725f8986
fix a (rare) case where search will fail due to failed serialization
2011-01-17 14:37:36 +02:00
b4e5a542f3
internal refactoring/simplification in percolator
2011-01-17 13:57:32 +02:00
f2bd2c7bbd
protect against a case when string field data value is null
2011-01-17 12:39:11 +02:00
89d31bbfde
properly print debug statement when nodes based operations fail
2011-01-17 12:38:08 +02:00
f55fa4223e
improve loading queries by adding all of them in batch to the executor
2011-01-17 11:11:13 +02:00
20c77a2ac5
clear the percolator reader from the cache explicitly
2011-01-17 10:11:14 +02:00
1f289df128
more append benchmark
2011-01-16 12:47:54 +02:00
285afe8053
add refresh interval to os/process/network info api which represents the refresh interval of their respective stats
2011-01-16 12:33:23 +02:00
c0e2e14c36
fix javadoc
2011-01-15 02:15:36 +02:00
998f5f4188
add lt(Object) to range filter builder
2011-01-15 02:15:29 +02:00
771e028e54
simple fs bench test
2011-01-15 02:14:10 +02:00
2381f668f8
wait for mappings to be created on other nodes before returning from the put mapping request
2011-01-15 02:13:57 +02:00
f8b1d1eebd
add explicit type missing exception when trying to search on a type that is not registered
2011-01-14 17:53:45 +02:00
a8be99b7e0
Node Stats: Process / Network / Os should only refresh every 5 seconds (refresh_interval to set it), closes #626 .
2011-01-14 16:00:55 +02:00
38d10d19bc
Add `prefer_local` flag to analyze and percolate request, closes #625 .
2011-01-14 01:01:37 +02:00
ff347858c5
properly report teh files and size recovered when doing primary local gateway recovery
2011-01-13 23:59:35 +02:00
7fc04a4ab6
make sure to close the term docs when loading version
2011-01-13 22:49:56 +02:00
ad236d19ee
add logging if failing to execute on a node
2011-01-13 16:51:06 +02:00
180d225016
Percolator, closes #624 .
2011-01-13 16:20:31 +02:00
2d180eb28a
upgrade to sigar 1.6.4
2011-01-13 16:02:35 +02:00
577135db97
upgrade jackson to 1.7.1
2011-01-13 15:50:58 +02:00
7213539d72
factor out exists collector
2011-01-12 20:51:19 +02:00
f8b1a8e38b
add internal event when an index shard is started
2011-01-12 20:47:35 +02:00
5e27e3fca4
support reader as well
2011-01-12 17:11:23 +02:00
85b6a982d4
A setting to auto expand the number of replicas of an index (based on data nodes), closes #623 .
2011-01-12 16:27:36 +02:00
f5a9f2d948
If the cluster does not contain any indices then index templates do not survive cluster restart, closes #617 .
2011-01-11 23:38:46 +02:00
a0a714e6a5
Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621 .
2011-01-11 22:03:44 +02:00
93dec72e43
optimize a filtered query with match_all query into a constant score that just wraps the filter
2011-01-11 19:17:17 +02:00
6130ac2ee7
optimize query facet in case the query is a filtered query with match_all query to use just the filter
2011-01-11 18:49:05 +02:00
ba9a12e201
Mapper: Add `byte` type (8bit signed), closes #620 .
2011-01-11 16:01:10 +02:00
38ea07cfbe
fix field data cache setting: used under index.cache.field.type, available values: resident, soft, weak
2011-01-11 06:33:24 +02:00
a5432ba7ce
limit the number of addresses to try and connect to when doing unicast discovery with just the host and not the port to 5
2011-01-11 00:53:53 +02:00
90d005a330
add trace logging to unicast discovery
2011-01-10 23:30:46 +02:00
50cdf2920f
Make ToXContent return a builder
2011-01-10 22:11:12 +02:00
89314f29a7
improve multi value field cache handling both in terms of memory usage and GC behavior
2011-01-10 20:58:31 +02:00
233ed1f8c6
improve multi value field cache handling both in terms of memory usage and GC behavior
2011-01-10 20:18:12 +02:00
cb8ceb1a39
upgrade to guice 3.0 rc2
2011-01-10 17:49:39 +02:00
d4246da7b3
/_open is not recovering indices correctly, closes #615 .
2011-01-09 23:31:10 +02:00
d650705a03
refresh param to bulk not working, closes #614 .
2011-01-09 22:06:51 +02:00
373af6b1e0
use fs channel to write to file to improve speed of adding to translog
2011-01-09 20:53:40 +02:00
5c08271e74
improve numeric stream analysis performance
2011-01-09 19:35:24 +02:00
3c3d01347e
improve all stream analysis performance
2011-01-09 02:51:41 +02:00
8de7beadc8
Highlighting: Sometimes highlighting returns empty fragments even thought there should be, closes #613 .
2011-01-08 03:19:49 +02:00
7364159d69
NPE for when passing null date to content builder, closes #610 .
2011-01-07 23:28:57 +02:00
286a6fac76
upgrade to jackson 1.7, also fix (really unused case) of getting compressed smile stored through REST with smile context type
2011-01-07 16:35:52 +02:00
b9be6d9ea7
Geo-distance in scripts (like custom_score), closes #607 .
2011-01-07 15:22:11 +02:00
8b8bad7572
build on aferreira improvements to handle empty parameters with no =, and improve component decoding logic
2011-01-07 14:34:34 +02:00
2d81acbbf2
Adding test for edge cases of RestUtils.decodeQueryString()
...
When writing tests for the fix of decodeQueryString() to
handle gracefully edge cases like:
&a
&a&b
it arises the question of what behavior is desirable
for these pathological cases (vs the regular p=v pairs).
This change just skips them which is consonant
to the preexisting code.
To be thorough, we add tests for a bunch of edge cases, like:
QUERY PARSED PARAMS
? {}
?& {}
?= { "": "" }
?a {}
?p=v&a { "p": "v" }
?p=v&a&p1=v1 { "p": "v", "p1": "v1" }
?a&b {}
2011-01-07 14:13:26 +02:00
154dcf007e
Make RestUtils.decodeQueryString() more robust in edge cases
...
The code of decodeQueryString() had some trouble with weird URLs:
(1) an input like "uri?param&p=v" causes an exception to be thrown
(2) an input like "uri?param1¶m2" causes an infinite loop
This could be verified against an ES server with requests like
curl -XGET localhost:9200/test/_analyze?t&text=this+is+a+test
# the exception stack trace shows up in logs
curl -XGET localhost:9200/test/_analyze?t1&t2&text=this+is+a+test
# never returns, never ends
This change fixes these issues.
2011-01-07 14:13:25 +02:00
edb075b611
Minor changes to RestUtils.decodeQueryString() tests
...
Testing
RestUtils.decodeQueryString("something", "something".indexOf('?') + 1, params);
is not really checking decoding of an empty query.
Instead, it is testing decoding of "something"
as a query (because "something.index('?')+1" evaluates to 0).
The parameter map is left empty because
"malformed" pairs like "something" are currently skipped.
Instead, this change modify this test to check the edge cases:
+ fromIndex >= queryString.length()
+ fromIndex < 0
2011-01-07 14:13:25 +02:00
fe0f9ebc9d
make lucene document creation allowed to be indexed twice
2011-01-07 14:09:39 +02:00
c7cb353956
fix serialization of count request
2011-01-06 20:44:36 +02:00
6a0a9ff374
parse query with offset
2011-01-06 16:13:15 +02:00
b9e808f755
improve version loading by going directly to the relevant reader
2011-01-06 11:50:16 +02:00
26c5f6c482
Allow ./bin/plugin to install plugins from the local filesystem / custom url, closes #595 .
2011-01-06 10:46:42 +02:00
cc5978393b
with the new stemmer analyzer, don't break when there is no language stopwords, but just create it without stopwords
2011-01-06 09:53:56 +02:00
4a45df88c6
Add Snowball stemmer as analyzer and filter
2011-01-06 09:40:49 +02:00
66d63055df
Add to node stats the number of times field cache was evicted due to memory constraints, closes #603 .
2011-01-05 22:37:15 +02:00
754b0d7a0f
Add `resident` field cache type, closes #602 .
2011-01-05 21:23:47 +02:00
0954df0623
change the default interval for gc checks to 1 second
2011-01-05 20:40:52 +02:00
31231531e1
Highlighting: The result of highlighting for a hit can contain data from another document, closes #600 .
2011-01-05 15:45:46 +02:00
6258915205
Bulk API: Add how long the bulk API took (in milliseconds) to the response, closes #599 .
2011-01-05 14:12:45 +02:00
29b308005a
try to be more predictable when doing pagination (still can return duplicates when going to different shards) by sorting on the shards results based on the shard id first
2011-01-04 23:42:44 +02:00
0faa05b3f2
add more integration versioning tests
2011-01-04 18:09:46 +02:00
9423378f27
add heavy concurrent updates to same doc, and make sure it has the same data on all replicas
2011-01-04 17:44:33 +02:00
45c1ab06b3
Versioning, closes #594 .
2011-01-04 04:04:30 +02:00
9335b3a9e6
Search: Add a `timed_out` element indicating if the search request timed out, closes #592 .
2011-01-03 15:25:24 +02:00
ff6d7254fe
optimize query parsing to use single field parser when executing on single field
2011-01-03 15:14:28 +02:00
2c8c6aa22a
add a uid scan benchmark to check perf
2011-01-03 14:34:38 +02:00
dc17d10b81
small refactor
2011-01-03 13:32:09 +02:00
5e029865a8
Des.config=/path/to/config/file doesn't replace $ES_HOME/elasticsearch.conf, just appends to it, closes #588 .
2011-01-03 12:53:50 +02:00
ccdbbef276
don't send leave request when the master node is null
2011-01-03 12:01:33 +02:00
d2a70b21cd
key (which is time) can be negative as well
2011-01-02 22:03:52 +02:00
07d361816e
Search: Date Histogram Facet, closes #591 .
2011-01-02 15:07:45 +02:00
d523104b91
add some sanity tests with joda for date time manipulation
2011-01-01 23:48:25 +02:00
b7b775228e
add some sanity tests with joda for date time manipulation
2011-01-01 23:40:46 +02:00
aec720218d
Histogram Facet: Improve perf / memory by defaulting to just providing counts with no totals, closes #587 .
2011-01-01 17:27:55 +02:00
45b93e2781
add histogram facet benchmark
2011-01-01 16:33:18 +02:00
e6b4834768
Highlighting: Allow to highlight on fields without term vectors, closes #585 .
2010-12-31 18:57:26 +02:00
7c959e7ec3
Master based operations (create index, delete index) to automatically retry on retryable cluster blocks (like recovery from gateway)
2010-12-31 14:09:45 +02:00
a92dbc537a
those two should not be final...
2010-12-31 00:23:04 +02:00
fd593acafe
make every static field final (immutable)
2010-12-31 00:22:31 +02:00
6b672e29f5
Remove infinite loop typo
2010-12-31 00:01:45 +02:00
82298d890c
Terms Facet: Performance and memory improvements when faceting numeric fields, closes #583 .
2010-12-30 19:45:36 +02:00
019359a896
add more scanning options on the field data cache
2010-12-30 17:08:32 +02:00
6c8b06c967
clean unused method
2010-12-30 16:45:12 +02:00
8e8a3a894f
upgrade testing framework jars, improve build scripts to share the testing jars
2010-12-30 16:08:38 +02:00
fea93b7fea
Delete By Query: Types are not serialized over network, causing them to be ignored, closes #580 .
2010-12-30 14:43:08 +02:00
789e1a343f
failing to load plugins, return an empty map
2010-12-30 13:16:09 +02:00
2e46add991
remove debugging dead code
2010-12-30 13:14:49 +02:00
51277a9486
no need to check for shard if tis null, we know its not
2010-12-30 13:12:08 +02:00
c4646a2b55
use close helper method to close streams
2010-12-30 13:11:20 +02:00
76d042f3c5
explicitly pass null values to methods where applicable
2010-12-30 13:09:11 +02:00
5a45e9c8bd
close stream if file not found (though a stream is not really opened in this case...)
2010-12-30 12:30:50 +02:00
20b6e0bdde
close stream if file not found (though a stream is not really opened in this case...)
2010-12-30 12:30:33 +02:00
4f8b4b405c
though not really needed (working on in memory byte array), close the stream opened
2010-12-30 12:27:46 +02:00
ed996c3e85
Non-data master nodes and non-master data nodes fail to store data, closes #579 .
2010-12-30 12:10:40 +02:00
e3322836b5
make settings prefix simpler and not bail when not prefixed with org.elasticsearch, allow to provide settings prefix for analyzer provider
2010-12-29 19:12:38 +02:00
f73a5e62d3
improve error message
2010-12-29 18:55:37 +02:00
c7fca8f0e0
refactor terms facet into string terms facets, paving the way for optimized ones for numeric values
2010-12-29 18:34:08 +02:00
e764f41341
await closing sockets on shutdown
2010-12-29 12:49:37 +02:00
f993c4b72b
start refactoring of facets to make them more pluggable
2010-12-29 12:49:02 +02:00
c8bfa455ad
REST Create Index: Not taking JSON index settings into account unless wrapped in settings.
2010-12-29 12:10:51 +02:00
d8aef57baa
add filter_cache_size to node stats
2010-12-28 16:57:55 +02:00
f908a73ec6
allow to construct transport client with settings builder
2010-12-27 20:11:28 +02:00
a84e0a49b7
change scope to _score
2010-12-27 19:19:17 +02:00
d73a459f1e
when parent mapping is set, fix setting routing to required
2010-12-27 18:41:28 +02:00
d560ceabe4
use high transport type when sending the cluster state
2010-12-27 16:50:55 +02:00
4245eb7395
add node level field cache size to node stats api
2010-12-26 12:18:15 +02:00
5dcba8a38c
revert back a stupid bug in setting compress to true always introduced in the last commit
2010-12-26 12:05:22 +02:00
49deb80d03
when compression is enabled, use the compressed byte buffer to write it to the translog (less data to write), and handle recovery by being able to parse also compressed source
2010-12-24 01:09:15 +02:00
f2eae5b605
Memory Index Store: Separate to two buffer size types, and fix bugs, closes #577 .
2010-12-23 23:21:32 +02:00
22fa91efa0
add reconnection code between nodes that are not masters
2010-12-23 17:26:55 +02:00
f6afc01fe5
add reconnection code between nodes that are not masters
2010-12-23 17:26:32 +02:00
ff5990daec
listener should be threaded
2010-12-23 17:24:23 +02:00
de7dd3c070
default to try and connect after network disconnection with fault detection
2010-12-23 16:51:09 +02:00
e313379ed5
only force shutdown on cached threadpool if its not the same as the execture service
2010-12-23 16:13:05 +02:00
42e8567477
interrupt joining the cluster thread if shutting down
2010-12-23 16:11:43 +02:00
5f25ae4f2f
check if the scheduled thread pool is not terminated when trying to terminate it
2010-12-23 15:18:22 +02:00
9f72a8d68b
use cached thread pool for notifying on disconnections
2010-12-23 14:22:40 +02:00
6dcc04b59c
Transport: Increase the default transport.tcp.connect_timeout from 1s to 30s, also add `network.tcp.connect_timeout` to conform with other common network settings, closes #576 .
2010-12-23 14:20:11 +02:00
5c338b7af2
add message to connect transport failure exception
2010-12-23 13:05:39 +02:00
5a58ed4274
when replacing a mapping, clear the aggregated mapping information and then readd it
2010-12-23 11:32:16 +02:00
473c2fa8f4
add reason for state change logging in index shard, add debug logging on ignore recovery in when handling cluster change in indices cluster
2010-12-23 10:56:37 +02:00
5ac42f2a4f
Excessive mapping parsing when cluster state changes, closes #575 .
2010-12-23 09:53:05 +02:00
f869951364
rename type method on MapperService to the more descriptive documentMapperWithAutoCreate
2010-12-23 08:43:17 +02:00
e0b2b4b4a6
add a warn when not using the custom FieldCache with eager reader based eviction
2010-12-23 07:58:43 +02:00
800b7f39bd
add toString to CompressedString to show when logging it
2010-12-23 07:45:04 +02:00
3b30930460
improve logging when trying to delete unallocated shard, check first if deleting is required, and only then delete it
2010-12-23 07:37:49 +02:00
ac73334c87
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:59 +02:00
bb0d7190e9
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:31 +02:00
1ee24ce60f
add an option to provide an OutputStream to a builder, allowing to generate directly into a stream provided by the user
2010-12-22 13:26:29 +02:00
eef3a95fa6
move the query parser cache to be index level and not node level
2010-12-22 12:31:30 +02:00
33339ae4b1
improve concurrency control in filter caching, reuse one if it was created already under concurrent request
2010-12-22 10:42:38 +02:00
d283c158d2
optimize for the more common case of single value facets when loading values
2010-12-22 09:04:35 +02:00
59ee8493ce
use public terms filter in all places
2010-12-21 23:43:05 +02:00
a1df3c637c
improve logic of when to load fields from source, only if they actually have mappings, otherwise, ignore them (as was the previous behavior)
2010-12-21 13:02:15 +02:00
3035254885
Search API: Allow to pass `&fields=` without any fields to cause only id and type to be returned, closes #572 .
2010-12-21 12:01:51 +02:00
a96b294de0
add multicast socket to execption message
2010-12-20 20:07:51 +02:00
efc95dc00a
Java Search API: Passing a the query as json fails, closes #568 .
2010-12-20 11:31:09 +02:00
789073639d
fix transport client compilation problem, the client cluster service was not used and removed
2010-12-19 05:50:07 +02:00
8dfc3acba0
when using dates in scripts, initialize the dates (DateTime) with UTC
2010-12-19 05:01:59 +02:00
96a2950ab5
Disable calling mlockall by default, can be enabled by setting bootstrap.mlockall to `true`, closes #567 .
2010-12-19 02:30:48 +02:00
415bb5d7f3
Java TransportClient: By default, don't sniff other nodes and use addresses provided as is, closes #565 .
2010-12-17 19:31:28 +02:00
005c6d9124
allow to set term index divisor
2010-12-16 21:56:59 +02:00
ff0eeb3d1a
improve getting setting as array, automatically support comma delimited values under the exact setting
2010-12-16 05:02:24 +02:00
f827b7cff5
fix settings
2010-12-16 00:48:26 +02:00
d6bab1a892
Tcp Transport: Connection pool between nodes and different connection types, closes #564 .
2010-12-15 20:11:10 +02:00
085066ed19
set, by default, the send and receive buffers to 32k on tcp
2010-12-15 05:54:09 +02:00
36be13ffb3
bring back the file chunk size in recovery to 100kb from 500kb
2010-12-15 01:28:21 +02:00
b6277ac14d
increase netty worker count to default to the updated value netty defaults to
2010-12-15 01:16:00 +02:00
bb178c9c1a
cleanup
2010-12-13 21:30:26 +02:00
d0eed79175
add log message on hte concurrent streams used
2010-12-13 00:08:57 +02:00
ceb7b90740
Recovery: Allow to control `concurrent_streams` (per node) during recovery
2010-12-13 00:03:04 +02:00
1c5477d4ed
Improve local node recovery process, removing using a block as indication for an index not being recovered. Moving to shard replication group level allocation (with the ability to distinguish between api based creation or recovery based creation). This also allows for throttling based control on initial local gateway based shard allocation.
2010-12-12 22:46:27 +02:00
bc04243a2b
Search Fields: If a field is not stored, automatically extract it from _source (without the need for _source prefix), closes #562 .
2010-12-12 05:00:24 +02:00
216b2ab912
Highlighting: Automatically use the field values extracted from _source if not stored explicitly in the mapping, closes #561 .
2010-12-12 04:40:25 +02:00
fe3f5d45de
remove global settings from the settings conf, a relic that is no longer needed...
2010-12-12 02:37:36 +02:00
dddca692b8
add search hit phase, which operates on a hit, and have all relevant hit phases implement and use it
2010-12-12 02:01:13 +02:00
be4b2e2de6
externalize script search lookup into a generalized lookup that can be used outside of scripts
2010-12-12 01:01:56 +02:00
a914865c45
Close API might cause index data to be wiped, closes #560 .
2010-12-10 22:19:45 +02:00
bc2dc9465a
add to the receive timeout exception the request id that it timed out on
2010-12-10 12:40:39 +02:00
2a7f964ca2
Geo search fails to find some docs when wrapping over IDL, closes #559 .
2010-12-10 08:39:10 +02:00
9d2fe162fa
better log message
2010-12-10 00:17:55 +02:00
3f6ed7e1de
improve update mapping on master, if we end up with the same mappings as the one the cluster state has, no need for a new cluster state...
2010-12-10 00:17:10 +02:00
167d35807c
Add terms/in query, alias terms filter to be in filter as well, closes #557 .
2010-12-09 07:25:05 +02:00
0828f18738
better child bench
2010-12-09 06:11:06 +02:00
e1495ff8be
add scrolling update test
2010-12-08 20:56:09 +02:00
34f3f3f79e
Aliased analyzers cause index deletion / cleanup failure, closes #555 .
2010-12-08 19:30:38 +02:00
f5a8c3881f
add debug logging on failed bug items executions
2010-12-08 01:21:21 +02:00
54437c1bd3
Parent / Child Support, closes #553 .
2010-12-08 00:16:05 +02:00
1a8017d17e
upgrade to jackson 1.6.3
2010-12-07 09:14:13 +02:00
22c27e4ff8
correct field name
2010-12-05 00:02:53 +02:00
d3cae103d5
wait for green status in test
2010-12-04 23:57:44 +02:00
d659bd0479
upgrade to jackson 1.6.2
2010-12-04 00:46:57 +02:00
a90684aaa5
Upgrade to Lucene 3.0.3, closes #549 .
2010-12-03 20:43:51 +02:00
d9610ed0a1
Search API: Optimize single shard search to `QUERY_AND_FETCH` from any other search type, closes #547 .
2010-12-01 03:59:03 +02:00
3ea19a514b
Index Setting: Add `index.refresh_interval` to simplify setting instead of "index.engine.robin.refresh_interval` (still works), closes #546 .
2010-12-01 03:38:41 +02:00
2b039bd0b0
change the default chunk size when recovering from the default 100kb to 500kb.
2010-11-29 14:33:49 +02:00
c0945831e8
Search Scroll API: Allow to provide the scroll id as the body of the scroll request, closes #545 .
2010-11-29 13:59:30 +02:00
103221e58a
remove the timed out message, can be misleading
2010-11-29 02:55:23 +02:00
84f97e96a5
Scrolling issues, fix releasing search context eagerly, they should not be released when scrolling, closes #136 .
2010-11-29 02:05:45 +02:00
6d9576c217
Reduce the number of concurrent recoveries per node to 2 from number_of_processors, closes #543 .
2010-11-28 16:35:39 +02:00
a222de1dbf
internal change to scope based collectors
2010-11-28 14:57:17 +02:00
8285ffe221
encode scroll id with base64 in url safe manner
2010-11-28 02:23:38 +02:00
cfa8c9aa79
Index / Index Template: Allow to define `_default_` mapping, closes #542 .
2010-11-27 23:30:18 +02:00
526f28f479
Create Index API: Allow to provide mappings. closes #541 .
2010-11-27 00:28:18 +02:00
151715dc2f
also merge lists
2010-11-27 00:05:11 +02:00
577f06fd43
add indices API to groovy client
2010-11-26 22:19:57 +02:00
73e5eb9e14
clean compile warnings
2010-11-26 16:03:25 +02:00
6dab568a4b
Index Templates, closes #540 .
2010-11-26 15:53:04 +02:00
ebd6316db9
Index templates, closes #540 .
2010-11-26 15:45:18 +02:00
d150ac2da4
Search API: Add how long the search took (in milliseconds), closes #536 .
2010-11-24 13:27:32 +02:00
51273587de
Bulk API: Add refresh flag, closes #535 .
2010-11-24 00:58:48 +02:00
4a3e5b6348
Query Cache: Invalidate the query cache when mappings change, closes #532 .
2010-11-23 15:26:19 +02:00
9479ac636e
Delete Mapping API: Wrongly deleting existing mapping information, closes #531 .
2010-11-23 14:56:03 +02:00
3b2b901db0
improve error handling, we can't always parse the source to a stirng
2010-11-23 00:41:53 +02:00
db1f7e09f3
Support date and ip types for `numeric_range` filter, closes #530 .
2010-11-22 16:17:51 +02:00
b4113d57d3
Analyze API: An API to analyzer custom text based on an optional analyzer, closes #529 .
2010-11-21 17:33:35 +02:00
8689e5cf16
more cleaning of shards iterators
2010-11-21 14:49:57 +02:00
e183fbd6ad
add shards iterator that can iterate over unrelated list of shards
2010-11-21 14:27:22 +02:00
7db5e63ab7
rename shardsIt to shardIt
2010-11-21 13:54:44 +02:00
a74465000d
rename single operation base support to single shard operation
2010-11-21 13:26:36 +02:00
c40eaaae38
serializing get result should use the same construct as search hit fields
2010-11-20 18:38:43 +02:00
58ecc4f77f
cleanup single operation action support
2010-11-20 18:23:13 +02:00
03f66b0c45
log4j syslog appender don't load, closes #527 .
2010-11-19 22:08:18 +02:00
1560e05e01
upgrade to mvel 2.0.19
2010-11-19 21:40:12 +02:00
fdb98b1dcb
Highlighting bug where fragments are broken when number_of_fragments is 0, closes #479 .
2010-11-18 20:52:51 +02:00
d1ef445632
clean thread local vars eagerly
2010-11-18 20:22:42 +02:00
16ed69daa3
add routing to delete by query rest endpoint
2010-11-18 13:46:45 +02:00
cf4f6decc4
add a test for overloaded method of builder and List
2010-11-18 02:25:22 +02:00
282a7a5162
Add non inspection checks
2010-11-18 02:05:32 +02:00
44775c2aa8
Routing: Allow to define `path` on the `_routing` mapping, to automatically extract the routing from it, closes #524 .
2010-11-17 17:05:51 +02:00
4e75f3de4a
republish the cluster state if a node exists in the cluster
2010-11-17 11:33:33 +02:00
0172eaea89
add broadcasting when no routing and its marked as required to bulk delete as well
2010-11-16 18:53:32 +02:00
619efea940
Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522 .
2010-11-16 18:31:43 +02:00
a04d8ec5ad
Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522 .
2010-11-16 18:31:08 +02:00
2483a37db5
fix comparator implementation in histogram facet
2010-11-16 15:30:27 +02:00
e7fdea8858
fix underscore casing to transform Name to name, and not _name
2010-11-16 15:16:54 +02:00
02981f6101
Routing: Allow to specify on the `_routing` mapping that its required, and fail index operations that do not provide one, closes #520 .
2010-11-16 15:10:41 +02:00
8a8a6d5547
Mapping: Rename _attributes to _meta, closes #518 .
2010-11-16 01:34:01 +02:00
b8b4cbbb46
add mapping metadata to cluster state metadata, will allow in the future to add specific mappings hints (since we don't have the parsed mapping on each node anymore)
2010-11-15 21:21:18 +02:00
51c18cd9c1
refactor ip field mapper into its own package
2010-11-15 19:21:23 +02:00
36183af22c
automatically use match_all query when executing a _all:* query string
2010-11-15 17:15:24 +02:00
effdd52586
sync changes done on the indices cluster service with changes happening in an async manner during recovery
2010-11-15 16:54:29 +02:00
4b06eeb75a
better desc
2010-11-15 16:39:16 +02:00
a342029d36
Histogram Facet: Allow to define a key field and value script, closes #517 .
2010-11-15 15:05:50 +02:00
5c6c4bfb5a
Histogram Facet: Allow to define a key field and value script, closes #517 .
2010-11-15 15:02:35 +02:00
b1db5c43d6
Mapper: `date` type to also allow providing values in numeric (milliseconds since epoch), closes #516 .
2010-11-15 14:12:54 +02:00
6d214d69b9
Mapper: Store the routing (if provided) under a `_routing` field, closes #515 .
2010-11-15 11:34:56 +02:00
8ee038574d
add _routing to documetn indexed when providing routing value
2010-11-14 21:23:52 +02:00
9505cb14f1
bring back the retry on shard missing
2010-11-14 21:02:46 +02:00
fa1d8c7bcd
only remove the shard (not clean it) when ignoring recovery
2010-11-14 20:09:27 +02:00
37335bc6a9
also retry when there are no routing shards, might happen in case of recovery from gateway before shard routing initialization
2010-11-14 20:09:00 +02:00
d0ac9087b6
add bootstrap.mlockall setting to control if mlockall should be called or not
2010-11-14 15:54:40 +02:00
30929c3d01
better logging, include index and shard id in log statement
2010-11-14 00:24:51 +02:00
31986c4486
add a check to not allow to create an alias with a name of an existing index
2010-11-13 18:53:12 +02:00
73bf371912
fix exception logging on failed index creation
2010-11-13 18:08:11 +02:00
38d77f8cf3
Query DSL: Allow to provide pattern field names when using query_string query, closes #511 .
2010-11-13 02:26:14 +02:00
6839cc6965
clear memory after parsing a doc, and not on parsing of a new doc
2010-11-12 15:36:23 +02:00
d994a862dd
add support for analyzer mapping when the mapping is not indexd nor stored
2010-11-12 14:54:28 +02:00
bba98cf1b7
cleanup traversing unneeded mappings
2010-11-12 14:50:05 +02:00
beb77c9b0a
fix a bug in mapping serialization (introduced on 0.13), where properties gets underscore cased by mistake, and not retain their original naming
2010-11-11 15:38:20 +02:00
17cba798e6
add double restart test for local gateway
2010-11-11 14:08:58 +02:00
70a0e110d4
apping: add threshold to _source field compression, closes #506 .
2010-11-10 21:03:54 +02:00
a2e674df49
add filteredQuery to QueryBuilders to conform with xxxQuery notation
2010-11-10 00:03:33 +02:00
4c6af6afa5
Cluster health API should return RED status (on applicable levels) when an index has not recovered from the gateway, closes #507 .
2010-11-09 21:25:22 +02:00
4695f93276
add index routing table changed
2010-11-09 16:31:21 +02:00
d0e0b85178
add many indices stress test
2010-11-09 16:22:50 +02:00
8ceba0dca1
don't overflow with cluster events if the index level block was removed already
2010-11-09 15:42:27 +02:00
36bf5ee9fe
add toString to cluster block
2010-11-09 15:41:47 +02:00
a0f4359ffa
handle any exception when failing to snapshot
2010-11-09 15:34:43 +02:00
8266315f51
handle any exception when failing to snapshot
2010-11-09 15:34:17 +02:00
f9fb67616d
don't write checksum file for the segments file, we anyhow recover it and that way the index can be read by pure Lucene code
2010-11-09 14:27:28 +02:00
b5f1a1b49c
Parsing a deeply nested json might fail
2010-11-09 10:26:15 +02:00
33ff95af05
add more trove helpers
2010-11-09 09:35:35 +02:00
8e2db2c68f
rename field to path in _analyzer mapping
2010-11-09 09:16:47 +02:00
6b5e884b93
have the default path value for analyzer mapper to be _analyzer.
2010-11-09 08:59:30 +02:00
6567fcaf35
remove an index level block if its empty (make no sense to keep an empty set for it, also, shouldn't shot it back in APIs)
2010-11-09 00:08:30 +02:00
c69b94d769
rename field to path in _analyzer mapping
2010-11-08 11:07:34 +02:00
c9228ed26d
Get Action: Allow to pass refresh forcing getting latest, closes #488 .
2010-11-07 23:51:18 +02:00
c095d72439
Get Action: Allow to pass refresh forcing getting latest, closes #488 .
2010-11-07 23:50:48 +02:00
e51523385d
Analysis: Allow to alias analyzers, closes #486 .
2010-11-07 20:10:53 +02:00
171fa4a7e8
Mapper: An analyzer mapper allowing to control the index analyzer of a document based on a document field, closes #485 .
2010-11-07 18:18:24 +02:00
b45ade467e
send transport exception is a wrapper exception around the actual exception
2010-11-07 17:56:50 +02:00
c9e8a2ac68
no need to pass the id mapprt to serialization twice...
2010-11-07 16:00:27 +02:00
d77a0c41d0
make sure attributes are also serialized across restarts
2010-11-07 15:32:37 +02:00
598225f833
document level analyzer (analyzer, index_analyzer, search_analyzer) are not serialized (and not maintained across restarts), closes #484 .
2010-11-07 13:13:29 +02:00
7340d6973d
slim down the mapping serialization to xcontent (json), don't write default values
2010-11-07 12:33:44 +02:00
e44604b441
better transport exception handling, refactor out an action based transport exception, and don't fill stack trace only for remote ones
2010-11-07 04:08:05 +02:00
ef3e7fe62b
renamve method
2010-11-07 00:02:58 +02:00
6b952f6719
Fs Gateway: Add (native) file lock to ensure two nodes in a split brain are not updating same gateway, closes #481 .
2010-11-06 23:27:46 +02:00
998bde0820
Add an option to display max_open_files, by setting -Des.max-open-files to `true`, closes #483 .
2010-11-06 22:47:09 +02:00
b568174bee
add a comment on why we don't mark as relocated when relcoating primaries
2010-11-06 22:03:11 +02:00
87efccf677
expose boolean and Object as values for TermQueryBuilder and FieldQueryBuilder
2010-11-06 01:04:14 +02:00
129b9a3938
Query DSL: Allow to control (globally) the max clause count for `bool` query (defaults to 1024), closes #482 .
2010-11-06 00:59:37 +02:00
9385476340
fix expected setting, had an additional _ by mistake
2010-11-05 20:54:01 +02:00
53a98275cf
remove unused variable
2010-11-05 18:39:10 +02:00
99a3e615ab
Improve performance when searching across multiple types, closes #478 .
2010-11-04 20:34:49 +02:00
bbd63f0ffe
constant_score query might apply deletes wrongly, closes #477 .
2010-11-04 20:18:05 +02:00
770ccf421b
don't write the local gateway state if there is no master, since we don't want to override the fact that they do exists on that node under the respective version
2010-11-04 12:17:17 +02:00
e2d6f82cd3
Mapper: Add `path_match` for full object navigation path matching, closes #476 .
2010-11-04 10:55:19 +02:00
805d43c77a
properly clean index shard and index level data when deleting them
2010-11-03 15:34:30 +02:00
6e0180db6a
refactor node data location of index and shard into common code
2010-11-03 15:07:23 +02:00
6804c02e97
Create specific `data` location for indices (move from work), closes #473 .
2010-11-03 14:41:29 +02:00
92b3ae3f73
Change single operation shard hashing to only use id, and not id and type, closes #472 .
2010-11-03 12:47:34 +02:00
8d454ba293
Query DSL: Add `field_masking_span` query, closes #471 .
2010-11-02 23:50:28 +02:00
a62f1f3e0d
API: Allow to control document shard routing, and search shard routing, closes #470 .
2010-11-02 19:56:18 +02:00
8e2e85f460
enhance bulk stress test
2010-11-02 14:01:22 +02:00
3fe2851dae
Index Merge: Change default `index.merge.scheduler.max_thread_count` from ` to be adaptive based on processor count, closes #469 .
2010-11-02 14:00:58 +02:00
2cdaf6357b
Rivers: Add a _status doc for each river, closes #468 .
2010-11-02 12:09:45 +02:00
ef4c44577a
add toString to match_all docs
2010-11-02 10:23:05 +02:00
4ff1b429f1
Possible (rare) shard index corruption / different doc count on recovery (gateway / shard), closes #466 .
2010-11-01 23:00:16 +02:00
49439a09e2
fix logging
2010-11-01 20:42:10 +02:00
f79719beaa
fix parsing of bytes value
2010-10-31 15:47:19 +02:00
feb854b742
On full cluster restart, replicas transaction logs are not getting cleaned, closes #465 .
2010-10-31 14:36:10 +02:00
b8fa68f97a
check if the commit point has a size at all, if not, not flushed yet, its ok
2010-10-31 12:23:56 +02:00
c14783d3e2
remove jarjar'ed files that are not needed (notice, license)
2010-10-31 11:45:10 +02:00
e6b4a8b55c
remove inclusion of config and logging file in jar
2010-10-31 10:50:35 +02:00
96a1ad6335
When on linux, force it not to swap elasticsearch process (jvm), closes #464 .
2010-10-30 19:40:24 +02:00
1feb43a0af
Index: Move compound format setting to `index.compound_format` (old setting still supported), closes #463 .
2010-10-30 18:24:28 +02:00
db24148413
fix listAll when using switch dir to return unique list of files
2010-10-30 01:26:00 +02:00
b315c5f848
add getOffsetGap to field analyzer
2010-10-29 19:05:11 +02:00
8f7a8dabc1
only flush if there is something to flush
2010-10-29 17:50:51 +02:00
11c55185e8
add another test
2010-10-29 00:22:49 +02:00
c194fa67e9
default logger (when embedded in java) to log with org.elasticsearch prefix for simpler logging configruation
2010-10-28 23:39:37 +02:00
7082593166
add term filter toString
2010-10-28 23:18:24 +02:00
e31cbb5267
fix NPE when enabling trace logging
2010-10-28 21:47:55 +02:00
4579c04a9e
Mapper: Ip Type Support (ipv4), auto detection with dynamic mapping, closes #461 .
2010-10-28 12:02:20 +02:00
6f8b859d90
better inet address serialization, also better handle ipv6
2010-10-28 01:48:54 +02:00
e7fdf16402
add number of data nodes to cluster health
2010-10-28 00:39:53 +02:00
d487d809ea
Query DSL: Revert back and have range, terms, and prefix filter _cache set to true, closes #456 .
2010-10-27 20:34:24 +02:00
3a9dc8f452
change back to cached thread pool
2010-10-27 20:13:42 +02:00
185f5a9e18
Search: Change default operation threading to `thread_per_shard` from `single_thread`, closes #455 .
2010-10-27 19:51:49 +02:00
ca67c12de5
add and/not/or docid sets, not just docsets, and improve caching behavior
2010-10-27 18:16:15 +02:00
8fef3df16f
improve threading usage on discovery and fd
2010-10-26 23:49:09 +02:00
73e6aa72cd
for some reason the test only runs with @Test on the main class...
2010-10-26 20:20:58 +02:00
c08ad0cad6
Fix parsing of "geo_distance" filter wrt "distance" / "unit" parameters
...
The problem was that when "unit" was given,
the conversion to miles was happening too early,
which caused wrong computations. This change
postpones this computation when one really knows
which unit should be used.
2010-10-26 20:13:29 +02:00
9b206146e3
Fix MILES.toKilometers() and KILOMETERS.toMiles()
...
This mistake should have been caught by DistanceUnitTests.
But the problem is that the tests in this file does not
run during the execution of the test suite, and I don't have
a clue why this is so.
2010-10-26 20:13:29 +02:00
2d15cd8009
Another test for parsing "geo_distance" filter: 12mi and km
...
If an explicit unit is provided with "distance",
the "unit" can be safely ignored, as it works
as a fallback unit.
2010-10-26 20:13:29 +02:00
8c8b7bee3a
Three tests for parsing "geo_distance" filter: 12 miles in km
...
The added test files should be equivalent. Actually they
hit the same bug as change
Two tests for parsing "geo_distance" filter: distance/unit parameters
2010-10-26 20:13:29 +02:00
244a566e49
Two tests for parsing "geo_distance" filter: default unit is km
2010-10-26 20:13:29 +02:00
0660a2912e
Two tests for parsing "geo_distance" filter: distance/unit parameters
...
Those two are supposed to be equivalent:
distance: 12, unit: "mi"
vs
distance: "12", unit: "mi"
but they are not because of an underlying bug in the query parsing
code, providing non-equivalent behavior whether a number or a string
comes via JSON.
2010-10-26 20:13:29 +02:00
14703aa1be
doc
2010-10-26 20:05:57 +02:00
184276154c
add search stress test
2010-10-26 17:17:12 +02:00
5804e9132a
Query DSL: `term` filter to have `_cache` set to `true` by default, closes #453 ,
2010-10-26 13:40:14 +02:00
442f1d7677
add the request id to the timeout message
2010-10-26 11:22:02 +02:00
c59bfea43c
add the request id to the timeout message
2010-10-26 11:19:31 +02:00
529303c533
Query: match_all query (also in query_string: *:*) is very slow
2010-10-26 11:04:55 +02:00
5966d2005d
refacto package name from facets to facet (make more sense when facet will be easily pluggable)
2010-10-25 18:49:30 +02:00
0a0ac35792
bring back query parsing cache (weak)
2010-10-25 18:09:40 +02:00
2c65be2aad
better exception when a field is missing
2010-10-25 16:33:55 +02:00
cccefad091
upgrade to netty 3.2.3
2010-10-25 16:15:05 +02:00
bc4121c06b
Query DSL: `term`, `term`, `prefix`, and `range` filter are now weakly cached, for more strong caching, set `_cache` to true, closes #450 .
2010-10-25 15:59:15 +02:00
5c5b882b5d
clean code
2010-10-25 14:44:47 +02:00
517f3eb0fd
chance default query parser cache to none from weak
2010-10-25 14:43:06 +02:00
deada942e5
Query DSL: `constant_score` and `filtered` queries cache filters by default, remove it, closes #449 .
2010-10-25 13:52:15 +02:00
835a81c16c
always use deletion aware constant score
2010-10-25 13:35:43 +02:00
b7eacc3618
add comment / todo
2010-10-24 12:38:24 +02:00
9a80fedf52
add simple map stream capability
2010-10-23 23:19:08 +02:00
ca7a7467dc
Indices API: Add open and close index, closes #447 .
2010-10-23 21:52:09 +02:00
a76824e395
make index not recovered a bock used in both gateways (shared/blob and local)
2010-10-23 17:03:38 +02:00
3f8c03db95
add test in node allocation is there are no shards, no need to do local gateway allocation
2010-10-23 01:25:23 +02:00
f0f62ce00c
improve test to wait for 2 nodes
2010-10-23 01:24:53 +02:00
e11589f3c7
add doc
2010-10-23 01:07:37 +02:00
62526444fd
better caching of missing filter / query
2010-10-22 19:44:25 +02:00
b0a0604473
Query DSL: Query String _missing_ and _exists_ syntax, closes #446 .
2010-10-22 18:14:07 +02:00
8b0daf48f4
Query DSL: Query String _missing_ and _exists_ syntax, closes #446 .
2010-10-22 17:54:02 +02:00
9237dafef9
Query DSL: Query String _missing_ and _exists_ syntax, closes #446 .
2010-10-22 17:51:19 +02:00
f63ee3158a
Query DSL: Add `exists` and `missing` filters to filter documents where a field either has a value or not in them, closes #445 .
2010-10-22 15:14:05 +02:00
9a8e033424
improve fixing negative query with adding the optimized match_all query
2010-10-22 14:50:48 +02:00
5d1d927e09
Write Consistency Level for index/delete/delete_by_query/bulk with one/quorum/all. Defaults to quorum, closes #444 .
2010-10-22 02:51:00 +02:00
5649df572a
update search expiration to work in scheduled reaper mode
2010-10-21 16:38:44 +02:00
c37a0afbf0
improve update of mappings, and delete index process with the new optimization of when index is created
2010-10-20 12:49:21 +02:00
0b593bd6d9
upgrade to guava r07
2010-10-20 12:09:19 +02:00
ae5bc20959
Reduce multiple indices overhead, don't create Indices data on nodes that don't hold any shard for an index, closes #441 .
2010-10-20 02:57:49 +02:00
1235358848
remove unused indices service
2010-10-19 19:50:12 +02:00
a4eea0aeaa
change index creation / deletion logic not to wait for it to be created on other nodes since now, they might not be created...
2010-10-19 19:33:27 +02:00
69b8b0f437
don't use the index serivce to get the stored blobs in shared gateway, move it to upper node level
2010-10-19 18:03:48 +02:00
53a3df5d8e
move list of local files to be indices level, so no need for index created on a node in order to list it
2010-10-19 17:36:21 +02:00
5635260922
remove check on if indices has an index, cluster state is enough
2010-10-19 16:42:39 +02:00
4c8978237f
move operation routing to be cluster level and not index level
2010-10-19 16:23:39 +02:00
1eee7f381a
dont case node names and index names
2010-10-18 19:03:48 +02:00
5c760d1e8c
don't case the index name in cluster health, use string constants in xcontent generation
2010-10-18 18:55:38 +02:00
3a52c2f7f4
Improve automatic publish network address logic, closes #439 .
2010-10-18 15:19:24 +02:00
019c844dd1
Plugins: plugins should now be in extracted format under `ES_HOME/plugins`, closes #438 .
2010-10-18 11:14:16 +02:00
0a3d187e6a
Mapper: Allow to configure `date_formats` only on the root object mapper, closes #437 .
2010-10-17 19:56:58 +02:00
69ecf8b66b
rollback commit, allocation should only happen when index is not recovered
2010-10-17 19:43:30 +02:00
9a09261383
remove checking for client node on rivers, its automatically done with master and non river node anyhow
2010-10-17 19:20:37 +02:00
648da2e6ff
add cluster name to cluster health response
2010-10-17 18:58:59 +02:00
5d54e36964
Statistical Facet: Allow to compute statistical facets on more than one field, closes #436 .
2010-10-17 16:22:20 +02:00
2fc0022477
clean code
2010-10-17 02:33:12 +02:00
caa6495e2b
doc
2010-10-17 01:52:23 +02:00
4708d31040
add the option to control filter caching on each filter in the java filter builders
2010-10-16 16:12:38 +02:00
d9f966d83c
Query DSL: Numeric Range Filter - A filter that uses the field data cache to perform numeric tests, closes #435 .
2010-10-16 15:38:43 +02:00
cc3a1dbe90
move geo handling (filter) into the index package from common.lucene since it uses field data and not really only dependant on lucene constucts
2010-10-16 12:30:20 +02:00
1587a3815e
more options on stress rolling restart test, variable number of fields, variable length of text
2010-10-16 03:26:11 +02:00
b09675dcfa
add a stress test for rolling restart nodes
2010-10-16 01:05:25 +02:00
bbb05a57e0
add the ability to run check index before starting a shard, used for internal testing (as it has a large overhead)
2010-10-15 20:56:30 +02:00
6c9120a51b
Local Gateway: Don't block meta operations (delete index) on an index that is not recovered due to not all shards being available, closes #433 .
2010-10-15 11:04:54 +02:00
ae05ce0551
Scripting: Allow to define scripts within `config/scripts`, automatically compiled and can be referenced by name, closes #429 .
2010-10-14 16:14:23 +02:00
e0488fa87e
Plugins: Allow to place "extracted" plugins under the `plugins` directory, closes #428 .
2010-10-14 14:04:00 +02:00
8d533e8a99
dynamic tempaltes are now named (change to the mapping definition) to allow for simpler merging
2010-10-14 12:56:50 +02:00
ad01f19db8
move dynamic tempaltes to only allow to be defined on root object mapping (so easily reusable and simpler merging) #397 .
2010-10-14 12:25:32 +02:00
1578da404c
improve geo internal cache of lat/lon, stored two double arrays instead of an array of GeoPoints.
2010-10-13 22:03:48 +02:00
9077bb6528
Geo Overhaul (work with multiple locations), closes #414 . Change (again) how geo location is stored, not using geohash but explicit double conversion
2010-10-13 03:35:35 +02:00
8a8a4d648a
Query DSL: Fine grained filter caching control with sensible defaults, closes #424 .
2010-10-13 01:37:43 +02:00
3fa214653e
increase precision to 16 from 12, omit norms / tf on geohash
2010-10-12 22:30:56 +02:00
c3cb5a3e34
Use Base64 encoding for UUID generation (auto generated doc ids, and node ids), closes #422 .
2010-10-12 00:17:01 +02:00
4f9d9c1395
add test for merging two stats field facet using same facet name
2010-10-11 00:40:37 +02:00
18d8e9dcdd
add more script tests
2010-10-10 20:05:37 +02:00
a14b73bc13
Bulk API: Rename `index` to `_index`, `type` to `_type` and `id` to `_id`, closes #421 .
2010-10-10 19:31:56 +02:00
c15a612b8a
optimize get/delete/index response xcontent generation
2010-10-09 04:06:03 +02:00
087b4e6f23
optimize search response xcontent generation
2010-10-09 04:01:17 +02:00
f64e636415
add xcontent string that will allow to speed up json/smile serialization
2010-10-09 03:06:01 +02:00
bd962ba693
upgrade to jackson 1.6.1
2010-10-09 01:51:40 +02:00
6314c2460c
Geo Overhaul (work with multiple locations), closes #414 .
2010-10-08 22:31:21 +02:00
523a8b4c3e
rename xonctent mappers to just mappers
2010-10-08 15:05:07 +02:00
a61f3a939b
add option to reuse double[] when decoding geohash
2010-10-07 23:58:49 +02:00
0f6beeb263
reuse search lookup data for the two remaining cases (custom score and script filter) by having a "current" search context to access
2010-10-07 23:18:26 +02:00
34ed85a40f
internal refactoring of field data type
2010-10-07 18:41:17 +02:00
d0bf743ab4
Query DSL: query_string / field to use the optimized match_all query when using * (or *:*), closes #413 .
2010-10-07 16:48:24 +02:00
cf5ed1d177
Term Facet: Use a script that provides the facets to index, closes #410 .
2010-10-07 01:49:12 +02:00
4c34840627
fix dynamic tempaltes persistency and merging (so it will be there across restarts, and when a new mapping is merged)
2010-10-07 00:44:53 +02:00
4422a4c48a
doc
2010-10-06 14:07:34 +02:00
22ed71e2e6
allow to execute term facet on more than one field
2010-10-06 13:39:02 +02:00
31d94b19a1
Local Gateway: Possible failure to allocate shards to nodes when more than one index exists in the cluster (on full cluster restart), closes #409 .
2010-10-06 00:35:10 +02:00
1f49eb0b9d
Gateway: Add `gateway.expected_nodes` for state recovery, closes #404 .
2010-10-04 16:20:32 +02:00
c737b36df7
better handling of dynamic types in template mappings
2010-10-04 12:37:56 +02:00
425744e0db
add bzip2 compress lib
2010-10-03 16:24:10 +02:00
7180636df6
add close to script services
2010-10-03 14:31:36 +02:00
c9a47a126f
Scripts: Allow to access `_fields` providing access to stored fields, closes #402 .
2010-10-03 12:51:41 +02:00
5b8bc333bd
JavaScript Plugin: Allow to use javascript for scripts, closes #401 .
2010-10-03 02:20:37 +02:00
5a7c8fe2cb
allow script engines to have several types
2010-10-02 21:18:01 +02:00
a127499e3c
doc
2010-10-02 21:07:59 +02:00
31ebed11fd
script handling refactoring, better support for languages that perform better with some caching on a per search aspect (and execution per doc)
2010-10-02 17:32:29 +02:00
9e8ebd46e8
Groovy Plugin: Allow to run use groovy for scripts (where applicable), closes #398 .
2010-10-02 01:22:05 +02:00
aa116e5d40
add lang parameter to all script constructs, allowing for (later) custom script languages
2010-10-01 22:14:20 +02:00
99fcfde307
Mapper: Dynamic Template Support, closes #397 .
2010-10-01 16:56:04 +02:00
f66f0218ca
`/_cluster/nodes/stats` is broken in 0.11, closes #391 .
2010-09-30 08:35:11 +02:00
3b02bd3952
rename package
2010-09-30 08:17:33 +02:00
d3978383a5
when using keyword based analayzer on _all, an NPE is thrown since there is no current entry, ignore it (it does not make sense to have keywork analyzer on _all field...)
2010-09-28 14:53:37 +02:00
55ae6b2001
fix possible problem when trying to convert a binary format to a string
2010-09-28 12:32:40 +02:00
86e17eae2c
fix auto conversion from source content type to rest content type
2010-09-28 00:01:35 +02:00
1f3adc213f
add nodes attributes to cluster state
2010-09-27 10:46:11 +02:00
d9c2cc9d37
allow to sepcify stopwords as comma delimiated list of words
2010-09-26 22:50:25 +02:00
ce28882660
add refresh option to index/create/delete opereation, REST allows for refresh parameter (defaults to false)
2010-09-26 09:07:37 +02:00
2288c5d670
setHighlighterPostTags sets pre tags instead of post, closes #386 .
2010-09-25 00:01:14 +02:00
ab9aa15bb4
add auto sync of translog when using local gateway
2010-09-24 21:25:10 +02:00
1c2733ebee
add flush to gateway
2010-09-24 12:29:52 +02:00
485f904140
Default to not using compound file format for the index (increases number of open files, but faster indexing and recovery), closes #384 .
2010-09-24 11:46:41 +02:00
2f43af0bd7
use directly the directory and not the metaData API
2010-09-24 11:36:13 +02:00
9bb86ea865
imrpvoe boolean filter performance
2010-09-24 00:59:26 +02:00
31fd196687
doc the use of mapbuilder
2010-09-23 20:06:42 +02:00
097071a9d2
add smart name filter wrapping for geo filters to automatically filter by type if as well if provided
2010-09-23 19:34:41 +02:00
832914bf6d
create a mapbuilder when listing files and not ImmutableMap builder since it seems like listFiles might return duplicate files.
2010-09-23 19:13:48 +02:00
761639150d
doc
2010-09-23 19:03:48 +02:00
c96014bb90
default the _river to 1/1 for better OOB experiance (single node recovery with local gateway support)
2010-09-23 02:46:13 +02:00
ecaaeb5250
River CouchDB Plugin, closes #382 .
2010-09-23 02:26:12 +02:00
a59912db02
disable restart API
2010-09-23 00:02:12 +02:00
fd9266dbc6
fix wrong REST response generation of cluster state
2010-09-22 16:03:42 +02:00
91344170ee
doc
2010-09-22 15:39:30 +02:00
f301138e6f
Change default thread pool to scaling from cached, closes #381 .
2010-09-22 15:20:32 +02:00
6d0829f331
imrpove shard target streaming, only do it when needed
2010-09-22 14:36:29 +02:00
cfdf6b0103
add support for op type in also in bulk
2010-09-22 00:07:45 +02:00
3479f2a981
better exception message
2010-09-21 23:49:55 +02:00
2cbcc8dd2e
better handling of search context timeout
2010-09-21 23:17:46 +02:00
b9b91db5c8
building search response should handle cases where the sort is null valued
2010-09-21 22:13:27 +02:00
aa68667d63
rabbitmq river
2010-09-21 17:32:34 +02:00
32acd88b2e
default river index to have 1 shard with 2 replicas by default
2010-09-21 15:07:51 +02:00
8dfac512ba
move parsing of framed bulk binary data into the bulk request
2010-09-21 14:29:19 +02:00
4fe7cbccca
rename indexer to river
2010-09-21 13:35:09 +02:00
69fad80b01
add rest response for allocations
2010-09-21 13:05:10 +02:00
a1299a3d4f
refactoring in routing logic to allow adding allocation explanation that later can be shown
2010-09-21 11:39:22 +02:00
b5b36215ae
refactoring in routing logic to allow adding allocation explanation that later can be shown
2010-09-21 11:37:36 +02:00
dbb2ae69b9
upgrade to latest mvel (2.0.18)
2010-09-21 01:57:41 +02:00
a68c00cd0d
add special handling for primitive arrays as fields in xcontent builder
2010-09-21 01:41:35 +02:00
121e548d76
add to nodes stats the total store size of the indices shards allocated to that node
2010-09-21 01:11:43 +02:00
94a77b69d6
add a twitter indexer
2010-09-20 18:17:02 +02:00
eb4f4f99b3
add recover_after gateway tests
2010-09-20 09:44:57 +02:00
3ec95f4e84
javadoc
2010-09-20 08:58:33 +02:00
770bac252a
fix local discovery to handle master nodes specifically better
2010-09-19 23:49:15 +02:00
25246902cc
Gateway: Add `recover_after_data_nodes` and `recover_after_master_nodes`, closes #376 .
2010-09-19 22:46:13 +02:00
95bb02b330
simple specific master nodes test
2010-09-19 21:11:53 +02:00
8def6f59b3
simple specific master nodes test
2010-09-19 18:48:48 +02:00
20b6688b0a
make ping tests run faster using cluster state api
2010-09-19 18:13:03 +02:00
589dbce89b
move persistenting state and sharsd state in local gateway to another thread
2010-09-19 17:54:14 +02:00
f82ceb1e1e
do snapshots on more lower level interval
2010-09-18 22:18:21 +02:00
e3948115f4
doc
2010-09-18 22:00:18 +02:00
2372f481aa
Shared Storage Gateway (fs/s3): Wrong snapshotting of transaction log, closes #375 .
2010-09-18 21:33:38 +02:00
a2011e0151
no need to cache match all filter
2010-09-17 16:47:35 +02:00
cd7b84e808
improve match_all query to use a filter when possible
2010-09-17 16:38:27 +02:00
3c95d6a215
more work on inexers
2010-09-17 16:36:12 +02:00
ff081240eb
imrpove caching and fix delete mapping logic
2010-09-17 01:25:37 +02:00
08d7125cd5
more work on indexer
2010-09-17 00:22:42 +02:00
4b87f63bed
Terms Facet: Allow to provide `_index` as the field, resulting in facets on indices, closes #374 .
2010-09-16 15:11:30 +02:00
f49f3e169a
Mapping API: Delete Mapping (with data), closes #373 .
2010-09-16 14:35:07 +02:00
aef4704fed
more indexer work
2010-09-16 13:22:09 +02:00
0a6600818a
add count at the end of the stress test
2010-09-15 23:51:25 +02:00
09cdc1c379
don't wait for indices if there are none when using local gateway
2010-09-15 18:22:13 +02:00
e52daa9670
automatic index creation when using the bulk api
2010-09-15 18:18:48 +02:00
e93eb16deb
docs and wrap the rest bulk request in an array
2010-09-15 17:59:10 +02:00
5a5a892cc7
return the correct content type
2010-09-15 12:55:36 +02:00
8db2a217c0
Expose internal search source builder
2010-09-15 12:43:21 +02:00
3afe4da550
Bulk API, closes #371 .
2010-09-15 12:22:07 +02:00
f6fa6ea44e
more work on bulk, client API
2010-09-14 22:08:43 +02:00
d96ffe9153
internal bulk operaiton on the index shard
2010-09-14 01:46:44 +02:00
85160ae341
Mapper: Upgrading a simple mapping to multi_field mapping fails on merge conflicts, closes #369 .
2010-09-14 00:10:01 +02:00
686b59c33f
more work on indexer
2010-09-13 23:00:34 +02:00
0c8dfd967c
better raw generation of json
2010-09-13 02:43:39 +02:00
2d5883ccb5
improve normalization performance from one content type to the other
2010-09-13 02:09:15 +02:00
38aeba438d
XContent refactoring, closes #367 .
2010-09-12 23:20:15 +02:00
4822517d5d
add query parser cache to cache common query strings (+settings) with the parsed queries
2010-09-12 17:08:26 +02:00
77a7938891
move to use guice to register also the default query parsers and filters
2010-09-12 16:46:57 +02:00
2442e1fb16
improve query string parsing by reusing the same parser (bounded to the query parser context)
2010-09-12 15:39:07 +02:00
ed5ffd6591
Setting `path.work` does not affect the logs location, closes #366 .
2010-09-11 22:22:49 +03:00
bc42352f7e
change the local gateway metadata file from state- to metadata-
2010-09-11 21:45:45 +03:00
0718757612
Query DSL: `match_all` filter, closes #365 .
2010-09-11 16:01:30 +03:00
eccc7d5ef2
Search API: Allow to name filters and return per hit the filters it matched on, closes #364 .
2010-09-11 12:38:19 +03:00
ab2a655a59
parsing a query should result in ParsedQuery object, so we can piggyback on it more parsing state / data
2010-09-11 00:34:22 +03:00
a47638dd3c
imrove filter caching handling by not holding an implicit ref to the parent cache
2010-09-11 00:11:47 +03:00
de05a10ae5
use fastGet in docset
2010-09-10 16:16:45 +03:00
4e661c165a
Geo search across anti-meridian doesn't work, closes #363 .
2010-09-10 16:04:10 +03:00
b31b0e979c
Search failure when no results are found and sorting by score, closes #362 .
2010-09-09 15:47:55 +03:00
31362e4c60
upgrade to joda 1.6
2010-09-09 00:53:20 +03:00
a768016779
Allow to configure a common logger prefix using `es.logger.prefix` system prop, closes #360 .
2010-09-08 12:16:41 +03:00
e151b83372
add simple dummy indexer
2010-09-07 18:19:02 +03:00
ad5945f141
Mapper: `geo_point` to support passing array of [lat, lon], closes #361 .
2010-09-07 17:23:06 +03:00
c045b4d0ef
Mapper: `geo_point` type to allow to set `store` on the mapping, closes #359 .
2010-09-07 14:10:29 +03:00
7c48f27e60
throw an exception when no lat/lon or geohash are found
2010-09-07 11:36:12 +03:00
2cb45d4fe7
hack to work around complete text highlighting
2010-09-07 01:28:30 +03:00
bbb2033d3b
start working on indexers
2010-09-07 00:41:30 +03:00
f270fc00d2
earch API: Automatically identify "script" fields on the field elements in search, close #357 .
2010-09-06 11:51:31 +03:00
243b7455e8
fix javadoc
2010-09-06 01:10:46 +03:00
cc1eac147a
Allow to specify highlighter parameters on a per field level basis, closes #356 .
2010-09-05 20:47:38 +03:00
8efe5dc9ae
Highlighter enhancements.
2010-09-05 14:52:48 +03:00
c050bb58da
allow to set a query using a string as well
2010-09-04 21:30:02 +03:00
42b2e60af2
Create Index / Update Settings: Automatically prefix all settings with `index.`, closes #355 .
2010-09-04 14:04:51 +03:00
4f08801bb9
Thrift Plugin: Expose REST interface using thrift, closes #354 .
2010-09-04 02:45:37 +03:00
3d30b9c034
fix not called processModule on plugin for index and shard level modules
2010-09-03 19:06:11 +03:00
1079941397
javadoc
2010-09-03 18:40:30 +03:00
b40f0bc5a4
Local Gateway: Expose `gateway.local.initial_shards` to control when to recover and index, closes #352 .
2010-09-03 18:38:24 +03:00
575f5b406b
abstract away script execution
2010-09-03 01:49:06 +03:00
cd28afe950
Search API: Allow for script fields to extract parts of the stored _`source`, closes #349 .
2010-09-02 21:29:41 +03:00
1e75638b31
refactor field funtion to use internal docmap to be used in scripts
2010-09-02 17:19:50 +03:00
807c485a38
make the cached compile scripts a soft map
2010-09-02 16:29:41 +03:00
7bd08d638d
JMX: Disable creating by default an RMI JMX connector, closes #348 .
2010-09-02 14:17:53 +03:00
0250896a09
reduce shard search response size by not serilaizing the node id, index, and shard id
2010-09-02 11:19:25 +03:00
042af200e8
Gateway: Default to `local` gateway (replace `none` gateway), closes #347 .
2010-09-01 23:21:26 +03:00
0de24218ff
improve local gateway, store started shards and metadata in separated files, metadata stored on master nodes, and started shards on data nodes.
2010-09-01 21:32:07 +03:00
7709cd1bc2
improve GC logging
2010-09-01 15:02:56 +03:00
7d6aa6c027
local gateway: don't store the local state when not a data/master node
2010-09-01 00:07:10 +03:00
ba5cd19989
gateway test to make sure it recovers from the latest version
2010-08-31 21:13:42 +03:00
a3efa21d71
Mapper: Failure to handle null valued objects ("obj1" : null), closes #341 .
2010-08-31 13:33:21 +03:00
f3292f6778
upgrade netty version to 3.2.2
2010-08-30 23:57:37 +03:00
289cfdf25a
improve replica allocation, fix test to wait for recovery on node2
2010-08-30 23:37:09 +03:00
9503fca2ae
fix logging
2010-08-30 22:53:47 +03:00
61764c5b69
add another test for local gateway, fix race when loading the current state of a node
2010-08-30 19:29:00 +03:00
908fba44e7
fsync translog when closing and not deleting, allocate failed shard to another started shard
2010-08-30 16:55:57 +03:00
d9979f8dfe
more work on local gateway, start integration test it
2010-08-30 01:25:45 +03:00
8ed54c24bd
change nodeFile to nodeLocation
2010-08-29 23:25:23 +03:00
5b5d42445d
move the shared fs gateway base class to fs package
2010-08-29 23:22:55 +03:00
269616f35e
more work on getting local gateway to work, apply transaction log operations when primary "recovering"
2010-08-29 16:56:04 +03:00
4f4471483d
initial work on local gateway
2010-08-29 01:24:23 +03:00
163b7be639
refactor gateway service to allow for more custom gateway implemenations
2010-08-28 00:34:15 +03:00
a10ab7fe08
better exception thrown when failing to handle responses
2010-08-27 14:14:28 +03:00
e85c47db74
improve stack trace when failing to send a transaction request
2010-08-27 13:52:58 +03:00
e5b041c8ef
simplify gateway snapshot operation
2010-08-27 00:41:55 +03:00
19ddee5ec9
add a test for time interval
2010-08-26 18:12:51 +03:00
a49af6072b
add objects option to range filter builder
2010-08-26 16:39:39 +03:00
d56b4d266e
move query hint only to broadcast requests that use it
2010-08-26 14:31:54 +03:00
dfa24f6d03
improve caching of stored metadata fetched from nodes during allocation in order to reuse existing shards
2010-08-25 23:12:07 +03:00
2910b6ab7f
add callback for shards_started and shards_failed to better handle caching on node allocations level
2010-08-25 22:20:27 +03:00
3ebd03f69a
doc
2010-08-25 22:03:11 +03:00
9d615a4f0b
Query DSL: Improve `or` and `and` filters to accept just array of filters, closes #336 .
2010-08-25 18:06:28 +03:00
c7a36ed431
add an exception when on filtesr are provided to "and" and "not" filters
2010-08-25 17:56:50 +03:00
fcdc5f872a
improve (perf) getting last committed version of the index to create a new translog with
2010-08-25 15:12:26 +03:00
9d08e56d8a
cache nodes store metadata for on a shard basis when iteratring over the unassigned nodes
2010-08-25 15:03:25 +03:00
f36d80f66d
don't go and find local storage for a shard on nodes if its not going to be allocated
2010-08-25 15:01:09 +03:00
4bfd0a8c26
cache commit points during smart allocation based on local storage when recovering from gateway
2010-08-25 01:12:16 +03:00
244cd42298
allow to use just hosts when using unicast discover, will use the transport level ports
2010-08-25 00:44:04 +03:00
fc812a306b
change logging
2010-08-24 23:33:03 +03:00
ba5814a72f
change log level
2010-08-24 23:25:20 +03:00
31aed01220
increase timeout to 5 seconds
2010-08-24 23:18:58 +03:00
fdc82dd5a3
ignore parsing of wrong file format in the gateway (log warn), use index vesrion as the translog id
2010-08-24 23:12:18 +03:00
d0f5bc3403
add russian letter tokenizer
2010-08-24 23:11:22 +03:00
49b4659322
Indexing Buffer Size: Refine default setting to 10% (from 40%) and add more settings, closes #334 .
2010-08-24 18:12:45 +03:00
7ae8d4c669
thread pool type setting is wrong, fix blocking max setting to have a minimum of 10, use cached TP where needed
2010-08-24 15:28:54 +03:00
b8ab50828c
only list and delete files we created
2010-08-24 14:48:49 +03:00
df23d8f7ec
don't snapshot a translog that has no content
2010-08-24 03:58:21 +03:00
6c29142b91
throw recovery failure if failing to parse all commit points
2010-08-24 01:28:39 +03:00
b52d854711
smarter handling of throttling when preferring allocating to an existing work location
2010-08-23 21:39:54 +03:00
78b6879ecd
move rebalance only when active logic into node allocation, add canRebalance hook point
2010-08-23 18:28:35 +03:00
149962691e
move rebalance only when active logic into node allocation, add canRebalance hook point
2010-08-23 18:27:01 +03:00
4300a6ca18
move rebalance only when active logic into node allocation, add canRebalance hook point
2010-08-23 18:26:17 +03:00
0e47898902
add /_shutdown to the REST endpoints
2010-08-23 18:01:47 +03:00
5900e01a0d
list remote nodest storage information with a timeout
2010-08-23 18:00:37 +03:00
1461da5b49
move prefetch allocation to be a NodeAllocation
2010-08-23 17:22:44 +03:00
edbd586ee5
add load test for recovery from gateway
2010-08-23 16:33:33 +03:00
939d583550
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
2010-08-23 15:42:03 +03:00
b49d331c86
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
2010-08-23 15:28:12 +03:00
62cc4d554a
better logging message for reused vs. recovered from gateway
2010-08-23 15:25:06 +03:00
5bd37f6f47
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
2010-08-23 14:48:49 +03:00
1517fa3d28
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
2010-08-23 01:45:03 +03:00
36ad3b246a
addlow to add node allocation ot the module
2010-08-22 12:35:59 +03:00
664f28492d
improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation
2010-08-22 10:42:25 +03:00
aa28b93610
refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it
2010-08-22 02:47:34 +03:00
7592862646
add a callback for allocation as well
2010-08-22 01:00:37 +03:00
a3852766ff
only check for prefered allocation on data nodes
2010-08-22 00:32:43 +03:00
3f701365b0
move the allocate replica after primary active logic to a node allocation
2010-08-22 00:14:56 +03:00
5ded04c5cb
refactor shard allocation to be more pluggable for node allocation "deciders"
2010-08-21 21:59:31 +03:00
2865ceef85
more on sorted nodes when allocating shards above average number of shards per node
2010-08-21 19:55:38 +03:00
76e1a6b1bf
check also for negative values
2010-08-21 19:51:14 +03:00
5d2c005622
pass to canAllocate (though nothing is done there now) the actual routing nodes
2010-08-21 17:52:24 +03:00
1ddd969fa7
pass to canAllocate (though nothing is done there now) the actual routing nodes
2010-08-21 17:52:02 +03:00
11dbbebb7a
renamve var to better reflect its state (started, not active)
2010-08-21 17:50:08 +03:00
3117341f44
Shards Allocation: Only rebalance a shard if all its instances are already active, closes #331 .
2010-08-21 17:49:19 +03:00
38e6649a7e
Cluster Health API: Add `initializing_shards` and `unassigned_shards` to the response, closes #330 .
2010-08-21 16:03:29 +03:00
113ea1bb1b
don't throttle gateway recovery based on peer recoveries (gateway recoveries are important to do as fast as possible). still throttle peer recoveries based on both.
2010-08-21 15:37:12 +03:00
e12bdd9faf
rename RETRY stage in recovery to THROTTLE
2010-08-21 15:13:34 +03:00
0c72bb2125
better writing of local md5 caches
2010-08-21 02:16:36 +03:00
1ef1e9b25b
don't spawn on received cluster state
2010-08-20 19:36:39 +03:00
800e450e3a
handle local md5 cases, don't include them in the list of files the directory has
2010-08-20 19:30:26 +03:00
9acae60dbf
also have a minimum value for concurrent recoveries, at 3
2010-08-20 17:28:31 +03:00
f62f7b8ffe
check the progress in case the index size has not been set yet...
2010-08-20 17:17:32 +03:00
9f0d5f8ef1
better default concurrent recoveries, based on number of processors, tap it at 10
2010-08-20 17:06:56 +03:00
8c25be6dee
better exception message with primary not started exception on index/delete/delete_by_query apis
2010-08-20 16:36:25 +03:00
07285d81d1
add stream done when there is no file (should not happen)
2010-08-20 15:59:46 +03:00
b609162be3
don't ignore recovery on throttling unless the shard is closed
2010-08-20 15:58:24 +03:00
4e74001bde
move marking recovering before creating a status
2010-08-20 15:24:49 +03:00
4c00e89f5e
move memory monitor benchamrk to single indexing stress test
2010-08-20 15:05:21 +03:00
ef64f5d970
move memory monitor benchamrk to single indexing stress test
2010-08-20 13:41:33 +03:00
c0552bdc70
Can't set "no stopwords" on analyzer, closes #329 .
2010-08-20 03:22:43 +03:00
6f1a9fbfb9
create md5 files on the local index storage as well, so they won't have to be recomputed when performing initial recovery
2010-08-20 02:28:14 +03:00
acae0650c8
bail out of recovery when close and still waiting on throttling
2010-08-20 01:24:02 +03:00
a05c367c5e
don't snapshot gateway when cleaning shard
2010-08-20 00:59:37 +03:00
4a2e076c6a
do a reuse work prefetching not on the cluster state thread, so it won't block while fetching md5s from other nodes
2010-08-20 00:45:17 +03:00
a5c5f65da5
fix recovery status when all index got reused
2010-08-19 22:46:58 +03:00
7437acfcea
add progress to indices status API
2010-08-19 22:29:31 +03:00
8d0e5b239c
recator source rest building into common code
2010-08-19 20:24:12 +03:00
7b1093fb16
anoter compressed string test
2010-08-19 18:45:15 +03:00
kimchy
Lukáš Vlček
Adriano Ferreira
harryf
Tim Dysinger