f2eae5b605
Memory Index Store: Separate to two buffer size types, and fix bugs, closes #577 .
2010-12-23 23:21:32 +02:00
22fa91efa0
add reconnection code between nodes that are not masters
2010-12-23 17:26:55 +02:00
f6afc01fe5
add reconnection code between nodes that are not masters
2010-12-23 17:26:32 +02:00
ff5990daec
listener should be threaded
2010-12-23 17:24:23 +02:00
de7dd3c070
default to try and connect after network disconnection with fault detection
2010-12-23 16:51:09 +02:00
e313379ed5
only force shutdown on cached threadpool if its not the same as the execture service
2010-12-23 16:13:05 +02:00
42e8567477
interrupt joining the cluster thread if shutting down
2010-12-23 16:11:43 +02:00
5f25ae4f2f
check if the scheduled thread pool is not terminated when trying to terminate it
2010-12-23 15:18:22 +02:00
9f72a8d68b
use cached thread pool for notifying on disconnections
2010-12-23 14:22:40 +02:00
6dcc04b59c
Transport: Increase the default transport.tcp.connect_timeout from 1s to 30s, also add `network.tcp.connect_timeout` to conform with other common network settings, closes #576 .
2010-12-23 14:20:11 +02:00
5c338b7af2
add message to connect transport failure exception
2010-12-23 13:05:39 +02:00
5a58ed4274
when replacing a mapping, clear the aggregated mapping information and then readd it
2010-12-23 11:32:16 +02:00
473c2fa8f4
add reason for state change logging in index shard, add debug logging on ignore recovery in when handling cluster change in indices cluster
2010-12-23 10:56:37 +02:00
5ac42f2a4f
Excessive mapping parsing when cluster state changes, closes #575 .
2010-12-23 09:53:05 +02:00
f869951364
rename type method on MapperService to the more descriptive documentMapperWithAutoCreate
2010-12-23 08:43:17 +02:00
e0b2b4b4a6
add a warn when not using the custom FieldCache with eager reader based eviction
2010-12-23 07:58:43 +02:00
800b7f39bd
add toString to CompressedString to show when logging it
2010-12-23 07:45:04 +02:00
3b30930460
improve logging when trying to delete unallocated shard, check first if deleting is required, and only then delete it
2010-12-23 07:37:49 +02:00
ac73334c87
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:59 +02:00
bb0d7190e9
make id cache an index component, so a new instance will be created per index
2010-12-22 14:21:31 +02:00
1ee24ce60f
add an option to provide an OutputStream to a builder, allowing to generate directly into a stream provided by the user
2010-12-22 13:26:29 +02:00
eef3a95fa6
move the query parser cache to be index level and not node level
2010-12-22 12:31:30 +02:00
33339ae4b1
improve concurrency control in filter caching, reuse one if it was created already under concurrent request
2010-12-22 10:42:38 +02:00
d283c158d2
optimize for the more common case of single value facets when loading values
2010-12-22 09:04:35 +02:00
59ee8493ce
use public terms filter in all places
2010-12-21 23:43:05 +02:00
a1df3c637c
improve logic of when to load fields from source, only if they actually have mappings, otherwise, ignore them (as was the previous behavior)
2010-12-21 13:02:15 +02:00
3035254885
Search API: Allow to pass `&fields=` without any fields to cause only id and type to be returned, closes #572 .
2010-12-21 12:01:51 +02:00
a96b294de0
add multicast socket to execption message
2010-12-20 20:07:51 +02:00
efc95dc00a
Java Search API: Passing a the query as json fails, closes #568 .
2010-12-20 11:31:09 +02:00
789073639d
fix transport client compilation problem, the client cluster service was not used and removed
2010-12-19 05:50:07 +02:00
8dfc3acba0
when using dates in scripts, initialize the dates (DateTime) with UTC
2010-12-19 05:01:59 +02:00
96a2950ab5
Disable calling mlockall by default, can be enabled by setting bootstrap.mlockall to `true`, closes #567 .
2010-12-19 02:30:48 +02:00
415bb5d7f3
Java TransportClient: By default, don't sniff other nodes and use addresses provided as is, closes #565 .
2010-12-17 19:31:28 +02:00
005c6d9124
allow to set term index divisor
2010-12-16 21:56:59 +02:00
ff0eeb3d1a
improve getting setting as array, automatically support comma delimited values under the exact setting
2010-12-16 05:02:24 +02:00
f827b7cff5
fix settings
2010-12-16 00:48:26 +02:00
d6bab1a892
Tcp Transport: Connection pool between nodes and different connection types, closes #564 .
2010-12-15 20:11:10 +02:00
085066ed19
set, by default, the send and receive buffers to 32k on tcp
2010-12-15 05:54:09 +02:00
36be13ffb3
bring back the file chunk size in recovery to 100kb from 500kb
2010-12-15 01:28:21 +02:00
b6277ac14d
increase netty worker count to default to the updated value netty defaults to
2010-12-15 01:16:00 +02:00
bb178c9c1a
cleanup
2010-12-13 21:30:26 +02:00
d0eed79175
add log message on hte concurrent streams used
2010-12-13 00:08:57 +02:00
ceb7b90740
Recovery: Allow to control `concurrent_streams` (per node) during recovery
2010-12-13 00:03:04 +02:00
1c5477d4ed
Improve local node recovery process, removing using a block as indication for an index not being recovered. Moving to shard replication group level allocation (with the ability to distinguish between api based creation or recovery based creation). This also allows for throttling based control on initial local gateway based shard allocation.
2010-12-12 22:46:27 +02:00
bc04243a2b
Search Fields: If a field is not stored, automatically extract it from _source (without the need for _source prefix), closes #562 .
2010-12-12 05:00:24 +02:00
216b2ab912
Highlighting: Automatically use the field values extracted from _source if not stored explicitly in the mapping, closes #561 .
2010-12-12 04:40:25 +02:00
fe3f5d45de
remove global settings from the settings conf, a relic that is no longer needed...
2010-12-12 02:37:36 +02:00
dddca692b8
add search hit phase, which operates on a hit, and have all relevant hit phases implement and use it
2010-12-12 02:01:13 +02:00
be4b2e2de6
externalize script search lookup into a generalized lookup that can be used outside of scripts
2010-12-12 01:01:56 +02:00
a914865c45
Close API might cause index data to be wiped, closes #560 .
2010-12-10 22:19:45 +02:00
bc2dc9465a
add to the receive timeout exception the request id that it timed out on
2010-12-10 12:40:39 +02:00
2a7f964ca2
Geo search fails to find some docs when wrapping over IDL, closes #559 .
2010-12-10 08:39:10 +02:00
9d2fe162fa
better log message
2010-12-10 00:17:55 +02:00
3f6ed7e1de
improve update mapping on master, if we end up with the same mappings as the one the cluster state has, no need for a new cluster state...
2010-12-10 00:17:10 +02:00
167d35807c
Add terms/in query, alias terms filter to be in filter as well, closes #557 .
2010-12-09 07:25:05 +02:00
0828f18738
better child bench
2010-12-09 06:11:06 +02:00
34f3f3f79e
Aliased analyzers cause index deletion / cleanup failure, closes #555 .
2010-12-08 19:30:38 +02:00
f5a8c3881f
add debug logging on failed bug items executions
2010-12-08 01:21:21 +02:00
54437c1bd3
Parent / Child Support, closes #553 .
2010-12-08 00:16:05 +02:00
22c27e4ff8
correct field name
2010-12-05 00:02:53 +02:00
a90684aaa5
Upgrade to Lucene 3.0.3, closes #549 .
2010-12-03 20:43:51 +02:00
d9610ed0a1
Search API: Optimize single shard search to `QUERY_AND_FETCH` from any other search type, closes #547 .
2010-12-01 03:59:03 +02:00
3ea19a514b
Index Setting: Add `index.refresh_interval` to simplify setting instead of "index.engine.robin.refresh_interval` (still works), closes #546 .
2010-12-01 03:38:41 +02:00
2b039bd0b0
change the default chunk size when recovering from the default 100kb to 500kb.
2010-11-29 14:33:49 +02:00
c0945831e8
Search Scroll API: Allow to provide the scroll id as the body of the scroll request, closes #545 .
2010-11-29 13:59:30 +02:00
103221e58a
remove the timed out message, can be misleading
2010-11-29 02:55:23 +02:00
84f97e96a5
Scrolling issues, fix releasing search context eagerly, they should not be released when scrolling, closes #136 .
2010-11-29 02:05:45 +02:00
6d9576c217
Reduce the number of concurrent recoveries per node to 2 from number_of_processors, closes #543 .
2010-11-28 16:35:39 +02:00
a222de1dbf
internal change to scope based collectors
2010-11-28 14:57:17 +02:00
8285ffe221
encode scroll id with base64 in url safe manner
2010-11-28 02:23:38 +02:00
cfa8c9aa79
Index / Index Template: Allow to define `_default_` mapping, closes #542 .
2010-11-27 23:30:18 +02:00
526f28f479
Create Index API: Allow to provide mappings. closes #541 .
2010-11-27 00:28:18 +02:00
151715dc2f
also merge lists
2010-11-27 00:05:11 +02:00
577f06fd43
add indices API to groovy client
2010-11-26 22:19:57 +02:00
73e5eb9e14
clean compile warnings
2010-11-26 16:03:25 +02:00
6dab568a4b
Index Templates, closes #540 .
2010-11-26 15:53:04 +02:00
ebd6316db9
Index templates, closes #540 .
2010-11-26 15:45:18 +02:00
d150ac2da4
Search API: Add how long the search took (in milliseconds), closes #536 .
2010-11-24 13:27:32 +02:00
51273587de
Bulk API: Add refresh flag, closes #535 .
2010-11-24 00:58:48 +02:00
4a3e5b6348
Query Cache: Invalidate the query cache when mappings change, closes #532 .
2010-11-23 15:26:19 +02:00
9479ac636e
Delete Mapping API: Wrongly deleting existing mapping information, closes #531 .
2010-11-23 14:56:03 +02:00
3b2b901db0
improve error handling, we can't always parse the source to a stirng
2010-11-23 00:41:53 +02:00
db1f7e09f3
Support date and ip types for `numeric_range` filter, closes #530 .
2010-11-22 16:17:51 +02:00
b4113d57d3
Analyze API: An API to analyzer custom text based on an optional analyzer, closes #529 .
2010-11-21 17:33:35 +02:00
8689e5cf16
more cleaning of shards iterators
2010-11-21 14:49:57 +02:00
e183fbd6ad
add shards iterator that can iterate over unrelated list of shards
2010-11-21 14:27:22 +02:00
7db5e63ab7
rename shardsIt to shardIt
2010-11-21 13:54:44 +02:00
a74465000d
rename single operation base support to single shard operation
2010-11-21 13:26:36 +02:00
c40eaaae38
serializing get result should use the same construct as search hit fields
2010-11-20 18:38:43 +02:00
58ecc4f77f
cleanup single operation action support
2010-11-20 18:23:13 +02:00
03f66b0c45
log4j syslog appender don't load, closes #527 .
2010-11-19 22:08:18 +02:00
fdb98b1dcb
Highlighting bug where fragments are broken when number_of_fragments is 0, closes #479 .
2010-11-18 20:52:51 +02:00
d1ef445632
clean thread local vars eagerly
2010-11-18 20:22:42 +02:00
16ed69daa3
add routing to delete by query rest endpoint
2010-11-18 13:46:45 +02:00
cf4f6decc4
add a test for overloaded method of builder and List
2010-11-18 02:25:22 +02:00
282a7a5162
Add non inspection checks
2010-11-18 02:05:32 +02:00
44775c2aa8
Routing: Allow to define `path` on the `_routing` mapping, to automatically extract the routing from it, closes #524 .
2010-11-17 17:05:51 +02:00
4e75f3de4a
republish the cluster state if a node exists in the cluster
2010-11-17 11:33:33 +02:00
0172eaea89
add broadcasting when no routing and its marked as required to bulk delete as well
2010-11-16 18:53:32 +02:00
619efea940
Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522 .
2010-11-16 18:31:43 +02:00
a04d8ec5ad
Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522 .
2010-11-16 18:31:08 +02:00
2483a37db5
fix comparator implementation in histogram facet
2010-11-16 15:30:27 +02:00
e7fdea8858
fix underscore casing to transform Name to name, and not _name
2010-11-16 15:16:54 +02:00
02981f6101
Routing: Allow to specify on the `_routing` mapping that its required, and fail index operations that do not provide one, closes #520 .
2010-11-16 15:10:41 +02:00
8a8a6d5547
Mapping: Rename _attributes to _meta, closes #518 .
2010-11-16 01:34:01 +02:00
b8b4cbbb46
add mapping metadata to cluster state metadata, will allow in the future to add specific mappings hints (since we don't have the parsed mapping on each node anymore)
2010-11-15 21:21:18 +02:00
51c18cd9c1
refactor ip field mapper into its own package
2010-11-15 19:21:23 +02:00
36183af22c
automatically use match_all query when executing a _all:* query string
2010-11-15 17:15:24 +02:00
effdd52586
sync changes done on the indices cluster service with changes happening in an async manner during recovery
2010-11-15 16:54:29 +02:00
4b06eeb75a
better desc
2010-11-15 16:39:16 +02:00
a342029d36
Histogram Facet: Allow to define a key field and value script, closes #517 .
2010-11-15 15:05:50 +02:00
5c6c4bfb5a
Histogram Facet: Allow to define a key field and value script, closes #517 .
2010-11-15 15:02:35 +02:00
b1db5c43d6
Mapper: `date` type to also allow providing values in numeric (milliseconds since epoch), closes #516 .
2010-11-15 14:12:54 +02:00
6d214d69b9
Mapper: Store the routing (if provided) under a `_routing` field, closes #515 .
2010-11-15 11:34:56 +02:00
8ee038574d
add _routing to documetn indexed when providing routing value
2010-11-14 21:23:52 +02:00
9505cb14f1
bring back the retry on shard missing
2010-11-14 21:02:46 +02:00
fa1d8c7bcd
only remove the shard (not clean it) when ignoring recovery
2010-11-14 20:09:27 +02:00
37335bc6a9
also retry when there are no routing shards, might happen in case of recovery from gateway before shard routing initialization
2010-11-14 20:09:00 +02:00
d0ac9087b6
add bootstrap.mlockall setting to control if mlockall should be called or not
2010-11-14 15:54:40 +02:00
30929c3d01
better logging, include index and shard id in log statement
2010-11-14 00:24:51 +02:00
31986c4486
add a check to not allow to create an alias with a name of an existing index
2010-11-13 18:53:12 +02:00
73bf371912
fix exception logging on failed index creation
2010-11-13 18:08:11 +02:00
38d77f8cf3
Query DSL: Allow to provide pattern field names when using query_string query, closes #511 .
2010-11-13 02:26:14 +02:00
6839cc6965
clear memory after parsing a doc, and not on parsing of a new doc
2010-11-12 15:36:23 +02:00
d994a862dd
add support for analyzer mapping when the mapping is not indexd nor stored
2010-11-12 14:54:28 +02:00
bba98cf1b7
cleanup traversing unneeded mappings
2010-11-12 14:50:05 +02:00
beb77c9b0a
fix a bug in mapping serialization (introduced on 0.13), where properties gets underscore cased by mistake, and not retain their original naming
2010-11-11 15:38:20 +02:00
70a0e110d4
apping: add threshold to _source field compression, closes #506 .
2010-11-10 21:03:54 +02:00
a2e674df49
add filteredQuery to QueryBuilders to conform with xxxQuery notation
2010-11-10 00:03:33 +02:00
4c6af6afa5
Cluster health API should return RED status (on applicable levels) when an index has not recovered from the gateway, closes #507 .
2010-11-09 21:25:22 +02:00
4695f93276
add index routing table changed
2010-11-09 16:31:21 +02:00
8ceba0dca1
don't overflow with cluster events if the index level block was removed already
2010-11-09 15:42:27 +02:00
36bf5ee9fe
add toString to cluster block
2010-11-09 15:41:47 +02:00
a0f4359ffa
handle any exception when failing to snapshot
2010-11-09 15:34:43 +02:00
8266315f51
handle any exception when failing to snapshot
2010-11-09 15:34:17 +02:00
f9fb67616d
don't write checksum file for the segments file, we anyhow recover it and that way the index can be read by pure Lucene code
2010-11-09 14:27:28 +02:00
b5f1a1b49c
Parsing a deeply nested json might fail
2010-11-09 10:26:15 +02:00
33ff95af05
add more trove helpers
2010-11-09 09:35:35 +02:00
8e2db2c68f
rename field to path in _analyzer mapping
2010-11-09 09:16:47 +02:00
6b5e884b93
have the default path value for analyzer mapper to be _analyzer.
2010-11-09 08:59:30 +02:00
6567fcaf35
remove an index level block if its empty (make no sense to keep an empty set for it, also, shouldn't shot it back in APIs)
2010-11-09 00:08:30 +02:00
c69b94d769
rename field to path in _analyzer mapping
2010-11-08 11:07:34 +02:00
c9228ed26d
Get Action: Allow to pass refresh forcing getting latest, closes #488 .
2010-11-07 23:51:18 +02:00
c095d72439
Get Action: Allow to pass refresh forcing getting latest, closes #488 .
2010-11-07 23:50:48 +02:00
e51523385d
Analysis: Allow to alias analyzers, closes #486 .
2010-11-07 20:10:53 +02:00
171fa4a7e8
Mapper: An analyzer mapper allowing to control the index analyzer of a document based on a document field, closes #485 .
2010-11-07 18:18:24 +02:00
b45ade467e
send transport exception is a wrapper exception around the actual exception
2010-11-07 17:56:50 +02:00
c9e8a2ac68
no need to pass the id mapprt to serialization twice...
2010-11-07 16:00:27 +02:00
d77a0c41d0
make sure attributes are also serialized across restarts
2010-11-07 15:32:37 +02:00
598225f833
document level analyzer (analyzer, index_analyzer, search_analyzer) are not serialized (and not maintained across restarts), closes #484 .
2010-11-07 13:13:29 +02:00
7340d6973d
slim down the mapping serialization to xcontent (json), don't write default values
2010-11-07 12:33:44 +02:00
e44604b441
better transport exception handling, refactor out an action based transport exception, and don't fill stack trace only for remote ones
2010-11-07 04:08:05 +02:00
ef3e7fe62b
renamve method
2010-11-07 00:02:58 +02:00
6b952f6719
Fs Gateway: Add (native) file lock to ensure two nodes in a split brain are not updating same gateway, closes #481 .
2010-11-06 23:27:46 +02:00
998bde0820
Add an option to display max_open_files, by setting -Des.max-open-files to `true`, closes #483 .
2010-11-06 22:47:09 +02:00
b568174bee
add a comment on why we don't mark as relocated when relcoating primaries
2010-11-06 22:03:11 +02:00
87efccf677
expose boolean and Object as values for TermQueryBuilder and FieldQueryBuilder
2010-11-06 01:04:14 +02:00
129b9a3938
Query DSL: Allow to control (globally) the max clause count for `bool` query (defaults to 1024), closes #482 .
2010-11-06 00:59:37 +02:00
9385476340
fix expected setting, had an additional _ by mistake
2010-11-05 20:54:01 +02:00
53a98275cf
remove unused variable
2010-11-05 18:39:10 +02:00
99a3e615ab
Improve performance when searching across multiple types, closes #478 .
2010-11-04 20:34:49 +02:00
bbd63f0ffe
constant_score query might apply deletes wrongly, closes #477 .
2010-11-04 20:18:05 +02:00
770ccf421b
don't write the local gateway state if there is no master, since we don't want to override the fact that they do exists on that node under the respective version
2010-11-04 12:17:17 +02:00
e2d6f82cd3
Mapper: Add `path_match` for full object navigation path matching, closes #476 .
2010-11-04 10:55:19 +02:00
805d43c77a
properly clean index shard and index level data when deleting them
2010-11-03 15:34:30 +02:00
6e0180db6a
refactor node data location of index and shard into common code
2010-11-03 15:07:23 +02:00
6804c02e97
Create specific `data` location for indices (move from work), closes #473 .
2010-11-03 14:41:29 +02:00
92b3ae3f73
Change single operation shard hashing to only use id, and not id and type, closes #472 .
2010-11-03 12:47:34 +02:00
8d454ba293
Query DSL: Add `field_masking_span` query, closes #471 .
2010-11-02 23:50:28 +02:00
a62f1f3e0d
API: Allow to control document shard routing, and search shard routing, closes #470 .
2010-11-02 19:56:18 +02:00
8e2e85f460
enhance bulk stress test
2010-11-02 14:01:22 +02:00
3fe2851dae
Index Merge: Change default `index.merge.scheduler.max_thread_count` from ` to be adaptive based on processor count, closes #469 .
2010-11-02 14:00:58 +02:00
2cdaf6357b
Rivers: Add a _status doc for each river, closes #468 .
2010-11-02 12:09:45 +02:00
ef4c44577a
add toString to match_all docs
2010-11-02 10:23:05 +02:00
4ff1b429f1
Possible (rare) shard index corruption / different doc count on recovery (gateway / shard), closes #466 .
2010-11-01 23:00:16 +02:00
49439a09e2
fix logging
2010-11-01 20:42:10 +02:00
f79719beaa
fix parsing of bytes value
2010-10-31 15:47:19 +02:00
feb854b742
On full cluster restart, replicas transaction logs are not getting cleaned, closes #465 .
2010-10-31 14:36:10 +02:00
b8fa68f97a
check if the commit point has a size at all, if not, not flushed yet, its ok
2010-10-31 12:23:56 +02:00
e6b4a8b55c
remove inclusion of config and logging file in jar
2010-10-31 10:50:35 +02:00
96a1ad6335
When on linux, force it not to swap elasticsearch process (jvm), closes #464 .
2010-10-30 19:40:24 +02:00
1feb43a0af
Index: Move compound format setting to `index.compound_format` (old setting still supported), closes #463 .
2010-10-30 18:24:28 +02:00
db24148413
fix listAll when using switch dir to return unique list of files
2010-10-30 01:26:00 +02:00
b315c5f848
add getOffsetGap to field analyzer
2010-10-29 19:05:11 +02:00
8f7a8dabc1
only flush if there is something to flush
2010-10-29 17:50:51 +02:00
11c55185e8
add another test
2010-10-29 00:22:49 +02:00
c194fa67e9
default logger (when embedded in java) to log with org.elasticsearch prefix for simpler logging configruation
2010-10-28 23:39:37 +02:00
7082593166
add term filter toString
2010-10-28 23:18:24 +02:00
e31cbb5267
fix NPE when enabling trace logging
2010-10-28 21:47:55 +02:00
4579c04a9e
Mapper: Ip Type Support (ipv4), auto detection with dynamic mapping, closes #461 .
2010-10-28 12:02:20 +02:00
6f8b859d90
better inet address serialization, also better handle ipv6
2010-10-28 01:48:54 +02:00
e7fdf16402
add number of data nodes to cluster health
2010-10-28 00:39:53 +02:00
d487d809ea
Query DSL: Revert back and have range, terms, and prefix filter _cache set to true, closes #456 .
2010-10-27 20:34:24 +02:00
3a9dc8f452
change back to cached thread pool
2010-10-27 20:13:42 +02:00
185f5a9e18
Search: Change default operation threading to `thread_per_shard` from `single_thread`, closes #455 .
2010-10-27 19:51:49 +02:00
ca67c12de5
add and/not/or docid sets, not just docsets, and improve caching behavior
2010-10-27 18:16:15 +02:00
8fef3df16f
improve threading usage on discovery and fd
2010-10-26 23:49:09 +02:00
73e6aa72cd
for some reason the test only runs with @Test on the main class...
2010-10-26 20:20:58 +02:00
c08ad0cad6
Fix parsing of "geo_distance" filter wrt "distance" / "unit" parameters
...
The problem was that when "unit" was given,
the conversion to miles was happening too early,
which caused wrong computations. This change
postpones this computation when one really knows
which unit should be used.
2010-10-26 20:13:29 +02:00
9b206146e3
Fix MILES.toKilometers() and KILOMETERS.toMiles()
...
This mistake should have been caught by DistanceUnitTests.
But the problem is that the tests in this file does not
run during the execution of the test suite, and I don't have
a clue why this is so.
2010-10-26 20:13:29 +02:00
kimchy
Adriano Ferreira