Commit Graph

1491 Commits

Author SHA1 Message Date
kimchy 49deb80d03 when compression is enabled, use the compressed byte buffer to write it to the translog (less data to write), and handle recovery by being able to parse also compressed source 2010-12-24 01:09:15 +02:00
kimchy f2eae5b605 Memory Index Store: Separate to two buffer size types, and fix bugs, closes #577. 2010-12-23 23:21:32 +02:00
kimchy 22fa91efa0 add reconnection code between nodes that are not masters 2010-12-23 17:26:55 +02:00
kimchy f6afc01fe5 add reconnection code between nodes that are not masters 2010-12-23 17:26:32 +02:00
kimchy ff5990daec listener should be threaded 2010-12-23 17:24:23 +02:00
kimchy de7dd3c070 default to try and connect after network disconnection with fault detection 2010-12-23 16:51:09 +02:00
kimchy e313379ed5 only force shutdown on cached threadpool if its not the same as the execture service 2010-12-23 16:13:05 +02:00
kimchy 42e8567477 interrupt joining the cluster thread if shutting down 2010-12-23 16:11:43 +02:00
kimchy 5f25ae4f2f check if the scheduled thread pool is not terminated when trying to terminate it 2010-12-23 15:18:22 +02:00
kimchy 9f72a8d68b use cached thread pool for notifying on disconnections 2010-12-23 14:22:40 +02:00
kimchy 6dcc04b59c Transport: Increase the default transport.tcp.connect_timeout from 1s to 30s, also add `network.tcp.connect_timeout` to conform with other common network settings, closes #576. 2010-12-23 14:20:11 +02:00
kimchy 5c338b7af2 add message to connect transport failure exception 2010-12-23 13:05:39 +02:00
kimchy 5a58ed4274 when replacing a mapping, clear the aggregated mapping information and then readd it 2010-12-23 11:32:16 +02:00
kimchy 473c2fa8f4 add reason for state change logging in index shard, add debug logging on ignore recovery in when handling cluster change in indices cluster 2010-12-23 10:56:37 +02:00
kimchy 5ac42f2a4f Excessive mapping parsing when cluster state changes, closes #575. 2010-12-23 09:53:05 +02:00
kimchy f869951364 rename type method on MapperService to the more descriptive documentMapperWithAutoCreate 2010-12-23 08:43:17 +02:00
kimchy e0b2b4b4a6 add a warn when not using the custom FieldCache with eager reader based eviction 2010-12-23 07:58:43 +02:00
kimchy 800b7f39bd add toString to CompressedString to show when logging it 2010-12-23 07:45:04 +02:00
kimchy 3b30930460 improve logging when trying to delete unallocated shard, check first if deleting is required, and only then delete it 2010-12-23 07:37:49 +02:00
kimchy ac73334c87 make id cache an index component, so a new instance will be created per index 2010-12-22 14:21:59 +02:00
kimchy bb0d7190e9 make id cache an index component, so a new instance will be created per index 2010-12-22 14:21:31 +02:00
kimchy 1ee24ce60f add an option to provide an OutputStream to a builder, allowing to generate directly into a stream provided by the user 2010-12-22 13:26:29 +02:00
kimchy eef3a95fa6 move the query parser cache to be index level and not node level 2010-12-22 12:31:30 +02:00
kimchy 33339ae4b1 improve concurrency control in filter caching, reuse one if it was created already under concurrent request 2010-12-22 10:42:38 +02:00
kimchy d283c158d2 optimize for the more common case of single value facets when loading values 2010-12-22 09:04:35 +02:00
kimchy 59ee8493ce use public terms filter in all places 2010-12-21 23:43:05 +02:00
kimchy a1df3c637c improve logic of when to load fields from source, only if they actually have mappings, otherwise, ignore them (as was the previous behavior) 2010-12-21 13:02:15 +02:00
kimchy 3035254885 Search API: Allow to pass `&fields=` without any fields to cause only id and type to be returned, closes #572. 2010-12-21 12:01:51 +02:00
kimchy a96b294de0 add multicast socket to execption message 2010-12-20 20:07:51 +02:00
kimchy efc95dc00a Java Search API: Passing a the query as json fails, closes #568. 2010-12-20 11:31:09 +02:00
kimchy 789073639d fix transport client compilation problem, the client cluster service was not used and removed 2010-12-19 05:50:07 +02:00
kimchy 8dfc3acba0 when using dates in scripts, initialize the dates (DateTime) with UTC 2010-12-19 05:01:59 +02:00
kimchy 96a2950ab5 Disable calling mlockall by default, can be enabled by setting bootstrap.mlockall to `true`, closes #567. 2010-12-19 02:30:48 +02:00
kimchy 415bb5d7f3 Java TransportClient: By default, don't sniff other nodes and use addresses provided as is, closes #565. 2010-12-17 19:31:28 +02:00
kimchy 005c6d9124 allow to set term index divisor 2010-12-16 21:56:59 +02:00
kimchy ff0eeb3d1a improve getting setting as array, automatically support comma delimited values under the exact setting 2010-12-16 05:02:24 +02:00
kimchy f827b7cff5 fix settings 2010-12-16 00:48:26 +02:00
kimchy d6bab1a892 Tcp Transport: Connection pool between nodes and different connection types, closes #564. 2010-12-15 20:11:10 +02:00
kimchy 085066ed19 set, by default, the send and receive buffers to 32k on tcp 2010-12-15 05:54:09 +02:00
kimchy 36be13ffb3 bring back the file chunk size in recovery to 100kb from 500kb 2010-12-15 01:28:21 +02:00
kimchy b6277ac14d increase netty worker count to default to the updated value netty defaults to 2010-12-15 01:16:00 +02:00
kimchy bb178c9c1a cleanup 2010-12-13 21:30:26 +02:00
kimchy d0eed79175 add log message on hte concurrent streams used 2010-12-13 00:08:57 +02:00
kimchy ceb7b90740 Recovery: Allow to control `concurrent_streams` (per node) during recovery 2010-12-13 00:03:04 +02:00
kimchy 1c5477d4ed Improve local node recovery process, removing using a block as indication for an index not being recovered. Moving to shard replication group level allocation (with the ability to distinguish between api based creation or recovery based creation). This also allows for throttling based control on initial local gateway based shard allocation. 2010-12-12 22:46:27 +02:00
kimchy bc04243a2b Search Fields: If a field is not stored, automatically extract it from _source (without the need for _source prefix), closes #562. 2010-12-12 05:00:24 +02:00
kimchy 216b2ab912 Highlighting: Automatically use the field values extracted from _source if not stored explicitly in the mapping, closes #561. 2010-12-12 04:40:25 +02:00
kimchy fe3f5d45de remove global settings from the settings conf, a relic that is no longer needed... 2010-12-12 02:37:36 +02:00
kimchy dddca692b8 add search hit phase, which operates on a hit, and have all relevant hit phases implement and use it 2010-12-12 02:01:13 +02:00
kimchy be4b2e2de6 externalize script search lookup into a generalized lookup that can be used outside of scripts 2010-12-12 01:01:56 +02:00
kimchy a914865c45 Close API might cause index data to be wiped, closes #560. 2010-12-10 22:19:45 +02:00
kimchy bc2dc9465a add to the receive timeout exception the request id that it timed out on 2010-12-10 12:40:39 +02:00
kimchy 2a7f964ca2 Geo search fails to find some docs when wrapping over IDL, closes #559. 2010-12-10 08:39:10 +02:00
kimchy 9d2fe162fa better log message 2010-12-10 00:17:55 +02:00
kimchy 3f6ed7e1de improve update mapping on master, if we end up with the same mappings as the one the cluster state has, no need for a new cluster state... 2010-12-10 00:17:10 +02:00
kimchy 167d35807c Add terms/in query, alias terms filter to be in filter as well, closes #557. 2010-12-09 07:25:05 +02:00
kimchy 0828f18738 better child bench 2010-12-09 06:11:06 +02:00
kimchy e1495ff8be add scrolling update test 2010-12-08 20:56:09 +02:00
kimchy 34f3f3f79e Aliased analyzers cause index deletion / cleanup failure, closes #555. 2010-12-08 19:30:38 +02:00
kimchy f5a8c3881f add debug logging on failed bug items executions 2010-12-08 01:21:21 +02:00
kimchy 54437c1bd3 Parent / Child Support, closes #553. 2010-12-08 00:16:05 +02:00
kimchy 1a8017d17e upgrade to jackson 1.6.3 2010-12-07 09:14:13 +02:00
kimchy 22c27e4ff8 correct field name 2010-12-05 00:02:53 +02:00
kimchy d3cae103d5 wait for green status in test 2010-12-04 23:57:44 +02:00
kimchy d659bd0479 upgrade to jackson 1.6.2 2010-12-04 00:46:57 +02:00
kimchy a90684aaa5 Upgrade to Lucene 3.0.3, closes #549. 2010-12-03 20:43:51 +02:00
kimchy d9610ed0a1 Search API: Optimize single shard search to `QUERY_AND_FETCH` from any other search type, closes #547. 2010-12-01 03:59:03 +02:00
kimchy 3ea19a514b Index Setting: Add `index.refresh_interval` to simplify setting instead of "index.engine.robin.refresh_interval` (still works), closes #546. 2010-12-01 03:38:41 +02:00
kimchy 2b039bd0b0 change the default chunk size when recovering from the default 100kb to 500kb. 2010-11-29 14:33:49 +02:00
kimchy c0945831e8 Search Scroll API: Allow to provide the scroll id as the body of the scroll request, closes #545. 2010-11-29 13:59:30 +02:00
kimchy 103221e58a remove the timed out message, can be misleading 2010-11-29 02:55:23 +02:00
kimchy 84f97e96a5 Scrolling issues, fix releasing search context eagerly, they should not be released when scrolling, closes #136. 2010-11-29 02:05:45 +02:00
kimchy 6d9576c217 Reduce the number of concurrent recoveries per node to 2 from number_of_processors, closes #543. 2010-11-28 16:35:39 +02:00
kimchy a222de1dbf internal change to scope based collectors 2010-11-28 14:57:17 +02:00
kimchy 8285ffe221 encode scroll id with base64 in url safe manner 2010-11-28 02:23:38 +02:00
kimchy cfa8c9aa79 Index / Index Template: Allow to define `_default_` mapping, closes #542. 2010-11-27 23:30:18 +02:00
kimchy 526f28f479 Create Index API: Allow to provide mappings. closes #541. 2010-11-27 00:28:18 +02:00
kimchy 151715dc2f also merge lists 2010-11-27 00:05:11 +02:00
kimchy 577f06fd43 add indices API to groovy client 2010-11-26 22:19:57 +02:00
kimchy 73e5eb9e14 clean compile warnings 2010-11-26 16:03:25 +02:00
kimchy 6dab568a4b Index Templates, closes #540. 2010-11-26 15:53:04 +02:00
kimchy ebd6316db9 Index templates, closes #540. 2010-11-26 15:45:18 +02:00
kimchy d150ac2da4 Search API: Add how long the search took (in milliseconds), closes #536. 2010-11-24 13:27:32 +02:00
kimchy 51273587de Bulk API: Add refresh flag, closes #535. 2010-11-24 00:58:48 +02:00
kimchy 4a3e5b6348 Query Cache: Invalidate the query cache when mappings change, closes #532. 2010-11-23 15:26:19 +02:00
kimchy 9479ac636e Delete Mapping API: Wrongly deleting existing mapping information, closes #531. 2010-11-23 14:56:03 +02:00
kimchy 3b2b901db0 improve error handling, we can't always parse the source to a stirng 2010-11-23 00:41:53 +02:00
kimchy db1f7e09f3 Support date and ip types for `numeric_range` filter, closes #530. 2010-11-22 16:17:51 +02:00
kimchy b4113d57d3 Analyze API: An API to analyzer custom text based on an optional analyzer, closes #529. 2010-11-21 17:33:35 +02:00
kimchy 8689e5cf16 more cleaning of shards iterators 2010-11-21 14:49:57 +02:00
kimchy e183fbd6ad add shards iterator that can iterate over unrelated list of shards 2010-11-21 14:27:22 +02:00
kimchy 7db5e63ab7 rename shardsIt to shardIt 2010-11-21 13:54:44 +02:00
kimchy a74465000d rename single operation base support to single shard operation 2010-11-21 13:26:36 +02:00
kimchy c40eaaae38 serializing get result should use the same construct as search hit fields 2010-11-20 18:38:43 +02:00
kimchy 58ecc4f77f cleanup single operation action support 2010-11-20 18:23:13 +02:00
kimchy 03f66b0c45 log4j syslog appender don't load, closes #527. 2010-11-19 22:08:18 +02:00
kimchy 1560e05e01 upgrade to mvel 2.0.19 2010-11-19 21:40:12 +02:00
kimchy fdb98b1dcb Highlighting bug where fragments are broken when number_of_fragments is 0, closes #479. 2010-11-18 20:52:51 +02:00
kimchy d1ef445632 clean thread local vars eagerly 2010-11-18 20:22:42 +02:00
kimchy 16ed69daa3 add routing to delete by query rest endpoint 2010-11-18 13:46:45 +02:00