kimchy
|
686b59c33f
|
more work on indexer
|
2010-09-13 23:00:34 +02:00 |
|
kimchy
|
0c8dfd967c
|
better raw generation of json
|
2010-09-13 02:43:39 +02:00 |
|
kimchy
|
2d5883ccb5
|
improve normalization performance from one content type to the other
|
2010-09-13 02:09:15 +02:00 |
|
kimchy
|
38aeba438d
|
XContent refactoring, closes #367.
|
2010-09-12 23:20:15 +02:00 |
|
kimchy
|
4822517d5d
|
add query parser cache to cache common query strings (+settings) with the parsed queries
|
2010-09-12 17:08:26 +02:00 |
|
kimchy
|
77a7938891
|
move to use guice to register also the default query parsers and filters
|
2010-09-12 16:46:57 +02:00 |
|
kimchy
|
2442e1fb16
|
improve query string parsing by reusing the same parser (bounded to the query parser context)
|
2010-09-12 15:39:07 +02:00 |
|
kimchy
|
ed5ffd6591
|
Setting `path.work` does not affect the logs location, closes #366.
|
2010-09-11 22:22:49 +03:00 |
|
kimchy
|
bc42352f7e
|
change the local gateway metadata file from state- to metadata-
|
2010-09-11 21:45:45 +03:00 |
|
kimchy
|
0718757612
|
Query DSL: `match_all` filter, closes #365.
|
2010-09-11 16:01:30 +03:00 |
|
kimchy
|
eccc7d5ef2
|
Search API: Allow to name filters and return per hit the filters it matched on, closes #364.
|
2010-09-11 12:38:19 +03:00 |
|
kimchy
|
ab2a655a59
|
parsing a query should result in ParsedQuery object, so we can piggyback on it more parsing state / data
|
2010-09-11 00:34:22 +03:00 |
|
kimchy
|
a47638dd3c
|
imrove filter caching handling by not holding an implicit ref to the parent cache
|
2010-09-11 00:11:47 +03:00 |
|
kimchy
|
de05a10ae5
|
use fastGet in docset
|
2010-09-10 16:16:45 +03:00 |
|
kimchy
|
4e661c165a
|
Geo search across anti-meridian doesn't work, closes #363.
|
2010-09-10 16:04:10 +03:00 |
|
kimchy
|
b31b0e979c
|
Search failure when no results are found and sorting by score, closes #362.
|
2010-09-09 15:47:55 +03:00 |
|
kimchy
|
31362e4c60
|
upgrade to joda 1.6
|
2010-09-09 00:53:20 +03:00 |
|
kimchy
|
a768016779
|
Allow to configure a common logger prefix using `es.logger.prefix` system prop, closes #360.
|
2010-09-08 12:16:41 +03:00 |
|
kimchy
|
e151b83372
|
add simple dummy indexer
|
2010-09-07 18:19:02 +03:00 |
|
kimchy
|
ad5945f141
|
Mapper: `geo_point` to support passing array of [lat, lon], closes #361.
|
2010-09-07 17:23:06 +03:00 |
|
kimchy
|
c045b4d0ef
|
Mapper: `geo_point` type to allow to set `store` on the mapping, closes #359.
|
2010-09-07 14:10:29 +03:00 |
|
kimchy
|
7c48f27e60
|
throw an exception when no lat/lon or geohash are found
|
2010-09-07 11:36:12 +03:00 |
|
kimchy
|
2cb45d4fe7
|
hack to work around complete text highlighting
|
2010-09-07 01:28:30 +03:00 |
|
kimchy
|
bbb2033d3b
|
start working on indexers
|
2010-09-07 00:41:30 +03:00 |
|
kimchy
|
f270fc00d2
|
earch API: Automatically identify "script" fields on the field elements in search, close #357.
|
2010-09-06 11:51:31 +03:00 |
|
kimchy
|
243b7455e8
|
fix javadoc
|
2010-09-06 01:10:46 +03:00 |
|
kimchy
|
cc1eac147a
|
Allow to specify highlighter parameters on a per field level basis, closes #356.
|
2010-09-05 20:47:38 +03:00 |
Lukáš Vlček
|
8efe5dc9ae
|
Highlighter enhancements.
|
2010-09-05 14:52:48 +03:00 |
|
kimchy
|
c050bb58da
|
allow to set a query using a string as well
|
2010-09-04 21:30:02 +03:00 |
|
kimchy
|
42b2e60af2
|
Create Index / Update Settings: Automatically prefix all settings with `index.`, closes #355.
|
2010-09-04 14:04:51 +03:00 |
|
kimchy
|
4f08801bb9
|
Thrift Plugin: Expose REST interface using thrift, closes #354.
|
2010-09-04 02:45:37 +03:00 |
|
kimchy
|
3d30b9c034
|
fix not called processModule on plugin for index and shard level modules
|
2010-09-03 19:06:11 +03:00 |
|
kimchy
|
1079941397
|
javadoc
|
2010-09-03 18:40:30 +03:00 |
|
kimchy
|
b40f0bc5a4
|
Local Gateway: Expose `gateway.local.initial_shards` to control when to recover and index, closes #352.
|
2010-09-03 18:38:24 +03:00 |
|
kimchy
|
575f5b406b
|
abstract away script execution
|
2010-09-03 01:49:06 +03:00 |
|
kimchy
|
cd28afe950
|
Search API: Allow for script fields to extract parts of the stored _`source`, closes #349.
|
2010-09-02 21:29:41 +03:00 |
|
kimchy
|
1e75638b31
|
refactor field funtion to use internal docmap to be used in scripts
|
2010-09-02 17:19:50 +03:00 |
|
kimchy
|
807c485a38
|
make the cached compile scripts a soft map
|
2010-09-02 16:29:41 +03:00 |
|
kimchy
|
7bd08d638d
|
JMX: Disable creating by default an RMI JMX connector, closes #348.
|
2010-09-02 14:17:53 +03:00 |
|
kimchy
|
0250896a09
|
reduce shard search response size by not serilaizing the node id, index, and shard id
|
2010-09-02 11:19:25 +03:00 |
|
kimchy
|
042af200e8
|
Gateway: Default to `local` gateway (replace `none` gateway), closes #347.
|
2010-09-01 23:21:26 +03:00 |
|
kimchy
|
0de24218ff
|
improve local gateway, store started shards and metadata in separated files, metadata stored on master nodes, and started shards on data nodes.
|
2010-09-01 21:32:07 +03:00 |
|
kimchy
|
7709cd1bc2
|
improve GC logging
|
2010-09-01 15:02:56 +03:00 |
|
kimchy
|
7d6aa6c027
|
local gateway: don't store the local state when not a data/master node
|
2010-09-01 00:07:10 +03:00 |
|
kimchy
|
a3efa21d71
|
Mapper: Failure to handle null valued objects ("obj1" : null), closes #341.
|
2010-08-31 13:33:21 +03:00 |
|
kimchy
|
289cfdf25a
|
improve replica allocation, fix test to wait for recovery on node2
|
2010-08-30 23:37:09 +03:00 |
|
kimchy
|
9503fca2ae
|
fix logging
|
2010-08-30 22:53:47 +03:00 |
|
kimchy
|
61764c5b69
|
add another test for local gateway, fix race when loading the current state of a node
|
2010-08-30 19:29:00 +03:00 |
|
kimchy
|
908fba44e7
|
fsync translog when closing and not deleting, allocate failed shard to another started shard
|
2010-08-30 16:55:57 +03:00 |
|
kimchy
|
d9979f8dfe
|
more work on local gateway, start integration test it
|
2010-08-30 01:25:45 +03:00 |
|
kimchy
|
8ed54c24bd
|
change nodeFile to nodeLocation
|
2010-08-29 23:25:23 +03:00 |
|
kimchy
|
269616f35e
|
more work on getting local gateway to work, apply transaction log operations when primary "recovering"
|
2010-08-29 16:56:04 +03:00 |
|
kimchy
|
4f4471483d
|
initial work on local gateway
|
2010-08-29 01:24:23 +03:00 |
|
kimchy
|
163b7be639
|
refactor gateway service to allow for more custom gateway implemenations
|
2010-08-28 00:34:15 +03:00 |
|
kimchy
|
a10ab7fe08
|
better exception thrown when failing to handle responses
|
2010-08-27 14:14:28 +03:00 |
|
kimchy
|
e85c47db74
|
improve stack trace when failing to send a transaction request
|
2010-08-27 13:52:58 +03:00 |
|
kimchy
|
e5b041c8ef
|
simplify gateway snapshot operation
|
2010-08-27 00:41:55 +03:00 |
|
kimchy
|
a49af6072b
|
add objects option to range filter builder
|
2010-08-26 16:39:39 +03:00 |
|
kimchy
|
d56b4d266e
|
move query hint only to broadcast requests that use it
|
2010-08-26 14:31:54 +03:00 |
|
kimchy
|
dfa24f6d03
|
improve caching of stored metadata fetched from nodes during allocation in order to reuse existing shards
|
2010-08-25 23:12:07 +03:00 |
|
kimchy
|
2910b6ab7f
|
add callback for shards_started and shards_failed to better handle caching on node allocations level
|
2010-08-25 22:20:27 +03:00 |
|
kimchy
|
3ebd03f69a
|
doc
|
2010-08-25 22:03:11 +03:00 |
|
kimchy
|
9d615a4f0b
|
Query DSL: Improve `or` and `and` filters to accept just array of filters, closes #336.
|
2010-08-25 18:06:28 +03:00 |
|
kimchy
|
c7a36ed431
|
add an exception when on filtesr are provided to "and" and "not" filters
|
2010-08-25 17:56:50 +03:00 |
|
kimchy
|
fcdc5f872a
|
improve (perf) getting last committed version of the index to create a new translog with
|
2010-08-25 15:12:26 +03:00 |
|
kimchy
|
9d08e56d8a
|
cache nodes store metadata for on a shard basis when iteratring over the unassigned nodes
|
2010-08-25 15:03:25 +03:00 |
|
kimchy
|
f36d80f66d
|
don't go and find local storage for a shard on nodes if its not going to be allocated
|
2010-08-25 15:01:09 +03:00 |
|
kimchy
|
4bfd0a8c26
|
cache commit points during smart allocation based on local storage when recovering from gateway
|
2010-08-25 01:12:16 +03:00 |
|
kimchy
|
244cd42298
|
allow to use just hosts when using unicast discover, will use the transport level ports
|
2010-08-25 00:44:04 +03:00 |
|
kimchy
|
fc812a306b
|
change logging
|
2010-08-24 23:33:03 +03:00 |
|
kimchy
|
ba5814a72f
|
change log level
|
2010-08-24 23:25:20 +03:00 |
|
kimchy
|
31aed01220
|
increase timeout to 5 seconds
|
2010-08-24 23:18:58 +03:00 |
|
kimchy
|
fdc82dd5a3
|
ignore parsing of wrong file format in the gateway (log warn), use index vesrion as the translog id
|
2010-08-24 23:12:18 +03:00 |
|
kimchy
|
d0f5bc3403
|
add russian letter tokenizer
|
2010-08-24 23:11:22 +03:00 |
|
kimchy
|
49b4659322
|
Indexing Buffer Size: Refine default setting to 10% (from 40%) and add more settings, closes #334.
|
2010-08-24 18:12:45 +03:00 |
|
kimchy
|
7ae8d4c669
|
thread pool type setting is wrong, fix blocking max setting to have a minimum of 10, use cached TP where needed
|
2010-08-24 15:28:54 +03:00 |
|
kimchy
|
b8ab50828c
|
only list and delete files we created
|
2010-08-24 14:48:49 +03:00 |
|
kimchy
|
df23d8f7ec
|
don't snapshot a translog that has no content
|
2010-08-24 03:58:21 +03:00 |
|
kimchy
|
6c29142b91
|
throw recovery failure if failing to parse all commit points
|
2010-08-24 01:28:39 +03:00 |
|
kimchy
|
b52d854711
|
smarter handling of throttling when preferring allocating to an existing work location
|
2010-08-23 21:39:54 +03:00 |
|
kimchy
|
78b6879ecd
|
move rebalance only when active logic into node allocation, add canRebalance hook point
|
2010-08-23 18:28:35 +03:00 |
|
kimchy
|
149962691e
|
move rebalance only when active logic into node allocation, add canRebalance hook point
|
2010-08-23 18:27:01 +03:00 |
|
kimchy
|
4300a6ca18
|
move rebalance only when active logic into node allocation, add canRebalance hook point
|
2010-08-23 18:26:17 +03:00 |
|
kimchy
|
0e47898902
|
add /_shutdown to the REST endpoints
|
2010-08-23 18:01:47 +03:00 |
|
kimchy
|
5900e01a0d
|
list remote nodest storage information with a timeout
|
2010-08-23 18:00:37 +03:00 |
|
kimchy
|
1461da5b49
|
move prefetch allocation to be a NodeAllocation
|
2010-08-23 17:22:44 +03:00 |
|
kimchy
|
939d583550
|
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
|
2010-08-23 15:42:03 +03:00 |
|
kimchy
|
b49d331c86
|
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
|
2010-08-23 15:28:12 +03:00 |
|
kimchy
|
62cc4d554a
|
better logging message for reused vs. recovered from gateway
|
2010-08-23 15:25:06 +03:00 |
|
kimchy
|
5bd37f6f47
|
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
|
2010-08-23 14:48:49 +03:00 |
|
kimchy
|
1517fa3d28
|
initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information
|
2010-08-23 01:45:03 +03:00 |
|
kimchy
|
36ad3b246a
|
addlow to add node allocation ot the module
|
2010-08-22 12:35:59 +03:00 |
|
kimchy
|
664f28492d
|
improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation
|
2010-08-22 10:42:25 +03:00 |
|
kimchy
|
aa28b93610
|
refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it
|
2010-08-22 02:47:34 +03:00 |
|
kimchy
|
7592862646
|
add a callback for allocation as well
|
2010-08-22 01:00:37 +03:00 |
|
kimchy
|
a3852766ff
|
only check for prefered allocation on data nodes
|
2010-08-22 00:32:43 +03:00 |
|
kimchy
|
3f701365b0
|
move the allocate replica after primary active logic to a node allocation
|
2010-08-22 00:14:56 +03:00 |
|
kimchy
|
5ded04c5cb
|
refactor shard allocation to be more pluggable for node allocation "deciders"
|
2010-08-21 21:59:31 +03:00 |
|
kimchy
|
2865ceef85
|
more on sorted nodes when allocating shards above average number of shards per node
|
2010-08-21 19:55:38 +03:00 |
|
kimchy
|
76e1a6b1bf
|
check also for negative values
|
2010-08-21 19:51:14 +03:00 |
|
kimchy
|
5d2c005622
|
pass to canAllocate (though nothing is done there now) the actual routing nodes
|
2010-08-21 17:52:24 +03:00 |
|
kimchy
|
1ddd969fa7
|
pass to canAllocate (though nothing is done there now) the actual routing nodes
|
2010-08-21 17:52:02 +03:00 |
|
kimchy
|
11dbbebb7a
|
renamve var to better reflect its state (started, not active)
|
2010-08-21 17:50:08 +03:00 |
|
kimchy
|
3117341f44
|
Shards Allocation: Only rebalance a shard if all its instances are already active, closes #331.
|
2010-08-21 17:49:19 +03:00 |
|
kimchy
|
38e6649a7e
|
Cluster Health API: Add `initializing_shards` and `unassigned_shards` to the response, closes #330.
|
2010-08-21 16:03:29 +03:00 |
|
kimchy
|
113ea1bb1b
|
don't throttle gateway recovery based on peer recoveries (gateway recoveries are important to do as fast as possible). still throttle peer recoveries based on both.
|
2010-08-21 15:37:12 +03:00 |
|
kimchy
|
e12bdd9faf
|
rename RETRY stage in recovery to THROTTLE
|
2010-08-21 15:13:34 +03:00 |
|
kimchy
|
0c72bb2125
|
better writing of local md5 caches
|
2010-08-21 02:16:36 +03:00 |
|
kimchy
|
1ef1e9b25b
|
don't spawn on received cluster state
|
2010-08-20 19:36:39 +03:00 |
|
kimchy
|
800e450e3a
|
handle local md5 cases, don't include them in the list of files the directory has
|
2010-08-20 19:30:26 +03:00 |
|
kimchy
|
9acae60dbf
|
also have a minimum value for concurrent recoveries, at 3
|
2010-08-20 17:28:31 +03:00 |
|
kimchy
|
f62f7b8ffe
|
check the progress in case the index size has not been set yet...
|
2010-08-20 17:17:32 +03:00 |
|
kimchy
|
9f0d5f8ef1
|
better default concurrent recoveries, based on number of processors, tap it at 10
|
2010-08-20 17:06:56 +03:00 |
|
kimchy
|
8c25be6dee
|
better exception message with primary not started exception on index/delete/delete_by_query apis
|
2010-08-20 16:36:25 +03:00 |
|
kimchy
|
07285d81d1
|
add stream done when there is no file (should not happen)
|
2010-08-20 15:59:46 +03:00 |
|
kimchy
|
b609162be3
|
don't ignore recovery on throttling unless the shard is closed
|
2010-08-20 15:58:24 +03:00 |
|
kimchy
|
4e74001bde
|
move marking recovering before creating a status
|
2010-08-20 15:24:49 +03:00 |
|
kimchy
|
c0552bdc70
|
Can't set "no stopwords" on analyzer, closes #329.
|
2010-08-20 03:22:43 +03:00 |
|
kimchy
|
6f1a9fbfb9
|
create md5 files on the local index storage as well, so they won't have to be recomputed when performing initial recovery
|
2010-08-20 02:28:14 +03:00 |
|
kimchy
|
acae0650c8
|
bail out of recovery when close and still waiting on throttling
|
2010-08-20 01:24:02 +03:00 |
|
kimchy
|
a05c367c5e
|
don't snapshot gateway when cleaning shard
|
2010-08-20 00:59:37 +03:00 |
|
kimchy
|
4a2e076c6a
|
do a reuse work prefetching not on the cluster state thread, so it won't block while fetching md5s from other nodes
|
2010-08-20 00:45:17 +03:00 |
|
kimchy
|
a5c5f65da5
|
fix recovery status when all index got reused
|
2010-08-19 22:46:58 +03:00 |
|
kimchy
|
7437acfcea
|
add progress to indices status API
|
2010-08-19 22:29:31 +03:00 |
|
kimchy
|
8d0e5b239c
|
recator source rest building into common code
|
2010-08-19 20:24:12 +03:00 |
|
kimchy
|
7b1093fb16
|
anoter compressed string test
|
2010-08-19 18:45:15 +03:00 |
|
kimchy
|
19abe7a2a5
|
when using compressed source, extract the compressed source directly into the response without any buffering
|
2010-08-19 18:29:36 +03:00 |
|
kimchy
|
46ccee8f89
|
when deleting an index, remove any blocks associated with it
|
2010-08-19 17:21:14 +03:00 |
|
kimchy
|
c40935ae14
|
store the mapping definition in compressed form internally to save memory
|
2010-08-19 17:06:36 +03:00 |
|
kimchy
|
a2d10d490d
|
allocate list when deserializing, NPE galore...
|
2010-08-19 16:40:51 +03:00 |
|
kimchy
|
04ae1581a0
|
fix NPE introduced on optimization of index status on docs status creation
|
2010-08-19 15:37:06 +03:00 |
|
kimchy
|
70c344b079
|
add compressed string
|
2010-08-19 15:33:57 +03:00 |
|
kimchy
|
1a18387fab
|
add `standard_html_strip` analyzer that combines the standard analyzer with html_strip char filter.
|
2010-08-19 15:10:31 +03:00 |
|
kimchy
|
22ea5e6608
|
fix primary election on replica relocation
|
2010-08-19 14:59:50 +03:00 |
|
kimchy
|
9c0bbe9bb5
|
log failure to notify master on shard started/failed
|
2010-08-19 13:49:48 +03:00 |
|
kimchy
|
fd569a9523
|
renme tests to reflect replica and not backup
|
2010-08-19 13:11:53 +03:00 |
|
kimchy
|
27e92cd505
|
fix a case where node might not exists on relocating, don't fail the replication action (index / delete / ...) because of it
|
2010-08-19 13:08:20 +03:00 |
|
kimchy
|
51656552a5
|
better mehtod name
|
2010-08-19 11:20:06 +03:00 |
|
kimchy
|
965d7303cf
|
index status action - some docs and extract common docs status
|
2010-08-19 09:34:02 +03:00 |
|
kimchy
|
a3107bc5b1
|
add snapshot status (either current one or the latest one executed) to indices status api
|
2010-08-18 17:11:29 +03:00 |
|
kimchy
|
91aada2706
|
boolean values cannot be searched with expected queries, closes #327.
|
2010-08-18 15:11:23 +03:00 |
|
kimchy
|
de71a1ce99
|
filtered more_like_this doesn't parse correctly, closes #326.
|
2010-08-18 14:36:34 +03:00 |
|
kimchy
|
2259ef671b
|
Gateway: Failure to read full translog from the gateway, closes #328.
|
2010-08-18 14:29:46 +03:00 |
|
kimchy
|
3f9034b41c
|
add gateway recovery status to the indices status API exposing both on going and summary when recovering from a gateway
|
2010-08-17 22:34:56 +03:00 |
|
kimchy
|
311520d146
|
add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard
|
2010-08-17 21:33:11 +03:00 |
|
kimchy
|
5fb80c391b
|
add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard
|
2010-08-17 21:23:05 +03:00 |
|
kimchy
|
96fc16dddb
|
add ability to iterate over assigned shards, and add an extension point to control shard routing iteration in the broadcast based action support
|
2010-08-17 14:04:12 +03:00 |
|
kimchy
|
7833cb1c76
|
Document IDs need to be URL decoded when indexed, closes #324.
|
2010-08-17 10:47:02 +03:00 |
|
kimchy
|
c989d3a928
|
fix limit on UTF writing (the new mechanism) to be higher than short
|
2010-08-17 10:21:26 +03:00 |
|
kimchy
|
e1f3fee4e4
|
internally store on going state of snapshot to gateway
|
2010-08-17 10:03:19 +03:00 |