6804c02e97
Create specific `data` location for indices (move from work), closes #473 .
2010-11-03 14:41:29 +02:00
92b3ae3f73
Change single operation shard hashing to only use id, and not id and type, closes #472 .
2010-11-03 12:47:34 +02:00
8d454ba293
Query DSL: Add `field_masking_span` query, closes #471 .
2010-11-02 23:50:28 +02:00
a62f1f3e0d
API: Allow to control document shard routing, and search shard routing, closes #470 .
2010-11-02 19:56:18 +02:00
8e2e85f460
enhance bulk stress test
2010-11-02 14:01:22 +02:00
3fe2851dae
Index Merge: Change default `index.merge.scheduler.max_thread_count` from ` to be adaptive based on processor count, closes #469 .
2010-11-02 14:00:58 +02:00
2cdaf6357b
Rivers: Add a _status doc for each river, closes #468 .
2010-11-02 12:09:45 +02:00
ef4c44577a
add toString to match_all docs
2010-11-02 10:23:05 +02:00
4ff1b429f1
Possible (rare) shard index corruption / different doc count on recovery (gateway / shard), closes #466 .
2010-11-01 23:00:16 +02:00
49439a09e2
fix logging
2010-11-01 20:42:10 +02:00
f79719beaa
fix parsing of bytes value
2010-10-31 15:47:19 +02:00
feb854b742
On full cluster restart, replicas transaction logs are not getting cleaned, closes #465 .
2010-10-31 14:36:10 +02:00
b8fa68f97a
check if the commit point has a size at all, if not, not flushed yet, its ok
2010-10-31 12:23:56 +02:00
c14783d3e2
remove jarjar'ed files that are not needed (notice, license)
2010-10-31 11:45:10 +02:00
e6b4a8b55c
remove inclusion of config and logging file in jar
2010-10-31 10:50:35 +02:00
96a1ad6335
When on linux, force it not to swap elasticsearch process (jvm), closes #464 .
2010-10-30 19:40:24 +02:00
1feb43a0af
Index: Move compound format setting to `index.compound_format` (old setting still supported), closes #463 .
2010-10-30 18:24:28 +02:00
db24148413
fix listAll when using switch dir to return unique list of files
2010-10-30 01:26:00 +02:00
b315c5f848
add getOffsetGap to field analyzer
2010-10-29 19:05:11 +02:00
8f7a8dabc1
only flush if there is something to flush
2010-10-29 17:50:51 +02:00
11c55185e8
add another test
2010-10-29 00:22:49 +02:00
c194fa67e9
default logger (when embedded in java) to log with org.elasticsearch prefix for simpler logging configruation
2010-10-28 23:39:37 +02:00
7082593166
add term filter toString
2010-10-28 23:18:24 +02:00
e31cbb5267
fix NPE when enabling trace logging
2010-10-28 21:47:55 +02:00
4579c04a9e
Mapper: Ip Type Support (ipv4), auto detection with dynamic mapping, closes #461 .
2010-10-28 12:02:20 +02:00
6f8b859d90
better inet address serialization, also better handle ipv6
2010-10-28 01:48:54 +02:00
e7fdf16402
add number of data nodes to cluster health
2010-10-28 00:39:53 +02:00
d487d809ea
Query DSL: Revert back and have range, terms, and prefix filter _cache set to true, closes #456 .
2010-10-27 20:34:24 +02:00
3a9dc8f452
change back to cached thread pool
2010-10-27 20:13:42 +02:00
185f5a9e18
Search: Change default operation threading to `thread_per_shard` from `single_thread`, closes #455 .
2010-10-27 19:51:49 +02:00
ca67c12de5
add and/not/or docid sets, not just docsets, and improve caching behavior
2010-10-27 18:16:15 +02:00
8fef3df16f
improve threading usage on discovery and fd
2010-10-26 23:49:09 +02:00
73e6aa72cd
for some reason the test only runs with @Test on the main class...
2010-10-26 20:20:58 +02:00
c08ad0cad6
Fix parsing of "geo_distance" filter wrt "distance" / "unit" parameters
...
The problem was that when "unit" was given,
the conversion to miles was happening too early,
which caused wrong computations. This change
postpones this computation when one really knows
which unit should be used.
2010-10-26 20:13:29 +02:00
9b206146e3
Fix MILES.toKilometers() and KILOMETERS.toMiles()
...
This mistake should have been caught by DistanceUnitTests.
But the problem is that the tests in this file does not
run during the execution of the test suite, and I don't have
a clue why this is so.
2010-10-26 20:13:29 +02:00
2d15cd8009
Another test for parsing "geo_distance" filter: 12mi and km
...
If an explicit unit is provided with "distance",
the "unit" can be safely ignored, as it works
as a fallback unit.
2010-10-26 20:13:29 +02:00
8c8b7bee3a
Three tests for parsing "geo_distance" filter: 12 miles in km
...
The added test files should be equivalent. Actually they
hit the same bug as change
Two tests for parsing "geo_distance" filter: distance/unit parameters
2010-10-26 20:13:29 +02:00
244a566e49
Two tests for parsing "geo_distance" filter: default unit is km
2010-10-26 20:13:29 +02:00
0660a2912e
Two tests for parsing "geo_distance" filter: distance/unit parameters
...
Those two are supposed to be equivalent:
distance: 12, unit: "mi"
vs
distance: "12", unit: "mi"
but they are not because of an underlying bug in the query parsing
code, providing non-equivalent behavior whether a number or a string
comes via JSON.
2010-10-26 20:13:29 +02:00
14703aa1be
doc
2010-10-26 20:05:57 +02:00
184276154c
add search stress test
2010-10-26 17:17:12 +02:00
5804e9132a
Query DSL: `term` filter to have `_cache` set to `true` by default, closes #453 ,
2010-10-26 13:40:14 +02:00
442f1d7677
add the request id to the timeout message
2010-10-26 11:22:02 +02:00
c59bfea43c
add the request id to the timeout message
2010-10-26 11:19:31 +02:00
529303c533
Query: match_all query (also in query_string: *:*) is very slow
2010-10-26 11:04:55 +02:00
5966d2005d
refacto package name from facets to facet (make more sense when facet will be easily pluggable)
2010-10-25 18:49:30 +02:00
0a0ac35792
bring back query parsing cache (weak)
2010-10-25 18:09:40 +02:00
2c65be2aad
better exception when a field is missing
2010-10-25 16:33:55 +02:00
cccefad091
upgrade to netty 3.2.3
2010-10-25 16:15:05 +02:00
bc4121c06b
Query DSL: `term`, `term`, `prefix`, and `range` filter are now weakly cached, for more strong caching, set `_cache` to true, closes #450 .
2010-10-25 15:59:15 +02:00
5c5b882b5d
clean code
2010-10-25 14:44:47 +02:00
517f3eb0fd
chance default query parser cache to none from weak
2010-10-25 14:43:06 +02:00
deada942e5
Query DSL: `constant_score` and `filtered` queries cache filters by default, remove it, closes #449 .
2010-10-25 13:52:15 +02:00
835a81c16c
always use deletion aware constant score
2010-10-25 13:35:43 +02:00
b7eacc3618
add comment / todo
2010-10-24 12:38:24 +02:00
9a80fedf52
add simple map stream capability
2010-10-23 23:19:08 +02:00
ca7a7467dc
Indices API: Add open and close index, closes #447 .
2010-10-23 21:52:09 +02:00
a76824e395
make index not recovered a bock used in both gateways (shared/blob and local)
2010-10-23 17:03:38 +02:00
3f8c03db95
add test in node allocation is there are no shards, no need to do local gateway allocation
2010-10-23 01:25:23 +02:00
f0f62ce00c
improve test to wait for 2 nodes
2010-10-23 01:24:53 +02:00
e11589f3c7
add doc
2010-10-23 01:07:37 +02:00
62526444fd
better caching of missing filter / query
2010-10-22 19:44:25 +02:00
b0a0604473
Query DSL: Query String _missing_ and _exists_ syntax, closes #446 .
2010-10-22 18:14:07 +02:00
8b0daf48f4
Query DSL: Query String _missing_ and _exists_ syntax, closes #446 .
2010-10-22 17:54:02 +02:00
9237dafef9
Query DSL: Query String _missing_ and _exists_ syntax, closes #446 .
2010-10-22 17:51:19 +02:00
f63ee3158a
Query DSL: Add `exists` and `missing` filters to filter documents where a field either has a value or not in them, closes #445 .
2010-10-22 15:14:05 +02:00
9a8e033424
improve fixing negative query with adding the optimized match_all query
2010-10-22 14:50:48 +02:00
5d1d927e09
Write Consistency Level for index/delete/delete_by_query/bulk with one/quorum/all. Defaults to quorum, closes #444 .
2010-10-22 02:51:00 +02:00
5649df572a
update search expiration to work in scheduled reaper mode
2010-10-21 16:38:44 +02:00
c37a0afbf0
improve update of mappings, and delete index process with the new optimization of when index is created
2010-10-20 12:49:21 +02:00
0b593bd6d9
upgrade to guava r07
2010-10-20 12:09:19 +02:00
ae5bc20959
Reduce multiple indices overhead, don't create Indices data on nodes that don't hold any shard for an index, closes #441 .
2010-10-20 02:57:49 +02:00
1235358848
remove unused indices service
2010-10-19 19:50:12 +02:00
a4eea0aeaa
change index creation / deletion logic not to wait for it to be created on other nodes since now, they might not be created...
2010-10-19 19:33:27 +02:00
69b8b0f437
don't use the index serivce to get the stored blobs in shared gateway, move it to upper node level
2010-10-19 18:03:48 +02:00
53a3df5d8e
move list of local files to be indices level, so no need for index created on a node in order to list it
2010-10-19 17:36:21 +02:00
5635260922
remove check on if indices has an index, cluster state is enough
2010-10-19 16:42:39 +02:00
4c8978237f
move operation routing to be cluster level and not index level
2010-10-19 16:23:39 +02:00
1eee7f381a
dont case node names and index names
2010-10-18 19:03:48 +02:00
5c760d1e8c
don't case the index name in cluster health, use string constants in xcontent generation
2010-10-18 18:55:38 +02:00
3a52c2f7f4
Improve automatic publish network address logic, closes #439 .
2010-10-18 15:19:24 +02:00
019c844dd1
Plugins: plugins should now be in extracted format under `ES_HOME/plugins`, closes #438 .
2010-10-18 11:14:16 +02:00
0a3d187e6a
Mapper: Allow to configure `date_formats` only on the root object mapper, closes #437 .
2010-10-17 19:56:58 +02:00
69ecf8b66b
rollback commit, allocation should only happen when index is not recovered
2010-10-17 19:43:30 +02:00
9a09261383
remove checking for client node on rivers, its automatically done with master and non river node anyhow
2010-10-17 19:20:37 +02:00
648da2e6ff
add cluster name to cluster health response
2010-10-17 18:58:59 +02:00
5d54e36964
Statistical Facet: Allow to compute statistical facets on more than one field, closes #436 .
2010-10-17 16:22:20 +02:00
2fc0022477
clean code
2010-10-17 02:33:12 +02:00
caa6495e2b
doc
2010-10-17 01:52:23 +02:00
4708d31040
add the option to control filter caching on each filter in the java filter builders
2010-10-16 16:12:38 +02:00
d9f966d83c
Query DSL: Numeric Range Filter - A filter that uses the field data cache to perform numeric tests, closes #435 .
2010-10-16 15:38:43 +02:00
cc3a1dbe90
move geo handling (filter) into the index package from common.lucene since it uses field data and not really only dependant on lucene constucts
2010-10-16 12:30:20 +02:00
1587a3815e
more options on stress rolling restart test, variable number of fields, variable length of text
2010-10-16 03:26:11 +02:00
b09675dcfa
add a stress test for rolling restart nodes
2010-10-16 01:05:25 +02:00
bbb05a57e0
add the ability to run check index before starting a shard, used for internal testing (as it has a large overhead)
2010-10-15 20:56:30 +02:00
6c9120a51b
Local Gateway: Don't block meta operations (delete index) on an index that is not recovered due to not all shards being available, closes #433 .
2010-10-15 11:04:54 +02:00
ae05ce0551
Scripting: Allow to define scripts within `config/scripts`, automatically compiled and can be referenced by name, closes #429 .
2010-10-14 16:14:23 +02:00
e0488fa87e
Plugins: Allow to place "extracted" plugins under the `plugins` directory, closes #428 .
2010-10-14 14:04:00 +02:00
8d533e8a99
dynamic tempaltes are now named (change to the mapping definition) to allow for simpler merging
2010-10-14 12:56:50 +02:00
ad01f19db8
move dynamic tempaltes to only allow to be defined on root object mapping (so easily reusable and simpler merging) #397 .
2010-10-14 12:25:32 +02:00
1578da404c
improve geo internal cache of lat/lon, stored two double arrays instead of an array of GeoPoints.
2010-10-13 22:03:48 +02:00
9077bb6528
Geo Overhaul (work with multiple locations), closes #414 . Change (again) how geo location is stored, not using geohash but explicit double conversion
2010-10-13 03:35:35 +02:00
8a8a4d648a
Query DSL: Fine grained filter caching control with sensible defaults, closes #424 .
2010-10-13 01:37:43 +02:00
3fa214653e
increase precision to 16 from 12, omit norms / tf on geohash
2010-10-12 22:30:56 +02:00
c3cb5a3e34
Use Base64 encoding for UUID generation (auto generated doc ids, and node ids), closes #422 .
2010-10-12 00:17:01 +02:00
4f9d9c1395
add test for merging two stats field facet using same facet name
2010-10-11 00:40:37 +02:00
18d8e9dcdd
add more script tests
2010-10-10 20:05:37 +02:00
a14b73bc13
Bulk API: Rename `index` to `_index`, `type` to `_type` and `id` to `_id`, closes #421 .
2010-10-10 19:31:56 +02:00
c15a612b8a
optimize get/delete/index response xcontent generation
2010-10-09 04:06:03 +02:00
087b4e6f23
optimize search response xcontent generation
2010-10-09 04:01:17 +02:00
f64e636415
add xcontent string that will allow to speed up json/smile serialization
2010-10-09 03:06:01 +02:00
bd962ba693
upgrade to jackson 1.6.1
2010-10-09 01:51:40 +02:00
6314c2460c
Geo Overhaul (work with multiple locations), closes #414 .
2010-10-08 22:31:21 +02:00
523a8b4c3e
rename xonctent mappers to just mappers
2010-10-08 15:05:07 +02:00
a61f3a939b
add option to reuse double[] when decoding geohash
2010-10-07 23:58:49 +02:00
0f6beeb263
reuse search lookup data for the two remaining cases (custom score and script filter) by having a "current" search context to access
2010-10-07 23:18:26 +02:00
34ed85a40f
internal refactoring of field data type
2010-10-07 18:41:17 +02:00
d0bf743ab4
Query DSL: query_string / field to use the optimized match_all query when using * (or *:*), closes #413 .
2010-10-07 16:48:24 +02:00
cf5ed1d177
Term Facet: Use a script that provides the facets to index, closes #410 .
2010-10-07 01:49:12 +02:00
4c34840627
fix dynamic tempaltes persistency and merging (so it will be there across restarts, and when a new mapping is merged)
2010-10-07 00:44:53 +02:00
4422a4c48a
doc
2010-10-06 14:07:34 +02:00
22ed71e2e6
allow to execute term facet on more than one field
2010-10-06 13:39:02 +02:00
31d94b19a1
Local Gateway: Possible failure to allocate shards to nodes when more than one index exists in the cluster (on full cluster restart), closes #409 .
2010-10-06 00:35:10 +02:00
1f49eb0b9d
Gateway: Add `gateway.expected_nodes` for state recovery, closes #404 .
2010-10-04 16:20:32 +02:00
c737b36df7
better handling of dynamic types in template mappings
2010-10-04 12:37:56 +02:00
425744e0db
add bzip2 compress lib
2010-10-03 16:24:10 +02:00
7180636df6
add close to script services
2010-10-03 14:31:36 +02:00
c9a47a126f
Scripts: Allow to access `_fields` providing access to stored fields, closes #402 .
2010-10-03 12:51:41 +02:00
5b8bc333bd
JavaScript Plugin: Allow to use javascript for scripts, closes #401 .
2010-10-03 02:20:37 +02:00
5a7c8fe2cb
allow script engines to have several types
2010-10-02 21:18:01 +02:00
a127499e3c
doc
2010-10-02 21:07:59 +02:00
31ebed11fd
script handling refactoring, better support for languages that perform better with some caching on a per search aspect (and execution per doc)
2010-10-02 17:32:29 +02:00
9e8ebd46e8
Groovy Plugin: Allow to run use groovy for scripts (where applicable), closes #398 .
2010-10-02 01:22:05 +02:00
aa116e5d40
add lang parameter to all script constructs, allowing for (later) custom script languages
2010-10-01 22:14:20 +02:00
99fcfde307
Mapper: Dynamic Template Support, closes #397 .
2010-10-01 16:56:04 +02:00
f66f0218ca
`/_cluster/nodes/stats` is broken in 0.11, closes #391 .
2010-09-30 08:35:11 +02:00
3b02bd3952
rename package
2010-09-30 08:17:33 +02:00
d3978383a5
when using keyword based analayzer on _all, an NPE is thrown since there is no current entry, ignore it (it does not make sense to have keywork analyzer on _all field...)
2010-09-28 14:53:37 +02:00
55ae6b2001
fix possible problem when trying to convert a binary format to a string
2010-09-28 12:32:40 +02:00
86e17eae2c
fix auto conversion from source content type to rest content type
2010-09-28 00:01:35 +02:00
1f3adc213f
add nodes attributes to cluster state
2010-09-27 10:46:11 +02:00
d9c2cc9d37
allow to sepcify stopwords as comma delimiated list of words
2010-09-26 22:50:25 +02:00
ce28882660
add refresh option to index/create/delete opereation, REST allows for refresh parameter (defaults to false)
2010-09-26 09:07:37 +02:00
2288c5d670
setHighlighterPostTags sets pre tags instead of post, closes #386 .
2010-09-25 00:01:14 +02:00
ab9aa15bb4
add auto sync of translog when using local gateway
2010-09-24 21:25:10 +02:00
1c2733ebee
add flush to gateway
2010-09-24 12:29:52 +02:00
485f904140
Default to not using compound file format for the index (increases number of open files, but faster indexing and recovery), closes #384 .
2010-09-24 11:46:41 +02:00
2f43af0bd7
use directly the directory and not the metaData API
2010-09-24 11:36:13 +02:00
9bb86ea865
imrpvoe boolean filter performance
2010-09-24 00:59:26 +02:00
31fd196687
doc the use of mapbuilder
2010-09-23 20:06:42 +02:00
097071a9d2
add smart name filter wrapping for geo filters to automatically filter by type if as well if provided
2010-09-23 19:34:41 +02:00
832914bf6d
create a mapbuilder when listing files and not ImmutableMap builder since it seems like listFiles might return duplicate files.
2010-09-23 19:13:48 +02:00
761639150d
doc
2010-09-23 19:03:48 +02:00
c96014bb90
default the _river to 1/1 for better OOB experiance (single node recovery with local gateway support)
2010-09-23 02:46:13 +02:00
ecaaeb5250
River CouchDB Plugin, closes #382 .
2010-09-23 02:26:12 +02:00
a59912db02
disable restart API
2010-09-23 00:02:12 +02:00
fd9266dbc6
fix wrong REST response generation of cluster state
2010-09-22 16:03:42 +02:00
91344170ee
doc
2010-09-22 15:39:30 +02:00
f301138e6f
Change default thread pool to scaling from cached, closes #381 .
2010-09-22 15:20:32 +02:00
6d0829f331
imrpove shard target streaming, only do it when needed
2010-09-22 14:36:29 +02:00
cfdf6b0103
add support for op type in also in bulk
2010-09-22 00:07:45 +02:00
3479f2a981
better exception message
2010-09-21 23:49:55 +02:00
2cbcc8dd2e
better handling of search context timeout
2010-09-21 23:17:46 +02:00
b9b91db5c8
building search response should handle cases where the sort is null valued
2010-09-21 22:13:27 +02:00
aa68667d63
rabbitmq river
2010-09-21 17:32:34 +02:00
32acd88b2e
default river index to have 1 shard with 2 replicas by default
2010-09-21 15:07:51 +02:00
8dfac512ba
move parsing of framed bulk binary data into the bulk request
2010-09-21 14:29:19 +02:00
4fe7cbccca
rename indexer to river
2010-09-21 13:35:09 +02:00
69fad80b01
add rest response for allocations
2010-09-21 13:05:10 +02:00
a1299a3d4f
refactoring in routing logic to allow adding allocation explanation that later can be shown
2010-09-21 11:39:22 +02:00
b5b36215ae
refactoring in routing logic to allow adding allocation explanation that later can be shown
2010-09-21 11:37:36 +02:00
dbb2ae69b9
upgrade to latest mvel (2.0.18)
2010-09-21 01:57:41 +02:00
a68c00cd0d
add special handling for primitive arrays as fields in xcontent builder
2010-09-21 01:41:35 +02:00
121e548d76
add to nodes stats the total store size of the indices shards allocated to that node
2010-09-21 01:11:43 +02:00
94a77b69d6
add a twitter indexer
2010-09-20 18:17:02 +02:00
eb4f4f99b3
add recover_after gateway tests
2010-09-20 09:44:57 +02:00
3ec95f4e84
javadoc
2010-09-20 08:58:33 +02:00
770bac252a
fix local discovery to handle master nodes specifically better
2010-09-19 23:49:15 +02:00
25246902cc
Gateway: Add `recover_after_data_nodes` and `recover_after_master_nodes`, closes #376 .
2010-09-19 22:46:13 +02:00
95bb02b330
simple specific master nodes test
2010-09-19 21:11:53 +02:00
8def6f59b3
simple specific master nodes test
2010-09-19 18:48:48 +02:00
20b6688b0a
make ping tests run faster using cluster state api
2010-09-19 18:13:03 +02:00
589dbce89b
move persistenting state and sharsd state in local gateway to another thread
2010-09-19 17:54:14 +02:00
f82ceb1e1e
do snapshots on more lower level interval
2010-09-18 22:18:21 +02:00
e3948115f4
doc
2010-09-18 22:00:18 +02:00
2372f481aa
Shared Storage Gateway (fs/s3): Wrong snapshotting of transaction log, closes #375 .
2010-09-18 21:33:38 +02:00
a2011e0151
no need to cache match all filter
2010-09-17 16:47:35 +02:00
cd7b84e808
improve match_all query to use a filter when possible
2010-09-17 16:38:27 +02:00
3c95d6a215
more work on inexers
2010-09-17 16:36:12 +02:00
ff081240eb
imrpove caching and fix delete mapping logic
2010-09-17 01:25:37 +02:00
08d7125cd5
more work on indexer
2010-09-17 00:22:42 +02:00
4b87f63bed
Terms Facet: Allow to provide `_index` as the field, resulting in facets on indices, closes #374 .
2010-09-16 15:11:30 +02:00
f49f3e169a
Mapping API: Delete Mapping (with data), closes #373 .
2010-09-16 14:35:07 +02:00
aef4704fed
more indexer work
2010-09-16 13:22:09 +02:00
0a6600818a
add count at the end of the stress test
2010-09-15 23:51:25 +02:00
09cdc1c379
don't wait for indices if there are none when using local gateway
2010-09-15 18:22:13 +02:00
e52daa9670
automatic index creation when using the bulk api
2010-09-15 18:18:48 +02:00
e93eb16deb
docs and wrap the rest bulk request in an array
2010-09-15 17:59:10 +02:00
5a5a892cc7
return the correct content type
2010-09-15 12:55:36 +02:00
8db2a217c0
Expose internal search source builder
2010-09-15 12:43:21 +02:00
kimchy
Adriano Ferreira