Martijn van Groningen
2d6adf6428
Percolator refactoring:
...
* Added percolator field mapper that extracts the query terms and indexes these terms with the percolator query.
* At percolate time these extracted terms are used to query percolator queries that are like to be evaluated. This can significantly cut down the time it takes to percolate. Whereas before all percolator queries were evaluated if they matches with the document being percolated.
* Changes made to percolator queries are no longer immediately visible, a refresh needs to happen before the changes are visible.
* By default the percolate api only returns upto 10 matches instead of returning all matching percolator queries.
* Made percolate more modular, so that it is easier to add unit tests.
* Added unit tests for the percolator.
Closes #12664
Closes #13646
2016-01-06 16:08:10 +01:00
Colin Goodheart-Smithe
2c33f78192
Merge branch 'master' into feature/aggs-refactoring
...
# Conflicts:
# core/src/main/java/org/elasticsearch/search/aggregations/bucket/children/ChildrenParser.java
# core/src/main/java/org/elasticsearch/search/aggregations/support/ValuesSourceParser.java
# test/framework/src/main/java/org/elasticsearch/test/TestSearchContext.java
2016-01-06 09:35:53 +00:00
Igor Motov
a89dba27c2
Task Management: Add framework for registering and communicating with tasks
...
Adds task manager class and enables all activities to register with the task manager. Currently, the immutable Transport*Activity class represents activity itself shared across all requests. This PR adds and an additional structure Task that keeps track of currently running requests and can be used to communicate with these requests using TransportTaskAction.
Related to #15117
2016-01-05 12:24:43 -05:00
Simon Willnauer
ea2a8150d3
Merge pull request #15692 from s1monw/issues/15675
...
Fix pharse suggest collate example to use correct script context/syntax
2016-01-05 09:27:18 +01:00
Adrien Grand
1a47226d9a
Merge pull request #15663 from jpountz/remove/mapping_backcompat
...
Remove mapping backward compatibilit with pre-2.0.
2016-01-04 10:05:39 +01:00
Adrien Grand
6d3c9b074c
Remove support for the `multi_field` type.
...
It is officially unsupported since version 1.0.
2015-12-30 12:03:15 +01:00
Simon Willnauer
3b06cd8d92
Fix pharse suggest collate example to use correct script context/syntax
...
Closes #15675
2015-12-29 09:22:36 +01:00
Robert Muir
180ab2493e
Improve thirdPartyAudit check, round 3
2015-12-28 22:38:55 -05:00
Adrien Grand
af122f4151
Remove mapping backward compatibilit with pre-2.0.
...
This removes the backward compatibility layer with pre-2.0 indices, notably
the extraction of _id, _routing or _timestamp from the source document when a
path is defined.
2015-12-24 13:47:37 +01:00
Adrien Grand
d8d8666877
Remove `index_name` back compat.
...
Since 2.0 we enforce that fields have the same full and index names. So in 3.x
we can remove the ability to have different names on the same field.
2015-12-23 14:55:26 +01:00
Adrien Grand
cf52e96c42
Upgrade to lucene-5.5.0-snapshot-1721183.
...
Some files that implement or use the Scorer API had to be changed because of
https://issues.apache.org/jira/browse/LUCENE-6919 .
2015-12-21 17:02:08 +01:00
Colin Goodheart-Smithe
97c2f7b037
Aggregations Refactor: Refactor Histogram and Date Histogram Aggregation
2015-12-21 09:34:05 +00:00
Ryan Ernst
4ea19995cf
Remove wildcard imports
2015-12-18 12:43:47 -08:00
Colin Goodheart-Smithe
15588a4991
Aggregations: Run pipeline aggregations for empty buckets added in the Range Aggregation
...
Closes #15471
2015-12-18 14:42:05 +00:00
Adrien Grand
6ea16671f4
Simplify the Text API.
...
We have the Text API, which is essentially a wrapper around a String and a
BytesReference and then we have 3 implementations depending on whether the
String view should be cached, the BytesReference view should be cached, or both
should be cached.
This commit merges everything into a single Text that is essentially the old
StringAndBytesText impl.
Long term we should look into whether this API has any performance benefit or
if we could just use plain strings. This would greatly simplify all our other
APIs that currently use Text.
2015-12-17 17:22:38 +01:00
Robert Muir
a7cc91e868
Merge pull request #15501 from rmuir/sheisty_classes
...
thirdPartyAudit round 2
2015-12-17 03:44:27 -05:00
Robert Muir
6692e42d9a
thirdPartyAudit round 2
...
This fixes the `lenient` parameter to be `missingClasses`. I will remove this boolean and we can handle them via the normal whitelist.
It also adds a check for sheisty classes (jar hell with the jdk).
This is inspired by the lucene "sheisty" classes check, but it has false positives. This check is more evil, it validates every class file against the extension classloader as a resource, to see if it exists there. If so: jar hell.
This jar hell is a problem for several reasons:
1. causes insanely-hard-to-debug problems (like bugs in forbidden-apis)
2. hides problems (like internal api access)
3. the code you think is executing, is not really executing
4. security permissions are not what you think they are
5. brings in unnecessary dependencies
6. its jar hell
The more difficult problems are stuff like jython, where these classes are simply 'uberjared' directly in, so you cant just fix them by removing a bogus dependency. And there is a legit reason for them to do that, they want to support java 1.4.
2015-12-17 02:35:00 -05:00
Jack Conradson
4523eaec88
Added plumbing for compile time script parameters.
...
Closes #15464
2015-12-16 18:29:21 -08:00
Robert Muir
4f9d4103f2
Merge pull request #15491 from rmuir/forbidden_third_party
...
Add gradle thirdPartyAudit to precommit tasks
2015-12-16 18:56:50 -05:00
Robert Muir
42138007db
add some more comments about internal api usage
2015-12-16 18:56:02 -05:00
Robert Muir
ee79d46583
Add gradle thirdPartyAudit to precommit tasks
2015-12-16 16:38:16 -05:00
Ryan Ernst
a2b8f4b90a
Merge pull request #15434 from rjernst/http_type
...
Expose http.type setting, and collapse al(most all) modules relating to transport/http
2015-12-16 11:54:30 -08:00
Adrien Grand
5d5c6591aa
Validate that fields are defined only once.
...
There are two ways that a field can be defined twice:
- by reusing the name of a meta mapper in the root object (`_id`, `_routing`,
etc.)
- by defining a sub-field both explicitly in the mapping and through the code
in a field mapper (like ExternalMapper does)
This commit adds new checks in order to make sure this never happens.
Close #15057
2015-12-15 10:37:18 +01:00
Ryan Ernst
60d35c81af
Plugins: Expose http.type setting, and collapse al(most all) modules relating to transport/http
...
This change adds back the http.type setting. It also cleans up all the
transport related guice code to be consolidated within the
NetworkModule (as transport and http related stuff is what and how ES
exposes over the network). The setter methods previously used by some
plugins to override eg the TransportService or HttpServerTransport are
removed, and those plugins should now register a custom implementation
of the class with a name and set that using the appropriate config
setting. Note that I think ActionModule should also be moved into here,
to sit along side the rest actions, but I left that for a followup.
closes #14148
2015-12-14 22:01:04 -08:00
Jason Tedor
11cbc08e45
Fix compilation in o.e.m.t.SimpleSortTests
2015-12-11 11:46:50 -05:00
Jason Tedor
3383c24be0
Remove and forbid use of Collections#shuffle(List) and Random#<init>()
...
This commit removes and now forbids all uses of
Collections#shuffle(List) and Random#<init>() across the codebase. The
rationale for removing and forbidding these methods is to increase test
reproducibility. As these methods use non-reproducible seeds, production
code and tests that rely on these methods contribute to
non-reproducbility of tests.
Instead of Collections#shuffle(List) the method
Collections#shuffle(List, Random) can be used. All that is required then
is a reproducible source of randomness. Consequently, the utility class
Randomness has been added to assist in creating reproducible sources of
randomness.
Instead of Random#<init>(), Random#<init>(long) with a reproducible seed
or the aforementioned Randomess class can be used.
Closes #15287
2015-12-11 11:16:38 -05:00
Robert Muir
1e8f9558a0
Remove now-dead code in expressions (fixed in https://issues.apache.org/jira/browse/LUCENE-6920 )
2015-12-10 14:50:32 -05:00
Robert Muir
2741888498
Remove RuntimePermission("accessDeclaredMembers")
...
Upgrades lucene to 5.5.0-1719088, randomizedtesting to 2.3.2, and securemock to 1.2
2015-12-10 14:26:55 -05:00
Robert Muir
e454fadc22
Merge branch 'master' into shave_mustache
2015-12-10 07:58:24 -05:00
Areek Zillur
025e9818e7
Refactors TransportReplicationAction to decouple request routing and shard operation logic
2015-12-10 01:32:07 -05:00
Robert Muir
61266dee19
mark messy rest test as messy and add to messy tests lists
2015-12-09 19:21:35 -05:00
Ryan Ernst
74dc5bf20a
Fix template query parser tests to register mustache script engine
2015-12-08 21:33:48 -08:00
Ryan Ernst
b7fb0824be
Fix render search template tests
2015-12-08 21:33:48 -08:00
Robert Muir
a6e1655fe9
fix integ tests
2015-12-09 00:30:32 -05:00
Robert Muir
17436d4332
get gradle check passing for lang-mustache
2015-12-09 00:10:37 -05:00
Robert Muir
3632ddf497
split out mustache methods so groovy works again
2015-12-09 00:00:40 -05:00
Ryan Ernst
907d3cf878
move template query builder tests back to core (using mockscript)
2015-12-08 20:26:45 -08:00
Robert Muir
2e299860e5
refactor mustache to lang-mustache plugin. No rest tests yet.
2015-12-08 22:45:21 -05:00
Robert Muir
3c419c2186
do expressions consistently with other engines
2015-12-05 22:08:40 -05:00
Robert Muir
2169a123a5
Filter classes loaded by scripts
...
Since 2.2 we run all scripts with minimal privileges, similar to applets in your browser.
The problem is, they have unrestricted access to other things they can muck with (ES, JDK, whatever).
So they can still easily do tons of bad things
This PR restricts what classes scripts can load via the classloader mechanism, to make life more difficult.
The "standard" list was populated from the old list used for the groovy sandbox: though
a few more were needed for tests to pass (java.lang.String, java.util.Iterator, nothing scary there).
Additionally, each scripting engine typically needs permissions to some runtime stuff.
That is the downside of this "good old classloader" approach, but I like the transparency and simplicity,
and I don't want to waste my time with any feature provided by the engine itself for this, I don't trust them.
This is not perfect and the engines are not perfect but you gotta start somewhere. For expert users that
need to tweak the permissions, we already support that via the standard java security configuration files, the
specification is simple, supports wildcards, etc (though we do not use them ourselves).
2015-12-05 21:46:52 -05:00
Robert Muir
46377778a9
Merge branch 'master' into getClassLoader
2015-12-04 15:58:36 -05:00
Robert Muir
7160c5ec15
list modules separately in pluginservice
2015-12-04 01:13:17 -05:00
Ryan Ernst
a8e9403204
added gradle checks for modules configuration, and ability to add
...
modules to integ test cluster
2015-12-03 20:53:06 -08:00
Ryan Ernst
0a4a81afaf
Added modules, distributions now include them (just plugins installed in
...
a diff dir)
2015-12-03 14:18:26 -08:00
Shay Banon
bf0caafa04
remove old modules and gradle
2011-12-06 01:01:04 +02:00
Shay Banon
a8fd2d48b8
first cleanup phase, move to single src
2011-12-06 00:59:23 +02:00
Shay Banon
9995d27841
Analysis: Add arabic, brazilian, czech to stemmer token filter language options, closes #1519 .
2011-12-04 16:36:42 +02:00
Shay Banon
720954d8a6
Version missing a space, closes #1517 .
2011-12-04 12:48:29 +02:00
Shay Banon
032e215f25
search missing from stats when using clear and search params, closes #1516 .
2011-12-02 12:32:51 +02:00
Shay Banon
be282cc4c8
Improve highlighting perf (a bit) by reusing some constructs across hits, closes #1513 .
2011-11-30 19:15:31 +02:00
Shay Banon
c93ddd9b61
check against hte fieldName...
2011-11-30 13:34:21 +02:00
Shay Banon
6c552b4187
have DocSet implement Bits interface
2011-11-29 23:53:38 +02:00
Shay Banon
a21c0829c7
Query DSL: Bool filter does not take should clauses properly into account, closes #1511 .
2011-11-29 22:39:07 +02:00
Shay Banon
76307a5e73
cleanup
2011-11-29 21:28:07 +02:00
Shay Banon
e9d2f44d49
Query DSL: Bool filter does not take should clauses properly into account, closes #1511 .
2011-11-29 21:27:36 +02:00
Shay Banon
de49a313c5
Query DSL: Bool filter does not take should clauses properly into account, closes #1511 .
2011-11-29 21:23:41 +02:00
Shay Banon
9bb9ce4e84
add 0.18.6
2011-11-29 13:55:11 +02:00
Shay Banon
ae4ae598e3
make node closed exception serializable
2011-11-29 10:18:13 +02:00
Shay Banon
b2fa6b7a94
When _source is disabled, don't return it in realtime get fetching the document from the transaction log, closes #1509 .
2011-11-29 09:39:46 +02:00
Shay Banon
e9fe8ec469
sync with latest Lucene block join, init parentDoc to -1, which makes the assert commented out valid again
2011-11-28 23:47:31 +02:00
Shay Banon
6b894d9f53
add the option to get mapping as a parsed map, also do some internal refactoring to share the code that parses into a map
2011-11-28 20:19:02 +02:00
Njal Karevoll
b1707d219f
set "http" on NodeInfo instances if it is passed in the constructor
2011-11-28 17:08:28 +02:00
Shay Banon
d5aa7574f3
Upgrade to netty 3.2.7, closes #1506 .
2011-11-28 14:48:49 +02:00
Shay Banon
4be7866bd9
Registering a percolate query with additional "object" level metadata can fail, closes #1505 .
2011-11-27 18:06:18 +02:00
Shay Banon
32f1edf6f7
Analysis: Add language setting to lowercase filter, supporting greek and turkish, closes #1503 .
2011-11-27 13:39:05 +02:00
George Chatzigeorgiou
a1a856e4b9
Support Greek stemming
...
While the GreekAnalyzer supports stemming, custom analyzers for the greek language cannot be build because there is no GreekStemmer (although lucene has one).
2011-11-27 13:22:58 +02:00
Shay Banon
f18ad903a9
Upgrade to Lucene 3.5, closes #1502 .
2011-11-27 12:57:26 +02:00
Shay Banon
fd5d754fe6
better failure messages when dynamic mapping is disabled
2011-11-25 09:40:44 +02:00
Shay Banon
a7803855a1
add another path trie test
2011-11-25 00:21:01 +02:00
Shay Banon
3f835eb780
even though it can't happen (offset is 0 when loading from the index), use properly the field to get binary values with offset and length
2011-11-24 21:44:18 +02:00
Shay Banon
21988a0ca7
support compressed percolator index
2011-11-24 21:32:56 +02:00
Shay Banon
ac2c2fb48d
enable unsafe optimization in lzf for 0.19
2011-11-24 20:12:51 +02:00
Shay Banon
03c2e5ea52
improve how decoding is done on the transport layer, embedding FrameDecoder into the message handler, and reducing allocation of buffers and better guess into allocating cumalation buffers
2011-11-24 20:03:25 +02:00
Shay Banon
f0efb8cdea
Using _parent:123 in a query string query fails to fetch docs, closes #1497 .
2011-11-24 13:59:10 +02:00
Shay Banon
81965d0ea9
Support using _id:1234, or using term query/filter on _id even when _id is not indexed, closes #1496 .
2011-11-24 12:31:50 +02:00
Shay Banon
daa4444e22
DocumentMapper.java wrong order on build rootMappers, closes #1493 .
2011-11-24 09:58:05 +02:00
Shay Banon
2c0662e18e
Query DSL: indices query to allow to set a `no_match_query`, closes #1492 .
2011-11-23 19:01:14 +02:00
Shay Banon
f47b77199d
Multi field mapper with more than one extra mapping can cause endless re-sync'ing of mapping between nodes, closes #1487 .
2011-11-23 09:04:28 +02:00
Shay Banon
05f98634d8
IndicesQueryBuilder generates the wrong query name, closes #1485 .
2011-11-22 15:57:54 +02:00
Shay Banon
f28c11b31c
By default, set http.compression to false, closes #1482 .
2011-11-21 19:50:24 +02:00
Shay Banon
bff980c797
Allow empty Strings to be null for Number's and don't autodetect empty string fields as string types, closes #1473 .
2011-11-21 18:02:12 +02:00
Shay Banon
fbb03c611a
add a sleep to fix test (need to think of a better fix)
2011-11-21 10:44:29 +02:00
Shay Banon
b10094b109
support boost on block join query (nested)
2011-11-21 10:43:58 +02:00
Shay Banon
90af54dad5
make sure bulk item failure on primary shards will not execute on a replica shard
2011-11-20 15:09:13 +02:00
Shay Banon
bb8ff3814e
Binary field compression causes wrong _source decoding, closes #1475 .
2011-11-20 12:59:22 +02:00
Jeremie BORDIER
6403a42e31
* Try to extract value from String using FieldMapper when reading from the transaction log.
2011-11-17 18:54:41 +02:00
Shay Banon
4d607bdd4a
handle valueForString in binary case
2011-11-17 18:19:16 +02:00
Shay Banon
c8641588ec
clean code, script service no longer used in get action
2011-11-17 15:48:05 +02:00
Shay Banon
835dc33d45
make sure we use the default index analyzer for _all field, even though it works well without it now because the _analyzer field comes before it and sets the context.analyzer
2011-11-17 15:37:51 +02:00
Shay Banon
b0880e114e
add another instanceof check on Date and not direct check
2011-11-17 14:27:40 +02:00
Shay Banon
09fe743790
add another instanceof check on Date and not direct check
2011-11-17 14:27:16 +02:00
Shay Banon
118acb3992
add 0.18.5 version
2011-11-16 22:00:13 +02:00
Shay Banon
b0fc243138
add 0.18.4 version
2011-11-16 15:23:58 +02:00
Shay Banon
72d2fd0da0
Inner queries not resolved correctly in has_child filter when searching directly against the parent type (in the URI for example), closes #1471 .
2011-11-16 14:15:29 +02:00
Shay Banon
b5a0ae2fbe
better toString for custom score query
2011-11-15 22:20:15 +02:00
Shay Banon
e52ec518f3
NPE when highlighting
2011-11-15 18:11:03 +02:00
Shay Banon
afb690e233
refactor sub fetch phase to also allow for hits level execution
2011-11-15 18:09:45 +02:00
Shay Banon
537d9c5db0
FVH should use the parsed query, and not a possible rewritten query
2011-11-15 16:45:05 +02:00
Shay Banon
8f392af207
upgrade to mvel 2.1 Beta7
2011-11-15 16:23:13 +02:00
Shay Banon
8d0ac1787b
upgrade to jackson 1.9.2
2011-11-15 15:53:18 +02:00
Shay Banon
a6a2a264c3
Highlighting on term vector enabled field should not highlight filters by default, closes #1469 .
2011-11-15 13:42:15 +02:00
Shay Banon
b8fe9999e0
XContentBuilder to handle extended classes of java.util.Date, closes #1465 .
2011-11-15 11:34:32 +02:00
Shay Banon
abaf4b5196
Indices Stats API: Providing groups as part of the HTTP API does not return stats for those groups, closes #1468 .
2011-11-15 10:31:55 +02:00
Igor Motov
0d714d580f
Add counts of currently executing get operations
2011-11-15 10:21:10 +02:00
Shay Banon
9bf42fed1b
Nested facet execution can fail with ArrayIndexOutOfBounds, closes #1467 .
2011-11-15 09:23:56 +02:00
Shay Banon
dc2824fe06
apply fix to unsafe decoder in lzf, still use vanilla for now
2011-11-15 08:46:05 +02:00
Shay Banon
73ba30b18a
Date Range: Inclusive upper range does not round up properly, closes #1463 .
2011-11-14 17:16:42 +02:00
Shay Banon
ed281fbfd5
Index shard search slow log (query and fetch), closes #1462 .
2011-11-14 14:10:39 +02:00
Shay Banon
b43c8fe128
get should report time in millis, but return in nanoseconds
2011-11-14 10:40:05 +02:00
Igor Motov
62d67e6c2d
Add counts of currently executing index, delete, query and fetch operations
2011-11-14 10:24:50 +02:00
Shay Banon
eefbe52580
disable optimized decoder by default
2011-11-14 10:10:22 +02:00
Shay Banon
eb1b0b150f
Using root object level mapping (_size, _source) can cause reparsing of the mapping on startup, close #1458 .
2011-11-13 20:56:16 +02:00
Shay Banon
3da6e0a5b0
Percolate / Analyzer API can hang if it fails to execute, closes #1457 .
2011-11-13 19:54:13 +02:00
Jeremie BORDIER
28c9595af3
* Add support for LZF compression on binary fields.
2011-11-13 14:32:53 +02:00
Shay Banon
4bbf29834e
upgrade to lzf compress 0.9
2011-11-13 14:06:09 +02:00
Shay Banon
27a7b0680c
fix top_terms_boost parsing for multi term rewrite
2011-11-13 12:51:10 +02:00
Igor Motov
9cc0b7a28b
Fix processing of regex patterns in large terms facet requests
2011-11-13 12:49:12 +02:00
Shay Banon
a3978402e5
add the search request to the search context
2011-11-13 12:48:17 +02:00
Shay Banon
f4adff652c
Blank routing should be ignored, closes #1450 .
2011-11-13 12:04:02 +02:00
Shay Banon
da98aab13f
also support _percolate for bulk item requests
2011-11-13 10:19:05 +02:00
Shay Banon
21c4530aaf
Search: Search requests execute by mistake on the networking http IO thread, causing other http operations to hang, closes #1455 .
2011-11-11 22:22:21 +02:00
Shay Banon
99d31cc8c8
better handlign of open channels
2011-11-11 22:22:15 +02:00
Shay Banon
93f1d50c18
configure the scheduled TP to not wait for delayed execution, so we shutodown faster
2011-11-10 21:52:42 +02:00
Shay Banon
68c8cac852
AbstractCompoundWordTokenFilterFactory should store the dictionary as a CharArraySet instance, not a Set, closes #1449 .
2011-11-10 20:12:35 +02:00
Shay Banon
15c798fb4c
fix minimum_should_match in query_string builder
2011-11-10 12:13:31 +02:00
Shay Banon
c4542c8349
increase search stats rounds to make sure the stats are higher than 0
2011-11-10 12:01:39 +02:00
Shay Banon
62bc0836c1
improve boolean filter
2011-11-10 12:00:43 +02:00
Igor Motov
ed8c289dec
Log warning when application of an updated cluster state fails with an exception
2011-11-10 10:12:58 +02:00
Igor Motov
e7baf30bd2
Fix reporting of total indexing stats
2011-11-10 10:07:10 +02:00
Igor Motov
eafa2b0c9a
Fix possible NPE in TransportNodesListGatewayStartedShards operation
2011-11-10 10:04:11 +02:00
Shay Banon
c5ebe6e86f
Mapping: Improve applying guessed types on dynamic templates, closes #1446 .
2011-11-09 09:02:20 +02:00
Shay Banon
75f522adaa
data.path locations are unevenly filled (0.18.2), closes #1436 .
2011-11-02 23:45:35 +02:00
Igor Motov
3c2dd959cb
Aliases should be processed when index routing changes
2011-11-01 20:05:46 +02:00
Shay Banon
ca7247e1b1
add more details logging on info of data path
2011-10-28 07:45:17 +02:00
Shay Banon
65a525bb15
add 0.18.3
2011-10-27 20:42:43 +02:00
Shay Banon
723d2e8b15
Search: Fetching fields that end up extracted from source might fail, closes #1431 .
2011-10-27 20:28:38 +02:00
Shay Banon
8922d5b073
Merge Scheduler: Allow to set index.merge.scheduler.max_merge_count, closes #1430 .
2011-10-27 02:14:47 +02:00
Shay Banon
efffcf2b26
add 0.18.2 option
2011-10-27 01:43:08 +02:00
Shay Banon
99e2bb270c
External data location configuration fails (path.data setting), closes #1429 .
2011-10-27 01:30:33 +02:00
Shay Banon
49a97f6fcf
move to 0.19.0 snap
2011-10-26 21:04:10 +02:00
Shay Banon
3544b07330
release 0.18.0
2011-10-26 20:58:24 +02:00
Shay Banon
0cde90fcb1
minimum_number_should_match in a query_string, closes #1420 .
2011-10-26 01:58:12 +02:00
Shay Banon
b652c655d2
Highlighting broken with custom_filters_score query, closes #1425 .
2011-10-26 00:58:52 +02:00
Shay Banon
2778a6756c
indexing option ignored in index_stats, closes #1423 .
2011-10-25 20:20:43 +02:00
Shay Banon
f9d0e82389
if source is not stored, treat it as an empty map in things like scripts or non stored field extraction
2011-10-25 20:18:53 +02:00
Shay Banon
8d08a66e66
make flags public just so people can hack it if needed
2011-10-25 19:01:12 +02:00
Shay Banon
6f39fce41f
First indexing fails when indexing a type with an attachment field mapped using a dynamic template, closes #1418 .
2011-10-25 01:40:27 +02:00
Shay Banon
3f4eea469c
better failure message if a type parser is not found with dynamic tempaltes
2011-10-25 01:10:49 +02:00
Shay Banon
3210785bf4
upgrade to jackson 1.9.1
2011-10-25 00:30:05 +02:00
Shay Banon
fd23d16eaa
Mapping: Allow to include / exclude specific parts of it when storing it, closes #1421 .
2011-10-25 00:01:58 +02:00
Shay Banon
dec8dc5bec
Bool Filter fails with ArrayIndexOutOfBoundsException, closes #1419 .
2011-10-24 00:30:30 +02:00
Shay Banon
d8f426a166
remove unused class
2011-10-23 23:41:18 +02:00
Shay Banon
a360cc4c4a
on multiple data locations, write the state files of local gateway on all locations
2011-10-23 22:57:37 +02:00
Shay Banon
b2b608f9dc
Query DSL: Indices query type, closes #1416 .
2011-10-23 01:35:09 +02:00
Shay Banon
721f315210
handle also illegal state case to see if OOM happened within the index writer
2011-10-21 20:18:57 +02:00
Hiroyuki Ikezoe
6444335f06
Use CJKAnalyzer instead of ChineseAnalyzer
...
Signed-off-by: Hiroyuki Ikezoe <hiikezoe@gnome.org>
2011-10-21 20:04:32 +02:00
Shay Banon
932215d6fa
rename check setting to check on startup
2011-10-20 16:17:38 +02:00
Shay Banon
ff977926a9
add equals support to index metadata
2011-10-20 00:51:24 +02:00
Lukas Vlcek
54273dd1ee
Added tests for synonym parsers.
2011-10-19 23:38:15 +02:00
Lukáš Vlček
f7747d7ff9
Adding Wordnet synonym format
2011-10-19 23:38:14 +02:00
Shay Banon
0f2b875df9
better failure message when failing to get a node lock
2011-10-19 23:12:01 +02:00
Shay Banon
9396735925
Script sorting doesn't accept parameters, closes #1382 .
2011-10-18 22:31:20 +02:00
Shay Banon
724611f249
don't clear on both obtain and release for the search cache
2011-10-18 19:21:06 +02:00
Shay Banon
4ffbdbeaea
better failure message for sorting when mapping is not found
2011-10-18 05:54:40 +02:00
Shay Banon
b113eb18fe
builder based search source is safe now
2011-10-18 05:53:53 +02:00
Shay Banon
184a38439f
Search: A failed search request might get overrun when trying another shard, closes #1403 .
2011-10-18 05:31:12 +02:00
Shay Banon
673655cc7b
When searching against an index/type, use the type information to derive different search aspects, closes #1391 .
2011-10-18 01:26:53 +02:00
Shay Banon
6a146e7ad0
When searching against an index/type, use the type information to derive different search aspects, closes #1391 .
2011-10-18 00:38:29 +02:00
Shay Banon
325064c7aa
add static close methods to main class entry point
2011-10-17 20:25:41 +02:00
Shay Banon
bfb4666b3d
remove casting
2011-10-17 00:43:25 +02:00
Shay Banon
bcd582b8c1
add internal cluster reroute api
2011-10-16 19:02:32 +02:00
Shay Banon
1047cebabe
replication base classes to allow for different implementation of the primary request and the replica request
2011-10-16 17:25:31 +02:00
Shay Banon
72ad722480
Array out-of-bounds exception with bool filter, closes #1400 .
2011-10-15 15:35:14 +02:00
Erick Tryzelaar
b2769b1086
multi_get ids shortcut should grab custom fields.
2011-10-15 11:56:55 +02:00
Shay Banon
6b497589ce
rest _count endpoint to also allow for no query provided (defaults to match_all)
2011-10-14 17:53:27 +02:00
Shay Banon
a76737ceaf
also ignore index missing failure when refreshing, as it might happen (we refresh on shards that might have not been allocated yet)
2011-10-14 17:50:02 +02:00
Shay Banon
dee4b42b16
Exception: TokenStream implementation classes or at least their incrementToken() implementation must be final, closes #1397 .
2011-10-14 16:56:53 +02:00
Shay Banon
24f1f0ff96
improve refreshing logic to resync mappings on upgrade, reduce the amount of cluster events processing requires if the even if fired from several nodes / sources
2011-10-14 15:20:38 +02:00
Shay Banon
ffc74260ac
Synonym filter fails to properly load synonyms (since 0.17.7), closes #1392 .
2011-10-13 00:18:01 +02:00
Shay Banon
19ff93b09a
all field mapper should be "included in root object"
2011-10-12 22:50:16 +02:00
Shay Banon
0367103423
Text Query does not use search_analyzer on field that is prefixed with the type name, closes #1390 .
2011-10-12 22:14:03 +02:00
Shay Banon
1012f6a3ea
Root mapper analyzer/index_analyzer/search_analyzer with unregistered analyzer name won't fail, closes #1389 .
2011-10-12 21:41:27 +02:00
Shay Banon
bb9d8fe342
Search / Get Preference: Add _only_node:[node_id] option, closes #1388 .
2011-10-12 21:11:12 +02:00
Igor Motov
bd87f8de3a
Fix NPE in HighlightField serialization. Fixes #1380
2011-10-08 20:54:56 +02:00
Shay Banon
4bbe1b111a
count doesn't work for empty query (discrepancy with search API), closes #1377 .
2011-10-06 21:57:19 +02:00
Shay Banon
768c6d2922
fix buffer recycler in lzf
2011-10-06 20:40:43 +02:00
Shay Banon
9c6dfc1508
now that the change to refresh can execute on not yet active shards, we need to ignore illegal shard state failures (expected...)
2011-10-05 23:35:07 +02:00
Shay Banon
d69baa3e04
when writing _river status, use consistency of one
2011-10-05 19:12:21 +02:00
Shay Banon
8f55e8835f
when getting the _meta doc from _river index (per river), make sure the callback listener is threaded
2011-10-05 17:29:11 +02:00
Shay Banon
111c472a0b
upgrade to jackson 1.9.0
2011-10-05 13:32:33 +02:00
Shay Banon
63844ddd43
REST Bulk API: Allow to execute _bulk against /{index}/_bulk and /{index}/{type}/_bulk endpoints, closes #1375 .
2011-10-05 13:03:30 +02:00
Shay Banon
3d4c31de91
associate a version with a discovery node
2011-10-05 12:42:27 +02:00
Shay Banon
3d49b4ed3a
add a simple integration level test for awareness
2011-10-03 13:48:10 +02:00
Igor Motov
a51baa7d6c
Allow limiting the number of concurrent ES nodes that can run on the same machine
2011-10-03 12:30:03 +02:00
Shay Banon
56a4c98e8b
Allow to specify a specific field in the clear cache API, closes #1374 .
2011-10-03 12:13:02 +02:00
Shay Banon
c47f73a1ea
better refresh stress test
2011-09-27 22:56:44 +03:00
Shay Banon
5ed064d532
execute the indices store listener as a last listener, to make sure we clean things up before we delete content if needed
2011-09-27 22:56:27 +03:00
Shay Banon
df3fa9c067
When refreshing, also execute the refresh operation on initializing shards to make sure we don't miss it, closes #1370 .
2011-09-27 21:46:24 +03:00
Shay Banon
de8644d95a
Fetch phase when searching might fail when mapping are updated with type missing, closes #1369 .
2011-09-27 21:45:10 +03:00
Shay Banon
4088236cf7
No need to reroute (check for possible shard allocations) when a new *non* data node is added to the cluster, closes #1368 .
2011-09-27 13:47:59 +03:00
Shay Banon
f63727e3c6
no need to log a failure when deleting an index and a shard is recovering
2011-09-27 13:21:20 +03:00
Shay Banon
8fd28320e4
Add an option to disallow deleting all indices, closes #1367 .
2011-09-27 11:54:34 +03:00
Shay Banon
e0fdccd9c0
Transport Client: When `sniff` is enabled, use the sniffed nodes to be the list fo nodes to ping as well as the provided nodes, closes #1217 .
2011-09-27 01:29:03 +03:00
Shay Banon
0c82fc5901
Remove Infinity values for Range facets when no docs match the range, closes #1366 .
2011-09-27 00:41:57 +03:00
Shay Banon
737589f50d
better handling of mean computation of some facets to handle division by 0, though, won't happen on most facets
2011-09-27 00:39:37 +03:00
Igor Motov
d611182dbf
Add support for non-elasticsearch namespaces to ImmutableSettings.getAsClass method
2011-09-26 23:29:08 +03:00
Shay Banon
8a63e58e1a
Add `cloud.node.auto_attributes` setting, when set to `true`, will automatically add aws ec2 related attributes to the node (like availability zone), closes #1364 .
2011-09-26 21:01:23 +03:00
Shay Banon
e33dbcd93e
more small optimizations to term creation
2011-09-26 12:05:48 +03:00
Shay Banon
8658856b48
use index iteration over iterator
2011-09-25 22:20:53 +03:00
Shay Banon
18f15f0a6f
use index iteration over iterator
2011-09-25 22:17:09 +03:00
Shay Banon
f36d89c554
use index iteration over iterator
2011-09-25 21:28:55 +03:00
Shay Banon
9bea902966
allow to dynamically set cluster.routing.allocation.cluster_concurrent_rebalance using cluster update settings API
2011-09-25 21:12:17 +03:00
Shay Banon
fca3adcd59
allow to dynamically set cluster.routing.allocation.cluster_concurrent_rebalance using cluster update settings API
2011-09-25 21:09:41 +03:00
Shay Banon
e8b88acbd3
allow to dynamically set cluster.routing.allocation.cluster_concurrent_rebalance using cluster update settings API
2011-09-25 21:09:15 +03:00
Shay Banon
d7e3c9538f
remove unnecessary check
2011-09-24 16:57:14 +03:00
Shay Banon
9d9133a451
required _routing fails when path points to an integer field, closes #1357 .
2011-09-24 01:59:21 +03:00
Shay Banon
d954a93d9d
Malformed REST create index causes the index to still be created, closes #1359 .
2011-09-24 01:04:12 +03:00
Shay Banon
d9d452a1ef
Allow to disable shard allocations, closes #1358 .
2011-09-23 17:35:31 +03:00
Shay Banon
f74793c92a
improve multiple data locations when reading checksums and local gateway state files by going through all the locations to find them.
2011-09-23 17:08:21 +03:00
Shay Banon
d76d7d4a56
Support external versioning for deletes arriving before initial update, closes #1351 .
2011-09-23 00:56:02 +03:00
Shay Banon
8d7aaa704a
Allow to stripe the data location over multiple locations, closes #1356 .
2011-09-23 00:35:59 +03:00
Shay Banon
c1ca21f4d5
more internal refactoring in directory providers
2011-09-22 18:04:59 +03:00
Shay Banon
7ab128bbba
Put mapping on a single node with new mapping will not wait for the mapping to be applied, closes #1355 .
2011-09-22 16:02:18 +03:00
Shay Banon
f74fa7511b
better failure when failing to find mapping for the key field in data histogram
2011-09-22 13:53:40 +03:00
Shay Banon
55d112b043
Even shard count distribution counts relocations as two, closes #1354 .
2011-09-22 01:00:51 +03:00
Shay Banon
7adf2fd497
make last commit compile...
2011-09-22 00:30:05 +03:00
Njal Karevoll
6d975cd6b7
also use the time unit configured by numeric_resolution if fallbacking to parsing a timestamp number
2011-09-21 23:51:50 +03:00
Njal Karevoll
9bc9e3f0bd
use "numeric_resolution" instead of "numeric_precision" as the field name
2011-09-21 23:51:50 +03:00
Njal Karevoll
41dbcdb7d6
Give the date field mapping a "numeric_precision" argument that allows a user to configure the precision of the numeric timestamps.
...
Supports all the time units from http://download.oracle.com/javase/6/docs/api/java/util/concurrent/TimeUnit.html
2011-09-21 23:51:50 +03:00
Shay Banon
3f8b7f0fce
allow to change awareness settings using cluster update settings API
2011-09-21 23:48:23 +03:00
Shay Banon
44efcca108
automatic preference when using awareness attributes
2011-09-21 23:09:44 +03:00
Shay Banon
3028d5a7a1
Shard allocation awareness (rack aware, zone aware, for example), closes #1352 .
2011-09-21 18:26:16 +03:00
Njal Karevoll
6a6cba1ff3
include the path when serializing _id field mappings
2011-09-20 17:50:32 +03:00
Shay Banon
8c322b4cc2
use the same improved fields extraction in get api
2011-09-20 16:54:02 +03:00
Shay Banon
9a13763315
Improve source based fields loading when searching, closes #1347 .
2011-09-20 14:33:02 +03:00
Shay Banon
29d0bfdaa9
don't log delete of unused shard location if it does not exists
2011-09-19 17:50:41 +03:00
Shay Banon
dc85e227af
upgrade to latest jsr166 code
2011-09-18 21:50:16 +03:00
Shay Banon
f072c7e91b
add meter metric implementation
2011-09-18 21:35:01 +03:00
Shay Banon
52ca63deb9
move refreshing version table to be done right after the commit within the respective lock, for full flush (rarely used) its needed...
2011-09-18 16:13:05 +03:00
Shay Banon
b66a3b7c59
Realtime Get: Under high concurrent indexing and immediate get, a get might be missed while flushing, closes #1344 .
2011-09-18 13:44:35 +03:00
Shay Banon
305cf4a567
Bulk API: Properly retry execution on temporal state changes, closes #1343 .
2011-09-17 02:21:49 +03:00
Austin McKinley
0977b793da
adding timeout to list of connection failures
2011-09-17 00:50:51 +03:00
Shay Banon
5ba6ec5a69
Versioning: Delete on an already deleted document should still affect versioning, closes #1341 .
2011-09-17 00:50:10 +03:00
Shay Banon
bdfa07934e
refactor creation of lucene directory and simplify different directories implemenation strcture
2011-09-16 18:39:23 +03:00
Shay Banon
a7e43005bb
Rest Delete API does not honor the `version_type` parameter, closes #1337 .
2011-09-15 17:07:04 +03:00
Shay Banon
25c6e8512d
fix full flush when no changes happen in the index, so the updated trans id is not written
2011-09-15 14:56:37 +03:00
Shay Banon
28f56262bc
use a simpler API call
2011-09-15 14:01:45 +03:00
Shay Banon
639515c240
Optimizing inactive (indexing wise) shard to only happen when there are no ongoing merges, closes #1336 .
2011-09-15 12:21:12 +03:00
Shay Banon
74079c8a13
Upgrade to Lucene 3.4.0, closes #1335 .
2011-09-15 12:16:58 +03:00
Shay Banon
3eaf73a380
Add number of committed and number of search segments to the segments API response
2011-09-14 20:48:02 +03:00
Shay Banon
e2b1cb1640
Allow to filter geo bounding box or distance based on indexed lat lon, closes #1334 .
2011-09-14 14:27:39 +03:00
Shay Banon
a8fc0cbcf3
when setting null value ttl, reset it
2011-09-13 21:43:56 +03:00
Benjamin Devèze
e52dbf4fda
fix bug when adding to BulkRequest with no TTL, add simple unit test for that
2011-09-13 21:41:13 +03:00
Shay Banon
a84eb1fc8f
Rivers: Close rivers early allowing them to still do index operations, closes #1330 .
2011-09-13 02:15:50 +03:00
Shay Banon
847938a88e
XContentBuilder.field : StackOverflowError with Integer[] parameters, closes #1324 .
2011-09-12 22:44:55 +03:00
Shay Banon
36f364c998
revert back to 5gb from 20gb (the lucene default) to create less confusion
2011-09-12 21:38:27 +03:00
Shay Banon
c62f476fa6
Indexation of document causes NullPointerException (on Linux) or ES process hanging, closes #1325 .
2011-09-12 21:35:45 +03:00
Shay Banon
d8377074a4
expose meteData directory
2011-09-12 21:33:33 +03:00
Shay Banon
93b1759804
Nested Mapping: Nested object with a null value causes wrong indexing structure (resulting in wrong search responses), closes #1323 .
2011-09-12 11:23:20 +03:00
Shay Banon
8fe1e5cdb8
upgrade to trove 3.0.0
2011-09-12 10:21:10 +03:00
Shay Banon
e6f277474e
Thread Pool: Blocking thread pool type configuration fails, closes #1321 .
2011-09-11 01:06:57 +03:00
Shay Banon
8532dc84e9
Query with stopwords executed directly against a type fails, closes #1320 .
2011-09-11 00:53:39 +03:00
Benjamin Devèze
4279016f30
add default ttl value support
2011-09-09 15:35:01 +03:00
Shay Banon
052f9aac1f
allow to force flush and use it when optimizing
2011-09-09 15:21:22 +03:00
Shay Banon
bf70836e92
don't do double int[] lookup for ordinal
2011-09-09 14:06:54 +03:00
Shay Banon
84ae001731
if ttl field mappers don't exists (yet), ignore it for that shard
2011-09-09 13:31:40 +03:00
Shay Banon
100df0dca8
Merge branch 'ttl-time-value-source' of https://github.com/Paikan/elasticsearch
2011-09-09 13:09:57 +03:00
Shay Banon
9ff4a95ee4
allow to filter also by node _name and _id, make sure to reroute properly after cluster update settings
2011-09-09 13:09:08 +03:00
Benjamin Devèze
fae6eaf690
add time value definition of ttl inside source
2011-09-09 11:35:15 +02:00
Shay Banon
d00edfb165
better check for defaults on jline, only enable it if not on windows
2011-09-09 10:59:35 +03:00
Shay Banon
0fcb4e88d4
cleanup ttl support, make sure we close the service on node lifecycle, better settings names, and allow to provide the ttl as a time value
2011-09-09 01:21:05 +03:00
Benjamin Devèze
65aad2da1e
add per doc ttl support
2011-09-09 00:03:40 +03:00
Shay Banon
5052282ab6
Cluster / Index level allocation filtering, closes #1311 .
2011-09-08 14:29:08 +03:00
Shay Banon
4180a7f73a
associate a DiscoveryNode instance with RoutingNode, so there is no need to look it up based on node id
2011-09-08 11:10:53 +03:00
Shay Banon
60933b0f1e
reroute after setting cluster level settings
2011-09-08 10:54:07 +03:00
Shay Banon
bcd4ef2823
custom nodes count
2011-09-07 20:38:48 +03:00
Shay Banon
60a73c475f
dynamic settings validation to allow for simple match patterns
2011-09-06 22:01:25 +03:00
Shay Banon
6a78cc2b72
fix wrong removal of flag
2011-09-06 21:10:54 +03:00
Lukáš Vlček
3d09fdee27
adding method allowing default value
2011-09-06 20:28:06 +03:00
Shay Banon
17c285090f
remove double setting clear
2011-09-06 20:13:06 +03:00
Jürgen Kartnaller
d276809822
fix clear for FieldLookup values
2011-09-06 20:12:50 +03:00
Shay Banon
203564a5b0
externalize shard allocation decision to a separate module
2011-09-06 17:51:11 +03:00
Shay Banon
d86c116273
extract logic of allocation to a separate module
2011-09-06 17:11:55 +03:00
Njal Karevoll
37f08ea8b8
Fix some typos:
...
hypennation_decompunder -> hyphenation_decompounder
only_longest_max -> only_longest_match
2011-09-06 15:23:48 +03:00
Shay Banon
b653d149d1
Peer recovery: Allow to throttle recovery based on "size per sec", closes #1304 .
2011-09-06 12:40:14 +03:00
Shay Banon
8ebbd1e7b9
Recovery Settings: Change settings (still support old settings) and allow for more dynamic settings, closes #1303 .
2011-09-06 11:21:32 +03:00
Shay Banon
9f427010bf
more to ABQ from LBQ is relevant places
2011-09-05 12:34:20 +03:00
Shay Banon
dee1addc17
Indices / Node Stats: Shard level search stats, closes #1301 .
2011-09-04 23:55:35 +03:00
Benjamin Devèze
8958e9fd4a
fix bug in parent handling where the parsed parent value was not set in the SourceToParse
2011-09-04 17:35:23 +03:00
Shay Banon
bcd7d97c58
only log async refresh / merge failure if the engine is not closed
2011-09-03 20:24:55 +03:00
Shay Banon
ed99a51406
ifx possible NPE when asking for _parent without parent mapping
2011-09-02 12:58:20 +03:00
Shay Banon
63f2e84535
Negative total cpu time reported by the node stats REST API, closes #1297 .
2011-09-02 10:13:26 +03:00
Shay Banon
8facdb2e3d
Rapidly concurrent deleting/creating an index leaves index inconsistent, closes #1296 .
2011-09-02 09:36:25 +03:00
Shay Banon
a8baec6960
improve logging of failure when merging
2011-09-01 23:32:26 +03:00
Shay Banon
d7943e8ebd
fix some highlighting encoder issues
2011-09-01 22:14:47 +03:00
LocJayMP
c0f8223a6c
adding escape html ability
2011-09-01 21:50:49 +03:00
Shay Banon
2bc2b3f4e2
add percolate api to groovy client
2011-09-01 21:10:46 +03:00
Shay Banon
b888684ff6
negative from parameter yields undescriptive error message, closes #1293 .
2011-09-01 19:25:04 +03:00
Shay Banon
87049d0d29
initialize the transport adapter on creation so asking for stats will not NPE
2011-09-01 19:18:28 +03:00
Shay Banon
3ae40487b6
Using 57744018578214912 as an id can cause failure to route to the correct shard, closes #1294 .
2011-09-01 18:33:44 +03:00