Commit Graph

3010 Commits

Author SHA1 Message Date
Martijn van Groningen 2d6adf6428 Percolator refactoring:
* Added percolator field mapper that extracts the query terms and indexes these terms with the percolator query.
* At percolate time these extracted terms are used to query percolator queries that are like to be evaluated. This can significantly cut down the time it takes to percolate. Whereas before all percolator queries were evaluated if they matches with the document being percolated.
* Changes made to percolator queries are no longer immediately visible, a refresh needs to happen before the changes are visible.
* By default the percolate api only returns upto 10 matches instead of returning all matching percolator queries.
* Made percolate more modular, so that it is easier to add unit tests.
* Added unit tests for the percolator.

Closes #12664
Closes #13646
2016-01-06 16:08:10 +01:00
Colin Goodheart-Smithe 2c33f78192 Merge branch 'master' into feature/aggs-refactoring
# Conflicts:
#	core/src/main/java/org/elasticsearch/search/aggregations/bucket/children/ChildrenParser.java
#	core/src/main/java/org/elasticsearch/search/aggregations/support/ValuesSourceParser.java
#	test/framework/src/main/java/org/elasticsearch/test/TestSearchContext.java
2016-01-06 09:35:53 +00:00
Igor Motov a89dba27c2 Task Management: Add framework for registering and communicating with tasks
Adds task manager class and enables all activities to register with the task manager. Currently, the immutable Transport*Activity class represents activity itself shared across all requests. This PR adds and an additional structure Task that keeps track of currently running requests and can be used to communicate with these requests using TransportTaskAction.

Related to #15117
2016-01-05 12:24:43 -05:00
Simon Willnauer ea2a8150d3 Merge pull request #15692 from s1monw/issues/15675
Fix pharse suggest collate example to use correct script context/syntax
2016-01-05 09:27:18 +01:00
Adrien Grand 1a47226d9a Merge pull request #15663 from jpountz/remove/mapping_backcompat
Remove mapping backward compatibilit with pre-2.0.
2016-01-04 10:05:39 +01:00
Adrien Grand 6d3c9b074c Remove support for the `multi_field` type.
It is officially unsupported since version 1.0.
2015-12-30 12:03:15 +01:00
Simon Willnauer 3b06cd8d92 Fix pharse suggest collate example to use correct script context/syntax
Closes #15675
2015-12-29 09:22:36 +01:00
Robert Muir 180ab2493e Improve thirdPartyAudit check, round 3 2015-12-28 22:38:55 -05:00
Adrien Grand af122f4151 Remove mapping backward compatibilit with pre-2.0.
This removes the backward compatibility layer with pre-2.0 indices, notably
the extraction of _id, _routing or _timestamp from the source document when a
path is defined.
2015-12-24 13:47:37 +01:00
Adrien Grand d8d8666877 Remove `index_name` back compat.
Since 2.0 we enforce that fields have the same full and index names. So in 3.x
we can remove the ability to have different names on the same field.
2015-12-23 14:55:26 +01:00
Adrien Grand cf52e96c42 Upgrade to lucene-5.5.0-snapshot-1721183.
Some files that implement or use the Scorer API had to be changed because of
https://issues.apache.org/jira/browse/LUCENE-6919.
2015-12-21 17:02:08 +01:00
Colin Goodheart-Smithe 97c2f7b037 Aggregations Refactor: Refactor Histogram and Date Histogram Aggregation 2015-12-21 09:34:05 +00:00
Ryan Ernst 4ea19995cf Remove wildcard imports 2015-12-18 12:43:47 -08:00
Colin Goodheart-Smithe 15588a4991 Aggregations: Run pipeline aggregations for empty buckets added in the Range Aggregation
Closes #15471
2015-12-18 14:42:05 +00:00
Adrien Grand 6ea16671f4 Simplify the Text API.
We have the Text API, which is essentially a wrapper around a String and a
BytesReference and then we have 3 implementations depending on whether the
String view should be cached, the BytesReference view should be cached, or both
should be cached.

This commit merges everything into a single Text that is essentially the old
StringAndBytesText impl.

Long term we should look into whether this API has any performance benefit or
if we could just use plain strings. This would greatly simplify all our other
APIs that currently use Text.
2015-12-17 17:22:38 +01:00
Robert Muir a7cc91e868 Merge pull request #15501 from rmuir/sheisty_classes
thirdPartyAudit round 2
2015-12-17 03:44:27 -05:00
Robert Muir 6692e42d9a thirdPartyAudit round 2
This fixes the `lenient` parameter to be `missingClasses`. I will remove this boolean and we can handle them via the normal whitelist.
It also adds a check for sheisty classes (jar hell with the jdk).
This is inspired by the lucene "sheisty" classes check, but it has false positives. This check is more evil, it validates every class file against the extension classloader as a resource, to see if it exists there. If so: jar hell.

This jar hell is a problem for several reasons:

1. causes insanely-hard-to-debug problems (like bugs in forbidden-apis)
2. hides problems (like internal api access)
3. the code you think is executing, is not really executing
4. security permissions are not what you think they are
5. brings in unnecessary dependencies
6. its jar hell

The more difficult problems are stuff like jython, where these classes are simply 'uberjared' directly in, so you cant just fix them by removing a bogus dependency. And there is a legit reason for them to do that, they want to support java 1.4.
2015-12-17 02:35:00 -05:00
Jack Conradson 4523eaec88 Added plumbing for compile time script parameters.
Closes #15464
2015-12-16 18:29:21 -08:00
Robert Muir 4f9d4103f2 Merge pull request #15491 from rmuir/forbidden_third_party
Add gradle thirdPartyAudit to precommit tasks
2015-12-16 18:56:50 -05:00
Robert Muir 42138007db add some more comments about internal api usage 2015-12-16 18:56:02 -05:00
Robert Muir ee79d46583 Add gradle thirdPartyAudit to precommit tasks 2015-12-16 16:38:16 -05:00
Ryan Ernst a2b8f4b90a Merge pull request #15434 from rjernst/http_type
Expose http.type setting, and collapse al(most all) modules relating to transport/http
2015-12-16 11:54:30 -08:00
Adrien Grand 5d5c6591aa Validate that fields are defined only once.
There are two ways that a field can be defined twice:
 - by reusing the name of a meta mapper in the root object (`_id`, `_routing`,
   etc.)
 - by defining a sub-field both explicitly in the mapping and through the code
   in a field mapper (like ExternalMapper does)

This commit adds new checks in order to make sure this never happens.

Close #15057
2015-12-15 10:37:18 +01:00
Ryan Ernst 60d35c81af Plugins: Expose http.type setting, and collapse al(most all) modules relating to transport/http
This change adds back the http.type setting. It also cleans up all the
transport related guice code to be consolidated within the
NetworkModule (as transport and http related stuff is what and how ES
exposes over the network). The setter methods previously used by some
plugins to override eg the TransportService or HttpServerTransport are
removed, and those plugins should now register a custom implementation
of the class with a name and set that using the appropriate config
setting. Note that I think ActionModule should also be moved into here,
to sit along side the rest actions, but I left that for a followup.

closes #14148
2015-12-14 22:01:04 -08:00
Jason Tedor 11cbc08e45 Fix compilation in o.e.m.t.SimpleSortTests 2015-12-11 11:46:50 -05:00
Jason Tedor 3383c24be0 Remove and forbid use of Collections#shuffle(List) and Random#<init>()
This commit removes and now forbids all uses of
Collections#shuffle(List) and Random#<init>() across the codebase. The
rationale for removing and forbidding these methods is to increase test
reproducibility. As these methods use non-reproducible seeds, production
code and tests that rely on these methods contribute to
non-reproducbility of tests.

Instead of Collections#shuffle(List) the method
Collections#shuffle(List, Random) can be used. All that is required then
is a reproducible source of randomness. Consequently, the utility class
Randomness has been added to assist in creating reproducible sources of
randomness.

Instead of Random#<init>(), Random#<init>(long) with a reproducible seed
or the aforementioned Randomess class can be used.

Closes #15287
2015-12-11 11:16:38 -05:00
Robert Muir 1e8f9558a0 Remove now-dead code in expressions (fixed in https://issues.apache.org/jira/browse/LUCENE-6920) 2015-12-10 14:50:32 -05:00
Robert Muir 2741888498 Remove RuntimePermission("accessDeclaredMembers")
Upgrades lucene to 5.5.0-1719088, randomizedtesting to 2.3.2, and securemock to 1.2
2015-12-10 14:26:55 -05:00
Robert Muir e454fadc22 Merge branch 'master' into shave_mustache 2015-12-10 07:58:24 -05:00
Areek Zillur 025e9818e7 Refactors TransportReplicationAction to decouple request routing and shard operation logic 2015-12-10 01:32:07 -05:00
Robert Muir 61266dee19 mark messy rest test as messy and add to messy tests lists 2015-12-09 19:21:35 -05:00
Ryan Ernst 74dc5bf20a Fix template query parser tests to register mustache script engine 2015-12-08 21:33:48 -08:00
Ryan Ernst b7fb0824be Fix render search template tests 2015-12-08 21:33:48 -08:00
Robert Muir a6e1655fe9 fix integ tests 2015-12-09 00:30:32 -05:00
Robert Muir 17436d4332 get gradle check passing for lang-mustache 2015-12-09 00:10:37 -05:00
Robert Muir 3632ddf497 split out mustache methods so groovy works again 2015-12-09 00:00:40 -05:00
Ryan Ernst 907d3cf878 move template query builder tests back to core (using mockscript) 2015-12-08 20:26:45 -08:00
Robert Muir 2e299860e5 refactor mustache to lang-mustache plugin. No rest tests yet. 2015-12-08 22:45:21 -05:00
Robert Muir 3c419c2186 do expressions consistently with other engines 2015-12-05 22:08:40 -05:00
Robert Muir 2169a123a5 Filter classes loaded by scripts
Since 2.2 we run all scripts with minimal privileges, similar to applets in your browser.
The problem is, they have unrestricted access to other things they can muck with (ES, JDK, whatever).
So they can still easily do tons of bad things

This PR restricts what classes scripts can load via the classloader mechanism, to make life more difficult.
The "standard" list was populated from the old list used for the groovy sandbox: though
a few more were needed for tests to pass (java.lang.String, java.util.Iterator, nothing scary there).

Additionally, each scripting engine typically needs permissions to some runtime stuff.
That is the downside of this "good old classloader" approach, but I like the transparency and simplicity,
and I don't want to waste my time with any feature provided by the engine itself for this, I don't trust them.

This is not perfect and the engines are not perfect but you gotta start somewhere. For expert users that
need to tweak the permissions, we already support that via the standard java security configuration files, the
specification is simple, supports wildcards, etc (though we do not use them ourselves).
2015-12-05 21:46:52 -05:00
Robert Muir 46377778a9 Merge branch 'master' into getClassLoader 2015-12-04 15:58:36 -05:00
Robert Muir 7160c5ec15 list modules separately in pluginservice 2015-12-04 01:13:17 -05:00
Ryan Ernst a8e9403204 added gradle checks for modules configuration, and ability to add
modules to integ test cluster
2015-12-03 20:53:06 -08:00
Ryan Ernst 0a4a81afaf Added modules, distributions now include them (just plugins installed in
a diff dir)
2015-12-03 14:18:26 -08:00
Shay Banon bf0caafa04 remove old modules and gradle 2011-12-06 01:01:04 +02:00
Shay Banon a8fd2d48b8 first cleanup phase, move to single src 2011-12-06 00:59:23 +02:00
Shay Banon 9995d27841 Analysis: Add arabic, brazilian, czech to stemmer token filter language options, closes #1519. 2011-12-04 16:36:42 +02:00
Shay Banon 720954d8a6 Version missing a space, closes #1517. 2011-12-04 12:48:29 +02:00
Shay Banon 032e215f25 search missing from stats when using clear and search params, closes #1516. 2011-12-02 12:32:51 +02:00
Shay Banon be282cc4c8 Improve highlighting perf (a bit) by reusing some constructs across hits, closes #1513. 2011-11-30 19:15:31 +02:00
Shay Banon c93ddd9b61 check against hte fieldName... 2011-11-30 13:34:21 +02:00
Shay Banon 6c552b4187 have DocSet implement Bits interface 2011-11-29 23:53:38 +02:00
Shay Banon a21c0829c7 Query DSL: Bool filter does not take should clauses properly into account, closes #1511. 2011-11-29 22:39:07 +02:00
Shay Banon 76307a5e73 cleanup 2011-11-29 21:28:07 +02:00
Shay Banon e9d2f44d49 Query DSL: Bool filter does not take should clauses properly into account, closes #1511. 2011-11-29 21:27:36 +02:00
Shay Banon de49a313c5 Query DSL: Bool filter does not take should clauses properly into account, closes #1511. 2011-11-29 21:23:41 +02:00
Shay Banon 9bb9ce4e84 add 0.18.6 2011-11-29 13:55:11 +02:00
Shay Banon ae4ae598e3 make node closed exception serializable 2011-11-29 10:18:13 +02:00
Shay Banon b2fa6b7a94 When _source is disabled, don't return it in realtime get fetching the document from the transaction log, closes #1509. 2011-11-29 09:39:46 +02:00
Shay Banon e9fe8ec469 sync with latest Lucene block join, init parentDoc to -1, which makes the assert commented out valid again 2011-11-28 23:47:31 +02:00
Shay Banon 6b894d9f53 add the option to get mapping as a parsed map, also do some internal refactoring to share the code that parses into a map 2011-11-28 20:19:02 +02:00
Njal Karevoll b1707d219f set "http" on NodeInfo instances if it is passed in the constructor 2011-11-28 17:08:28 +02:00
Shay Banon d5aa7574f3 Upgrade to netty 3.2.7, closes #1506. 2011-11-28 14:48:49 +02:00
Shay Banon 4be7866bd9 Registering a percolate query with additional "object" level metadata can fail, closes #1505. 2011-11-27 18:06:18 +02:00
Shay Banon 32f1edf6f7 Analysis: Add language setting to lowercase filter, supporting greek and turkish, closes #1503. 2011-11-27 13:39:05 +02:00
George Chatzigeorgiou a1a856e4b9 Support Greek stemming
While the GreekAnalyzer supports stemming, custom analyzers for the greek language cannot be build because there is no GreekStemmer (although lucene has one).
2011-11-27 13:22:58 +02:00
Shay Banon f18ad903a9 Upgrade to Lucene 3.5, closes #1502. 2011-11-27 12:57:26 +02:00
Shay Banon fd5d754fe6 better failure messages when dynamic mapping is disabled 2011-11-25 09:40:44 +02:00
Shay Banon a7803855a1 add another path trie test 2011-11-25 00:21:01 +02:00
Shay Banon 3f835eb780 even though it can't happen (offset is 0 when loading from the index), use properly the field to get binary values with offset and length 2011-11-24 21:44:18 +02:00
Shay Banon 21988a0ca7 support compressed percolator index 2011-11-24 21:32:56 +02:00
Shay Banon ac2c2fb48d enable unsafe optimization in lzf for 0.19 2011-11-24 20:12:51 +02:00
Shay Banon 03c2e5ea52 improve how decoding is done on the transport layer, embedding FrameDecoder into the message handler, and reducing allocation of buffers and better guess into allocating cumalation buffers 2011-11-24 20:03:25 +02:00
Shay Banon f0efb8cdea Using _parent:123 in a query string query fails to fetch docs, closes #1497. 2011-11-24 13:59:10 +02:00
Shay Banon 81965d0ea9 Support using _id:1234, or using term query/filter on _id even when _id is not indexed, closes #1496. 2011-11-24 12:31:50 +02:00
Shay Banon daa4444e22 DocumentMapper.java wrong order on build rootMappers, closes #1493. 2011-11-24 09:58:05 +02:00
Shay Banon 2c0662e18e Query DSL: indices query to allow to set a `no_match_query`, closes #1492. 2011-11-23 19:01:14 +02:00
Shay Banon f47b77199d Multi field mapper with more than one extra mapping can cause endless re-sync'ing of mapping between nodes, closes #1487. 2011-11-23 09:04:28 +02:00
Shay Banon 05f98634d8 IndicesQueryBuilder generates the wrong query name, closes #1485. 2011-11-22 15:57:54 +02:00
Shay Banon f28c11b31c By default, set http.compression to false, closes #1482. 2011-11-21 19:50:24 +02:00
Shay Banon bff980c797 Allow empty Strings to be null for Number's and don't autodetect empty string fields as string types, closes #1473. 2011-11-21 18:02:12 +02:00
Shay Banon fbb03c611a add a sleep to fix test (need to think of a better fix) 2011-11-21 10:44:29 +02:00
Shay Banon b10094b109 support boost on block join query (nested) 2011-11-21 10:43:58 +02:00
Shay Banon 90af54dad5 make sure bulk item failure on primary shards will not execute on a replica shard 2011-11-20 15:09:13 +02:00
Shay Banon bb8ff3814e Binary field compression causes wrong _source decoding, closes #1475. 2011-11-20 12:59:22 +02:00
Jeremie BORDIER 6403a42e31 * Try to extract value from String using FieldMapper when reading from the transaction log. 2011-11-17 18:54:41 +02:00
Shay Banon 4d607bdd4a handle valueForString in binary case 2011-11-17 18:19:16 +02:00
Shay Banon c8641588ec clean code, script service no longer used in get action 2011-11-17 15:48:05 +02:00
Shay Banon 835dc33d45 make sure we use the default index analyzer for _all field, even though it works well without it now because the _analyzer field comes before it and sets the context.analyzer 2011-11-17 15:37:51 +02:00
Shay Banon b0880e114e add another instanceof check on Date and not direct check 2011-11-17 14:27:40 +02:00
Shay Banon 09fe743790 add another instanceof check on Date and not direct check 2011-11-17 14:27:16 +02:00
Shay Banon 118acb3992 add 0.18.5 version 2011-11-16 22:00:13 +02:00
Shay Banon b0fc243138 add 0.18.4 version 2011-11-16 15:23:58 +02:00
Shay Banon 72d2fd0da0 Inner queries not resolved correctly in has_child filter when searching directly against the parent type (in the URI for example), closes #1471. 2011-11-16 14:15:29 +02:00
Shay Banon b5a0ae2fbe better toString for custom score query 2011-11-15 22:20:15 +02:00
Shay Banon e52ec518f3 NPE when highlighting 2011-11-15 18:11:03 +02:00
Shay Banon afb690e233 refactor sub fetch phase to also allow for hits level execution 2011-11-15 18:09:45 +02:00
Shay Banon 537d9c5db0 FVH should use the parsed query, and not a possible rewritten query 2011-11-15 16:45:05 +02:00
Shay Banon 8f392af207 upgrade to mvel 2.1 Beta7 2011-11-15 16:23:13 +02:00
Shay Banon 8d0ac1787b upgrade to jackson 1.9.2 2011-11-15 15:53:18 +02:00
Shay Banon a6a2a264c3 Highlighting on term vector enabled field should not highlight filters by default, closes #1469. 2011-11-15 13:42:15 +02:00
Shay Banon b8fe9999e0 XContentBuilder to handle extended classes of java.util.Date, closes #1465. 2011-11-15 11:34:32 +02:00
Shay Banon abaf4b5196 Indices Stats API: Providing groups as part of the HTTP API does not return stats for those groups, closes #1468. 2011-11-15 10:31:55 +02:00
Igor Motov 0d714d580f Add counts of currently executing get operations 2011-11-15 10:21:10 +02:00
Shay Banon 9bf42fed1b Nested facet execution can fail with ArrayIndexOutOfBounds, closes #1467. 2011-11-15 09:23:56 +02:00
Shay Banon dc2824fe06 apply fix to unsafe decoder in lzf, still use vanilla for now 2011-11-15 08:46:05 +02:00
Shay Banon 73ba30b18a Date Range: Inclusive upper range does not round up properly, closes #1463. 2011-11-14 17:16:42 +02:00
Shay Banon ed281fbfd5 Index shard search slow log (query and fetch), closes #1462. 2011-11-14 14:10:39 +02:00
Shay Banon b43c8fe128 get should report time in millis, but return in nanoseconds 2011-11-14 10:40:05 +02:00
Igor Motov 62d67e6c2d Add counts of currently executing index, delete, query and fetch operations 2011-11-14 10:24:50 +02:00
Shay Banon eefbe52580 disable optimized decoder by default 2011-11-14 10:10:22 +02:00
Shay Banon eb1b0b150f Using root object level mapping (_size, _source) can cause reparsing of the mapping on startup, close #1458. 2011-11-13 20:56:16 +02:00
Shay Banon 3da6e0a5b0 Percolate / Analyzer API can hang if it fails to execute, closes #1457. 2011-11-13 19:54:13 +02:00
Jeremie BORDIER 28c9595af3 * Add support for LZF compression on binary fields. 2011-11-13 14:32:53 +02:00
Shay Banon 4bbf29834e upgrade to lzf compress 0.9 2011-11-13 14:06:09 +02:00
Shay Banon 27a7b0680c fix top_terms_boost parsing for multi term rewrite 2011-11-13 12:51:10 +02:00
Igor Motov 9cc0b7a28b Fix processing of regex patterns in large terms facet requests 2011-11-13 12:49:12 +02:00
Shay Banon a3978402e5 add the search request to the search context 2011-11-13 12:48:17 +02:00
Shay Banon f4adff652c Blank routing should be ignored, closes #1450. 2011-11-13 12:04:02 +02:00
Shay Banon da98aab13f also support _percolate for bulk item requests 2011-11-13 10:19:05 +02:00
Shay Banon 21c4530aaf Search: Search requests execute by mistake on the networking http IO thread, causing other http operations to hang, closes #1455. 2011-11-11 22:22:21 +02:00
Shay Banon 99d31cc8c8 better handlign of open channels 2011-11-11 22:22:15 +02:00
Shay Banon 93f1d50c18 configure the scheduled TP to not wait for delayed execution, so we shutodown faster 2011-11-10 21:52:42 +02:00
Shay Banon 68c8cac852 AbstractCompoundWordTokenFilterFactory should store the dictionary as a CharArraySet instance, not a Set, closes #1449. 2011-11-10 20:12:35 +02:00
Shay Banon 15c798fb4c fix minimum_should_match in query_string builder 2011-11-10 12:13:31 +02:00
Shay Banon c4542c8349 increase search stats rounds to make sure the stats are higher than 0 2011-11-10 12:01:39 +02:00
Shay Banon 62bc0836c1 improve boolean filter 2011-11-10 12:00:43 +02:00
Igor Motov ed8c289dec Log warning when application of an updated cluster state fails with an exception 2011-11-10 10:12:58 +02:00
Igor Motov e7baf30bd2 Fix reporting of total indexing stats 2011-11-10 10:07:10 +02:00
Igor Motov eafa2b0c9a Fix possible NPE in TransportNodesListGatewayStartedShards operation 2011-11-10 10:04:11 +02:00
Shay Banon c5ebe6e86f Mapping: Improve applying guessed types on dynamic templates, closes #1446. 2011-11-09 09:02:20 +02:00
Shay Banon 75f522adaa data.path locations are unevenly filled (0.18.2), closes #1436. 2011-11-02 23:45:35 +02:00
Igor Motov 3c2dd959cb Aliases should be processed when index routing changes 2011-11-01 20:05:46 +02:00
Shay Banon ca7247e1b1 add more details logging on info of data path 2011-10-28 07:45:17 +02:00
Shay Banon 65a525bb15 add 0.18.3 2011-10-27 20:42:43 +02:00
Shay Banon 723d2e8b15 Search: Fetching fields that end up extracted from source might fail, closes #1431. 2011-10-27 20:28:38 +02:00
Shay Banon 8922d5b073 Merge Scheduler: Allow to set index.merge.scheduler.max_merge_count, closes #1430. 2011-10-27 02:14:47 +02:00
Shay Banon efffcf2b26 add 0.18.2 option 2011-10-27 01:43:08 +02:00
Shay Banon 99e2bb270c External data location configuration fails (path.data setting), closes #1429. 2011-10-27 01:30:33 +02:00
Shay Banon 49a97f6fcf move to 0.19.0 snap 2011-10-26 21:04:10 +02:00
Shay Banon 3544b07330 release 0.18.0 2011-10-26 20:58:24 +02:00
Shay Banon 0cde90fcb1 minimum_number_should_match in a query_string, closes #1420. 2011-10-26 01:58:12 +02:00
Shay Banon b652c655d2 Highlighting broken with custom_filters_score query, closes #1425. 2011-10-26 00:58:52 +02:00
Shay Banon 2778a6756c indexing option ignored in index_stats, closes #1423. 2011-10-25 20:20:43 +02:00
Shay Banon f9d0e82389 if source is not stored, treat it as an empty map in things like scripts or non stored field extraction 2011-10-25 20:18:53 +02:00
Shay Banon 8d08a66e66 make flags public just so people can hack it if needed 2011-10-25 19:01:12 +02:00
Shay Banon 6f39fce41f First indexing fails when indexing a type with an attachment field mapped using a dynamic template, closes #1418. 2011-10-25 01:40:27 +02:00
Shay Banon 3f4eea469c better failure message if a type parser is not found with dynamic tempaltes 2011-10-25 01:10:49 +02:00
Shay Banon 3210785bf4 upgrade to jackson 1.9.1 2011-10-25 00:30:05 +02:00
Shay Banon fd23d16eaa Mapping: Allow to include / exclude specific parts of it when storing it, closes #1421. 2011-10-25 00:01:58 +02:00
Shay Banon dec8dc5bec Bool Filter fails with ArrayIndexOutOfBoundsException, closes #1419. 2011-10-24 00:30:30 +02:00
Shay Banon d8f426a166 remove unused class 2011-10-23 23:41:18 +02:00
Shay Banon a360cc4c4a on multiple data locations, write the state files of local gateway on all locations 2011-10-23 22:57:37 +02:00
Shay Banon b2b608f9dc Query DSL: Indices query type, closes #1416. 2011-10-23 01:35:09 +02:00
Shay Banon 721f315210 handle also illegal state case to see if OOM happened within the index writer 2011-10-21 20:18:57 +02:00
Hiroyuki Ikezoe 6444335f06 Use CJKAnalyzer instead of ChineseAnalyzer
Signed-off-by: Hiroyuki Ikezoe <hiikezoe@gnome.org>
2011-10-21 20:04:32 +02:00
Shay Banon 932215d6fa rename check setting to check on startup 2011-10-20 16:17:38 +02:00
Shay Banon ff977926a9 add equals support to index metadata 2011-10-20 00:51:24 +02:00
Lukas Vlcek 54273dd1ee Added tests for synonym parsers. 2011-10-19 23:38:15 +02:00
Lukáš Vlček f7747d7ff9 Adding Wordnet synonym format 2011-10-19 23:38:14 +02:00
Shay Banon 0f2b875df9 better failure message when failing to get a node lock 2011-10-19 23:12:01 +02:00
Shay Banon 9396735925 Script sorting doesn't accept parameters, closes #1382. 2011-10-18 22:31:20 +02:00
Shay Banon 724611f249 don't clear on both obtain and release for the search cache 2011-10-18 19:21:06 +02:00
Shay Banon 4ffbdbeaea better failure message for sorting when mapping is not found 2011-10-18 05:54:40 +02:00
Shay Banon b113eb18fe builder based search source is safe now 2011-10-18 05:53:53 +02:00
Shay Banon 184a38439f Search: A failed search request might get overrun when trying another shard, closes #1403. 2011-10-18 05:31:12 +02:00
Shay Banon 673655cc7b When searching against an index/type, use the type information to derive different search aspects, closes #1391. 2011-10-18 01:26:53 +02:00
Shay Banon 6a146e7ad0 When searching against an index/type, use the type information to derive different search aspects, closes #1391. 2011-10-18 00:38:29 +02:00
Shay Banon 325064c7aa add static close methods to main class entry point 2011-10-17 20:25:41 +02:00
Shay Banon bfb4666b3d remove casting 2011-10-17 00:43:25 +02:00
Shay Banon bcd582b8c1 add internal cluster reroute api 2011-10-16 19:02:32 +02:00
Shay Banon 1047cebabe replication base classes to allow for different implementation of the primary request and the replica request 2011-10-16 17:25:31 +02:00
Shay Banon 72ad722480 Array out-of-bounds exception with bool filter, closes #1400. 2011-10-15 15:35:14 +02:00
Erick Tryzelaar b2769b1086 multi_get ids shortcut should grab custom fields. 2011-10-15 11:56:55 +02:00
Shay Banon 6b497589ce rest _count endpoint to also allow for no query provided (defaults to match_all) 2011-10-14 17:53:27 +02:00
Shay Banon a76737ceaf also ignore index missing failure when refreshing, as it might happen (we refresh on shards that might have not been allocated yet) 2011-10-14 17:50:02 +02:00
Shay Banon dee4b42b16 Exception: TokenStream implementation classes or at least their incrementToken() implementation must be final, closes #1397. 2011-10-14 16:56:53 +02:00
Shay Banon 24f1f0ff96 improve refreshing logic to resync mappings on upgrade, reduce the amount of cluster events processing requires if the even if fired from several nodes / sources 2011-10-14 15:20:38 +02:00
Shay Banon ffc74260ac Synonym filter fails to properly load synonyms (since 0.17.7), closes #1392. 2011-10-13 00:18:01 +02:00
Shay Banon 19ff93b09a all field mapper should be "included in root object" 2011-10-12 22:50:16 +02:00
Shay Banon 0367103423 Text Query does not use search_analyzer on field that is prefixed with the type name, closes #1390. 2011-10-12 22:14:03 +02:00
Shay Banon 1012f6a3ea Root mapper analyzer/index_analyzer/search_analyzer with unregistered analyzer name won't fail, closes #1389. 2011-10-12 21:41:27 +02:00
Shay Banon bb9d8fe342 Search / Get Preference: Add _only_node:[node_id] option, closes #1388. 2011-10-12 21:11:12 +02:00
Igor Motov bd87f8de3a Fix NPE in HighlightField serialization. Fixes #1380 2011-10-08 20:54:56 +02:00
Shay Banon 4bbe1b111a count doesn't work for empty query (discrepancy with search API), closes #1377. 2011-10-06 21:57:19 +02:00
Shay Banon 768c6d2922 fix buffer recycler in lzf 2011-10-06 20:40:43 +02:00
Shay Banon 9c6dfc1508 now that the change to refresh can execute on not yet active shards, we need to ignore illegal shard state failures (expected...) 2011-10-05 23:35:07 +02:00
Shay Banon d69baa3e04 when writing _river status, use consistency of one 2011-10-05 19:12:21 +02:00
Shay Banon 8f55e8835f when getting the _meta doc from _river index (per river), make sure the callback listener is threaded 2011-10-05 17:29:11 +02:00
Shay Banon 111c472a0b upgrade to jackson 1.9.0 2011-10-05 13:32:33 +02:00
Shay Banon 63844ddd43 REST Bulk API: Allow to execute _bulk against /{index}/_bulk and /{index}/{type}/_bulk endpoints, closes #1375. 2011-10-05 13:03:30 +02:00
Shay Banon 3d4c31de91 associate a version with a discovery node 2011-10-05 12:42:27 +02:00
Shay Banon 3d49b4ed3a add a simple integration level test for awareness 2011-10-03 13:48:10 +02:00
Igor Motov a51baa7d6c Allow limiting the number of concurrent ES nodes that can run on the same machine 2011-10-03 12:30:03 +02:00
Shay Banon 56a4c98e8b Allow to specify a specific field in the clear cache API, closes #1374. 2011-10-03 12:13:02 +02:00
Shay Banon c47f73a1ea better refresh stress test 2011-09-27 22:56:44 +03:00
Shay Banon 5ed064d532 execute the indices store listener as a last listener, to make sure we clean things up before we delete content if needed 2011-09-27 22:56:27 +03:00
Shay Banon df3fa9c067 When refreshing, also execute the refresh operation on initializing shards to make sure we don't miss it, closes #1370. 2011-09-27 21:46:24 +03:00
Shay Banon de8644d95a Fetch phase when searching might fail when mapping are updated with type missing, closes #1369. 2011-09-27 21:45:10 +03:00
Shay Banon 4088236cf7 No need to reroute (check for possible shard allocations) when a new *non* data node is added to the cluster, closes #1368. 2011-09-27 13:47:59 +03:00
Shay Banon f63727e3c6 no need to log a failure when deleting an index and a shard is recovering 2011-09-27 13:21:20 +03:00
Shay Banon 8fd28320e4 Add an option to disallow deleting all indices, closes #1367. 2011-09-27 11:54:34 +03:00
Shay Banon e0fdccd9c0 Transport Client: When `sniff` is enabled, use the sniffed nodes to be the list fo nodes to ping as well as the provided nodes, closes #1217. 2011-09-27 01:29:03 +03:00
Shay Banon 0c82fc5901 Remove Infinity values for Range facets when no docs match the range, closes #1366. 2011-09-27 00:41:57 +03:00
Shay Banon 737589f50d better handling of mean computation of some facets to handle division by 0, though, won't happen on most facets 2011-09-27 00:39:37 +03:00
Igor Motov d611182dbf Add support for non-elasticsearch namespaces to ImmutableSettings.getAsClass method 2011-09-26 23:29:08 +03:00
Shay Banon 8a63e58e1a Add `cloud.node.auto_attributes` setting, when set to `true`, will automatically add aws ec2 related attributes to the node (like availability zone), closes #1364. 2011-09-26 21:01:23 +03:00
Shay Banon e33dbcd93e more small optimizations to term creation 2011-09-26 12:05:48 +03:00
Shay Banon 8658856b48 use index iteration over iterator 2011-09-25 22:20:53 +03:00
Shay Banon 18f15f0a6f use index iteration over iterator 2011-09-25 22:17:09 +03:00
Shay Banon f36d89c554 use index iteration over iterator 2011-09-25 21:28:55 +03:00
Shay Banon 9bea902966 allow to dynamically set cluster.routing.allocation.cluster_concurrent_rebalance using cluster update settings API 2011-09-25 21:12:17 +03:00
Shay Banon fca3adcd59 allow to dynamically set cluster.routing.allocation.cluster_concurrent_rebalance using cluster update settings API 2011-09-25 21:09:41 +03:00
Shay Banon e8b88acbd3 allow to dynamically set cluster.routing.allocation.cluster_concurrent_rebalance using cluster update settings API 2011-09-25 21:09:15 +03:00
Shay Banon d7e3c9538f remove unnecessary check 2011-09-24 16:57:14 +03:00
Shay Banon 9d9133a451 required _routing fails when path points to an integer field, closes #1357. 2011-09-24 01:59:21 +03:00
Shay Banon d954a93d9d Malformed REST create index causes the index to still be created, closes #1359. 2011-09-24 01:04:12 +03:00
Shay Banon d9d452a1ef Allow to disable shard allocations, closes #1358. 2011-09-23 17:35:31 +03:00
Shay Banon f74793c92a improve multiple data locations when reading checksums and local gateway state files by going through all the locations to find them. 2011-09-23 17:08:21 +03:00
Shay Banon d76d7d4a56 Support external versioning for deletes arriving before initial update, closes #1351. 2011-09-23 00:56:02 +03:00
Shay Banon 8d7aaa704a Allow to stripe the data location over multiple locations, closes #1356. 2011-09-23 00:35:59 +03:00
Shay Banon c1ca21f4d5 more internal refactoring in directory providers 2011-09-22 18:04:59 +03:00
Shay Banon 7ab128bbba Put mapping on a single node with new mapping will not wait for the mapping to be applied, closes #1355. 2011-09-22 16:02:18 +03:00
Shay Banon f74fa7511b better failure when failing to find mapping for the key field in data histogram 2011-09-22 13:53:40 +03:00
Shay Banon 55d112b043 Even shard count distribution counts relocations as two, closes #1354. 2011-09-22 01:00:51 +03:00
Shay Banon 7adf2fd497 make last commit compile... 2011-09-22 00:30:05 +03:00
Njal Karevoll 6d975cd6b7 also use the time unit configured by numeric_resolution if fallbacking to parsing a timestamp number 2011-09-21 23:51:50 +03:00
Njal Karevoll 9bc9e3f0bd use "numeric_resolution" instead of "numeric_precision" as the field name 2011-09-21 23:51:50 +03:00
Njal Karevoll 41dbcdb7d6 Give the date field mapping a "numeric_precision" argument that allows a user to configure the precision of the numeric timestamps.
Supports all the time units from http://download.oracle.com/javase/6/docs/api/java/util/concurrent/TimeUnit.html
2011-09-21 23:51:50 +03:00
Shay Banon 3f8b7f0fce allow to change awareness settings using cluster update settings API 2011-09-21 23:48:23 +03:00
Shay Banon 44efcca108 automatic preference when using awareness attributes 2011-09-21 23:09:44 +03:00
Shay Banon 3028d5a7a1 Shard allocation awareness (rack aware, zone aware, for example), closes #1352. 2011-09-21 18:26:16 +03:00
Njal Karevoll 6a6cba1ff3 include the path when serializing _id field mappings 2011-09-20 17:50:32 +03:00
Shay Banon 8c322b4cc2 use the same improved fields extraction in get api 2011-09-20 16:54:02 +03:00
Shay Banon 9a13763315 Improve source based fields loading when searching, closes #1347. 2011-09-20 14:33:02 +03:00
Shay Banon 29d0bfdaa9 don't log delete of unused shard location if it does not exists 2011-09-19 17:50:41 +03:00
Shay Banon dc85e227af upgrade to latest jsr166 code 2011-09-18 21:50:16 +03:00
Shay Banon f072c7e91b add meter metric implementation 2011-09-18 21:35:01 +03:00
Shay Banon 52ca63deb9 move refreshing version table to be done right after the commit within the respective lock, for full flush (rarely used) its needed... 2011-09-18 16:13:05 +03:00
Shay Banon b66a3b7c59 Realtime Get: Under high concurrent indexing and immediate get, a get might be missed while flushing, closes #1344. 2011-09-18 13:44:35 +03:00
Shay Banon 305cf4a567 Bulk API: Properly retry execution on temporal state changes, closes #1343. 2011-09-17 02:21:49 +03:00
Austin McKinley 0977b793da adding timeout to list of connection failures 2011-09-17 00:50:51 +03:00
Shay Banon 5ba6ec5a69 Versioning: Delete on an already deleted document should still affect versioning, closes #1341. 2011-09-17 00:50:10 +03:00
Shay Banon bdfa07934e refactor creation of lucene directory and simplify different directories implemenation strcture 2011-09-16 18:39:23 +03:00
Shay Banon a7e43005bb Rest Delete API does not honor the `version_type` parameter, closes #1337. 2011-09-15 17:07:04 +03:00
Shay Banon 25c6e8512d fix full flush when no changes happen in the index, so the updated trans id is not written 2011-09-15 14:56:37 +03:00
Shay Banon 28f56262bc use a simpler API call 2011-09-15 14:01:45 +03:00
Shay Banon 639515c240 Optimizing inactive (indexing wise) shard to only happen when there are no ongoing merges, closes #1336. 2011-09-15 12:21:12 +03:00
Shay Banon 74079c8a13 Upgrade to Lucene 3.4.0, closes #1335. 2011-09-15 12:16:58 +03:00
Shay Banon 3eaf73a380 Add number of committed and number of search segments to the segments API response 2011-09-14 20:48:02 +03:00
Shay Banon e2b1cb1640 Allow to filter geo bounding box or distance based on indexed lat lon, closes #1334. 2011-09-14 14:27:39 +03:00
Shay Banon a8fc0cbcf3 when setting null value ttl, reset it 2011-09-13 21:43:56 +03:00
Benjamin Devèze e52dbf4fda fix bug when adding to BulkRequest with no TTL, add simple unit test for that 2011-09-13 21:41:13 +03:00
Shay Banon a84eb1fc8f Rivers: Close rivers early allowing them to still do index operations, closes #1330. 2011-09-13 02:15:50 +03:00
Shay Banon 847938a88e XContentBuilder.field : StackOverflowError with Integer[] parameters, closes #1324. 2011-09-12 22:44:55 +03:00
Shay Banon 36f364c998 revert back to 5gb from 20gb (the lucene default) to create less confusion 2011-09-12 21:38:27 +03:00
Shay Banon c62f476fa6 Indexation of document causes NullPointerException (on Linux) or ES process hanging, closes #1325. 2011-09-12 21:35:45 +03:00
Shay Banon d8377074a4 expose meteData directory 2011-09-12 21:33:33 +03:00
Shay Banon 93b1759804 Nested Mapping: Nested object with a null value causes wrong indexing structure (resulting in wrong search responses), closes #1323. 2011-09-12 11:23:20 +03:00
Shay Banon 8fe1e5cdb8 upgrade to trove 3.0.0 2011-09-12 10:21:10 +03:00
Shay Banon e6f277474e Thread Pool: Blocking thread pool type configuration fails, closes #1321. 2011-09-11 01:06:57 +03:00
Shay Banon 8532dc84e9 Query with stopwords executed directly against a type fails, closes #1320. 2011-09-11 00:53:39 +03:00
Benjamin Devèze 4279016f30 add default ttl value support 2011-09-09 15:35:01 +03:00
Shay Banon 052f9aac1f allow to force flush and use it when optimizing 2011-09-09 15:21:22 +03:00
Shay Banon bf70836e92 don't do double int[] lookup for ordinal 2011-09-09 14:06:54 +03:00
Shay Banon 84ae001731 if ttl field mappers don't exists (yet), ignore it for that shard 2011-09-09 13:31:40 +03:00
Shay Banon 100df0dca8 Merge branch 'ttl-time-value-source' of https://github.com/Paikan/elasticsearch 2011-09-09 13:09:57 +03:00
Shay Banon 9ff4a95ee4 allow to filter also by node _name and _id, make sure to reroute properly after cluster update settings 2011-09-09 13:09:08 +03:00
Benjamin Devèze fae6eaf690 add time value definition of ttl inside source 2011-09-09 11:35:15 +02:00
Shay Banon d00edfb165 better check for defaults on jline, only enable it if not on windows 2011-09-09 10:59:35 +03:00
Shay Banon 0fcb4e88d4 cleanup ttl support, make sure we close the service on node lifecycle, better settings names, and allow to provide the ttl as a time value 2011-09-09 01:21:05 +03:00
Benjamin Devèze 65aad2da1e add per doc ttl support 2011-09-09 00:03:40 +03:00
Shay Banon 5052282ab6 Cluster / Index level allocation filtering, closes #1311. 2011-09-08 14:29:08 +03:00
Shay Banon 4180a7f73a associate a DiscoveryNode instance with RoutingNode, so there is no need to look it up based on node id 2011-09-08 11:10:53 +03:00
Shay Banon 60933b0f1e reroute after setting cluster level settings 2011-09-08 10:54:07 +03:00
Shay Banon bcd4ef2823 custom nodes count 2011-09-07 20:38:48 +03:00
Shay Banon 60a73c475f dynamic settings validation to allow for simple match patterns 2011-09-06 22:01:25 +03:00
Shay Banon 6a78cc2b72 fix wrong removal of flag 2011-09-06 21:10:54 +03:00
Lukáš Vlček 3d09fdee27 adding method allowing default value 2011-09-06 20:28:06 +03:00
Shay Banon 17c285090f remove double setting clear 2011-09-06 20:13:06 +03:00
Jürgen Kartnaller d276809822 fix clear for FieldLookup values 2011-09-06 20:12:50 +03:00
Shay Banon 203564a5b0 externalize shard allocation decision to a separate module 2011-09-06 17:51:11 +03:00
Shay Banon d86c116273 extract logic of allocation to a separate module 2011-09-06 17:11:55 +03:00
Njal Karevoll 37f08ea8b8 Fix some typos:
hypennation_decompunder -> hyphenation_decompounder
only_longest_max -> only_longest_match
2011-09-06 15:23:48 +03:00
Shay Banon b653d149d1 Peer recovery: Allow to throttle recovery based on "size per sec", closes #1304. 2011-09-06 12:40:14 +03:00
Shay Banon 8ebbd1e7b9 Recovery Settings: Change settings (still support old settings) and allow for more dynamic settings, closes #1303. 2011-09-06 11:21:32 +03:00
Shay Banon 9f427010bf more to ABQ from LBQ is relevant places 2011-09-05 12:34:20 +03:00
Shay Banon dee1addc17 Indices / Node Stats: Shard level search stats, closes #1301. 2011-09-04 23:55:35 +03:00
Benjamin Devèze 8958e9fd4a fix bug in parent handling where the parsed parent value was not set in the SourceToParse 2011-09-04 17:35:23 +03:00
Shay Banon bcd7d97c58 only log async refresh / merge failure if the engine is not closed 2011-09-03 20:24:55 +03:00
Shay Banon ed99a51406 ifx possible NPE when asking for _parent without parent mapping 2011-09-02 12:58:20 +03:00
Shay Banon 63f2e84535 Negative total cpu time reported by the node stats REST API, closes #1297. 2011-09-02 10:13:26 +03:00
Shay Banon 8facdb2e3d Rapidly concurrent deleting/creating an index leaves index inconsistent, closes #1296. 2011-09-02 09:36:25 +03:00
Shay Banon a8baec6960 improve logging of failure when merging 2011-09-01 23:32:26 +03:00
Shay Banon d7943e8ebd fix some highlighting encoder issues 2011-09-01 22:14:47 +03:00
LocJayMP c0f8223a6c adding escape html ability 2011-09-01 21:50:49 +03:00
Shay Banon 2bc2b3f4e2 add percolate api to groovy client 2011-09-01 21:10:46 +03:00
Shay Banon b888684ff6 negative from parameter yields undescriptive error message, closes #1293. 2011-09-01 19:25:04 +03:00
Shay Banon 87049d0d29 initialize the transport adapter on creation so asking for stats will not NPE 2011-09-01 19:18:28 +03:00
Shay Banon 3ae40487b6 Using 57744018578214912 as an id can cause failure to route to the correct shard, closes #1294. 2011-09-01 18:33:44 +03:00