Commit Graph

5293 Commits

Author SHA1 Message Date
Shay Banon b4d75a50bf Dates accessed from scripts should use UTC timezone
this was broken in the field data refactoring we did in 0.90, fixes #3091
2013-05-25 22:43:48 +02:00
Alexander Reelsen 24fccc91d8 Stabilized SimplePercolaterTests 2013-05-24 22:22:43 +02:00
Alexander Reelsen 2e4d18b519 Fixing percolation of documents with TTL set
When a type is configured with a TTL, percolation of documents of this type
was not possible. This fix ignores the TTL for percolation instead of
throwing an exception that the document is already expired.

Closes #2975
2013-05-24 17:58:02 +02:00
Simon Willnauer 6e366bae34 Never throw an IAE if the IndexMapper isn't present in PostingsFormat
If we throw an exception in the PostingsFormat during a merge we essentially
fail the entire merge which can lead to a corrupt index. We should rather
return the default postings format for the new segment and log a warning.

Closes #3088
2013-05-24 17:40:36 +02:00
Martijn van Groningen 9ed274822d wait for green/yellow status 2013-05-24 17:32:45 +02:00
Simon Willnauer d5ca1be34e Added testcase to ensure #3078 doesn't fail 2013-05-23 23:18:45 +02:00
Simon Willnauer 13c1145548 Fix String.format to use Locale.ROOT 2013-05-23 18:26:12 +02:00
Martijn van Groningen ffdebe9bc3 Added three new index alias related apis.
Added apis to get specific index aliases based on filtering by alias name and index name:
```
curl -XGET 'localhost:9200/{index_or_alias}/_alias/{alias_name}'
```

Added delete index alias api for deleting a single index alias:
```
curl -XDELETE 'localhost:9200/{index}/_alias/{alias_name}'
```

Added create index alias api for adding a single index alias:
```
curl -XPUT 'localhost:9200/{index}/_alias/{alias_name}'

curl -XPUT 'localhost:9200/{index}/_alias/{alias_name}' -d '{
	"routing" : {routing},
	"filter" : {filter}
}'

```

Closes #3075 #3076 #3077
2013-05-23 09:18:17 +02:00
Simon Willnauer 841c2d1e14 Fix bug in DateFieldMapper where format is serialized instead of locale
This fix adds a default serialization step in the SimpleDateMappingTests
that parses the mapping, builds the mapper, serializes the mapper and
rebuilds the actual mapper from the serialization result. The contained
information must be equivalent to the original mapping.

The fixed bug has no issue assigned to is since the code is unreleased yet.
2013-05-22 21:14:19 +02:00
Clinton Gormley bb9871bcb5 Changed common terms query to also support camelCased parameters
and renamed disable_coords to disable_coord, to be consistent with
the bool query

Closes #3074
2013-05-22 16:52:32 +02:00
Matt Weber 927fda8a61 Apply QueryParser boost to top leve query if applicable.
Set the query boost of a parsed query string query to the product of
the parsed query boost and the boost value specified in the "boost"
query string parameter. This only applies if the top level query returned
from the query parser has a boost assigned to it. In such a case we must
multiply the boost with the top level query boost otherwise the boost
will be overwritten ie. 'foo^2' has a top-level boost of 2 while
'foo^2 OR bar^3' has a top level boost of 1.0 (default) since the
boolean query is the top level query.

Closes #3024
2013-05-21 10:29:28 +02:00
Simon Willnauer af4205fd30 Fix method name typo & beef up tests
s/DateFieldMapper#parseLocal/DateFieldMapper#parseLocal/
SimpleDateMappingTests Tests now also check local dependent
patters with root locale.
2013-05-21 09:37:35 +02:00
Shay Banon e0825686f3 rollback multi get fields change
seems like it still fails while serializing with sporadic failures in the tests (due to routing on serialization), need to test it in a consistent manner
2013-05-20 06:56:37 -07:00
Shay Banon 0066566357 External terms doesn't work with _id field
fixes #3063
2013-05-20 06:17:18 -07:00
Shay Banon d983389090 multi get semantics of empty/null fields missing
the semantics between null fields (asking for source), and empty fields (not asking for anything) is missing
also exposes the items in the request, relates to #3061
2013-05-20 05:09:48 -07:00
Simon Willnauer 31f0aca65d Integrate forbiddenAPI checks into Maven build.
This commit integrates the forbiddenAPI checks that checks
Java byte code against a list of "forbidden" API signatures.
The commit also contains the fixes of the current source code
that didn't pass the default API checks.

See https://code.google.com/p/forbidden-apis/ for details.

Closes #3059
2013-05-19 23:25:44 +02:00
Simon Willnauer c4db582f26 Allow Date Fields to have a locale for date parsing
Currently if somebody uses a date format that is locale dependend
date fields can only parse a single format depending on the nodes
host locale. This can cause lots of problems since nodes might have
different locales. ie. "E, d MMM yyyy HH:mm:ss Z" where you have
"Wed, 06 Dec 2000 02:55:00 -0800" for en_EN while
"Mi, 06 Dez 2000 02:55:00 -0800" for de_DE.

Closes #3047
2013-05-19 23:25:44 +02:00
Shay Banon e580507fbe wait for yellow after the index is created
also, remove starting one node, it not useful for the test, and slows down the execution
2013-05-17 18:21:51 +02:00
Simon Willnauer 17681d7104 Grow array buffer in ScriptDocValues if needed
The buffer in ScriptDocValues for Strings was never called causeing
NPE in scripts if a document has > 10 distinct values in a field.

Closes #3051
2013-05-17 15:16:59 +02:00
Alexander Reelsen bd857d6d2e Ensuring test isolation when jvm plugins are loaded
Instead of specifying 'path.plugins' configuration option, 'plugin.types'
is used to load plugins in integration tests. This makes sure the JVM
plugins are not loaded in all following tests from then.

Also removed the now unneeded es-plugin.properties files from JVM test
plugins.
2013-05-17 13:21:26 +02:00
Alexander Reelsen 2485c4890c Packaging improvements & bugfixes
* RPM: Use the ES_USER variable to set the user (same name as in the debian package
  now), while retaining backwards compatibility to existing /etc/sysconfig/elasticsearch
* RPM: Bugfix: Remove the user when uninstalling the package
* RPM: Set an existing homedir when adding the user (allows one to run cronjobs as this user)
* DEB & RPM: Unify Required-Start/Required-Stop fields in initscripts
2013-05-17 11:14:44 +02:00
Alexander Reelsen 2e07af63ba Allowing pluggable highlighter implementations.
Currently elasticsearch ships with the plain and the fast-vector highlighter.
In order to support arbitrary highlighters via plugins, you only need to
implement a Highlighter interface and register your implementation in your
plugin at the HighlightModule.

In addition you can also add arbitrary options via the 'options' field in
the highlight request, which can be parsed in the highlighter implementation.

In order to find out how to write add your own analyzer, check out the tests
classes (CustomHighlighterSearchTests and CustomHighlighter).

Closes #2828
2013-05-17 09:07:13 +02:00
Martijn van Groningen db421742f7 Added support for nested sorting for script sorting and geo sorting.
Closes #3044
2013-05-16 18:45:00 +02:00
Martijn van Groningen 42d5bdd337 If matching root doc's inner objects don't match the `nested_filter` then the `missing` value should be used to sort the root doc.
Closes #3020
2013-05-16 10:12:02 +02:00
Shay Banon 2779967279 fix package name... 2013-05-15 17:06:42 +02:00
Martijn van Groningen bc0c7f8f28 Added simple id loading test.
Relates to #3028
2013-05-15 16:10:22 +02:00
Simon Willnauer 8235b89e9c Don't apply min frequency smoothing if suggest type is 'always'
Using an automatically detected 'min_doc_freq' if suggest type is set to
'always' is counter intuitive. If we suggest always ignore the frequency and
set threshold frequency to 0 to allow all possible candidates to be drawn if
they are within the given bounds.

Closes #3037
2013-05-15 15:17:49 +02:00
Martijn van Groningen 48cb06c9cf Keep backwards compatible with 0.90.0 on the transport layer.
Relates to #3039
2013-05-15 13:28:55 +02:00
Martijn van Groningen 585cbf6886 Routing value not serialized on transport layer.
Closes #3039
2013-05-15 13:09:13 +02:00
Clinton Gormley db805cf5a9 Corrected English in a shard error message 2013-05-15 12:41:49 +02:00
Clinton Gormley 4d09e7562a Corrected a typo and improved the English in a master-discovery error 2013-05-15 12:39:31 +02:00
Shay Banon f92eed8591 clean thread locals without needing a wrapper
clean thread locals smartly by identifying "our" classes, and removing them, so there is no need to wrap it in our our clenable values
2013-05-15 12:13:13 +02:00
Shay Banon 4d357660ca reuse version key in an actual operation
no need to compute the hash several times
2013-05-15 00:27:48 +02:00
Shay Banon 1fb78c53b8 remove unused class 2013-05-14 20:21:37 +02:00
Shay Banon 1c7d2442c8 use bytes instead of String as key in versionMap
no need to create a String every time we put or get a value from the version map
2013-05-14 20:18:54 +02:00
Martijn van Groningen 15fcb17a81 During parent uid loading seek to next parent type when child type is encountered.
Relates to #3028
2013-05-14 16:22:05 +02:00
Simon Willnauer 6d5805c901 Use Recovery Throtteling by default.
To prevent to extensive resource use during recovery we use
recovery throtteling by default to prevent unexpected peak load
on clusters. The default is set to 20 MB/sec.

Closes #3035
2013-05-14 15:10:03 +02:00
Simon Willnauer 6624949501 Use Merge Throtteling by default on node level.
Merge Throtteling is one of the most recommended settings and crucial in the
RealTime indexing case. We should set the default to a reasonable setting
that allows folks to index in a production index and don't see large merge
peaks by default. The default is set to 20 MB/sec on the node level.

Closes #3033
2013-05-14 15:10:03 +02:00
Simon Willnauer 09fb2264d0 Raise search threadpool default size.
The default size used to be 2x availableProcessors which seemed to
be a to lowish value in practice. 3x appeared to be a sweetspot for
most application. The default is now 3 x availableProcessors

Closes #3023
2013-05-14 15:10:03 +02:00
uboness d06a15ec3e Support for term facets on unmapped fields
Added support for unmapped & partially mapped fields (partially mapped fields may occur when searching across multiple indices where the faceted field is mapped on some and unmapped on others). If a shard doesn't have mappings for a field, the matching documents count on that shard will be added to the missing count for that facet.
2013-05-14 13:53:41 +02:00
Martijn van Groningen 906f278896 Make sure only relevant documents are evaluated in the second round lookup phase.
Both has_parent and has_child filters are internally executed in two rounds. In the second round all documents are evaluated whilst only specific documents need to be checked. In the has_child case only documents belonging to a specific parent type need to be checked and in the has_parent case only child documents need to be checked.

Closes #3034
2013-05-14 11:02:03 +02:00
Shay Banon ae6c1b345f Allow to disable allocation on the index level
Similar to the global cluster wide disable allocation flags, allow to set those on a specific index by updating its settings. The keys are the same as the cluster one, except they start with an index, for example: index.routing.allocation.disable_allocation set to true.
closes #3031
2013-05-14 10:25:23 +02:00
Simon Willnauer 7b437e801a Added test for LimitTokenCountFilterFactory 2013-05-14 09:58:43 +02:00
Brusic 183ac1e04c Expose LimitTokenCountFilter as a TokenFilter
Closes #3013
2013-05-14 09:58:42 +02:00
Martijn van Groningen 669cf90d0c Not load the ids of child documents into memory.
Closes #3028
2013-05-14 09:46:43 +02:00
Alexander Reelsen 31b4b7ea58 Renaming span_multi_term query to span_multi
... due to discussing this on #2610 in order to have a more concise name
2013-05-13 12:32:57 +02:00
Simon Willnauer cffe333fe3 Ensure tests pass if store dir is a soft-link 2013-05-13 12:08:41 +02:00
Simon Willnauer a3a2ca0ad3 Reduce branches in TopChildrenQuery
The branches used in the score method can be moved into the
scorer call and be essentially a constant operation rather than
a linear operation depending on the number of parent docs.
2013-05-13 12:08:41 +02:00
Alexander Reelsen 52654179e7 Fix for RPM postinstall on old OpenSUSE distributions
Older OpenSUSE distributions do not ship with systemd and therefore are
using chkconfig, but do not have their scripts placed at /etc/init.d/
This patch is more defensive and adds additional checks in the postinstall
script to prevent aborted post install scripts, which makes the RPM
uninstallable.
2013-05-13 11:48:04 +02:00
Martijn van Groningen 3c58176d29 Also support `sum` as `score_mode` option for the nested query.
Relates to #3026
2013-05-13 10:38:20 +02:00