3455 Commits

Author SHA1 Message Date
Simon Willnauer
ff697c9ac2 Merge pull request #16156 from s1monw/check_for_invalid_settings_on_upgrade
Check for invalid index settings on metadata upgrade
2016-01-22 09:04:32 +01:00
Ryan Ernst
df24019261 Merge pull request #16038 from rjernst/remove_site_plugin
Plugins: Remove site plugins
2016-01-21 12:32:22 -08:00
Tal Levy
8f35e459d1 Merge pull request #16157 from talevy/tag_sans_processor
[Ingest] rename processor_tag to tag
2016-01-21 11:20:42 -08:00
Jason Tedor
7de8d2881b Fix shard ID logging in DWSDIT#testAckedIndexing
This commit fixes a minor issue with the shard ID that is logged while
indexing in DiscoveryWithServiceDisruptionsIT#testAckedIndexing. The
issue is that the operation routing hash could lead to a negative
remainder modulo the number of primaries (if the hash itself is
negative) but should instead be the normalized positive remainder. This
issue only impacts the logging of the shard ID as the actual shard ID
used during indexing is computed elsewhere but would cause the shard ID
in the affected logging statement to not match shard IDs that are logged
elsewhere.
2016-01-21 13:55:53 -05:00
Clinton Gormley
24ac9506bd Reverted #16048 2016-01-21 18:07:38 +01:00
Tal Levy
3a6c2d008e rename processor_tag to tag 2016-01-21 09:05:42 -08:00
Tal Levy
2c4e13bf7c split string into ArrayList so it can be appended to
Fixes #16109.
2016-01-21 08:38:10 -08:00
Simon Willnauer
34b5d37c74 Check for invalid index settings on metadata upgrade
this change allows us to open existing IndexMetaData that contains invalid, removed settings
or settings with invalid values and instead of filling up the users disks with exceptions we _archive_
the settings with and `archive.` prefix. This allows us to warn the user via logs (once it's archived) as
well as via external tools like the upgrade validation tool since those archived settings will be preserved
even over restarts etc. It will prevent indices from failing during the allocaiton phase but instead will
print a prominent warning on index metadata recovery from disk.
2016-01-21 17:31:18 +01:00
Simon Willnauer
6589fbe86e Also remove upgrade from OldIndexBackwardsCompatibilityIT 2016-01-21 17:22:33 +01:00
Jim Ferenczi
8f063b0a07 Do not apply minimum_should_match on auto generated boolean query if the coordination factor is disabled.
Affects match, multi_match, query_string and simple_query_string queries.
Direct bool queries are not affected anymore (minimum_should_match is applied even if the coord factor is disabled).
2016-01-21 17:22:15 +01:00
Tal Levy
c55f9bbd9b Merge pull request #16132 from talevy/holdmytag
[Ingest] add an AbstractProcessor to help hold the re-used processorTag variable
2016-01-21 07:30:29 -08:00
Simon Willnauer
b1afde257b Drop multi data path upgrade tool
Since we require upgrades to 2.x we don't need this anymore on master.
2016-01-21 15:57:52 +01:00
Isabel Drost-Fromm
086633a5ca Make sort order enum writable.
Related to #15178
2016-01-21 14:44:26 +01:00
Simon Willnauer
ae48422072 Fix IngestMetadata parsing and add unittest 2016-01-21 14:19:26 +01:00
Isabel Drost-Fromm
ca00808387 Merge pull request #16122 from MaineC/enhancement/15178-distance-unit-writable
Make DistanceUnit writable.
2016-01-21 14:03:39 +01:00
Isabel Drost-Fromm
d2dac8427e Make distance unit writable.
Relates to #15178
2016-01-21 13:40:19 +01:00
Martijn van Groningen
b61dc6d69c cleanup generics for the ingest action filters 2016-01-21 12:01:10 +01:00
Martijn van Groningen
44465c94f8 Merge remote-tracking branch 'es/master' into feature/ingest 2016-01-21 11:46:27 +01:00
Simon Willnauer
eaad8924d8 Merge branch 'bring_back_node_throttle' 2016-01-21 11:31:29 +01:00
Simon Willnauer
ebc9dcf0c7 Cleanup index settings updaters 2016-01-21 11:31:00 +01:00
Simon Willnauer
d9422b5e89 Bring back node throttle type which was lost after index setting refactoring
This has caused some test failures lately especially on window (which is likely caused
by the rather bad performance of the windows test machines).
See one failure here:
 http://build-us-00.elastic.co/job/es_core_master_window-2008/2934/

This fix has now also a unittest that tests this issue separately.
2016-01-21 11:30:54 +01:00
Christoph Büscher
08334af189 Merge pull request #16126 from cbuescher/completionSuggestionParse-ParseFields
Suggest: Fix "analyzer" and "size" parsing and move to shared ParseFields in CompletionSuggestParser
2016-01-21 11:08:44 +01:00
Nik Everett
4a71898e09 Merge pull request #16107 from nik9000/unraw_actions
Cleanup the raw generics in ActionFilter
2016-01-20 21:54:49 -05:00
Tal Levy
f1204cb1ab add an AbstractProcessor to help hold the re-used processorTag variable 2016-01-20 14:34:26 -08:00
Martijn van Groningen
cdecf725f8 The nonNestedFilter should always be included if no types have been specified and
null can only be returned if there are no type or alias filter and the index has nested fields.
2016-01-20 23:16:42 +01:00
Martijn van Groningen
7914d0f940 Several MapperService cleanups:
* Cleaned up MapperService#searchFilter(...) and moved it DefaultSearchContext, since it that class was the only user. As part of the cleanup percolate query documents are no longer excluded from the search response.
* Removed resolveClosestNestedObjectMapper(...) method as it was no longer used.
* Removed DocumentTypeListener infrastructure. Before it was used by the percolator and parent/child, but these features no longer use it.

Closes #15924
2016-01-20 22:26:56 +01:00
Tal Levy
437fe6c056 make DeDotProcessor's constructor package-private 2016-01-20 12:12:40 -08:00
Jason Tedor
bd1eefa5be Revert temporary compiler bug workaround
This reverts commit df5f1b1ee9da7d45e20880e411d7e5280ef5ca59.

Closes #16097
2016-01-20 14:37:12 -05:00
Jason Tedor
22318cb7e4 Remove import in IndicesClusterStateService.java
This commit removes an unused import from
o/e/i/c/IndicesClusterStateService.java.
2016-01-20 13:18:37 -05:00
Christoph Büscher
1550d0f013 Switch to using RescoreBuilder in SearchSourceBuilder 2016-01-20 19:09:02 +01:00
Christoph Büscher
428043700d RescoreBuilder: Add parsing and creating of RescoreSearchContext
Adding the ability to parse from xContent to the rescore builder.
Also making RescoreBuilder an interface and renaming the current
base builder that encapsulates the `window_size` setting the the
concrete rescorer implementation to RescoreBaseBuilder.
2016-01-20 18:45:54 +01:00
Martijn van Groningen
b9dc5acf2c Cleanup ParentFieldMapper:
* Remove remaining 1.x bwc logic.
* Stop storing stored fields and indexed terms. The _parent field's only purpose is to support joins between parent and child type and only storing doc values is sufficient.
* In the mapping the parent field mapper is now known under '{parent}#{child}' key, because this is the field the parent/child join uses too.
* Added new sub fetch phase to lookup that _parent field from doc values field if that is required (before this was fetched from stored _parent field)
* Removed the ability to query directly on `_parent` in the query dsl. Instead the `{parent}#{child}` field should be used. Under the hood a doc values query is used instead of a term query, because only doc values fields are stored now.
* Added a new `parent_id` query to easily query child documents with a specific parent id without having to know what join field to use
* Also in aggregations `_parent` field can't be used any more and `{parent}#{child}` field name should be used instead to aggregate directly on the _parent join field.
2016-01-20 16:56:22 +01:00
Martijn van Groningen
d2c608e1a8 fix test bug 2016-01-20 16:51:27 +01:00
Martijn van Groningen
e4a142f792 added constructors for the required parameters and removed the body of all validate methods 2016-01-20 16:40:10 +01:00
Yannick Welsch
303b430480 Merge pull request #16096 from ywelsch/feature/prefer-previous-primary
Prefer nodes that previously held primary shard for primary shard allocation
2016-01-20 16:32:55 +01:00
Martijn van Groningen
faf9ca2122 brought back the body of the validate() methods. This is still useful if no setter has been invoked. 2016-01-20 16:02:10 +01:00
Martijn van Groningen
b0c7096e2f changed delete pipeline request to getters and setters in right format and validate the provided id in the setId(...) method 2016-01-20 16:00:44 +01:00
Martijn van Groningen
f546b27ea0 removed the ClusterService constructor dependency from PipelineStore 2016-01-20 15:55:24 +01:00
Martijn van Groningen
fd31d6afdf Let NodeService implement closable and let NodeService delegate to IngestService 2016-01-20 15:46:48 +01:00
Martijn van Groningen
977bbaba02 fixed various small comments 2016-01-20 15:44:32 +01:00
Martijn van Groningen
7aeb360932 use AbstractRunnable 2016-01-20 15:26:37 +01:00
Christoph Büscher
5ce14cc356 Fixing small issues and using ParseFields in CompletionSuggestParser 2016-01-20 15:20:38 +01:00
Martijn van Groningen
9fe408adbd use ActionListenerResponseHandler 2016-01-20 15:13:27 +01:00
Martijn van Groningen
136e0fe1af remove parsing logic with ObjectParser 2016-01-20 15:03:58 +01:00
Simon Willnauer
f6db00fd33 push feedback from mr. regex optimizer 2016-01-20 14:19:29 +01:00
Martijn van Groningen
5eaaa95c61 address SimulatePipelineRequest comments 2016-01-20 14:16:41 +01:00
Martijn van Groningen
2645fc9145 renamed SimulateDocumentSimpleResult to SimulateDocumentBaseResult and added jdocs 2016-01-20 14:11:45 +01:00
Simon Willnauer
0941604919 Validate the settings key if it's simple chars separated by .
This adds additional safety to the settings since we don't have a full list of them
yet and it caught bugs already in tests.
2016-01-20 14:03:10 +01:00
Martijn van Groningen
8b520111d0 fix PutPipelineRequest comments 2016-01-20 14:00:55 +01:00
Martijn van Groningen
f7024bc4dd maintain a list of ingest nodes in the cluster state instead of creating it on the spot 2016-01-20 13:55:26 +01:00