Commit Graph

19572 Commits

Author SHA1 Message Date
Simon Willnauer fcdb24bc9d Run Metadata upgrade tool on every version
Today we run the metadata upgrade only on the current major version
but this should run on every upgrade at least once to ensure we don't miss
an important check or upgrade.
2016-01-22 09:30:07 +01:00
Jim Ferenczi 08a0e40d75 Merge pull request #16155 from jimferenczi/fix/min_should_match
Do not apply minimum_should_match on auto generated boolean query if the coordination factor is disabled.
2016-01-22 09:29:33 +01:00
Simon Willnauer ff697c9ac2 Merge pull request #16156 from s1monw/check_for_invalid_settings_on_upgrade
Check for invalid index settings on metadata upgrade
2016-01-22 09:04:32 +01:00
Ryan Ernst df24019261 Merge pull request #16038 from rjernst/remove_site_plugin
Plugins: Remove site plugins
2016-01-21 12:32:22 -08:00
Jason Tedor 26e5cd651e Default standard output to the journal in systemd
This commit modifies the default setting for standard output in the
systemd configuration to the journal instead of /dev/null. This is to
address a user pain point where Elasticsearch would fail to start but
the error message would be sent to standard output and therefore
/dev/null leading to difficult-to-debug situations.
2016-01-21 15:09:57 -05:00
Tal Levy 8f35e459d1 Merge pull request #16157 from talevy/tag_sans_processor
[Ingest] rename processor_tag to tag
2016-01-21 11:20:42 -08:00
Jason Tedor 7de8d2881b Fix shard ID logging in DWSDIT#testAckedIndexing
This commit fixes a minor issue with the shard ID that is logged while
indexing in DiscoveryWithServiceDisruptionsIT#testAckedIndexing. The
issue is that the operation routing hash could lead to a negative
remainder modulo the number of primaries (if the hash itself is
negative) but should instead be the normalized positive remainder. This
issue only impacts the logging of the shard ID as the actual shard ID
used during indexing is computed elsewhere but would cause the shard ID
in the affected logging statement to not match shard IDs that are logged
elsewhere.
2016-01-21 13:55:53 -05:00
Clinton Gormley 24ac9506bd Reverted #16048 2016-01-21 18:07:38 +01:00
Tal Levy 3a6c2d008e rename processor_tag to tag 2016-01-21 09:05:42 -08:00
Tal Levy 6ee5ea398e Merge pull request #16110 from talevy/fix-split-append
[Ingest] split string into ArrayList so it can be appended to
2016-01-21 09:04:19 -08:00
Martijn van Groningen 20f634952c mustache: Improve the mustache script engine
* Added a `content_type` option at compile time to decide how variable values are encoded. Possible values are `application/json` and `plain/text`. Defaults to `application/json`.
* Added support for variable placeholders to lookup values from specific slots in arrays/lists.
2016-01-21 18:04:06 +01:00
Lee Hinman 50d184066f [DOCS] Document the `string_distance` parameter for term suggestor 2016-01-21 10:00:46 -07:00
Simon Willnauer 11f5a2ebaf Merge pull request #16149 from s1monw/drop_multi_path_upgrader
Drop multi data path upgrade tool
2016-01-21 17:50:10 +01:00
Tal Levy 2c4e13bf7c split string into ArrayList so it can be appended to
Fixes #16109.
2016-01-21 08:38:10 -08:00
Simon Willnauer 34b5d37c74 Check for invalid index settings on metadata upgrade
this change allows us to open existing IndexMetaData that contains invalid, removed settings
or settings with invalid values and instead of filling up the users disks with exceptions we _archive_
the settings with and `archive.` prefix. This allows us to warn the user via logs (once it's archived) as
well as via external tools like the upgrade validation tool since those archived settings will be preserved
even over restarts etc. It will prevent indices from failing during the allocaiton phase but instead will
print a prominent warning on index metadata recovery from disk.
2016-01-21 17:31:18 +01:00
Simon Willnauer 6589fbe86e Also remove upgrade from OldIndexBackwardsCompatibilityIT 2016-01-21 17:22:33 +01:00
Jim Ferenczi 8f063b0a07 Do not apply minimum_should_match on auto generated boolean query if the coordination factor is disabled.
Affects match, multi_match, query_string and simple_query_string queries.
Direct bool queries are not affected anymore (minimum_should_match is applied even if the coord factor is disabled).
2016-01-21 17:22:15 +01:00
Simon Willnauer 6ec13e62a7 Ensure defautls are also serialized across the network 2016-01-21 17:12:42 +01:00
Tal Levy c55f9bbd9b Merge pull request #16132 from talevy/holdmytag
[Ingest] add an AbstractProcessor to help hold the re-used processorTag variable
2016-01-21 07:30:29 -08:00
Simon Willnauer b1afde257b Drop multi data path upgrade tool
Since we require upgrades to 2.x we don't need this anymore on master.
2016-01-21 15:57:52 +01:00
Greg Marzouka 8fffc474dd Merge pull request #15549 from gmarz/master
Fix Windows service installation failure
2016-01-21 09:33:47 -05:00
Simon Willnauer e8b9880211 Clarify semantics when defaults are overwritten.
Default headers are now read-only fallbacks if the key is actually not in
the headers map. That way we never serialize them across the wire and also never
prevent them from being  overwritten.
2016-01-21 15:30:25 +01:00
Isabel Drost-Fromm 67524571cb Merge pull request #16124 from MaineC/enhancement/15178-sort-order-writable
Make sort order enum writable.
2016-01-21 14:59:07 +01:00
Isabel Drost-Fromm 086633a5ca Make sort order enum writable.
Related to #15178
2016-01-21 14:44:26 +01:00
Simon Willnauer 142547271e Merge branch 'master' into trash_context_and_headers 2016-01-21 14:42:15 +01:00
Simon Willnauer f3c8068ba6 Merge pull request #16145 from s1monw/feature/ingest
Fix IngestMetadata parsing and add unittest
2016-01-21 14:40:36 +01:00
Simon Willnauer ae48422072 Fix IngestMetadata parsing and add unittest 2016-01-21 14:19:26 +01:00
Isabel Drost-Fromm ca00808387 Merge pull request #16122 from MaineC/enhancement/15178-distance-unit-writable
Make DistanceUnit writable.
2016-01-21 14:03:39 +01:00
Isabel Drost-Fromm d2dac8427e Make distance unit writable.
Relates to #15178
2016-01-21 13:40:19 +01:00
Martijn van Groningen b61dc6d69c cleanup generics for the ingest action filters 2016-01-21 12:01:10 +01:00
Martijn van Groningen 44465c94f8 Merge remote-tracking branch 'es/master' into feature/ingest 2016-01-21 11:46:27 +01:00
Simon Willnauer eaad8924d8 Merge branch 'bring_back_node_throttle' 2016-01-21 11:31:29 +01:00
Simon Willnauer ebc9dcf0c7 Cleanup index settings updaters 2016-01-21 11:31:00 +01:00
Simon Willnauer d9422b5e89 Bring back node throttle type which was lost after index setting refactoring
This has caused some test failures lately especially on window (which is likely caused
by the rather bad performance of the windows test machines).
See one failure here:
 http://build-us-00.elastic.co/job/es_core_master_window-2008/2934/

This fix has now also a unittest that tests this issue separately.
2016-01-21 11:30:54 +01:00
Christoph Büscher 08334af189 Merge pull request #16126 from cbuescher/completionSuggestionParse-ParseFields
Suggest: Fix "analyzer" and "size" parsing and move to shared ParseFields in CompletionSuggestParser
2016-01-21 11:08:44 +01:00
Nik Everett 4a71898e09 Merge pull request #16107 from nik9000/unraw_actions
Cleanup the raw generics in ActionFilter
2016-01-20 21:54:49 -05:00
Tal Levy f1204cb1ab add an AbstractProcessor to help hold the re-used processorTag variable 2016-01-20 14:34:26 -08:00
Martijn van Groningen cdecf725f8 The nonNestedFilter should always be included if no types have been specified and
null can only be returned if there are no type or alias filter and the index has nested fields.
2016-01-20 23:16:42 +01:00
Martijn van Groningen 7914d0f940 Several MapperService cleanups:
* Cleaned up MapperService#searchFilter(...) and moved it DefaultSearchContext, since it that class was the only user. As part of the cleanup percolate query documents are no longer excluded from the search response.
* Removed resolveClosestNestedObjectMapper(...) method as it was no longer used.
* Removed DocumentTypeListener infrastructure. Before it was used by the percolator and parent/child, but these features no longer use it.

Closes #15924
2016-01-20 22:26:56 +01:00
Tal Levy 437fe6c056 make DeDotProcessor's constructor package-private 2016-01-20 12:12:40 -08:00
Jason Tedor bd1eefa5be Revert temporary compiler bug workaround
This reverts commit df5f1b1ee9.

Closes #16097
2016-01-20 14:37:12 -05:00
Jason Tedor 22318cb7e4 Remove import in IndicesClusterStateService.java
This commit removes an unused import from
o/e/i/c/IndicesClusterStateService.java.
2016-01-20 13:18:37 -05:00
Christoph Büscher 1550d0f013 Switch to using RescoreBuilder in SearchSourceBuilder 2016-01-20 19:09:02 +01:00
Christoph Büscher 428043700d RescoreBuilder: Add parsing and creating of RescoreSearchContext
Adding the ability to parse from xContent to the rescore builder.
Also making RescoreBuilder an interface and renaming the current
base builder that encapsulates the `window_size` setting the the
concrete rescorer implementation to RescoreBaseBuilder.
2016-01-20 18:45:54 +01:00
Martijn van Groningen b9dc5acf2c Cleanup ParentFieldMapper:
* Remove remaining 1.x bwc logic.
* Stop storing stored fields and indexed terms. The _parent field's only purpose is to support joins between parent and child type and only storing doc values is sufficient.
* In the mapping the parent field mapper is now known under '{parent}#{child}' key, because this is the field the parent/child join uses too.
* Added new sub fetch phase to lookup that _parent field from doc values field if that is required (before this was fetched from stored _parent field)
* Removed the ability to query directly on `_parent` in the query dsl. Instead the `{parent}#{child}` field should be used. Under the hood a doc values query is used instead of a term query, because only doc values fields are stored now.
* Added a new `parent_id` query to easily query child documents with a specific parent id without having to know what join field to use
* Also in aggregations `_parent` field can't be used any more and `{parent}#{child}` field name should be used instead to aggregate directly on the _parent join field.
2016-01-20 16:56:22 +01:00
Martijn van Groningen d2c608e1a8 fix test bug 2016-01-20 16:51:27 +01:00
Martijn van Groningen e4a142f792 added constructors for the required parameters and removed the body of all validate methods 2016-01-20 16:40:10 +01:00
Yannick Welsch 303b430480 Merge pull request #16096 from ywelsch/feature/prefer-previous-primary
Prefer nodes that previously held primary shard for primary shard allocation
2016-01-20 16:32:55 +01:00
Martijn van Groningen faf9ca2122 brought back the body of the validate() methods. This is still useful if no setter has been invoked. 2016-01-20 16:02:10 +01:00
Martijn van Groningen b0c7096e2f changed delete pipeline request to getters and setters in right format and validate the provided id in the setId(...) method 2016-01-20 16:00:44 +01:00