OpenSearch/x-pack/plugin
Tanguy Leroux 87076c32e2
Determine shard size before allocating shards recovering from snapshots (#61906) (#63337)
Determines the shard size of shards before allocating shards that are
recovering from snapshots. It ensures during shard allocation that the
target node that is selected as recovery target will have enough free
disk space for the recovery event. This applies to regular restores,
CCR bootstrap from remote, as well as mounting searchable snapshots.

The InternalSnapshotInfoService is responsible for fetching snapshot
shard sizes from repositories. It provides a getShardSize() method
to other components of the system that can be used to retrieve the
latest known shard size. If the latest snapshot shard size retrieval
failed, the getShardSize() returns
ShardRouting.UNAVAILABLE_EXPECTED_SHARD_SIZE. While
we'd like a better way to handle such failures, returning this value
allows to keep the existing behavior for now.

Note that this PR does not address an issues (we already have today)
where a replica is being allocated without knowing how much disk
space is being used by the primary.

Co-authored-by: Yannick Welsch <yannick@welsch.lu>
2020-10-06 18:37:05 +02:00
..
analytics Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
async [7.x] Remove integTest task from PluginBuildPlugin (#61879) (#62135) 2020-09-09 14:25:41 -05:00
async-search Fix testRestartAfterCompletion (#63211) 2020-10-02 18:14:42 -04:00
autoscaling Autoscaling decision return absolute capacity (#61575) (#62670) 2020-09-19 09:05:23 +02:00
ccr Determine shard size before allocating shards recovering from snapshots (#61906) (#63337) 2020-10-06 18:37:05 +02:00
core Determine shard size before allocating shards recovering from snapshots (#61906) (#63337) 2020-10-06 18:37:05 +02:00
data-streams Refactor SnapshotsInProgress State Transitions (#60517) (#63266) 2020-10-06 00:03:42 +02:00
deprecation Tweak the ECS fields in DeprecatedMessage (#62855) 2020-09-24 12:07:48 +01:00
enrich Fix enrich policy test bug. 2020-10-02 19:34:39 +02:00
eql EQL: Remove match functions (#63275) 2020-10-05 23:30:41 +03:00
frozen-indices Make keep alive optional in PointInTimeBuilder (#62720) 2020-09-22 18:52:54 -04:00
graph [7.x] Remove integTest task from PluginBuildPlugin (#61879) (#62135) 2020-09-09 14:25:41 -05:00
identity-provider Optimize XContentParserUtils.ensureExpectedToken (#62691) (#63253) 2020-10-05 19:08:32 +02:00
ilm Refactor SnapshotsInProgress State Transitions (#60517) (#63266) 2020-10-06 00:03:42 +02:00
logstash Add refresh policy to logstash plugin write requests (#62583) (#62665) 2020-09-18 17:44:53 -04:00
mapper-constant-keyword Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
mapper-flattened Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
mapper-unsigned-long Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
mapper-version Move FieldMapper#valueFetcher to MappedFieldType (#62974) (#63220) 2020-10-04 14:54:59 +01:00
ml Mute RegressionIT.testAliasFields test (#63339) 2020-10-06 12:18:12 -04:00
monitoring Avoid Redundantly Loading Monitoring Templates on CS Applier Thread (#62913) (#62979) 2020-09-29 11:45:22 +02:00
ql Remove case_sensitive request option (#63218) (#63244) 2020-10-05 22:04:42 +03:00
repositories-metering-api [7.x] Remove integTest task from PluginBuildPlugin (#61879) (#62135) 2020-09-09 14:25:41 -05:00
rollup [7.x] Generalize AsyncTwoPhaseIndexer first phase (#61739) (#62482) 2020-09-17 11:57:22 +03:00
runtime-fields Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
search-business-rules [7.x] Remove integTest task from PluginBuildPlugin (#61879) (#62135) 2020-09-09 14:25:41 -05:00
searchable-snapshots Determine shard size before allocating shards recovering from snapshots (#61906) (#63337) 2020-10-06 18:37:05 +02:00
security Bulk invalidate API keys using a list of IDs (#63224) (#63320) 2020-10-07 00:49:21 +11:00
spatial Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
sql Upgrade to Lucene-8.7.0-snapshot-77396dbf339 (#63222) 2020-10-05 14:39:30 -04:00
src Bulk invalidate API keys using a list of IDs (#63224) (#63320) 2020-10-07 00:49:21 +11:00
stack [7.x] Add "synthetics-*-*" templates for synthetics fleet data (#62193) (#62346) 2020-09-14 17:14:34 -06:00
transform [ML] Auditor ensures template is installed before writes (#63286) 2020-10-06 11:20:37 +01:00
vectors Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
voting-only-node [7.x] Remove integTest task from PluginBuildPlugin (#61879) (#62135) 2020-09-09 14:25:41 -05:00
watcher Optimize XContentParserUtils.ensureExpectedToken (#62691) (#63253) 2020-10-05 19:08:32 +02:00
wildcard Remove MapperService argument from IndexFieldData.Builder#build (#63197) (#63311) 2020-10-06 15:04:23 +02:00
build.gradle Fix Eclipse build (#62733) (#62786) 2020-09-22 17:44:25 -04:00