OpenSearch/modules
Simon Willnauer fadbe0de08
Automatically prepare indices for splitting (#27451)
Today we require users to prepare their indices for split operations.
Yet, we can do this automatically when an index is created which would
make the split feature a much more appealing option since it doesn't have
any 3rd party prerequisites anymore.

This change automatically sets the number of routinng shards such that
an index is guaranteed to be able to split once into twice as many shards.
The number of routing shards is scaled towards the default shard limit per index
such that indices with a smaller amount of shards can be split more often than
larger ones. For instance an index with 1 or 2 shards can be split 10x
(until it approaches 1024 shards) while an index created with 128 shards can only
be split 3x by a factor of 2. Please note this is just a default value and users
can still prepare their indices with `index.number_of_routing_shards` for custom
splitting.

NOTE: this change has an impact on the document distribution since we are changing
the hash space. Documents are still uniformly distributed across all shards but since
we are artificually changing the number of buckets in the consistent hashign space
document might be hashed into different shards compared to previous versions.

This is a 7.0 only change.
2017-11-23 09:48:54 +01:00
..
aggs-matrix-stats Automatically prepare indices for splitting (#27451) 2017-11-23 09:48:54 +01:00
analysis-common Add limits for ngram and shingle settings (#27211) 2017-11-07 08:14:55 -05:00
ingest-common Rest test fixes (#27354) 2017-11-14 11:14:14 +01:00
lang-expression Upgrade to Lucene 7.1 (#27225) 2017-11-02 13:25:33 +00:00
lang-mustache Automatically prepare indices for splitting (#27451) 2017-11-23 09:48:54 +01:00
lang-painless Upgrade Painless from ANTLR 4.5.1-1 to ANTLR 4.5.3. (#27153) 2017-10-27 11:07:49 -07:00
mapper-extras #26260 Allow ip_range to accept CIDR notation (#27192) 2017-11-03 13:34:48 -06:00
parent-join Enhances exists queries to reduce need for `_field_names` (#26930) 2017-11-01 10:46:59 +00:00
percolator Use the primary_term field to identify parent documents (#27469) 2017-11-21 15:14:03 +01:00
reindex Cross Cluster Search: make remote clusters optional (#27182) 2017-11-21 11:41:47 +01:00
repository-url Remove the single argument Environment constructor (#27235) 2017-11-04 13:25:09 +00:00
transport-netty4 Fix issue where pages aren't released (#27459) 2017-11-20 14:53:08 -07:00
tribe Remove Settings#getAsMap() (#26845) 2017-10-04 01:21:38 -06:00
build.gradle Build: Change `gradle run` to use zip distribution (#21001) 2016-10-18 11:48:58 -07:00