[[indices-shrink-index]] === Shrink index API ++++ Shrink index ++++ Shrinks an existing index into a new index with fewer primary shards. [source,console] ---- POST /twitter/_shrink/shrunk-twitter-index ---- // TEST[s/^/PUT twitter\n{"settings":{"index.number_of_shards":2,"blocks.write":true}}\n/] [[shrink-index-api-request]] ==== {api-request-title} `POST //_shrink/` `PUT //_shrink/` [[shrink-index-api-prereqs]] ==== {api-prereq-title} Before you can shrink an index: * The index must be read-only. * A copy of every shard in the index must reside on the same node. * The <> status must be green. These three conditions can be achieved with the following request: [source,console] -------------------------------------------------- PUT /my_source_index/_settings { "settings": { "index.routing.allocation.require._name": "shrink_node_name", <1> "index.blocks.write": true <2> } } -------------------------------------------------- // TEST[s/^/PUT my_source_index\n{"settings":{"index.number_of_shards":2}}\n/] <1> Forces the relocation of a copy of each shard to the node with name `shrink_node_name`. See <> for more options. <2> Prevents write operations to this index while still allowing metadata changes like deleting the index. It can take a while to relocate the source index. Progress can be tracked with the <>, or the <> can be used to wait until all shards have relocated with the `wait_for_no_relocating_shards` parameter. [[shrink-index-api-desc]] ==== {api-description-title} The shrink index API allows you to shrink an existing index into a new index with fewer primary shards. The requested number of primary shards in the target index must be a factor of the number of shards in the source index. For example an index with `8` primary shards can be shrunk into `4`, `2` or `1` primary shards or an index with `15` primary shards can be shrunk into `5`, `3` or `1`. If the number of shards in the index is a prime number it can only be shrunk into a single primary shard. Before shrinking, a (primary or replica) copy of every shard in the index must be present on the same node. [[how-shrink-works]] ===== How shrinking works A shrink operation: . Creates a new target index with the same definition as the source index, but with a smaller number of primary shards. . Hard-links segments from the source index into the target index. (If the file system doesn't support hard-linking, then all segments are copied into the new index, which is a much more time consuming process. Also if using multiple data paths, shards on different data paths require a full copy of segment files if they are not on the same disk since hardlinks don’t work across disks) . Recovers the target index as though it were a closed index which had just been re-opened. [[_shrinking_an_index]] ===== Shrink an index To shrink `my_source_index` into a new index called `my_target_index`, issue the following request: [source,console] -------------------------------------------------- POST /my_source_index/_shrink/my_target_index { "settings": { "index.routing.allocation.require._name": null, <1> "index.blocks.write": null <2> } } -------------------------------------------------- // TEST[continued] <1> Clear the allocation requirement copied from the source index. <2> Clear the index write block copied from the source index. The above request returns immediately once the target index has been added to the cluster state -- it doesn't wait for the shrink operation to start. [IMPORTANT] ===================================== Indices can only be shrunk if they satisfy the following requirements: * the target index must not exist * The index must have more primary shards than the target index. * The number of primary shards in the target index must be a factor of the number of primary shards in the source index. The source index must have more primary shards than the target index. * The index must not contain more than `2,147,483,519` documents in total across all shards that will be shrunk into a single shard on the target index as this is the maximum number of docs that can fit into a single shard. * The node handling the shrink process must have sufficient free disk space to accommodate a second copy of the existing index. ===================================== The `_shrink` API is similar to the <> and accepts `settings` and `aliases` parameters for the target index: [source,console] -------------------------------------------------- POST /my_source_index/_shrink/my_target_index { "settings": { "index.number_of_replicas": 1, "index.number_of_shards": 1, <1> "index.codec": "best_compression" <2> }, "aliases": { "my_search_indices": {} } } -------------------------------------------------- // TEST[s/^/PUT my_source_index\n{"settings": {"index.number_of_shards":5,"index.blocks.write": true}}\n/] <1> The number of shards in the target index. This must be a factor of the number of shards in the source index. <2> Best compression will only take affect when new writes are made to the index, such as when <> the shard to a single segment. NOTE: Mappings may not be specified in the `_shrink` request. [[monitor-shrink]] ===== Monitor the shrink process The shrink process can be monitored with the <>, or the <> can be used to wait until all primary shards have been allocated by setting the `wait_for_status` parameter to `yellow`. The `_shrink` API returns as soon as the target index has been added to the cluster state, before any shards have been allocated. At this point, all shards are in the state `unassigned`. If, for any reason, the target index can't be allocated on the shrink node, its primary shard will remain `unassigned` until it can be allocated on that node. Once the primary shard is allocated, it moves to state `initializing`, and the shrink process begins. When the shrink operation completes, the shard will become `active`. At that point, Elasticsearch will try to allocate any replicas and may decide to relocate the primary shard to another node. [[shrink-wait-active-shards]] ===== Wait for active shards Because the shrink operation creates a new index to shrink the shards to, the <> setting on index creation applies to the shrink index action as well. [[shrink-index-api-path-params]] ==== {api-path-parms-title} ``:: (Required, string) Name of the source index to shrink. include::{docdir}/rest-api/common-parms.asciidoc[tag=target-index] [[shrink-index-api-query-params]] ==== {api-query-parms-title} include::{docdir}/rest-api/common-parms.asciidoc[tag=wait_for_active_shards] include::{docdir}/rest-api/common-parms.asciidoc[tag=timeoutparms] [[shrink-index-api-request-body]] ==== {api-request-body-title} include::{docdir}/rest-api/common-parms.asciidoc[tag=target-index-aliases] include::{docdir}/rest-api/common-parms.asciidoc[tag=target-index-settings]