2015-09-17 16:36:25 -04:00
|
|
|
[[indices-forcemerge]]
|
2019-07-19 14:35:36 -04:00
|
|
|
=== Force Merge
|
2015-09-17 16:36:25 -04:00
|
|
|
|
2019-07-23 02:32:44 -04:00
|
|
|
The force merge API allows you to force a <<index-modules-merge,merge>> on the
|
|
|
|
shards of one or more indices. Merging reduces the number of segments in each
|
|
|
|
shard by merging some of them together, and also frees up the space used by
|
|
|
|
deleted documents. Merging normally happens automatically, but sometimes it is
|
|
|
|
useful to trigger a merge manually.
|
|
|
|
|
|
|
|
WARNING: **Force merge should only be called against an index after you have
|
|
|
|
finished writing to it.** Force merge can cause very large (>5GB) segments to
|
|
|
|
be produced, and if you continue to write to such an index then the automatic
|
|
|
|
merge policy will never consider these segments for future merges until they
|
|
|
|
mostly consist of deleted documents. This can cause very large segments to
|
|
|
|
remain in the index which can result in increased disk usage and worse search
|
|
|
|
performance.
|
|
|
|
|
|
|
|
Calls to this API block until the merge is complete. If the client connection
|
|
|
|
is lost before completion then the force merge process will continue in the
|
|
|
|
background. Any new requests to force merge the same indices will also block
|
|
|
|
until the ongoing force merge is complete.
|
2015-09-17 16:36:25 -04:00
|
|
|
|
2019-09-06 11:31:13 -04:00
|
|
|
[source,console]
|
2019-07-23 02:32:44 -04:00
|
|
|
--------------------------------------------------
|
|
|
|
POST /twitter/_forcemerge
|
|
|
|
--------------------------------------------------
|
|
|
|
// TEST[setup:twitter]
|
2015-09-17 16:36:25 -04:00
|
|
|
|
2019-07-23 02:32:44 -04:00
|
|
|
Force-merging can be useful with time-based indices and when using
|
|
|
|
<<indices-rollover-index,rollover>>. In these cases each index only receives
|
|
|
|
indexing traffic for a certain period of time, and once an index will receive
|
|
|
|
no more writes its shards can be force-merged down to a single segment:
|
2018-05-09 12:53:55 -04:00
|
|
|
|
2019-09-06 11:31:13 -04:00
|
|
|
[source,console]
|
2015-09-17 16:36:25 -04:00
|
|
|
--------------------------------------------------
|
2019-07-23 02:32:44 -04:00
|
|
|
POST /logs-000001/_forcemerge?max_num_segments=1
|
2015-09-17 16:36:25 -04:00
|
|
|
--------------------------------------------------
|
2016-09-01 13:05:22 -04:00
|
|
|
// TEST[setup:twitter]
|
2019-07-23 02:32:44 -04:00
|
|
|
// TEST[s/logs-000001/twitter/]
|
|
|
|
|
|
|
|
This can be a good idea because single-segment shards can sometimes use simpler
|
|
|
|
and more efficient data structures to perform searches.
|
2015-09-17 16:36:25 -04:00
|
|
|
|
|
|
|
[float]
|
|
|
|
[[forcemerge-parameters]]
|
2019-07-19 14:35:36 -04:00
|
|
|
==== Request Parameters
|
2015-09-17 16:36:25 -04:00
|
|
|
|
|
|
|
The force merge API accepts the following request parameters:
|
|
|
|
|
|
|
|
[horizontal]
|
|
|
|
`max_num_segments`:: The number of segments to merge to. To fully
|
|
|
|
merge the index, set it to `1`. Defaults to simply checking if a
|
|
|
|
merge needs to execute, and if so, executes it.
|
|
|
|
|
|
|
|
`only_expunge_deletes`:: Should the merge process only expunge segments with
|
|
|
|
deletes in it. In Lucene, a document is not deleted from a segment, just marked
|
|
|
|
as deleted. During a merge process of segments, a new segment is created that
|
|
|
|
does not have those deletes. This flag allows to only merge segments that have
|
|
|
|
deletes. Defaults to `false`. Note that this won't override the
|
|
|
|
`index.merge.policy.expunge_deletes_allowed` threshold.
|
|
|
|
|
|
|
|
`flush`:: Should a flush be performed after the forced merge. Defaults to
|
|
|
|
`true`.
|
|
|
|
|
2019-09-06 11:31:13 -04:00
|
|
|
[source,console]
|
2018-05-07 08:54:06 -04:00
|
|
|
--------------------------------------------------
|
|
|
|
POST /kimchy/_forcemerge?only_expunge_deletes=false&max_num_segments=100&flush=true
|
|
|
|
--------------------------------------------------
|
2018-05-07 10:09:03 -04:00
|
|
|
// TEST[s/^/PUT kimchy\n/]
|
2018-05-07 08:54:06 -04:00
|
|
|
|
2015-09-17 16:36:25 -04:00
|
|
|
[float]
|
|
|
|
[[forcemerge-multi-index]]
|
2019-07-19 14:35:36 -04:00
|
|
|
==== Multi Index
|
2015-09-17 16:36:25 -04:00
|
|
|
|
|
|
|
The force merge API can be applied to more than one index with a single call, or
|
2018-10-23 06:25:04 -04:00
|
|
|
even on `_all` the indices. Multi index operations are executed one shard at a
|
|
|
|
time per node. Force merge makes the storage for the shard being merged
|
|
|
|
temporarily increase, up to double its size in case `max_num_segments` is set
|
|
|
|
to `1`, as all segments need to be rewritten into a new one.
|
|
|
|
|
2015-09-17 16:36:25 -04:00
|
|
|
|
2019-09-06 11:31:13 -04:00
|
|
|
[source,console]
|
2015-09-17 16:36:25 -04:00
|
|
|
--------------------------------------------------
|
2016-09-01 13:05:22 -04:00
|
|
|
POST /kimchy,elasticsearch/_forcemerge
|
2015-09-17 16:36:25 -04:00
|
|
|
|
2016-09-01 13:05:22 -04:00
|
|
|
POST /_forcemerge
|
2015-09-17 16:36:25 -04:00
|
|
|
--------------------------------------------------
|
2016-09-01 13:05:22 -04:00
|
|
|
// TEST[s/^/PUT kimchy\nPUT elasticsearch\n/]
|