OpenSearch/docs/reference/setup/cluster_restart.asciidoc

127 lines
4.3 KiB
Plaintext
Raw Normal View History

2015-06-19 10:27:28 -04:00
[[restart-upgrade]]
=== Full cluster restart upgrade
Elasticsearch requires a full cluster restart when upgrading across major
versions. Rolling upgrades are not supported across major versions. Consult
this <<setup-upgrade,table>> to verify that a full cluster restart is
required.
2015-06-19 10:27:28 -04:00
The process to perform an upgrade with a full cluster restart is as follows:
==== Step 1: Disable shard allocation
When you shut down a node, the allocation process will immediately try to
replicate the shards that were on that node to other nodes in the cluster,
causing a lot of wasted I/O. This can be avoided by disabling allocation
before shutting down a node:
[source,js]
2015-06-19 10:27:28 -04:00
--------------------------------------------------
PUT _cluster/settings
2015-06-19 10:27:28 -04:00
{
"persistent": {
"cluster.routing.allocation.enable": "none"
}
}
--------------------------------------------------
// AUTOSENSE
// TEST[skip:indexes don't assign]
2015-06-19 10:27:28 -04:00
==== Step 2: Perform a synced flush
Shard recovery will be much faster if you stop indexing and issue a
<<indices-synced-flush, synced-flush>> request:
[source,sh]
--------------------------------------------------
POST _flush/synced
2015-06-19 10:27:28 -04:00
--------------------------------------------------
// AUTOSENSE
A synced flush request is a ``best effort'' operation. It will fail if there
are any pending indexing operations, but it is safe to reissue the request
multiple times if necessary.
==== Step 3: Shutdown and upgrade all nodes
Stop all Elasticsearch services on all nodes in the cluster. Each node can be
upgraded following the same procedure described in <<upgrade-node>>.
==== Step 4: Upgrade any plugins
Elasticsearch plugins must be upgraded when upgrading a node. Use the
`elasticsearch-plugin` script to install the correct version of any plugins
that you need.
==== Step 5: Start the cluster
2015-06-19 10:27:28 -04:00
If you have dedicated master nodes -- nodes with `node.master` set to
`true`(the default) and `node.data` set to `false` -- then it is a good idea
to start them first. Wait for them to form a cluster and to elect a master
2015-10-26 16:47:44 -04:00
before proceeding with the data nodes. You can check progress by looking at the
2015-06-19 10:27:28 -04:00
logs.
As soon as the <<master-election,minimum number of master-eligible nodes>>
have discovered each other, they will form a cluster and elect a master. From
that point on, the <<cat-health,`_cat/health`>> and <<cat-nodes,`_cat/nodes`>>
APIs can be used to monitor nodes joining the cluster:
[source,sh]
--------------------------------------------------
GET _cat/health
GET _cat/nodes
--------------------------------------------------
// AUTOSENSE
Use these APIs to check that all nodes have successfully joined the cluster.
==== Step 6: Wait for yellow
2015-06-19 10:27:28 -04:00
As soon as each node has joined the cluster, it will start to recover any
primary shards that are stored locally. Initially, the
<<cat-health,`_cat/health`>> request will report a `status` of `red`, meaning
that not all primary shards have been allocated.
Once each node has recovered its local shards, the `status` will become
`yellow`, meaning all primary shards have been recovered, but not all replica
shards are allocated. This is to be expected because allocation is still
disabled.
==== Step 7: Reenable allocation
2015-06-19 10:27:28 -04:00
Delaying the allocation of replicas until all nodes have joined the cluster
allows the master to allocate replicas to nodes which already have local shard
copies. At this point, with all the nodes in the cluster, it is safe to
reenable shard allocation:
[source,js]
2015-06-19 10:27:28 -04:00
------------------------------------------------------
PUT _cluster/settings
2015-06-19 10:27:28 -04:00
{
"persistent": {
"cluster.routing.allocation.enable": "all"
}
}
------------------------------------------------------
// AUTOSENSE
The cluster will now start allocating replica shards to all data nodes. At this
point it is safe to resume indexing and searching, but your cluster will
recover more quickly if you can delay indexing and searching until all shards
have recovered.
You can monitor progress with the <<cat-health,`_cat/health`>> and
<<cat-recovery,`_cat/recovery`>> APIs:
[source,sh]
--------------------------------------------------
GET _cat/health
GET _cat/recovery
--------------------------------------------------
// AUTOSENSE
Once the `status` column in the `_cat/health` output has reached `green`, all
primary and replica shards have been successfully allocated.