mirror of
https://github.com/honeymoose/OpenSearch.git
synced 2025-02-13 16:35:45 +00:00
a2ffe494ae
Upgrades lucene to latest, and supports the BEST_COMPRESSION parameter now supported (with backwards compatibility, etc) in Lucene. This option uses deflate, tuned for highly compressible data. index.codec:: The default value compresses stored data with LZ4 compression, but this can be set to best_compression for a higher compression ratio, at the expense of slower stored fields performance. IMO its safest to implement as a named codec here, because ES already has logic to handle this correctly, and because its unrealistic to have a plethora of options to Lucene's default codec... we are practically limited in Lucene to what we can support with back compat, so I don't think we should overengineer this and add additional unnecessary plumbing. See also: https://issues.apache.org/jira/browse/LUCENE-5914 https://issues.apache.org/jira/browse/LUCENE-6089 https://issues.apache.org/jira/browse/LUCENE-6090 https://issues.apache.org/jira/browse/LUCENE-6100 Closes #8863
87 lines
2.9 KiB
Plaintext
87 lines
2.9 KiB
Plaintext
[[index-modules]]
|
|
= Index Modules
|
|
|
|
[partintro]
|
|
--
|
|
Index Modules are modules created per index and control all aspects
|
|
related to an index. Since those modules lifecycle are tied to an index,
|
|
all the relevant modules settings can be provided when creating an index
|
|
(and it is actually the recommended way to configure an index).
|
|
|
|
[float]
|
|
[[index-modules-settings]]
|
|
== Index Settings
|
|
|
|
There are specific index level settings that are not associated with any
|
|
specific module. These include:
|
|
|
|
[[index-compound-format]]`index.compound_format`::
|
|
|
|
Should the compound file format be used (boolean setting).
|
|
The compound format was created to reduce the number of open
|
|
file handles when using file based storage. However, by default it is set
|
|
to `false` as the non-compound format gives better performance. It is important
|
|
that OS is configured to give Elasticsearch ``enough'' file handles.
|
|
See <<file-descriptors>>.
|
|
+
|
|
Alternatively, `compound_format` can be set to a number between `0` and
|
|
`1`, where `0` means `false`, `1` means `true` and a number inbetween
|
|
represents a percentage: if the merged segment is less than this
|
|
percentage of the total index, then it is written in compound format,
|
|
otherwise it is written in non-compound format.
|
|
|
|
[[index-compound-on-flush]]`index.compound_on_flush`::
|
|
|
|
Should a new segment (create by indexing, not by merging) be written
|
|
in compound format or non-compound format? Defaults to `true`.
|
|
This is a dynamic setting.
|
|
|
|
`index.refresh_interval`::
|
|
A time setting controlling how often the
|
|
refresh operation will be executed. Defaults to `1s`. Can be set to `-1`
|
|
in order to disable it.
|
|
|
|
`index.codec`::
|
|
The `default` value compresses stored data with LZ4 compression, but
|
|
this can be set to `best_compression` for a higher compression ratio,
|
|
at the expense of slower stored fields performance.
|
|
|
|
`index.shard.check_on_startup`::
|
|
Should shard consistency be checked upon opening.
|
|
When `true`, the shard will be checked, preventing it from being open in
|
|
case some segments appear to be corrupted.
|
|
When `fix`, the shard will also be checked but segments that were reported
|
|
as corrupted will be automatically removed.
|
|
Default value is `false`, which doesn't check shards.
|
|
|
|
NOTE: Checking shards may take a lot of time on large indices.
|
|
|
|
WARNING: Setting `index.shard.check_on_startup` to `fix` may result in data loss,
|
|
use with caution.
|
|
|
|
--
|
|
|
|
include::index-modules/analysis.asciidoc[]
|
|
|
|
include::index-modules/allocation.asciidoc[]
|
|
|
|
include::index-modules/slowlog.asciidoc[]
|
|
|
|
include::index-modules/merge.asciidoc[]
|
|
|
|
include::index-modules/store.asciidoc[]
|
|
|
|
include::index-modules/mapper.asciidoc[]
|
|
|
|
include::index-modules/translog.asciidoc[]
|
|
|
|
include::index-modules/cache.asciidoc[]
|
|
|
|
include::index-modules/query-cache.asciidoc[]
|
|
|
|
include::index-modules/fielddata.asciidoc[]
|
|
|
|
include::index-modules/similarity.asciidoc[]
|
|
|
|
|