honeymoose
/
OpenSearch
mirror of https://github.com/honeymoose/OpenSearch.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
OpenSearch/x-pack/plugin
History
Tanguy Leroux 289b1f4ae7
Reduce locking in prewarming (#61837) (#61967) 
During prewarming of a Lucene file a CacheFile is acquired and 
then locked for the duration of the prewarming, ie locked until all 
the part of the file has been downloaded and written to cache on 
disk. The locking (executed with CacheFile#fileLock()) is here to 
prevent the cache file to be evicted while it is prewarming.

But holding the lock may take a while for large files, specially since
 restoring snapshot files now respects the 
indices.recovery.max_bytes_per_sec setting of 40mb (#58658), 
and this can have bad consequences like preventing the CacheFile 
to be evicted, opened or closed. In manual tests this bug slow 
downs various requests like mounting a new searchable snapshot
 index or deleting an existing one that is still prewarming.

This commit reduces the time the lock is held during prewarming so
 that the read lock is only required when actively writing to the CacheFile.
 		2020-09-04 15:06:50 +02:00
..
analytics Support longs in BitArray (backport of #61867) (#61871) 2020-09-02 17:24:31 -04:00
async [7.x] Cleanup xpack build.gradle (#60554) (#60603) 2020-08-03 13:11:43 -05:00
async-search [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
autoscaling [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
ccr [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
core [7.x] [ML] adds new n_gram_encoding custom processor (#61578) (#61935) 2020-09-04 08:36:50 -04:00
data-streams [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
deprecation Do not create two loggers for DeprecationLogger backport(#58435) (#61530) 2020-08-26 16:04:02 +02:00
enrich [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
eql EQL: Revert filter pipe (#61907) 2020-09-03 22:31:08 +03:00
frozen-indices [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
graph [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
identity-provider [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
ilm [7.x] Convert first 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#60630) (#61855) 2020-09-02 11:19:24 -05:00
logstash [7.x] Cleanup xpack build.gradle (#60554) (#60603) 2020-08-03 13:11:43 -05:00
mapper-constant-keyword upgrade to Lucene-8.7.0-snapshot-61ea26a (#61957) (#61974) 2020-09-04 13:46:20 +02:00
mapper-flattened upgrade to Lucene-8.7.0-snapshot-61ea26a (#61957) (#61974) 2020-09-04 13:46:20 +02:00
ml [7.x] [ML] adds new n_gram_encoding custom processor (#61578) (#61935) 2020-09-04 08:36:50 -04:00
monitoring [7.x] Correct the query dsl for watching elasticsearch version (#58321) (#61882) 2020-09-02 16:58:21 -05:00
ql QL: wildcard field type support (#58062) (#61205) 2020-08-17 18:24:32 +03:00
rollup Do not create two loggers for DeprecationLogger backport(#58435) (#61530) 2020-08-26 16:04:02 +02:00
search-business-rules [7.x] Cleanup xpack build.gradle (#60554) (#60603) 2020-08-03 13:11:43 -05:00
searchable-snapshots Reduce locking in prewarming (#61837) (#61967) 2020-09-04 15:06:50 +02:00
security [7.x] Convert second 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#61802) (#61856) 2020-09-02 11:20:55 -05:00
spatial [7.x] Convert second 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#61802) (#61856) 2020-09-02 11:20:55 -05:00
sql upgrade to Lucene-8.7.0-snapshot-61ea26a (#61957) (#61974) 2020-09-04 13:46:20 +02:00
src/test Fix skip versions fix xpack data stream yaml tests. (#61981) 2020-09-04 14:53:38 +02:00
stack [7.x] Convert second 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#61802) (#61856) 2020-09-02 11:20:55 -05:00
transform [7.x] Convert second 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#61802) (#61856) 2020-09-02 11:20:55 -05:00
vectors [7.x] Convert second 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#61802) (#61856) 2020-09-02 11:20:55 -05:00
voting-only-node [7.x] Convert second 1/2 x-pack plugins from integTest to [yaml | java]RestTest or internalClusterTest (#61802) (#61856) 2020-09-02 11:20:55 -05:00
watcher [7.x] Fix passing params to template or script failed in watcher (#58559) (#61885) 2020-09-03 15:47:51 -05:00
wildcard upgrade to Lucene-8.7.0-snapshot-61ea26a (#61957) (#61974) 2020-09-04 13:46:20 +02:00
build.gradle Merge test runner task into RestIntegTest (7.x backport) (#60600) 2020-08-04 14:46:32 +02:00