OpenSearch/release-notes/opensearch.release-notes-1....

391 lines
14 KiB
Markdown

## Version 1.1.0 Release Notes
* __Changes to support retrieval of operations from translog based on specified range (#1257)__
[Sai](mailto:karanas@amazon.com) - Sun, 26 Sep 2021 00:02:29 -0500
Backport changes to support retrieval of operations from translog based on
specified range
Signed-off-by: Sai Kumar <karanas@amazon.com>
* __[Backport] Support for translog pruning based on retention leases (#1038) (#1256)__
[Sai](mailto:karanas@amazon.com) - Sat, 25 Sep 2021 23:53:32 -0500
Support for translog pruning based on retention leases; including deprecations
for
refactoring to ccr plugin in the future.
Co-authored-by: Nicholas Walter Knize <nknize@apache.org>
Signed-off-by: Sai
Kumar <karanas@amazon.com>
* __fix gradle check fail due to renameing -min in #1094 (#1289) (#1291)__
[Xue Zhou](mailto:85715413+xuezhou25@users.noreply.github.com) - Fri, 24 Sep 2021 23:03:45 -0500
Signed-off-by: Xue Zhou <xuezhou@amazon.com>
* __Rename artifact produced by the build to include -min (#1251) (#1271)__
[Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Wed, 22 Sep 2021 10:52:24 -0400
Signed-off-by: Xue Zhou <xuezhou@amazon.com>
Co-authored-by: Xue Zhou <85715413+xuezhou25@users.noreply.github.com>
* __[Bug] Fix InstallPluginCommand to use proper key signatures (#1233) (#1235)__
[Nick Knize](mailto:nknize@apache.org) - Mon, 13 Sep 2021 11:55:24 -0700
efs/remotes/origin/1.1
The public key has changed since the initial release. This commit fixes the
public key and uses the .sig files that are published to the artifacts site.
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
* __Fix org.opensearch.index.reindex.ReindexRestClientSslTests#testClientSucceedsWithCertificateAuthorities - javax.net.ssl.SSLPeerUnverifiedException (#1212) (#1224)__
[Andriy Redko](mailto:andriy.redko@aiven.io) - Fri, 10 Sep 2021 11:49:33 -0400
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
* __Max scroll limit breach to throw a OpenSearchRejectedExecutionException (#1054) (#1231)__
[Rabi Panda](mailto:adnapibar@gmail.com) - Fri, 10 Sep 2021 10:34:46 -0400
* Changes the Exception to throw a OpenSearchRejectedExecutionException on max
scroll limit breach
Signed-off-by: Bukhtawar Khan bukhtawa@amazon.com
Co-authored-by: Bukhtawar Khan <bukhtawa@amazon.com>
* __[1.x] Backport opensearch-upgrade CLI tool (#1222)__
[Rabi Panda](mailto:adnapibar@gmail.com) - Wed, 8 Sep 2021 10:39:02 -0700
* A CLI tool to assist during an upgrade to OpenSearch. (#846)
This change adds the initial version of a new CLI tool `opensearch-upgrade` as
part of the OpenSearch distribution. This tool is meant for assisting during an
upgrade from an existing Elasticsearch v7.10.2/v6.8.0 node to OpenSearch. It
automates the process of importing existing configurations and installing of
core plugins.
Signed-off-by: Rabi Panda <adnapibar@gmail.com>
* Validation for official plugins for upgrade tool (#973)
Add validation to check for official plugins during the plugins installation
task for the upgrade tool.
Signed-off-by: Vacha Shah <vachshah@amazon.com>
Co-authored-by: Vacha <vachshah@amazon.com>
* __Kept the original constructor for PluginInfo to maintain bwc (#1206) (#1209)__
[Vacha](mailto:vachshah@amazon.com) - Thu, 2 Sep 2021 22:05:44 -0400
efs/remotes/upstream/1.x, refs/remotes/origin/1.x, refs/heads/1.x
Signed-off-by: Vacha <vachshah@amazon.com>
* __Clarify JDK requirement in the developer guide (#1153) (#1208)__
[Tianli Feng](mailto:ftianli@amazon.com) - Thu, 2 Sep 2021 17:02:59 -0700
* Explicitly point out the JDK 8 requirement is for runtime, but not for
compiling.
* Clarify the JAVAx_HOME env variables are for the "backwards compatibility
test".
* Add explanation on how the backwards compatibility tests get the OpenSearch
distributions for a specific version.
Signed-off-by: Tianli Feng
<ftianli@amazon.com>
* __Upgrade apache commons-compress to 1.21 (#1197) (#1203)__
[Abbas Hussain](mailto:abbashus@amazon.com) - Fri, 3 Sep 2021 01:47:57 +0530
Signed-off-by: Abbas Hussain <abbas_10690@yahoo.com>
* __Restoring alpha/beta/rc version semantics (#1112) (#1204)__
[Andriy Redko](mailto:andriy.redko@aiven.io) - Thu, 2 Sep 2021 08:01:46 -0500
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
* __[Bug] Fix mixed cluster support for OpenSearch 2+ (#1191) (#1195)__
[Nick Knize](mailto:nknize@apache.org) - Wed, 1 Sep 2021 17:04:40 -0500
The version framework only added support for OpenSearch 1.x bwc with legacy
clusters. This commit adds support for v2.0 which will be the last version with
bwc support for legacy clusters (v7.10)
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
* __Drop mocksocket & securemock dependencies from sniffer and rest client (no needed) (#1174) (#1187)__
[Andriy Redko](mailto:drreta@gmail.com) - Tue, 31 Aug 2021 19:44:42 -0400
* Drop mocksocket & securemock dependencies from sniffer and rest client (not
needed)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
* Removing .gitignore
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
* __Backporting the fix to 1.x for fixing Copyright licensing (#1188)__
[Minal Shah](mailto:87717056+minalsha@users.noreply.github.com) - Tue, 31 Aug 2021 19:38:56 -0400
Signed-off-by: Minal Shah <minalsha@amazon.com>
* __Reduce iterations to improve test run time (#1168) (#1177)__
[Abbas Hussain](mailto:abbashus@amazon.com) - Tue, 31 Aug 2021 01:06:29 +0530
Signed-off-by: Abbas Hussain <abbas_10690@yahoo.com>
* __Tune datanode count and shards count to improve test run time (#1170) (#1176)__
[Abbas Hussain](mailto:abbashus@amazon.com) - Tue, 31 Aug 2021 00:14:38 +0530
Signed-off-by: Abbas Hussain <abbas_10690@yahoo.com>
* __Add 1.0.1 revision (#1152) (#1160)__
[Nick Knize](mailto:nknize@gmail.com) - Thu, 26 Aug 2021 07:10:24 -0500
This commit stages the branch to the next 1.0.1 patch release. BWC testing
needs
this even if the next revision is never actually released.
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
* __[Bug] Change 1.0.0 version check in PluginInfo (#1159)__
[Nick Knize](mailto:nknize@gmail.com) - Wed, 25 Aug 2021 23:58:30 -0500
PluginInfo should use .onOrAfter(Version.V_1_1_0) instead of
.after(Version.V_1_0_0) for the new custom folder name for plugin feature.
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
* __Include sources and javadoc artifacts while publishing to a Maven repository (#1049) (#1139)__
[Rabi Panda](mailto:adnapibar@gmail.com) - Mon, 23 Aug 2021 17:12:20 -0700
This change fixes the issue where the sources and javadoc artifacts were not
built and included with the publish.
Signed-off-by: Rabi Panda <adnapibar@gmail.com>
* __Allowing custom folder name for plugin installation (#848) (#1116)__
[Vacha](mailto:vachshah@amazon.com) - Mon, 23 Aug 2021 14:39:27 -0700
Signed-off-by: Vacha Shah <vachshah@amazon.com>
* __Upgrade to Lucene 8.9 (#1080) (#1115)__
[Nick Knize](mailto:nknize@gmail.com) - Mon, 23 Aug 2021 10:06:34 -0700
This commit upgrades to the official lucene 8.9 release
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
* __[DEPRECATE] SimpleFS in favor of NIOFS (#1073) (#1114)__
[Nick Knize](mailto:nknize@gmail.com) - Fri, 20 Aug 2021 11:26:22 -0500
Lucene 9 removes support for SimpleFS File System format. This commit
deprecates
the SimpleFS format in favor of NIOFS.
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
* __Fix failure in SearchCancellationIT.testMSearchChildReqCancellationWithHybridTimeout (#1105)__
[Sorabh](mailto:sohami.apache@gmail.com) - Tue, 17 Aug 2021 16:23:55 -0400
In some cases as one shared with issue #1099, the maxConcurrentSearchRequests
was chosen as 0 which
will compute the final value during execution of the
request based on processor counts. When this
computed value is less than
number of search request in msearch request, it will execute all the
requests
in multiple iterations causing the failure since test will only wait for one
such
iteration. Hence setting the maxConcurrentSearchRequests explicitly to
number of search requests
being added in the test to ensure correct behavior
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
* __Support for bwc tests for plugins (#1051) (#1090)__
[Vacha](mailto:vachshah@amazon.com) - Sun, 15 Aug 2021 08:07:55 -0700
* Support for bwc tests for plugins
Signed-off-by: Vacha <vachshah@amazon.com>
* Adding support for restart upgrades for plugins bwc
Signed-off-by: Vacha <vachshah@amazon.com>
* __Improving the Grok circular reference check to prevent stack overflow (#1079) (#1087)__
[kartg](mailto:85275476+kartg@users.noreply.github.com) - Thu, 12 Aug 2021 18:47:56 -0400
This change refactors the circular reference check in the Grok processor class
to use a formal depth-first traversal. It also includes a logic update to
prevent a stack overflow in one scenario and a check for malformed patterns.
This bugfix addresses CVE-2021-22144.
Signed-off-by: Kartik Ganesh <85275476+kartg@users.noreply.github.com>
* __Part 1: Support for cancel_after_timeinterval parameter in search and msearch request (#986) (#1085)__
[Sorabh](mailto:sorabh@apache.org) - Thu, 12 Aug 2021 13:52:28 -0400
* Part 1: Support for cancel_after_timeinterval parameter in search and msearch
request
This commit introduces the new request level parameter to configure the
timeout interval after which
a search request will be cancelled. For msearch
request the parameter is supported both at parent
request and at sub child
search requests. If it is provided at parent level and child search request
doesn't have it then the parent level value is set at such child request. The
parent level msearch
is not used to cancel the parent request as it may be
tricky to come up with correct value in cases
when child search request can
have different runtimes
TEST: Added test for ser/de with new parameter
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
* Part 2: Support for cancel_after_timeinterval parameter in search and msearch
request
This commit adds the handling of the new request level parameter and schedule
cancellation task. It
also adds a cluster setting to set a global cancellation
timeout for search request which will be
used in absence of request level
timeout.
TEST: Added new tests in SearchCancellationIT
Signed-off-by: Sorabh
Hamirwasia <sohami.apache@gmail.com>
* Address Review feedback for Part 1
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
* Address review feedback for Part 2
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
* Update CancellableTask to remove the cancelOnTimeout boolean flag
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
* Replace search.cancellation.timeout cluster setting with
search.enforce_server.timeout.cancellation to control if cluster level
cancel_after_time_interval should take precedence over request level
cancel_after_time_interval value
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
* Removing the search.enforce_server.timeout.cancellation cluster setting and
just keeping search.cancel_after_time_interval setting with request level
parameter taking the precedence.
Signed-off-by: Sorabh Hamirwasia <sohami.apache@gmail.com>
Co-authored-by: Sorabh Hamirwasia <hsorabh@amazon.com>
Co-authored-by: Sorabh Hamirwasia <hsorabh@amazon.com>
* __Avoid crashing on using the index.lifecycle.name in the API body (#1060) (#1070)__
[frotsch](mailto:86320880+frotsch@users.noreply.github.com) - Tue, 10 Aug 2021 14:16:44 -0400
* Avoid crashing on using the index.lifecycle.name in the API body
Signed-off-by: frotsch <frotsch@mailbox.org>
* __Introduce RestHandler.Wrapper to help with delegate implementations (#1004) (#1031)__
[Vlad Rozov](mailto:vrozov@users.noreply.github.com) - Tue, 3 Aug 2021 09:02:40 -0400
Signed-off-by: Vlad Rozov <vrozov@users.noreply.github.com>
* __Rank feature - unknown field linear (#983) (#1025)__
[Yevhen Tienkaiev](mailto:hronom@gmail.com) - Fri, 30 Jul 2021 15:17:47 -0400
Signed-off-by: Yevhen Tienkaiev <hronom@gmail.com>
* __Replace Elasticsearch docs links in scripts (#994) (#1001)__
[Poojita Raj](mailto:poojiraj@amazon.com) - Fri, 23 Jul 2021 14:21:31 -0700
Replace the docs links In scripts bin/opensearch-env and config/jvm.options,
with OpenSearch docs links.
Signed-off-by: Poojita-Raj <poojiraj@amazon.com>
(cherry picked from commit 6bc4ce017ad654cc2c8d7d37553c82d61c61b964)
Signed-off-by: Poojita-Raj <poojiraj@amazon.com>
* __Introduce replaceRoutes() method and 2 new constructors to RestHandler.java (#947) (#998)__
[Chang Liu](mailto:lc12251109@gmail.com) - Thu, 22 Jul 2021 14:26:16 -0400
* Add addRoutesPrefix() method to RestHandler.java
Signed-off-by: Azar Fazel <azar.fazel@gmail.com>
Signed-off-by: cliu123
<lc12251109@gmail.com>
Co-authored-by: afazel <afazel@users.noreply.github.com>
* __Avoid override of routes() in BaseRestHandler to respect the default behavior defined in RestHandler (#889) (#991)__
[Chang Liu](mailto:lc12251109@gmail.com) - Thu, 22 Jul 2021 10:57:18 -0400
Signed-off-by: cliu123 <lc12251109@gmail.com>
* __Cleanup TESTING and DEVELOPER_GUIDE markdowns (#946) (#954)__
[Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Tue, 13 Jul 2021 14:13:26 -0500
* __Updated READMEs on releasing, maintaining, admins and security. (#853) (#950)__
[Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Mon, 12 Jul 2021 15:06:20 -0500
Signed-off-by: dblock <dblock@amazon.com>
* __Pass interceptor to super constructor (#876) (#937)__
[Sooraj Sinha](mailto:81695996+soosinha@users.noreply.github.com) - Mon, 12 Jul 2021 11:48:09 -0700
Signed-off-by: Sooraj Sinha <soosinha@amazon.com>