OpenSearch/release-notes/opensearch.release-notes-1.0.0-rc1.md

## Version 1.0.0-rc1 Release Notes

* __[BWC] fix mixedCluster and rolling upgrades (#775) (#793)__

    [Nick Knize](mailto:nknize@gmail.com) - Fri, 28 May 2021 10:08:05 -0500

    EAD -> refs/heads/1.0, tag: refs/tags/1.0.0-rc1, refs/remotes/origin/1.0
    This commit fixes mixedCluster and rolling upgrades by spoofing OpenSearch

    version 1.0.0 as Legacy version 7.10.2. With this commit an OpenSearch 1.x node
     can join a legacy (<= 7.10.2) cluster and rolling upgrades work as expected.

    Mixed clusters will not work beyond the duration of the upgrade since shards

    cannot be replicated from upgraded nodes to nodes running older versions.
     Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
     Co-authored-by: Shweta Thareja <tharejas@amazon.com>


* __[BUG] fix MainResponse to spoof version number for legacy clients (#708)__

    [Nick Knize](mailto:nknize@gmail.com) - Fri, 28 May 2021 10:07:06 -0500


    This commit changes MainResponse to spoof OpenSearch 1.x version numbers as

    Legacy version number 7.10.2 for legacy clients.
     Signed-off-by: Nicholas Walter Knize <nknize@apache.org>

* __[CVE] Upgrade dependencies for Azure related plugins to mitigate CVEs (#688) (#771) (#784)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Thu, 27 May 2021 00:43:40 +0530


    * Update commons-io-2.4.jar to 2.7 for plugins/discovery-azure-classic module
    * Remove unused jackson dependency and respective LICENSE and NOTICE
    * Update guava dependency to mitigate CVE for repository-azure plugin
     Signed-off-by: Abbas Hussain <abbas_10690@yahoo.com>

* __distribution/packages: Fix RPM architecture name for 64-bit x86 (#620) (#770) (#783)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Wed, 26 May 2021 23:55:35 +0530


    RPM uses the "x86_64" name for 64-bit x86, which is in-line with GCC
    and other
    compilers.
     Signed-off-by: Neal Gompa <ngompa13@gmail.com>

* __[Bug] Fix gradle build on Windows failing from a recent change (#765)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Tue, 25 May 2021 10:51:53 -0700


    A recent change as part of the commit c2e816ec introduced a bug where the build
    is failing on Windows. The change was made to include the NOTICE.txt file as
    read-only in the distributions. The code fails on Windows as it's not a
    POSIX-compliant. This commit adds a check on the current operating system.
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Add timeout on cat/stats API (#759)__

    [Dhwanil Patel](mailto:dhwanip@amazon.com) - Mon, 24 May 2021 23:18:04 +0530


    Signed-off-by: Dhwanil Patel <dhwanip@amazon.com>

* __Remove URL content from Reindex error response (#630) (#748)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Fri, 21 May 2021 17:20:34 -0700


    Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
     Co-authored-by: Sooraj Sinha <81695996+soosinha@users.noreply.github.com>

* __Add Remote Reindex SPI extension (#547) (#756)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Sat, 22 May 2021 04:50:00 +0530


    This change extends the remote reindex SPI to allow adding a custom
    interceptor.
    This interceptor can be plugged in to perform any processing on
    the request or response.
     Signed-off-by: Sooraj Sinha <soosinha@amazon.com>
     Co-authored-by: Sooraj Sinha <81695996+soosinha@users.noreply.github.com>

* __Catch runtime exceptions to make class loader race conditions easier to debug. (#608) (#750)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Fri, 21 May 2021 11:04:14 +0530


    Signed-off-by: dblock <dblock@amazon.com>
     Co-authored-by: Daniel Doubrovkine (dB.) <dblock@dblock.org>

* __distribution/packages: Fix filename format for deb archives (#621) (#753)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Fri, 21 May 2021 11:03:36 +0530


    Debian packages are formatted with the following filename structure:
     name_[epoch:]version-release_arch.deb
     Make generated Debian packages follow this convention.
     Signed-off-by: Neal Gompa <ngompa13@gmail.com>
     Co-authored-by: Neal Gompa (ニール・ゴンパ) <ngompa13@gmail.com>

* __Update/maintainers.md (#723) (#752)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Fri, 21 May 2021 04:45:28 +0530


    Adding Gopala, Vengad, Shweta, db and Itiyama to maintainers list
     Signed-off-by: CEHENKLE <henkle@amazon.com>

* __Updating README and CONTRIBUTING guide to get ready for beta1 release. (#672) (#751)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Thu, 20 May 2021 15:57:07 -0700


    * Updating README and CONTRIBUTING guide to get ready for beta1 release.
     Signed-off-by: Sarat Vemulapalli <vemulapallisarat@gmail.com>

    * Addressing comments.
     Signed-off-by: Sarat Vemulapalli <vemulapallisarat@gmail.com>
     Co-authored-by: Sarat Vemulapalli <vemulapallisarat@gmail.com>

* __Update issue template with multiple labels (#668) (#749)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Thu, 20 May 2021 15:55:56 -0700


    Signed-off-by: Vacha Shah <vachshah@amazon.com>
     Co-authored-by: Vacha Shah <vachshah@amazon.com>
     Co-authored-by: Vacha <VachaShah@users.noreply.github.com>
    Co-authored-by:
    Vacha Shah <vachshah@amazon.com>

* __Support Data Streams in OpenSearch (#690) (#713)__

    [Ketan Verma](mailto:ketanv3@users.noreply.github.com) - Thu, 20 May 2021 17:14:28 -0400


    This commit adds support for data streams by adding a DataStreamFieldMapper,
    and making timestamp
    field name configurable. Backwards compatibility is
    supported.
     Signed-off-by: Ketan Verma <ketan9495@gmail.com>

* __Make default number of shards configurable (#726)__

    [arunabh23](mailto:singharunabh18@gmail.com) - Thu, 20 May 2021 17:13:46 -0400


    The default number of primary shards for a new index, when the number of shards
    are not provided in the request, can be configured for the cluster. This is a
    backport commit of pull #625
     Signed-off-by: Arunabh Singh <arunabs@amazon.com>
     Co-authored-by: Arunabh Singh <arunabs@amazon.com>

* __[CVE-2020-7692] Upgrade google-oauth clients for goolge cloud plugins (#662) (#734)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Thu, 20 May 2021 17:13:15 -0400


    For discovery-gce and repository-gcs plugins update the google-oauth-client
    library to version 1.31.0. See CVE details at
    https://nvd.nist.gov/vuln/detail/CVE-2020-7692
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Update dependencies for ingest-attachment plugin. (#666) (#735)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Thu, 20 May 2021 17:13:02 -0400


    This PR resolves the CVEs for dependencies in the ingest-attachment plugin.
     tika : '1.24' -> '1.24.1'
    (https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-9489)
    pdfbox :
    '2.0.19' -> '2.0.23'
    (https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-27807)

    commons-io:commons-io : '2.6' -> '2.7'
    (https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-29425)
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __[CVE-2018-11765] Upgrade hadoop dependencies for hdfs plugin (#654) (#736)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Thu, 20 May 2021 17:12:33 -0400


    Hadoop 2.8.5 has been reported to have CVEs
    (https://bugzilla.redhat.com/show_bug.cgi?id=1883549). We need to upgrade this
    to 2.10.1. This also updates the hadoop-minicluster version to 2.10.1 as well.
    This upgrade also brings in two additional dependencies, woodstox-core and
    stax2-api that are added along with the sha1s, licenses and notices.
     Also upgrade guava to the latest as per the CVE
    https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-8908
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __[1.x] Add read_only block argument to opensearch-node unsafe-bootstrap command #599 (#725)__

    [Harmish](mailto:harmish.lakhani@gmail.com) - Thu, 20 May 2021 17:12:16 -0400


    * apply user defined cluster wide read only block after unsafe bootstrap
    command
     Signed-off-by: Harmish Lakhani <harmish.lakhani@gmail.com>

    * Fixed gradle precommit failures
     Signed-off-by: Harmish Lakhani <harmish.lakhani@gmail.com>

    * remove default as false for read only block to avoid overriding user's
    existing settings
     Signed-off-by: Harmish Lakhani <harmish.lakhani@gmail.com>

* __Handle inefficiencies while fetching the delayed unassigned shards during cluster health (#588) (#730)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Thu, 20 May 2021 17:11:49 -0400


    Signed-off-by: Meet Shah <meetshsh@gmail.com>
     Co-authored-by: Meet Shah <48720201+meetshah777@users.noreply.github.com>

* __[TEST] Fix failing distro tests for linux packages (#569) (#733)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Thu, 20 May 2021 17:11:03 -0400


    Changes to fix the failing OpenSearch distribution tests for packages
    (linux-archive, linux-archive-aarch64, debian, rpm, docker) on supported linux
    distros.
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Update instructions on debugging OpenSearch. (#689) (#738)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Thu, 20 May 2021 17:09:59 -0400


    Add clear instructions on how to run OpenSearch with debugging mode in
    IntelliJ.
    Fixed a few minor typos and grammars.
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Create group settings with fallback. (#743) (#745)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Thu, 20 May 2021 17:06:58 -0400


    * Create group settings with fallback.
     Signed-off-by: dblock <dblock@amazon.com>

    * Use protected fallbackSetting in Setting.
     Signed-off-by: dblock <dblock@amazon.com>

* __Make allocation decisions at node level first for pending task optimi… (#534) (#739)__

    [Ankit Jain](mailto:akjain@amazon.com) - Thu, 20 May 2021 14:02:18 -0700


    * Make allocation decisions at node level first for pending task optimization
     Signed-off-by: Ankit Jain <akjain@amazon.com>

    * Addressing review comments
     Signed-off-by: Ankit Jain <akjain@amazon.com>

    * Fixing benchmark and adding debug mode tests
     Signed-off-by: Ankit Jain <akjain@amazon.com>

    * Fixing typo in previous commit
     Signed-off-by: Ankit Jain <akjain@amazon.com>

    * Moving test file to correct package
     Signed-off-by: Ankit Jain <akjain@amazon.com>

    * Addressing review comments
     Signed-off-by: Ankit Jain <akjain@amazon.com>

* __[CVE] Upgrade dependencies to mitigate CVEs (#657) (#737)__

    [Rabi Panda](mailto:adnapibar@gmail.com) - Wed, 19 May 2021 21:20:53 -0700


    This PR upgrade the following dependencies to fix CVEs.

    - commons-codec:1.12 (->1.13) apache/commons-codec@48b6157
    - ant:1.10.8 (->1.10.9) https://ant.apache.org/security.html
    - jackson-databind:2.10.4 (->2.11.0) FasterXML/jackson-databind#2589
    - jackson-dataformat-cbor:2.10.4 (->2.11.0)
    https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-28491
    - apache-httpclient:4.5.10 (->4.5.13)
    https://bugzilla.redhat.com/show_bug.cgi?id=CVE-2020-13956
    - checkstyle:8.20 (->8.29)
    https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-10782
    - junit:4.12 (->4.13.1)
    https://github.com/junit-team/junit4/security/advisories/GHSA-269g-pwp5-87pp
    - netty:4.1.49.Final (->4.1.59)
    https://github.com/netty/netty/security/advisories/GHSA-5mcr-gq6c-3hq2
     Signed-off-by: Rabi Panda <adnapibar@gmail.com>

* __Added a link to the maintainer file in contribution guides (#589) (#731)__

    [Abbas Hussain](mailto:abbas_10690@yahoo.com) - Wed, 19 May 2021 13:41:32 -0700


    Co-authored-by: Dawn Foster <fosterd@vmware.com>

* __Fix snapshot deletion task getting stuck in the event of exceptions (#629) (#650)__

    [amitai stern](mailto:amitai.stern@logz.io) - Thu, 13 May 2021 09:02:57 -0500


    Changes the behavior of the recursive deletion function
    `executeOneStaleIndexDelete()` stop
    condition to be when the queue of
    `staleIndicesToDelete` is empty -- also in the error flow.
    Otherwise the
    GroupedActionListener never responds and in the event of a few exceptions the

    deletion task gets stuck.
    Alters the test case to fail to delete in bulk many
    snapshots at the first attempt, and then
    the next successful deletion also
    takes care of the previously failed attempt as the test
    originally intended.

    SNAPSHOT threadpool is at most 5. So in the event we get more than 5 exceptions
    there are no
    more threads to handle the deletion task and there is still one
    more snapshot to delete in the
    queue. Thus, in the test I made the number of
    extra snapshots be one more than the max in the
    SNAPSHOT threadpool.
     Signed-off-by: AmiStrn <amitai.stern@logz.io>

* __Standardize int, long, double and float Setting constructors. (#665)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Thu, 6 May 2021 21:17:49 +0000




* __Converted all .asciidoc to .md. (#658)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Thu, 6 May 2021 20:12:49 +0000


    Signed-off-by: dblock <dblock@amazon.com>

* __Fix #649: Properly escape @ in JavaDoc. (#651)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Thu, 6 May 2021 20:12:22 +0000


    Signed-off-by: dblock <dblock@amazon.com>

* __Make -Dtests.output=always actually work. (#648)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Thu, 6 May 2021 20:11:33 +0000


    Signed-off-by: dblock <dblock@amazon.com>

* __[WIP] Developer guide updates (#595)__

    [Daniel Doubrovkine (dB.)](mailto:dblock@dblock.org) - Wed, 28 Apr 2021 17:28:17 +0000


    * Add detail on how to install Java.
     Signed-off-by: dblock <dblock@amazon.com>

    * There's no password requirement for the instance.
     Signed-off-by: dblock <dblock@amazon.com>

    * Explain how to listen on an external IP.
     Signed-off-by: dblock <dblock@amazon.com>

* __Speedup snapshot stale indices delete (#613) (#616)__

    [Nick Knize](mailto:nknize@gmail.com) - Wed, 28 Apr 2021 11:02:21 -0500


    Instead of snapshot delete of stale indices being a single threaded operation
    this commit makes
    it a multithreaded operation and delete multiple stale
    indices in parallel using SNAPSHOT
    threadpool's workers.
     Signed-off-by: Piyush Daftary <piyush.besu@gmail.com>

* __Speedup lang-painless tests (#605) (#617)__

    [Nick Knize](mailto:nknize@gmail.com) - Wed, 28 Apr 2021 11:01:39 -0500


    Painless tests would previously create script engine for every single test
    method.
    Now the tests that need to tweak script engine settings create a class
     level fixture (BeforeClass/AfterClass) that is used across all the test

    methods in that suite.
     RegexLimitTests was split into two suites (limit=1 and limit=2) rather
    than
    dynamically applying different settings.
     C2 compiler is no longer needed for tests to be fast, instead tests run

    faster with C1 only as expected, like the rest of the unit tests.
     Signed-off-by: Robert Muir <rmuir@apache.org>

* __Replace elastic.co with opensearch.org (#611) (#623)__

    [Nick Knize](mailto:nknize@gmail.com) - Wed, 28 Apr 2021 10:59:36 -0500


    Signed-off-by: Abbas Hussain <abbas_10690@yahoo.com>