55285 Commits

Author SHA1 Message Date
Andriy Redko
6db435412b
Upgrade to log4j 2.16.0 (#1721)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-12-14 07:34:45 -05:00
Poojita Raj
297089ac0d
link checker fix - only run on opensearch-project/OpenSearch (#1719)
Signed-off-by: Poojita Raj <poojiraj@amazon.com>
2021-12-13 15:20:00 -08:00
Andriy Redko
c0a2bff01a
Fixing .gitattributes for binary content, removing *.class files (#1717)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-12-13 15:02:42 -08:00
Andriy Redko
069e229b29
Support JDK 18 EA builds (#1710)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-12-13 12:42:25 -05:00
Andrew Ross
309649ce8a
Upgrade to logj4 2.15.0 (#1698)
Signed-off-by: Andrew Ross <andrross@amazon.com>
2021-12-10 13:03:41 -08:00
Daniel Doubrovkine (dB.)
ec00b86859
Add version 1.2.1. (#1701)
Signed-off-by: dblock <dblock@dblock.org>
2021-12-10 14:47:52 -05:00
Tianli Feng
baa10b9b20
Fix unit test testFailsHealthOnHungIOBeyondHealthyTimeout() by incresing the max waiting time before assertion (#1692)
* Increase the max waiting time before checking the FS health after restoring the FS status in the test

Signed-off-by: Tianli Feng <ftianli@amazon.com>

* Remove another duplicate assetion statement

Signed-off-by: Tianli Feng <ftianli@amazon.com>
2021-12-10 12:25:57 -05:00
Sarat Vemulapalli
e0e6995c4a
Updating Log4j to 2.11.2 (#1696)
Signed-off-by: Sarat Vemulapalli <vemulapallisarat@gmail.com>
2021-12-10 08:03:45 -08:00
Nick Knize
538b40a0dc
Remove LegacyESVersion.V_6_2_x constants (#1686)
This commit removes LegacyESVersion.V_6_2_x constants including all
pre-release versions and bug fixes.

Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-12-09 16:08:00 -06:00
Nick Knize
821417b9ab
Remove LegacyESVersion.V_6_1_x constants (#1681)
This commit removes LegacyESVersion.V_6_1_x constants including all
pre-release versions and bug fixes.

Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-12-08 23:11:36 -06:00
Nick Knize
b74d71fb74
Remove 6.0.* version constants (#1658)
This PR removes LegacyESVersion.V_6_0_* constants including all pre-release
versions and bug fixes.

Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-12-08 13:37:21 -06:00
Daniel Doubrovkine (dB.)
e983facc16
Move Gradle wrapper and precommit checks into OpenSearch repo. (#1664)
* Move Gradle checks into OpenSearch repo.

Signed-off-by: dblock <dblock@amazon.com>

* Use working-directory for gradle wrapper validation.

Signed-off-by: dblock <dblock@amazon.com>

* Use https://github.com/gradle/wrapper-validation-action.

Signed-off-by: dblock <dblock@amazon.com>
2021-12-07 23:06:52 -05:00
Nick Knize
33d8677796
Refactor LegacyESVersion tests from Version tests (#1662)
In preparation for removing all LegacyESVersion support by 3.0; this commit
largely refactors the LegacyESVersion test logic from the OpenSearch Version
test logic into an independent test class. This PR also updates Version.fromString
to ensure a proper legacy version is returned when major is > 3 (to support
legacy yaml test and build scripts).

Note that bwc w/ legacy versions are still supported so some cross compatibility
testing is retained in the Version test class.

Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-12-07 08:27:17 -06:00
Ryan Bogan
7496f8058b
Added more detailed logging for SSLHandshakeException (#1602)
* Added more detailed logging for SSLHandshakeException

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Fixed spotless errors for logging change

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Changed message to include original error and limited to specific instance

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Applied troubleshooting message to all instances of SSlHandshakeException

Signed-off-by: Ryan Bogan <rbogan@amazon.com>
2021-12-06 08:05:28 -05:00
Nick Knize
4db97aa470
[Remove] Deprecated Zen1 Discovery (#1216)
Zen1 discovery was deprecated in Legacy 7.x for eventual removal. OpenSearch 1.x
carries this deprecation. This commit completely removes all support for Zen1
discovery in favor of Zen2.

Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-12-03 15:27:10 -06:00
Andriy Redko
70f07872f8
Added .gitattributes to manage end-of-line checks for Windows/*nix systems (#1638)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-12-03 16:16:15 -05:00
Andriy Redko
fc8dc4310a
Support Gradle 7. Fixing 'eclipse' plugin dependencies (#1648)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-12-03 15:53:28 -05:00
Nick Knize
17e7a4962d
Remove Deprecated SimpleFS (#1639)
Lucene 9 removes support for SimpleFS File System format. This PR completely
removes SimpleFS support which was deprecated in a previous PR.

Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-12-03 09:57:59 -06:00
Vacha
77d9b643b2
Updating auto backport documentation (#1620)
Signed-off-by: Vacha <vachshah@amazon.com>
2021-12-01 20:07:43 -05:00
Andriy Redko
30c31f9400
Support Gradle 7. More reliable tasks dependencies for Maven plugins publishing (#1630)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-11-30 18:41:17 -05:00
Andriy Redko
231c29f418
Support Gradle 7. Fixing publishing to Maven Local for plugins (#1624)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-11-29 23:17:20 -05:00
Andriy Redko
8bf6fa6b4f
Support Gradle 7 (#1609)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-11-29 14:34:06 -05:00
Xue Zhou
74943c43c6
Rename field_masking_span to span_field_masking (#1606)
* Rename field_masking_span to span_field_masking

Signed-off-by: Xue Zhou <xuezhou@amazon.com>

* Update SearchModuleTests.java

Signed-off-by: Xue Zhou <xuezhou@amazon.com>

* Rename field_masking_span to span_field_masking

Signed-off-by: Xue Zhou <xuezhou@amazon.com>
2021-11-29 14:01:43 -05:00
Vacha
84772904be
Adding Github action for auto backport PR creation (#1600)
* Adding Github action for auto backport PR creation

Signed-off-by: Vacha <vachshah@amazon.com>

* Adding details to DEVELOPER_GUIDE

Signed-off-by: Vacha <vachshah@amazon.com>
2021-11-23 16:45:50 -05:00
Vacha
fd87f3a2d7
Upgrading commons-codec in hdfs-fixture and cleaning up dependencies in repository-hdfs (#1603)
Signed-off-by: Vacha <vachshah@amazon.com>
2021-11-23 13:32:33 -05:00
Megha Sai Kavikondala
12a229410c
Giving informative error messages for double slashes in API call URLs (#1568)
* Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

Changes related to Informative error messages.

* Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

Spotless changes

* Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

naming and message changes.

Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

* Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

Deleting the log message.
2021-11-22 18:01:39 -05:00
Rishikesh Pasham
0c21689202
Renaming slave to replica in filebeat-6.0.template.json file. (#1569)
Signed-off-by: Rishikesh Pasham <rishireddy1159@gmail.com>
2021-11-22 17:59:56 -05:00
Jan Baudisch
4eaa60ce60
Enable RestHighLevel-Client to set parameter require_alias for bulk index and reindex requests (#1533)
Signed-off-by: Jan Baudisch <jan.baudisch.libri@gmail.com>

Co-authored-by: Jan Baudisch <jan.baudisch.libri@gmail.com>
2021-11-22 12:50:35 -05:00
Marc Handalian
79eaa06612
Add 1.2 release notes and correct 1.1 release notes. (#1581)
The 1.1 release notes are missing a set of commits. This updates the release notes
to the commit specified in our relase 15e9f13.

Signed-off-by: Marc Handalian <handalm@amazon.com>
2021-11-22 12:46:57 -05:00
Poojita Raj
a15c526612
Improve leader node-left logging to indicate timeout/coordination state rejection (#1584) 2021-11-19 13:15:01 -08:00
Andrew Ross
d467283475
Start MockLogAppender before adding to static context (#1587)
I observed a test failure with the message
'Attempted to append to non-started appender mock' from an assertion in
`OpenSearchTestCase::after`. I believe this indicates that a
MockLogAppender (which is named "mock") was added as an appender to the
static logging context and some other test in the same JVM happened to
cause a logging statement to hit that appender and cause an error, which
then caused an unrelated test to fail (because they share static state
with the logger). Almost all usages of MockLogAppender start it
immediately after creation. I found a few that did not and fixed those.
I also made a static helper in MockLogAppender to start it upon
creation.

Signed-off-by: Andrew Ross <andrross@amazon.com>
2021-11-19 13:37:46 -05:00
Vacha
bcfb57c06a
Upgrade dependency (#1571)
* Upgrading guava, commons-io and apache-ant dependencies

Signed-off-by: Vacha <vachshah@amazon.com>

* Adding failureaccess since guava needs it

Signed-off-by: Vacha <vachshah@amazon.com>
2021-11-18 13:38:49 -05:00
Zelin Hao
90a8a72ba7
Add a whitesource unified agent file and update the config (#1540)
Signed-off-by: Zelin Hao <zelinhao@amazon.com>
2021-11-17 14:57:15 -08:00
Vacha
c6dd484ce3
Upgrading gson to 2.8.9 (#1541)
Signed-off-by: Vacha <vachshah@amazon.com>
2021-11-15 14:10:29 -05:00
Ryan Bogan
01d1cb0ce6
Updated links for linkchecker (#1539)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
2021-11-11 18:24:26 -05:00
Andrew Ross
c437b3442d
Update developer guide reference to download JDK 14 (#1452)
* Fix documentation reference from Java 14 to 17

Signed-off-by: Andrew Ross <andrross@amazon.com>

* Update developer guide reference to download JDK 14

Signed-off-by: Andrew Ross <andrross@amazon.com>
2021-11-11 17:57:41 -05:00
whitesource-for-github-com[bot]
762601fb68
Add .whitesource configuration file (#1525)
Co-authored-by: whitesource-for-github-com[bot] <50673670+whitesource-for-github-com[bot]@users.noreply.github.com>
2021-11-11 13:47:33 -08:00
Andriy Redko
0e6b0c5b4f
[repository-azure] Update to the latest Azure Storage SDK v12, remove privileged runnable wrapper in favor of access helper (#1521)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-11-11 12:57:34 -08:00
CEHENKLE
37233a9280
add codeowners file (#1530)
* initial commit of CODEOWNERS

Signed-off-by: CEHENKLE <henkle@amazon.com>

* put the @ sign in the right spot

Signed-off-by: CEHENKLE <henkle@amazon.com>

* updating wild card

Signed-off-by: CEHENKLE <henkle@amazon.com>

* removed extra comment

Signed-off-by: CEHENKLE <henkle@amazon.com>

* you know what?  I didn't like that other wildcard.  f++ would nnot wildcard again

Signed-off-by: CEHENKLE <henkle@amazon.com>
2021-11-11 11:47:47 -08:00
Megha Sai Kavikondala
fb78d10f1a
Integration test that checks for settings upgrade (#1482)
* Made changes.

Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

* Signed-off-by: Megha Sai Kavikondala <kavmegha@amazon.com>

Changes made by deleting the TestSettingsIT file and adding new lines in FullClusterRestartSettingsUpgradeIT.java
2021-11-09 10:57:38 -08:00
Andrew Ross
546ab21989
Use a non-default port for upgrade-cli unit tests (#1512)
I observed a [test failure][1] that I believe was caused by the fact
that an OpenSearch server happened to be running at localhost:9200 when
these unit tests were executed. The code under test has logic to try to
connect to localhost:9200 and then fall back to defaults if that port is
not open. The tests expect these defaults and will fail if different
data is returned. The change here is to use a non-default port to make
it very unlikely that a real instance will be running at the non-default
port. I don't know why an OpenSearch service happened to be running
during the linked test failure, but I think making these unit tests more
independent and isolated is helpful no matter the underlying cause in
this case.

[1]: https://fork-jenkins.searchservices.aws.dev/job/OpenSearch_CI/job/PR_Checks/job/Gradle_Check/975/artifact/gradle_check_975.log/*view*/

Signed-off-by: Andrew Ross <andrross@amazon.com>
2021-11-05 09:52:16 -04:00
Nick Knize
eb5e454cc2
[bwc] reenable bwc testing after syncing staged branches (#1511)
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-11-05 09:50:56 -04:00
Nick Knize
99a356bfc6
[main] Add staged version 1.3.0 for bwc (#1510)
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-11-04 15:56:08 -05:00
Nick Knize
ac37cc99b2
Add staged version 1.1.1 (#1506)
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-11-04 14:19:21 -05:00
Nick Knize
4c42c142cb
[BWC] Diable BWC tests until branch versions are synced (#1508)
Signed-off-by: Nicholas Walter Knize <nknize@apache.org>
2021-11-04 12:03:41 -05:00
Ryan Bogan
286121f0dc
Added logic to allow {dot} files on startup (#1437)
* Added logic to allow {dot} files on startup

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Ensures that only plugin directories are returned by findPluginDirs()

Signed-off-by: Ryan Bogan <rbogan@amazon.com>

* Prevents . files from being returned as plugins

Signed-off-by: Ryan Bogan <rbogan@amazon.com>
2021-11-04 10:01:55 -04:00
Xue Zhou
f54cc382d5
remove codeQL warning about implicit narrowing conversion in compound assignment (#1403)
Signed-off-by: Xue Zhou <xuezhou@amazon.com>
2021-11-02 13:49:25 -07:00
Vacha
af6ae752b4
Upgrading dependencies (#1491)
Signed-off-by: Vacha <vachshah@amazon.com>
2021-11-02 13:47:54 -07:00
Owais Kazi
a439371bc9
Cleanup for Checkstyle (#1370)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
2021-11-02 10:59:33 -07:00
Himanshu Setia
681e5548c1
Enabling spotless, disabling checkstyle check on plugins (#1488)
* Enabling spotless, disabling checkstyle on below modules

:plugins:mapper-annotated-text
:plugins:mapper-murmur3
:plugins:mapper-size
:plugins:repository-azure
:plugins:repository-gcs
:plugins:repository-hdfs
:plugins:repository-s3
:plugins:store-smb
:plugins:transport-nio
:qa:die-with-dignity

Signed-off-by: Himanshu Setia <setiah@amazon.com>

* Enabling spotless for more plugins

Signed-off-by: Himanshu Setia <setiah@amazon.com>

* Fixing error in merge conflict

Signed-off-by: Himanshu Setia <setiah@amazon.com>
2021-11-01 17:40:06 -07:00