Commit Graph

54904 Commits

Author SHA1 Message Date
Rene Groeschke ce2ba7a02d
Add release notes for 7.10.2 (#67140)
* Add release notes for 7.10.2

* Add xref

* Update docs/reference/release-notes/7.10.asciidoc

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

* Update docs/reference/release-notes/7.10.asciidoc

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

* Update docs/reference/release-notes/7.10.asciidoc

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-01-11 08:37:26 +01:00
Nhat Nguyen 6ba5ae2388 Retry synced-flush on conflict in tests (#66968)
Closes #66631
2021-01-10 22:35:06 -05:00
Julie Tibshirani 150a734a83 Add note to 'known issues' docs about nested hits. 2021-01-07 15:12:27 -08:00
Lee Hinman b2bfa9ed4f
[7.10] Fix ignoring existed cluster settings in DataTierAllocationDecider (#67137) (4295d489) (#67180)
Relates to #67133.
Seem to #65037.

The main changes of this PR are:

    Modify the construction method of DataTierAllocationDecider, add a param settings like FilterAllocationDecider.
    Create DataTierAllocationDecider in the main method of DataTierMigrationRoutedStep and SetSingleNodeAllocateStep, and the DataTierAllocationDecider is constructed using the cluster settings in the cluster metadata, so the cluster level _tier filters can be seen when executing the steps.
    Add some tests for the change.

Co-authored-by: bellengao <gbl_long@163.com>
2021-01-07 11:27:22 -07:00
Marios Trivyzas a2a389afdb
EQL: [Tests] Fix issues for SequenceSpecTests (#67104) (#67143)
- Use `argumentFormatting` starting with 1 as 0 is problematic for Java 16
- Actually enable the tests since the listener that checks the results
  was not called and nothing was asserted.
- Disable one test that fails which is tracked with: #67102

Fixes: #66778
(cherry picked from commit a4199af58b8c5ab4757a45248672e0233978b208)
2021-01-07 11:56:57 +01:00
Julie Tibshirani 747e1cc71d Fix the skip version for inner hits REST test. 2021-01-06 11:46:17 -08:00
Tanguy Leroux 5c7fd01b59
Mute DockerTests.test085EnvironmentVariablesAreRespectedUnderDockerExec (#67101)
Relates #67097
2021-01-06 14:55:32 +01:00
Tanguy Leroux ceea5b313f
Mute MixedClusterClientYamlTestSuiteIT search.inner_hits/10_basic/Inner hits with disabled _source (#67083)
Relates #67079
2021-01-06 12:51:29 +01:00
Julie Tibshirani ff67baac38 Make sure shared source always represents the top-level root document. (#66725)
We started passing down the root document's _source when processing
nested hits, to avoid reloading and reparsing the root source for each hit.
Unfortunately the approach did not work when there are multiple layers of
`inner_hits`. In this case, the second-layer inner hit received its immediate
parent's source instead of the root source. This parent source is filtered to
just contain the parts corresponding to the nested document, but the source
parsing logic is designed to always operate on the top-level root source. This
caused failures when loading the second-layer inner hits.

This PR makes sure to always pass the root document's _source when processing
inner hits, even if there are multiple layers.
2021-01-05 14:27:41 -08:00
James Rodewig 0fad7f6fc6
[DOCS] Rewrite agg breakdown docs for profile API (#67042) (#67057) 2021-01-05 17:25:07 -05:00
Przemko Robakowski fdd2a9c235
Fix whitespace as a separator in CSV processor (#67045) (#67050)
This change fixes problem when using space or tab as a separator in CSV processor - we check if current character is separator before we check if it is whitespace.

This also improves tests to always check all combinations of separators and quotes.

Closes #67013
2021-01-05 23:05:10 +01:00
Lisa Cawley 6175e18e92
[DOCS] Clarify impact of delayed data in anomaly detection (#66816) (#67041)
Co-authored-by: Benjamin Trent <ben.w.trent@gmail.com>
2021-01-05 13:15:19 -08:00
Lee Hinman e9b798bdb1
[7.10] Make FilterAllocationDecider totally ignore tier-based allocation settings (#67019) (#67034)
Previously we treated attribute filtering for _tier-prefixed attributes a pass-through, meaning
that they were essentially always treated as matching in DiscoveryNodeFilters.match, however, for
exclude settings, this meant that the node was considered to match the node if a _tier* filter was
specified.

This commit prunes these attributes from the DiscoveryNodeFilters when considering the filters for
FilterAllocationDecider so that they are only considered in DataTierAllocationDecider.

Resolves #66679
2021-01-05 12:42:34 -07:00
Jack Conradson 8e294d53bc Fix static inner class resolution in Painless (#67027)
When removing the "lexer hack" to remove type context from the lexer, static inner class resolution 
wasn't properly accounted for. This change adds code to handle static inner class resolution.
2021-01-05 11:12:11 -08:00
James Rodewig 67f43ffc5f
[DOCS] Fix formatting for `fieldata` docs (#67017) (#67025) 2021-01-05 12:36:25 -05:00
James Rodewig 8d0fc47d3c
[DOCS] Remove duplicate xpack.enabled setting in example (#66897) (#67008)
Co-authored-by: Jacob Ouellette <jackscripter45@gmail.com>
2021-01-05 10:22:22 -05:00
James Rodewig 3bd66ba94a
[DOCS] Clarify memlock settings in `/etc/security/limits.conf` (#66694) (#67000) 2021-01-05 09:19:30 -05:00
István Zoltán Szabó 8cd1d98431
[DOCS] Improves inference processor linking and docs (#66119) (#66985) 2021-01-05 14:05:29 +01:00
Yang Wang cb041c747d
[Test] Consistent datetime formatting for java and joda time (#66914) (#66974)
This PR fixes the test failure by ensuring consistent datetime formatting
between java DateTimeFormatter and joda time.
2021-01-05 17:00:57 +11:00
James Rodewig dae36e45ca
[DOCS] Add `nodes` and `parent_task_id` parms (#66562) (#66892) 2020-12-30 09:21:48 -05:00
James Rodewig 9838a0c28e
[DOCS] Fix attribute typo (#66858) (#66861) 2020-12-29 10:39:11 -05:00
James Rodewig f6aa358408
[DOCS] Update rollup xrefs (#66799) (#66802) 2020-12-23 14:25:32 -05:00
Seth Michael Larson 8f3a6cd913
[7.10] Use single backslash for nested paths (#66794) 2020-12-23 12:58:43 -06:00
James Rodewig 3a3a099a49
[DOCS] Fix typo (#66779) (#66784)
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Sandeep Kanabar <sandeepkanabar@gmail.com>
2020-12-23 09:25:18 -05:00
Ioannis Kakavas 2fd049cda7
Mute JDBC client tests with SSL in FIPS mode (#66566) (#66747)
JDBC client can only be configured for SSL with keystores,
but we can't use JKS/PKCS12 keystores in FIPS 140-2 mode.

Resolves: #66095
2020-12-22 17:16:33 +02:00
James Rodewig 40c99e56c3
[DOCS] Fix typo (#66721) (#66743)
Co-authored-by: Alan Tan <taalantan@gmail.com>
2020-12-22 09:16:28 -05:00
Julie Tibshirani 08b0920c6c Adjust test skips now that inner_hits fix is backported. 2020-12-21 15:01:54 -08:00
James Rodewig 2bc0dea2cc
Add info on how to disable cleaner service (#64655) (#66707)
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Julien Guay <guay_j@yahoo.fr>
2020-12-21 13:23:10 -05:00
James Rodewig 8c22348232
[DOCS] Fix timeout parameter defaults (#66111) (#66692) 2020-12-21 09:21:43 -05:00
Andrei Stefan 12ffe4a4b3
QL: handle IP type fields extraction with ignore_malformed property (#66622) (#66686)
Return null for any field that is present in the _ignored section of the
response, not only numerics and IPs.

(cherry picked from commit 106719f6af1eb2f06396161143a5f0185c5d1b54)
2020-12-21 16:07:03 +02:00
Julie Tibshirani d4039228ae Fix regressions around nested hits and disabled _source. (#66572)
This PR fixes two bugs that can arise when _source is disabled and we fetch nested documents:
* Fix exception when highlighting `inner_hits` with disabled _source.
* Fix exception in nested `top_hits` with disabled _source.
* Add more tests for highlighting `inner_hits`.
2020-12-18 15:21:37 -08:00
Gordon Brown df8c92cfef
Mute tests failing on Debian 8 due to memory reporting (#66648) 2020-12-18 15:27:07 -07:00
Adam Locke a4d5e36905
[DOCS] Clarifying TLS steps (#65326) (#66614)
* [DOCS] Clarifying TLS steps

* Fix file name

* Clarifying note based on reviewer feedback
2020-12-18 16:00:28 -05:00
AndyHunt66 e2228df04a
[DOCS] Fix typos (#66576) 2020-12-18 12:02:53 -05:00
Adam Locke 3b58f8fd5b
[DOCS] Adding headers in TOC for aggregation docs. (#66604) (#66608) 2020-12-18 12:00:20 -05:00
Andrei Dan 2620725297
Fix MANAGE_IDX_TEMPLATE privilege to allow `component_template/*` (#66514) (#66581)
(cherry picked from commit bcc28e0ab8e6883e14b23f93f428dee03b377a1d)
Signed-off-by: Andrei Dan <andrei.dan@elastic.co>
2020-12-18 11:17:16 +00:00
Albert Zaharovits 480561dbc3
Store and use only internal security headers (#66365)
For async searches (EQL included) the client's request headers were
erroneously stored in the .tasks index. This might expose the requesting
client's HTTP Authorization header. This PR fixes that by employing the
usual approach to store only the security-internal headers, which carry
the authentication result, instead of the original Authorization header,
which is commonly utilized to redo authentication for scheduled tasks.
2020-12-17 23:40:55 +02:00
James Rodewig 50aca62486
[DOCS] Fix rollup docs formatting (#66425) (#66547)
Co-authored-by: Howard <danielhuang@tencent.com>
2020-12-17 14:14:28 -05:00
Costin Leau 4cb3ee5b4e EQL: Fix early trimming of in-flight data (#66493)
Rework trimToLast to take into account an ordinal for last trimming so
instead of keeping the last entry in a stage, it keeps the last entry
before the given ordinal.
This takes care of the case where a dense stage that requires several
passes does not discard valid data from a previous sparse stage that go
beyond the current stage point.

(cherry picked from commit 4f55749072b39f89822bdd52c67998f7bed890a9)
(cherry picked from commit 6b61dfead88a144c6e85e384d47a24f0c1480c6b)
(cherry picked from commit cece81b5dee88b18e3e7ea189fc342ef53ea19f2)
2020-12-17 18:00:33 +02:00
James Rodewig 499f4a09e7
[DOCS] Fix S3 bucket names in S3 repo plugin docs (#66521) (#66529)
Co-authored-by: Inbar Shimshon <inbar.shimshon@elastic.co>
2020-12-17 10:27:57 -05:00
Inbar Shimshon c17b409237
Update repository-s3.asciidoc 2020-12-17 15:30:46 +02:00
Inbar Shimshon 713f97a20b
Update repository-s3.asciidoc 2020-12-17 15:12:28 +02:00
Inbar Shimshon 8a8c6aff45
Update repository-s3.asciidoc
Additionally I want to point out that in all of our examples we of bucket name we use ourselves underscores which is confusing since using "_" is not supported for AWS  
see https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-s3-bucket-naming-requirements.html


IMO this is a larger change throughout the docs that should be made - its something we know about for a while and mentioned here https://github.com/elastic/sdh-cloud/issues/1501#issuecomment-638122152 though also that should be updates because specifically underscore is not mentioned there.
2020-12-17 15:11:35 +02:00
Julie Tibshirani 24c0f01543 Ensure all query builder tests consider older versions. (#66401)
This PR removes outdated overrides in some tests that prevent them from testing
older index versions. Also removes an old comment + logic from
AggregatorFactoriesTests.
2020-12-16 11:57:01 -08:00
Benjamin Trent a370104535
[ML] change to only calculate model size on initial load to prevent slow cache promotions (#66451) (#66462)
When a value is promoted in the LRU cache, its weight is removed and added.

The LocalModel object was recalculating the model size for ever weight check, which caused a polynomial runtime.

This commit changes the model size to only be calculated in the LocalModel ctor.
2020-12-16 14:01:21 -05:00
asce0705 5000ec87ca Fix constructors of NoOpResult (#66269) 2020-12-16 13:37:49 -05:00
James Rodewig 5e5eb7bc08
[DOCS] Fix formatting (#66450) (#66455) 2020-12-16 11:40:03 -05:00
Gao Ruifeng a3757ab43e
[DOCS] Remove duplicate word (#66320) 2020-12-16 10:16:47 -05:00
Bogdan Pintea 176587ebc4
QL: Verify filter's condition type (backport of #66268) (#66408)
* SQL: Verify filter's condition type (#66268)

* Verify filter's condition type

This adds a check in the verifier to check if filter's condition is of a
boolean type and fail the request otherwise.

(cherry picked from commit 3aec1a3d99a3f4650ec8be014a97106320f0874a)
2020-12-15 23:24:11 +01:00
Julie Tibshirani 9fa80c1896 Fix failure in fvh REST tests. (#66192)
In general, we can't guarantee that a match_all query will return documents in
the order they were indexed. This PR adds an ID to each document to avoid
relying on document order.
2020-12-15 12:01:25 -08:00