OpenSearch/docs/reference/release-notes/7.5.asciidoc

[[release-notes-7.5.2]]
== {es} version 7.5.2

[[enhancement-7.5.2]]
[float]
=== Enhancements

Features/Ingest::
* Fork recursive calls in Foreach processor {es-pull}50514[#50514]

Infra/Core::
* Fix unintended debug logging in subclasses of TransportMasterNodeAction  {es-pull}50839[#50839] (issues: {es-issue}50056[#50056], {es-issue}50074[#50074], {es-issue}50076[#50076])


[[bug-7.5.2]]
[float]
=== Bug fixes

Analysis::
* Fix caching for PreConfiguredTokenFilter {es-pull}50912[#50912] (issue: {es-issue}50734[#50734])

CRUD::
* Block too many concurrent mapping updates {es-pull}51038[#51038] (issue: {es-issue}50670[#50670])

Engine::
* Account soft-deletes in FrozenEngine {es-pull}51192[#51192] (issue: {es-issue}50775[#50775])

Features/ILM+SLM::
* Fix SLM check for restore in progress {es-pull}50868[#50868]

Features/Ingest::
* Fix ingest simulate response document order if processor executes async {es-pull}50244[#50244]

Features/Java Low Level REST Client::
* Improve warning value extraction performance in response {es-pull}50208[#50208] (issue: {es-issue}24114[#24114])

Machine Learning::
* Fixes potential memory corruption or inconsistent state when background
persisting categorizer state. {ml-pull}921[#921]

Mapping::
* Ensure that field collapsing works with field aliases. {es-pull}50722[#50722] (issues: {es-issue}32648[#32648], {es-issue}50121[#50121])
* Fix meta version of task index mapping {es-pull}50363[#50363] (issue: {es-issue}48393[#48393])

Recovery::
* Check allocation ID when failing shard on recovery {es-pull}50656[#50656] (issue: {es-issue}50508[#50508])

SQL::
* Change the way unsupported data types fields are handled {es-pull}50823[#50823]
* Optimization fixes for conjunction merges {es-pull}50703[#50703] (issue: {es-issue}49637[#49637])
*  Fix issue with CAST and NULL checking. {es-pull}50371[#50371] (issue: {es-issue}50191[#50191])
* Fix NPE for JdbcResultSet.getDate(param, Calendar) calls {es-pull}50184[#50184] (issue: {es-issue}50174[#50174])

Search::
* Fix upgrade of custom similarity {es-pull}50851[#50851] (issue: {es-issue}50763[#50763])

Security::
* Always consume the request body of `has_privileges` API {es-pull}50298[#50298] (issue: {es-issue}50288[#50288])


[[release-notes-7.5.1]]
== {es} version 7.5.1

Also see <<breaking-changes-7.5,Breaking changes in 7.5>>.

[[enhancement-7.5.1]]
[float]
=== Enhancements

Features/Watcher::
* Log attachment generation failures {es-pull}50080[#50080]

Network::
* Netty4: switch to composite cumulator {es-pull}49478[#49478]



[[bug-7.5.1]]
[float]
=== Bug fixes

Authentication::
* Fix iterate-from-1 bug in smart realm order {es-pull}49473[#49473]

CRUD::
* Do not mutate request on scripted upsert {es-pull}49578[#49578] (issue: {es-issue}48670[#48670])

Cluster Coordination::
* Make elasticsearch-node tools custom metadata-aware {es-pull}48390[#48390]

Engine::
* Account trimAboveSeqNo in committed translog generation {es-pull}50205[#50205] (issue: {es-issue}49970[#49970])

Features/ILM+SLM::
* Handle failure to retrieve ILM policy step better {es-pull}49193[#49193] (issue: {es-pull}49128[#49128])

Features/Java High Level REST Client::
* Support es7 node http publish_address format {es-pull}49279[#49279] (issue: {es-issue}48950[#48950])

Geo::
* Fix handling of circles in legacy geo_shape queries {es-pull}49410[#49410] (issue: {es-issue}49296[#49296])

Infra/Packaging::
* Extend systemd timeout during startup {es-pull}49784[#49784] (issue: {es-issue}49593[#49593])

Machine Learning::
* Use query in cardinality check {es-pull}49939[#49939]
* Fix expired job results deletion audit message {es-pull}49560[#49560] (issue: {es-issue}49549[#49549])
* Apply source query on data frame analytics memory estimation {es-pull}49527[#49527] (issue: {es-issue}49454[#49454])
* Stop timing stats failure propagation {es-pull}49495[#49495]

Mapping::
* Improve DateFieldMapper `ignore_malformed` handling {es-pull}50090[#50090] (issue: {es-issue}50081[#50081])

Recovery::
* Migrate peer recovery from translog to retention lease {es-pull}49448[#49448] (issue: {es-issue}45136[#45136])

SQL::
* COUNT DISTINCT returns 0 instead of NULL for no matching docs {es-pull}50037[#50037] (issue: {es-issue}50013[#50013])
* Fix LOCATE function optional parameter handling  {es-pull}49666[#49666] (issue: {es-issue}49557[#49557])
* Fix NULL handling for FLOOR and CEIL functions {es-pull}49644[#49644] (issue: {es-issue}49556[#49556])
* Handle NULL arithmetic operations with INTERVALs {es-pull}49633[#49633] (issue: {es-issue}49297[#49297])
* Fix issue with GROUP BY YEAR() {es-pull}49559[#49559] (issue: {es-issue}49386[#49386])
* Fix issue with CASE/IIF pre-calculating results {es-pull}49553[#49553] (issue: {es-issue}49388[#49388])
* Fix issue with folding of CASE/IIF {es-pull}49449[#49449] (issue: {es-issue}49387[#49387])
* Fix issues with WEEK/ISO_WEEK/DATEDIFF {es-pull}49405[#49405] (issues: {es-issue}48209[#48209], {es-issue}49376[#49376])

Snapshot/Restore::
* Fix Index Deletion during Snapshot Finalization {es-pull}50202[#50202] (issues: {es-issue}45689[#45689], {es-issue}50200[#50200])

Transform::
* Fix possible audit logging disappearance after rolling upgrade {es-pull}49731[#49731] (issue: {es-issue}49730[#49730])


[[release-notes-7.5.0]]
== {es} version 7.5.0

Also see <<breaking-changes-7.5,Breaking changes in 7.5>>.

[[known-issues-7.5.0]]
[float]
=== Known issues

* Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
https://issues.apache.org/jira/browse/LUCENE-9300[corresponding issue].

* Stop all {transforms} during a rolling upgrade to 7.5.
If a {transform} is running during upgrade, the {transform} audit index might disappear.
(issue: {es-issue}/49730[#49730])

* Indices created in 6.x with <<date,`date`>> and <<date_nanos,`date_nanos`>> fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.

[[breaking-7.5.0]]
[float]
=== Breaking changes

Search::
* Add support for aliases in queries on _index. {es-pull}46640[#46640] (issues: {es-issue}23306[#23306], {es-issue}34089[#34089])



[[deprecation-7.5.0]]
[float]
=== Deprecations

Aggregations::
* Deprecate the  "index.max_adjacency_matrix_filters" setting {es-pull}46394[#46394] (issue: {es-issue}46324[#46324])

Allocation::
* Deprecate include_relocations setting {es-pull}47443[#47443] (issue: {es-issue}46079[#46079])

Mapping::
* Deprecate `_field_names` disabling {es-pull}42854[#42854] (issue: {es-issue}27239[#27239])

Search::
* Reject regexp queries on the _index field. {es-pull}46945[#46945] (issues: {es-issue}34089[#34089], {es-issue}46640[#46640])



[[feature-7.5.0]]
[float]
=== New features

Features/ILM+SLM::
* Add API to execute SLM retention on-demand {es-pull}47405[#47405] (issues: {es-issue}43663[#43663], {es-issue}46508[#46508])
* Add retention to Snapshot Lifecycle Management {es-pull}46407[#46407] (issues: {es-issue}38461[#38461], {es-issue}43663[#43663], {es-issue}45362[#45362])

Features/Ingest::
* Add enrich processor {es-pull}48039[#48039] (issue: {es-issue}32789[#32789])

Machine Learning::
* Implement evaluation API for multiclass classification problem {es-pull}47126[#47126] (issue: {es-issue}46735[#46735])
* Implement new analysis type: classification {es-pull}46537[#46537] (issue: {es-issue}46735[#46735])
* Add audit messages for Data Frame Analytics {es-pull}46521[#46521] (issue: {es-issue}184[#184])
* Implement DataFrameAnalyticsAuditMessage and DataFrameAnalyticsAuditor {es-pull}45967[#45967]

SQL::
* SQL: Implement DATEDIFF function {es-pull}47920[#47920] (issue: {es-issue}47919[#47919])
* SQL: Implement DATEADD function {es-pull}47747[#47747] (issue: {es-issue}47746[#47746])
* SQL: Implement DATE_PART function {es-pull}47206[#47206] (issue: {es-issue}46372[#46372])
* SQL: Add alias DATETRUNC to DATE_TRUNC function {es-pull}47173[#47173] (issue: {es-issue}46473[#46473])
* SQL: Add PIVOT support {es-pull}46489[#46489]
* SQL: Implement DATE_TRUNC function {es-pull}46473[#46473] (issue: {es-issue}46319[#46319])



[[enhancement-7.5.0]]
[float]
=== Enhancements

Aggregations::
* Adjacency_matrix aggregation memory usage optimisation. {es-pull}46257[#46257] (issue: {es-issue}46212[#46212])
* Support geotile_grid aggregation in composite agg sources {es-pull}45810[#45810] (issue: {es-issue}40568[#40568])

Allocation::
* Do not cancel ongoing recovery for noop copy on broken node {es-pull}48265[#48265] (issue: {es-issue}47974[#47974])
* Shrink should not touch max_retries {es-pull}47719[#47719]
* Re-fetch shard info of primary when new node joins {es-pull}47035[#47035] (issues: {es-issue}42518[#42518], {es-issue}46959[#46959])
* Sequence number based replica allocation {es-pull}46959[#46959] (issue: {es-issue}46318[#46318])

Authorization::
* Add support to retrieve all API keys if user has privilege {es-pull}47274[#47274] (issue: {es-issue}46887[#46887])
* Add 'create_doc' index privilege {es-pull}45806[#45806]
* Reducing privileges needed by built-in beats_admin role {es-pull}41586[#41586]

CCR::
* Add Pause/Resume Auto-Follower APIs to High Level REST Client {es-pull}47989[#47989] (issue: {es-issue}47510[#47510])
* Add Pause/Resume Auto Follower APIs {es-pull}47510[#47510] (issue: {es-issue}46665[#46665])

CRUD::
* Allow optype CREATE for append-only indexing operations {es-pull}47169[#47169]

Cluster Coordination::
* Warn on slow metadata persistence {es-pull}47005[#47005]
* Improve LeaderCheck rejection messages {es-pull}46998[#46998]

Engine::
* Do not warm up searcher in engine constructor {es-pull}48605[#48605] (issue: {es-issue}47186[#47186])
* Refresh should not acquire readLock {es-pull}48414[#48414] (issue: {es-issue}47186[#47186])
* Avoid unneeded refresh with concurrent realtime gets {es-pull}47895[#47895]
* sync before trimUnreferencedReaders to improve index preformance {es-pull}47790[#47790] (issues: {es-issue}46201[#46201], {es-issue}46203[#46203])
* Limit number of retaining translog files for peer recovery {es-pull}47414[#47414]
* Remove isRecovering method from Engine {es-pull}47039[#47039]

Features/ILM+SLM::
* Separate SLM stop/start/status API from ILM {es-pull}47710[#47710] (issue: {es-issue}43663[#43663])
* Set default SLM retention invocation time {es-pull}47604[#47604] (issue: {es-issue}43663[#43663])
* ILM: Skip rolling indexes that are already rolled {es-pull}47324[#47324] (issue: {es-issue}44175[#44175])
*  Add support for POST requests to SLM Execute API  {es-pull}47061[#47061]
* Wait for snapshot completion in SLM snapshot invocation {es-pull}47051[#47051] (issues: {es-issue}38461[#38461], {es-issue}43663[#43663])
* Add node setting for disabling SLM {es-pull}46794[#46794] (issue: {es-issue}38461[#38461])
* ILM: parse origination date from index name {es-pull}46755[#46755] (issues: {es-issue}42449[#42449], {es-issue}46561[#46561])
* [ILM] Add date setting to calculate index age {es-pull}46561[#46561] (issue: {es-issue}42449[#42449])

Features/Ingest::
* Add the ability to require an ingest pipeline {es-pull}46847[#46847]

Features/Java High Level REST Client::
* add function submitDeleteByQueryTask in class RestHighLevelClient {es-pull}46833[#46833]
* return Cancellable in RestHighLevelClient {es-pull}45688[#45688] (issue: {es-issue}44802[#44802])

Features/Java Low Level REST Client::
* Add cloudId builder to the HLRC {es-pull}47868[#47868]
* Add support for cancelling async requests in low-level REST client {es-pull}45379[#45379] (issues: {es-issue}43332[#43332], {es-issue}44802[#44802])

Features/Monitoring::
* Remove hard coded version_created in default monitoring alerts {es-pull}47744[#47744]

Infra/Circuit Breakers::
* Emit log message when parent circuit breaker trips {es-pull}47000[#47000]
* Fix G1 GC default IHOP {es-pull}46169[#46169]

Infra/Core::
* Introduce system JVM options {es-pull}48252[#48252] (issue: {es-issue}48222[#48222])
* Set start of the week to Monday for root locale {es-pull}43652[#43652] (issues: {es-issue}41670[#41670], {es-issue}42588[#42588], {es-issue}43275[#43275])

Infra/Packaging::
* Package the JDK into jdk.app on macOS {es-pull}48765[#48765]
* Move ES_TMPDIR substitution into jvm options parser {es-pull}47189[#47189] (issue: {es-issue}47133[#47133])
* Clarify missing java error message {es-pull}46160[#46160] (issue: {es-issue}44139[#44139])

Infra/Scripting::
* Add explanations to script score queries {es-pull}46693[#46693]

Infra/Settings::
* Do not reference values for filtered settings {es-pull}48066[#48066]
* Allow setting validation against arbitrary types {es-pull}47264[#47264] (issue: {es-issue}25560[#25560])
* Clarify error message on keystore write permissions {es-pull}46321[#46321]
* Add more meaningful keystore version mismatch errors {es-pull}46291[#46291] (issue: {es-issue}44624[#44624])

Machine Learning::
* Throw an exception when memory usage estimation endpoint encounters empty data frame. {es-pull}49143[#49143] (issue: {es-issue}49140[#49140])
* Change format of MulticlassConfusionMatrix result to be more self-explanatory {es-pull}48174[#48174] (issue: {es-issue}46735[#46735])
* Make num_top_classes parameter's default value equal to 2 {es-pull}48119[#48119] (issue: {es-issue}46735[#46735])
* [ML] Add option to stop datafeed that finds no data {es-pull}47922[#47922]
* Allow integer types for classification's dependent variable {es-pull}47902[#47902] (issue: {es-issue}46735[#46735])
* [ML] Add lazy assignment job config option {es-pull}47726[#47726]
* [ML] Additional outlier detection parameters {es-pull}47600[#47600]
* [ML] More accurate job memory overhead {es-pull}47516[#47516]
* [ML] Throttle the delete-by-query of expired results {es-pull}47177[#47177] (issues: {es-issue}47003[#47003], {es-issue}47103[#47103])

Mapping::
* Add migration tool checks for _field_names disabling {es-pull}46972[#46972] (issues: {es-issue}42854[#42854], {es-issue}46681[#46681])

Network::
* Introduce simple remote connection strategy {es-pull}47480[#47480]
* Enhanced logging when transport is misconfigured to talk to HTTP port {es-pull}45964[#45964] (issue: {es-issue}32688[#32688])

Recovery::
* Do not send recovery requests with CancellableThreads {es-pull}46287[#46287] (issue: {es-issue}46178[#46178])

SQL::
* SQL: make date/datetime and interval types compatible in conditional functions {es-pull}47595[#47595] (issue: {es-issue}46674[#46674])
* SQL: use calendar interval of 1y instead of fixed interval for grouping by YEAR and HISTOGRAMs {es-pull}47558[#47558] (issue: {es-issue}40162[#40162])
* SQL: Support queries with HAVING over SELECT {es-pull}46709[#46709] (issue: {es-issue}37051[#37051])
* SQL: Add support for shape type {es-pull}46464[#46464] (issues: {es-issue}43644[#43644], {es-issue}46412[#46412])

Search::
* Remove response search phase from ExpandSearchPhase {es-pull}48401[#48401]
* Add builder for distance_feature to QueryBuilders {es-pull}47846[#47846] (issue: {es-issue}47767[#47767])
* Fold InitialSearchPhase into AbstractSearchAsyncAction {es-pull}47182[#47182]
* max_children exist only in top level nested sort {es-pull}46731[#46731]
* First round of optimizations for vector functions. {es-pull}46294[#46294] (issues: {es-issue}45390[#45390], {es-issue}45936[#45936], {es-issue}46103[#46103], {es-issue}46155[#46155], {es-issue}46190[#46190], {es-issue}46202[#46202])
* Throw exception in scroll requests using `from` {es-pull}46087[#46087] (issues: {es-issue}26235[#26235], {es-issue}44493[#44493], {es-issue}9373[#9373])

Snapshot/Restore::
* Track Repository Gen. in BlobStoreRepository {es-pull}48944[#48944] (issues: {es-issue}38941[#38941], {es-issue}47520[#47520], {es-issue}47834[#47834], {es-issue}49048[#49048])
* Resume partial download from S3 on connection drop {es-pull}46589[#46589]
* More Efficient Ordering of Shard Upload Execution {es-pull}42791[#42791]

Transform::
* [ML][Transforms] allow executor to call start on started task {es-pull}46347[#46347]
* [ML-DataFrame] improve error message for timeout case in stop {es-pull}46131[#46131] (issue: {es-issue}45610[#45610])
* [ML][Data Frame] add support for `wait_for_checkpoint` flag on `_stop` API {es-pull}45469[#45469] (issue: {es-issue}45293[#45293])



[[bug-7.5.0]]
[float]
=== Bug fixes

Aggregations::
* Fix ignoring missing values in min/max aggregations {es-pull}48970[#48970] (issue: {es-issue}48905[#48905])
* DocValueFormat implementation for date range fields {es-pull}47472[#47472] (issues: {es-issue}47323[#47323], {es-issue}47469[#47469])

Allocation::
* Auto-expand replicated closed indices {es-pull}48973[#48973]
* Handle negative free disk space in deciders {es-pull}48392[#48392] (issue: {es-issue}48380[#48380])
* Dangling indices strip aliases {es-pull}47581[#47581]
* Cancel recoveries even if all shards assigned {es-pull}46520[#46520]
* Fail allocation of new primaries in empty cluster {es-pull}43284[#43284] (issue: {es-issue}41073[#41073])

Analysis::
* Reset Token position on reuse in `predicate_token_filter` {es-pull}47424[#47424] (issue: {es-issue}47197[#47197])

Audit::
* Audit log filter and marker {es-pull}45456[#45456] (issue: {es-issue}47251[#47251])

Authentication::
* Add owner flag parameter to the rest spec {es-pull}48500[#48500] (issue: {es-issue}48499[#48499])
* Add populate_user_metadata in OIDC realm {es-pull}48357[#48357] (issue: {es-issue}48217[#48217])
* Remove unnecessary details logged for OIDC {es-pull}48271[#48271]
* Fix AD realm additional metadata {es-pull}47179[#47179] (issue: {es-issue}45848[#45848])
* Fallback to realm authc if ApiKey fails {es-pull}46538[#46538]
* PKI realm accept only verified certificates {es-pull}45590[#45590]

Authorization::
* Fix security origin for TokenService#findActiveTokensFor... {es-pull}47418[#47418] (issue: {es-issue}47151[#47151])
* Use 'should' clause instead of 'filter' when querying native privileges {es-pull}47019[#47019]
* Do not rewrite aliases on remove-index from aliases requests {es-pull}46989[#46989]
* Validate index and cluster privilege names when creating a role {es-pull}46361[#46361] (issue: {es-issue}29703[#29703])
* Validate `query` field when creating roles {es-pull}46275[#46275] (issue: {es-issue}34252[#34252])

CCR::
* CCR should auto-retry rejected execution exceptions {es-pull}49213[#49213]
* Do not auto-follow closed indices {es-pull}47721[#47721] (issue: {es-issue}47582[#47582])
* Relax maxSeqNoOfUpdates assertion in FollowingEngine {es-pull}47188[#47188] (issue: {es-issue}47137[#47137])
* Handle lower retaining seqno retention lease error {es-pull}46420[#46420] (issues: {es-issue}46013[#46013], {es-issue}46416[#46416])

CRUD::
* Close query cache on index service creation failure {es-pull}48230[#48230] (issue: {es-issue}48186[#48186])
* Use optype CREATE for single auto-id index requests {es-pull}47353[#47353]
* Ignore replication for noop updates {es-pull}46458[#46458] (issues: {es-issue}41065[#41065], {es-issue}44603[#44603], {es-issue}46366[#46366])

Client::
* Correct default refresh policy for security APIs {es-pull}46896[#46896]

Cluster Coordination::
* Ignore metadata of deleted indices at start {es-pull}48918[#48918]
* Omit writing index metadata for non-replicated closed indices on data-only node {es-pull}47285[#47285] (issue: {es-issue}47276[#47276])
* Assert no exceptions during state application {es-pull}47090[#47090] (issue: {es-issue}47038[#47038])
* Remove trailing comma from nodes lists {es-pull}46484[#46484]

Distributed::
* Closed shard should never open new engine {es-pull}47186[#47186] (issues: {es-issue}45263[#45263], {es-issue}47060[#47060])
* Fix false positive out of sync warning in synced-flush {es-pull}46576[#46576] (issues: {es-issue}28464[#28464], {es-issue}30244[#30244])
* Suppress warning logs from background sync on relocated primary {es-pull}46247[#46247] (issues: {es-issue}40800[#40800], {es-issue}42241[#42241])

Engine::
* Greedily advance safe commit on new global checkpoint {es-pull}48559[#48559] (issue: {es-issue}48532[#48532])

Features/ILM+SLM::
* Don't halt policy execution on policy trigger exception {es-pull}49128[#49128]
* Don't schedule SLM jobs when services have been stopped {es-pull}48658[#48658] (issue: {es-issue}47749[#47749])
* Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48367[#48367]
* Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48361[#48361]
* Add SLM support to xpack usage and info APIs {es-pull}48096[#48096] (issue: {es-issue}43663[#43663])
* Change policy_id to list type in slm.get_lifecycle {es-pull}47766[#47766] (issue: {es-issue}47765[#47765])
* Throw error retrieving non-existent SLM policy {es-pull}47679[#47679] (issue: {es-issue}47664[#47664])
* Handle partial failure retrieving segments in SegmentCountStep {es-pull}46556[#46556]
* Fixes for API specification {es-pull}46522[#46522]

Features/Indices APIs::
* Fix Rollover error when alias has closed indices {es-pull}47148[#47148] (issue: {es-issue}47146[#47146])

Features/Ingest::
* Do not wrap ingest processor exception with IAE {es-pull}48816[#48816] (issue: {es-issue}48810[#48810])
* Introduce dedicated ingest processor exception {es-pull}48810[#48810] (issue: {es-issue}48803[#48803])
* Allow dropping documents with auto-generated ID {es-pull}46773[#46773] (issue: {es-issue}46678[#46678])
* Expose cache setting in UserAgentPlugin {es-pull}46533[#46533]

Features/Java High Level REST Client::
* fix incorrect comparison {es-pull}48208[#48208]
* Fix ILM HLRC Javadoc->Documentation links {es-pull}48083[#48083]
* Change HLRC count request to accept a QueryBuilder {es-pull}46904[#46904] (issue: {es-issue}46829[#46829])
* [HLRC] Send min_score as query string parameter to the count API {es-pull}46829[#46829] (issue: {es-issue}46474[#46474])
* HLRC multisearchTemplate forgot params {es-pull}46492[#46492] (issue: {es-issue}46488[#46488])
* Added fields for MultiTermVectors (#42232) {es-pull}42877[#42877] (issue: {es-issue}42232[#42232])

Features/Java Low Level REST Client::
* Update http-core and http-client dependencies {es-pull}46549[#46549] (issues: {es-issue}45379[#45379], {es-issue}45577[#45577], {es-issue}45808[#45808])

Features/Monitoring::
* [Monitoring] Add new cluster privilege now necessary for the stack monitoring ui {es-pull}47871[#47871]
* Validating monitoring hosts setting while parsing {es-pull}47246[#47246] (issue: {es-issue}47125[#47125])

Features/Watcher::
* Fix class used to initialize logger in Watcher {es-pull}46467[#46467]
* Fix wrong URL encoding in watcher HTTP client {es-pull}45894[#45894] (issue: {es-issue}44970[#44970])
* Prevent deadlock by using separate schedulers {es-pull}48697[#48697] (issues: {es-issue}41451[#41451], {es-issue}47599[#47599])
* Fix cluster alert for watcher/monitoring IndexOutOfBoundsExcep… {es-pull}45308[#45308] (issue: {es-issue}43184[#43184])

Geo::
* Geo: implement proper handling of out of bounds geo points {es-pull}47734[#47734] (issue: {es-issue}43916[#43916])
* Geo: Fixes indexing of linestrings that go around the globe {es-pull}47471[#47471] (issues: {es-issue}43826[#43826], {es-issue}43837[#43837])
* Provide better error when updating geo_shape field mapper settings {es-pull}47281[#47281] (issue: {es-issue}47006[#47006])
* Geo: fix indexing of west to east linestrings crossing the antimeridian {es-pull}46601[#46601] (issue: {es-issue}43775[#43775])
* Reset queryGeometry in ShapeQueryTests {es-pull}45974[#45974] (issue: {es-issue}45628[#45628])

Highlighting::
* Fix highlighting of overlapping terms in the unified highlighter {es-pull}47227[#47227]
* Fix highlighting for script_score query {es-pull}46507[#46507] (issue: {es-issue}46471[#46471])

Infra/Core::
* Don't drop user's MaxDirectMemorySize flag on jdk8/windows {es-pull}48657[#48657] (issues: {es-issue}44174[#44174], {es-issue}48365[#48365])
* Warn when MaxDirectMemorySize may be incorrect (Windows/JDK8 only issue) {es-pull}48365[#48365] (issue: {es-issue}47384[#47384])
* Support optional parsers in any order with DateMathParser and roundup {es-pull}46654[#46654] (issue: {es-issue}45284[#45284])

Infra/Logging::
* SearchSlowLog uses a non thread-safe object to escape json {es-pull}48363[#48363] (issues: {es-issue}44642[#44642], {es-issue}48358[#48358])

Infra/Scripting::
* Drop stored scripts with the old style-id {es-pull}48078[#48078] (issue: {es-issue}47593[#47593])

Machine Learning::
* [ML] Fixes for stop datafeed edge cases {es-pull}49191[#49191] (issues: {es-issue}43670[#43670], {es-issue}48931[#48931])
* [ML] Avoid NPE when node load is calculated on job assignment {es-pull}49186[#49186] (issue: {es-issue}49150[#49150])
* Do not throw exceptions resulting from persisting datafeed timing stats. {es-pull}49044[#49044] (issue: {es-issue}49032[#49032])
* [ML] Deduplicate multi-fields for data frame analytics {es-pull}48799[#48799] (issues: {es-issue}48756[#48756], {es-issue}48770[#48770])
* [ML] Prevent fetching multi-field from source {es-pull}48770[#48770] (issue: {es-issue}48756[#48756])
* [ML] Fix detection of syslog-like timestamp in find_file_structure {es-pull}47970[#47970]
* Fix serialization of evaluation response. {es-pull}47557[#47557]
* [ML] Reinstate ML daily maintenance actions {es-pull}47103[#47103] (issue: {es-issue}47003[#47003])
* [ML] fix two datafeed flush lockup bugs {es-pull}46982[#46982]

Network::
* Fix es.http.cname_in_publish_address Deprecation Logging {es-pull}47451[#47451] (issue: {es-issue}47436[#47436])

Recovery::
* Ignore Lucene index in peer recovery if translog corrupted {es-pull}49114[#49114]

Reindex::
* Fix issues with serializing BulkByScrollResponse {es-pull}45357[#45357]

SQL::
* SQL: Fix issue with mins & hours for DATEDIFF {es-pull}49252[#49252]
* SQL: Fix issue with negative literels and parentheses {es-pull}48113[#48113] (issue: {es-issue}48009[#48009])
* SQL: add "format" for "full" date range queries {es-pull}48073[#48073] (issue: {es-issue}48033[#48033])
* SQL: Fix arg verification for DateAddProcessor {es-pull}48041[#48041]
* SQL: Fix Nullability of DATEADD {es-pull}47921[#47921]
* SQL: Allow whitespaces in escape patterns {es-pull}47577[#47577] (issue: {es-issue}47401[#47401])
* SQL: fix multi full-text functions usage with aggregate functions {es-pull}47444[#47444] (issue: {es-issue}47365[#47365])
* SQL: Check case where the pivot limit is reached {es-pull}47121[#47121] (issue: {es-issue}47002[#47002])
* SQL: Properly handle indices with no/empty mapping {es-pull}46775[#46775] (issue: {es-issue}46757[#46757])
* SQL: improve ResultSet behavior when no rows are available {es-pull}46753[#46753] (issue: {es-issue}46750[#46750])
* SQL: use the correct data type for types conversion {es-pull}46574[#46574] (issue: {es-issue}46090[#46090])
* SQL: Fix issue with common type resolution {es-pull}46565[#46565] (issue: {es-issue}46551[#46551])
* SQL: fix scripting for grouped by datetime functions {es-pull}46421[#46421] (issue: {es-issue}40241[#40241])
* SQL: Use null schema response {es-pull}46386[#46386] (issue: {es-issue}46381[#46381])
* SQL: Fix issue with IIF function when condition folds {es-pull}46290[#46290] (issue: {es-issue}46268[#46268])
* SQL: Fix issue with DataType for CASE with NULL {es-pull}46173[#46173] (issue: {es-issue}46032[#46032])
* SQL: Failing Group By queries due to different ExpressionIds {es-pull}43072[#43072] (issues: {es-issue}33361[#33361], {es-issue}34543[#34543], {es-issue}36074[#36074], {es-issue}37044[#37044], {es-issue}40001[#40001], {es-issue}40240[#40240], {es-issue}41159[#41159], {es-issue}42041[#42041], {es-issue}46316[#46316])
* SQL: wrong number of values for columns {es-pull}42122[#42122]

Search::
* Lucene#asSequentialBits gets the leadCost backwards. {es-pull}48335[#48335]
* Ensure that we don't call listener twice when detecting a partial failures in _search {es-pull}47694[#47694]
* Fix alias field resolution in match query {es-pull}47369[#47369]
* Multi-get requests should wait for search active {es-pull}46283[#46283] (issue: {es-issue}27500[#27500])
* Resolve the incorrect scroll_current when delete or close index {es-pull}45226[#45226]
* Don't apply the plugin's reader wrapper in can_match phase {es-pull}47816[#47816] (issue: {es-issue}46817[#46817])

Security::
* Remove uniqueness constraint for API key name and make it optional {es-pull}47549[#47549] (issue: {es-issue}46646[#46646])
* Initialize document subset bit set cache used for DLS {es-pull}46211[#46211] (issue: {es-issue}45147[#45147])

Snapshot/Restore::
* Fix RepoCleanup not Removed on Master-Failover {es-pull}49217[#49217]
* Make FsBlobContainer Listing Resilient to Concurrent Modifications {es-pull}49142[#49142] (issue: {es-issue}37581[#37581])
* Fix SnapshotShardStatus Reporting for Failed Shard {es-pull}48556[#48556] (issue: {es-issue}48526[#48526])
* Cleanup Concurrent RepositoryData Loading {es-pull}48329[#48329] (issue: {es-issue}48122[#48122])
* Fix Bug in Azure Repo Exception Handling {es-pull}47968[#47968]
* Make loadShardSnapshot Exceptions Consistent {es-pull}47728[#47728] (issue: {es-issue}47507[#47507])
* Fix Snapshot Corruption in Edge Case {es-pull}47552[#47552] (issues: {es-issue}46250[#46250], {es-issue}47550[#47550])
* Fix Bug in Snapshot Status Response Timestamps {es-pull}46919[#46919] (issue: {es-issue}46913[#46913])
* Normalize Blob Store Repo Paths {es-pull}46869[#46869] (issue: {es-issue}41814[#41814])
* GCS deleteBlobsIgnoringIfNotExists should catch StorageException {es-pull}46832[#46832] (issue: {es-issue}46772[#46772])
* Execute SnapshotsService Error Callback on Generic Thread {es-pull}46277[#46277]
* Make Snapshot Logic Write Metadata after Segments {es-pull}45689[#45689] (issue: {es-issue}41581[#41581])

Store::
* Allow truncation of clean translog {es-pull}47866[#47866]

Task Management::
* Fix .tasks index strict mapping: parent_id should be parent_task_id {es-pull}48393[#48393]

Transform::
* [Transform] do not fail checkpoint creation due to global checkpoint mismatch {es-pull}48423[#48423] (issue: {es-issue}48379[#48379])
* [7.5][Transform] prevent assignment if any node is older than 7.4 {es-pull}48055[#48055] (issue: {es-issue}48019[#48019])
* [Transform] prevent assignment to nodes older than 7.4 {es-pull}48044[#48044] (issue: {es-issue}48019[#48019])
* [ML][Transforms] fix bwc serialization with 7.3 {es-pull}48021[#48021]
* [ML][Transforms] signal listener early on task _stop failure {es-pull}47954[#47954]
* [ML][Transform] Use field_caps API for mapping deduction {es-pull}46703[#46703] (issue: {es-issue}46694[#46694])
* [ML-DataFrame] Fix off-by-one error in checkpoint operations_behind {es-pull}46235[#46235]



[[regression-7.5.0]]
[float]
=== Regressions

Aggregations::
* Implement rounding optimization for fixed offset timezones {es-pull}46670[#46670] (issue: {es-issue}45702[#45702])

Infra/Core::
* [Java.time] Support partial parsing {es-pull}46814[#46814] (issues: {es-issue}45284[#45284], {es-issue}47473[#47473])
* Enable ResolverStyle.STRICT for java formatters {es-pull}46675[#46675]



[[upgrade-7.5.0]]
[float]
=== Upgrades

Infra/Scripting::
* Update mustache dependency to 0.9.6 {es-pull}46243[#46243]

Snapshot/Restore::
* Update AWS SDK for repository-s3 plugin to support IAM Roles for Service Accounts {es-pull}46969[#46969]
* Upgrade to Azure SDK 8.4.0 {es-pull}46094[#46094]

Store::
* Upgrade to Lucene 8.3. {es-pull}48829[#48829]