[[release-notes-7.5.2]] == {es} version 7.5.2 [[enhancement-7.5.2]] [float] === Enhancements Features/Ingest:: * Fork recursive calls in Foreach processor {es-pull}50514[#50514] Infra/Core:: * Fix unintended debug logging in subclasses of TransportMasterNodeAction {es-pull}50839[#50839] (issues: {es-issue}50056[#50056], {es-issue}50074[#50074], {es-issue}50076[#50076]) [[bug-7.5.2]] [float] === Bug fixes Analysis:: * Fix caching for PreConfiguredTokenFilter {es-pull}50912[#50912] (issue: {es-issue}50734[#50734]) CRUD:: * Block too many concurrent mapping updates {es-pull}51038[#51038] (issue: {es-issue}50670[#50670]) Engine:: * Account soft-deletes in FrozenEngine {es-pull}51192[#51192] (issue: {es-issue}50775[#50775]) Features/ILM+SLM:: * Fix SLM check for restore in progress {es-pull}50868[#50868] Features/Ingest:: * Fix ingest simulate response document order if processor executes async {es-pull}50244[#50244] Features/Java Low Level REST Client:: * Improve warning value extraction performance in response {es-pull}50208[#50208] (issue: {es-issue}24114[#24114]) Machine Learning:: * Fixes potential memory corruption or inconsistent state when background persisting categorizer state. {ml-pull}921[#921] Mapping:: * Ensure that field collapsing works with field aliases. {es-pull}50722[#50722] (issues: {es-issue}32648[#32648], {es-issue}50121[#50121]) * Fix meta version of task index mapping {es-pull}50363[#50363] (issue: {es-issue}48393[#48393]) Recovery:: * Check allocation ID when failing shard on recovery {es-pull}50656[#50656] (issue: {es-issue}50508[#50508]) SQL:: * Change the way unsupported data types fields are handled {es-pull}50823[#50823] * Optimization fixes for conjunction merges {es-pull}50703[#50703] (issue: {es-issue}49637[#49637]) * Fix issue with CAST and NULL checking. {es-pull}50371[#50371] (issue: {es-issue}50191[#50191]) * Fix NPE for JdbcResultSet.getDate(param, Calendar) calls {es-pull}50184[#50184] (issue: {es-issue}50174[#50174]) Search:: * Fix upgrade of custom similarity {es-pull}50851[#50851] (issue: {es-issue}50763[#50763]) Security:: * Always consume the request body of `has_privileges` API {es-pull}50298[#50298] (issue: {es-issue}50288[#50288]) [[release-notes-7.5.1]] == {es} version 7.5.1 Also see <>. [[enhancement-7.5.1]] [float] === Enhancements Features/Watcher:: * Log attachment generation failures {es-pull}50080[#50080] Network:: * Netty4: switch to composite cumulator {es-pull}49478[#49478] [[bug-7.5.1]] [float] === Bug fixes Authentication:: * Fix iterate-from-1 bug in smart realm order {es-pull}49473[#49473] CRUD:: * Do not mutate request on scripted upsert {es-pull}49578[#49578] (issue: {es-issue}48670[#48670]) Cluster Coordination:: * Make elasticsearch-node tools custom metadata-aware {es-pull}48390[#48390] Engine:: * Account trimAboveSeqNo in committed translog generation {es-pull}50205[#50205] (issue: {es-issue}49970[#49970]) Features/ILM+SLM:: * Handle failure to retrieve ILM policy step better {es-pull}49193[#49193] (issue: {es-pull}49128[#49128]) Features/Java High Level REST Client:: * Support es7 node http publish_address format {es-pull}49279[#49279] (issue: {es-issue}48950[#48950]) Geo:: * Fix handling of circles in legacy geo_shape queries {es-pull}49410[#49410] (issue: {es-issue}49296[#49296]) Infra/Packaging:: * Extend systemd timeout during startup {es-pull}49784[#49784] (issue: {es-issue}49593[#49593]) Machine Learning:: * Use query in cardinality check {es-pull}49939[#49939] * Fix expired job results deletion audit message {es-pull}49560[#49560] (issue: {es-issue}49549[#49549]) * Apply source query on data frame analytics memory estimation {es-pull}49527[#49527] (issue: {es-issue}49454[#49454]) * Stop timing stats failure propagation {es-pull}49495[#49495] Mapping:: * Improve DateFieldMapper `ignore_malformed` handling {es-pull}50090[#50090] (issue: {es-issue}50081[#50081]) Recovery:: * Migrate peer recovery from translog to retention lease {es-pull}49448[#49448] (issue: {es-issue}45136[#45136]) SQL:: * COUNT DISTINCT returns 0 instead of NULL for no matching docs {es-pull}50037[#50037] (issue: {es-issue}50013[#50013]) * Fix LOCATE function optional parameter handling {es-pull}49666[#49666] (issue: {es-issue}49557[#49557]) * Fix NULL handling for FLOOR and CEIL functions {es-pull}49644[#49644] (issue: {es-issue}49556[#49556]) * Handle NULL arithmetic operations with INTERVALs {es-pull}49633[#49633] (issue: {es-issue}49297[#49297]) * Fix issue with GROUP BY YEAR() {es-pull}49559[#49559] (issue: {es-issue}49386[#49386]) * Fix issue with CASE/IIF pre-calculating results {es-pull}49553[#49553] (issue: {es-issue}49388[#49388]) * Fix issue with folding of CASE/IIF {es-pull}49449[#49449] (issue: {es-issue}49387[#49387]) * Fix issues with WEEK/ISO_WEEK/DATEDIFF {es-pull}49405[#49405] (issues: {es-issue}48209[#48209], {es-issue}49376[#49376]) Snapshot/Restore:: * Fix Index Deletion during Snapshot Finalization {es-pull}50202[#50202] (issues: {es-issue}45689[#45689], {es-issue}50200[#50200]) Transform:: * Fix possible audit logging disappearance after rolling upgrade {es-pull}49731[#49731] (issue: {es-issue}49730[#49730]) [[release-notes-7.5.0]] == {es} version 7.5.0 Also see <>. [[known-issues-7.5.0]] [float] === Known issues * Applying deletes or updates on an index after it has been shrunk may corrupt the index. In order to prevent this issue, it is recommended to stop shrinking read-write indices. For read-only indices, it is recommended to force-merge indices after shrinking, which significantly reduces the likeliness of this corruption in the case that deletes/updates would be applied by mistake. This bug is fixed in {es} 7.7 and later versions. More details can be found on the https://issues.apache.org/jira/browse/LUCENE-9300[corresponding issue]. * Stop all {transforms} during a rolling upgrade to 7.5. If a {transform} is running during upgrade, the {transform} audit index might disappear. (issue: {es-issue}/49730[#49730]) * Indices created in 6.x with <> and <> fields using formats that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results. https://github.com/elastic/elasticsearch/pull/52555 This is fixed in {es} 7.7 and later versions. [[breaking-7.5.0]] [float] === Breaking changes Search:: * Add support for aliases in queries on _index. {es-pull}46640[#46640] (issues: {es-issue}23306[#23306], {es-issue}34089[#34089]) [[deprecation-7.5.0]] [float] === Deprecations Aggregations:: * Deprecate the "index.max_adjacency_matrix_filters" setting {es-pull}46394[#46394] (issue: {es-issue}46324[#46324]) Allocation:: * Deprecate include_relocations setting {es-pull}47443[#47443] (issue: {es-issue}46079[#46079]) Mapping:: * Deprecate `_field_names` disabling {es-pull}42854[#42854] (issue: {es-issue}27239[#27239]) Search:: * Reject regexp queries on the _index field. {es-pull}46945[#46945] (issues: {es-issue}34089[#34089], {es-issue}46640[#46640]) [[feature-7.5.0]] [float] === New features Features/ILM+SLM:: * Add API to execute SLM retention on-demand {es-pull}47405[#47405] (issues: {es-issue}43663[#43663], {es-issue}46508[#46508]) * Add retention to Snapshot Lifecycle Management {es-pull}46407[#46407] (issues: {es-issue}38461[#38461], {es-issue}43663[#43663], {es-issue}45362[#45362]) Features/Ingest:: * Add enrich processor {es-pull}48039[#48039] (issue: {es-issue}32789[#32789]) Machine Learning:: * Implement evaluation API for multiclass classification problem {es-pull}47126[#47126] (issue: {es-issue}46735[#46735]) * Implement new analysis type: classification {es-pull}46537[#46537] (issue: {es-issue}46735[#46735]) * Add audit messages for Data Frame Analytics {es-pull}46521[#46521] (issue: {es-issue}184[#184]) * Implement DataFrameAnalyticsAuditMessage and DataFrameAnalyticsAuditor {es-pull}45967[#45967] SQL:: * SQL: Implement DATEDIFF function {es-pull}47920[#47920] (issue: {es-issue}47919[#47919]) * SQL: Implement DATEADD function {es-pull}47747[#47747] (issue: {es-issue}47746[#47746]) * SQL: Implement DATE_PART function {es-pull}47206[#47206] (issue: {es-issue}46372[#46372]) * SQL: Add alias DATETRUNC to DATE_TRUNC function {es-pull}47173[#47173] (issue: {es-issue}46473[#46473]) * SQL: Add PIVOT support {es-pull}46489[#46489] * SQL: Implement DATE_TRUNC function {es-pull}46473[#46473] (issue: {es-issue}46319[#46319]) [[enhancement-7.5.0]] [float] === Enhancements Aggregations:: * Adjacency_matrix aggregation memory usage optimisation. {es-pull}46257[#46257] (issue: {es-issue}46212[#46212]) * Support geotile_grid aggregation in composite agg sources {es-pull}45810[#45810] (issue: {es-issue}40568[#40568]) Allocation:: * Do not cancel ongoing recovery for noop copy on broken node {es-pull}48265[#48265] (issue: {es-issue}47974[#47974]) * Shrink should not touch max_retries {es-pull}47719[#47719] * Re-fetch shard info of primary when new node joins {es-pull}47035[#47035] (issues: {es-issue}42518[#42518], {es-issue}46959[#46959]) * Sequence number based replica allocation {es-pull}46959[#46959] (issue: {es-issue}46318[#46318]) Authorization:: * Add support to retrieve all API keys if user has privilege {es-pull}47274[#47274] (issue: {es-issue}46887[#46887]) * Add 'create_doc' index privilege {es-pull}45806[#45806] * Reducing privileges needed by built-in beats_admin role {es-pull}41586[#41586] CCR:: * Add Pause/Resume Auto-Follower APIs to High Level REST Client {es-pull}47989[#47989] (issue: {es-issue}47510[#47510]) * Add Pause/Resume Auto Follower APIs {es-pull}47510[#47510] (issue: {es-issue}46665[#46665]) CRUD:: * Allow optype CREATE for append-only indexing operations {es-pull}47169[#47169] Cluster Coordination:: * Warn on slow metadata persistence {es-pull}47005[#47005] * Improve LeaderCheck rejection messages {es-pull}46998[#46998] Engine:: * Do not warm up searcher in engine constructor {es-pull}48605[#48605] (issue: {es-issue}47186[#47186]) * Refresh should not acquire readLock {es-pull}48414[#48414] (issue: {es-issue}47186[#47186]) * Avoid unneeded refresh with concurrent realtime gets {es-pull}47895[#47895] * sync before trimUnreferencedReaders to improve index preformance {es-pull}47790[#47790] (issues: {es-issue}46201[#46201], {es-issue}46203[#46203]) * Limit number of retaining translog files for peer recovery {es-pull}47414[#47414] * Remove isRecovering method from Engine {es-pull}47039[#47039] Features/ILM+SLM:: * Separate SLM stop/start/status API from ILM {es-pull}47710[#47710] (issue: {es-issue}43663[#43663]) * Set default SLM retention invocation time {es-pull}47604[#47604] (issue: {es-issue}43663[#43663]) * ILM: Skip rolling indexes that are already rolled {es-pull}47324[#47324] (issue: {es-issue}44175[#44175]) * Add support for POST requests to SLM Execute API {es-pull}47061[#47061] * Wait for snapshot completion in SLM snapshot invocation {es-pull}47051[#47051] (issues: {es-issue}38461[#38461], {es-issue}43663[#43663]) * Add node setting for disabling SLM {es-pull}46794[#46794] (issue: {es-issue}38461[#38461]) * ILM: parse origination date from index name {es-pull}46755[#46755] (issues: {es-issue}42449[#42449], {es-issue}46561[#46561]) * [ILM] Add date setting to calculate index age {es-pull}46561[#46561] (issue: {es-issue}42449[#42449]) Features/Ingest:: * Add the ability to require an ingest pipeline {es-pull}46847[#46847] Features/Java High Level REST Client:: * add function submitDeleteByQueryTask in class RestHighLevelClient {es-pull}46833[#46833] * return Cancellable in RestHighLevelClient {es-pull}45688[#45688] (issue: {es-issue}44802[#44802]) Features/Java Low Level REST Client:: * Add cloudId builder to the HLRC {es-pull}47868[#47868] * Add support for cancelling async requests in low-level REST client {es-pull}45379[#45379] (issues: {es-issue}43332[#43332], {es-issue}44802[#44802]) Features/Monitoring:: * Remove hard coded version_created in default monitoring alerts {es-pull}47744[#47744] Infra/Circuit Breakers:: * Emit log message when parent circuit breaker trips {es-pull}47000[#47000] * Fix G1 GC default IHOP {es-pull}46169[#46169] Infra/Core:: * Introduce system JVM options {es-pull}48252[#48252] (issue: {es-issue}48222[#48222]) * Set start of the week to Monday for root locale {es-pull}43652[#43652] (issues: {es-issue}41670[#41670], {es-issue}42588[#42588], {es-issue}43275[#43275]) Infra/Packaging:: * Package the JDK into jdk.app on macOS {es-pull}48765[#48765] * Move ES_TMPDIR substitution into jvm options parser {es-pull}47189[#47189] (issue: {es-issue}47133[#47133]) * Clarify missing java error message {es-pull}46160[#46160] (issue: {es-issue}44139[#44139]) Infra/Scripting:: * Add explanations to script score queries {es-pull}46693[#46693] Infra/Settings:: * Do not reference values for filtered settings {es-pull}48066[#48066] * Allow setting validation against arbitrary types {es-pull}47264[#47264] (issue: {es-issue}25560[#25560]) * Clarify error message on keystore write permissions {es-pull}46321[#46321] * Add more meaningful keystore version mismatch errors {es-pull}46291[#46291] (issue: {es-issue}44624[#44624]) Machine Learning:: * Throw an exception when memory usage estimation endpoint encounters empty data frame. {es-pull}49143[#49143] (issue: {es-issue}49140[#49140]) * Change format of MulticlassConfusionMatrix result to be more self-explanatory {es-pull}48174[#48174] (issue: {es-issue}46735[#46735]) * Make num_top_classes parameter's default value equal to 2 {es-pull}48119[#48119] (issue: {es-issue}46735[#46735]) * [ML] Add option to stop datafeed that finds no data {es-pull}47922[#47922] * Allow integer types for classification's dependent variable {es-pull}47902[#47902] (issue: {es-issue}46735[#46735]) * [ML] Add lazy assignment job config option {es-pull}47726[#47726] * [ML] Additional outlier detection parameters {es-pull}47600[#47600] * [ML] More accurate job memory overhead {es-pull}47516[#47516] * [ML] Throttle the delete-by-query of expired results {es-pull}47177[#47177] (issues: {es-issue}47003[#47003], {es-issue}47103[#47103]) Mapping:: * Add migration tool checks for _field_names disabling {es-pull}46972[#46972] (issues: {es-issue}42854[#42854], {es-issue}46681[#46681]) Network:: * Introduce simple remote connection strategy {es-pull}47480[#47480] * Enhanced logging when transport is misconfigured to talk to HTTP port {es-pull}45964[#45964] (issue: {es-issue}32688[#32688]) Recovery:: * Do not send recovery requests with CancellableThreads {es-pull}46287[#46287] (issue: {es-issue}46178[#46178]) SQL:: * SQL: make date/datetime and interval types compatible in conditional functions {es-pull}47595[#47595] (issue: {es-issue}46674[#46674]) * SQL: use calendar interval of 1y instead of fixed interval for grouping by YEAR and HISTOGRAMs {es-pull}47558[#47558] (issue: {es-issue}40162[#40162]) * SQL: Support queries with HAVING over SELECT {es-pull}46709[#46709] (issue: {es-issue}37051[#37051]) * SQL: Add support for shape type {es-pull}46464[#46464] (issues: {es-issue}43644[#43644], {es-issue}46412[#46412]) Search:: * Remove response search phase from ExpandSearchPhase {es-pull}48401[#48401] * Add builder for distance_feature to QueryBuilders {es-pull}47846[#47846] (issue: {es-issue}47767[#47767]) * Fold InitialSearchPhase into AbstractSearchAsyncAction {es-pull}47182[#47182] * max_children exist only in top level nested sort {es-pull}46731[#46731] * First round of optimizations for vector functions. {es-pull}46294[#46294] (issues: {es-issue}45390[#45390], {es-issue}45936[#45936], {es-issue}46103[#46103], {es-issue}46155[#46155], {es-issue}46190[#46190], {es-issue}46202[#46202]) * Throw exception in scroll requests using `from` {es-pull}46087[#46087] (issues: {es-issue}26235[#26235], {es-issue}44493[#44493], {es-issue}9373[#9373]) Snapshot/Restore:: * Track Repository Gen. in BlobStoreRepository {es-pull}48944[#48944] (issues: {es-issue}38941[#38941], {es-issue}47520[#47520], {es-issue}47834[#47834], {es-issue}49048[#49048]) * Resume partial download from S3 on connection drop {es-pull}46589[#46589] * More Efficient Ordering of Shard Upload Execution {es-pull}42791[#42791] Transform:: * [ML][Transforms] allow executor to call start on started task {es-pull}46347[#46347] * [ML-DataFrame] improve error message for timeout case in stop {es-pull}46131[#46131] (issue: {es-issue}45610[#45610]) * [ML][Data Frame] add support for `wait_for_checkpoint` flag on `_stop` API {es-pull}45469[#45469] (issue: {es-issue}45293[#45293]) [[bug-7.5.0]] [float] === Bug fixes Aggregations:: * Fix ignoring missing values in min/max aggregations {es-pull}48970[#48970] (issue: {es-issue}48905[#48905]) * DocValueFormat implementation for date range fields {es-pull}47472[#47472] (issues: {es-issue}47323[#47323], {es-issue}47469[#47469]) Allocation:: * Auto-expand replicated closed indices {es-pull}48973[#48973] * Handle negative free disk space in deciders {es-pull}48392[#48392] (issue: {es-issue}48380[#48380]) * Dangling indices strip aliases {es-pull}47581[#47581] * Cancel recoveries even if all shards assigned {es-pull}46520[#46520] * Fail allocation of new primaries in empty cluster {es-pull}43284[#43284] (issue: {es-issue}41073[#41073]) Analysis:: * Reset Token position on reuse in `predicate_token_filter` {es-pull}47424[#47424] (issue: {es-issue}47197[#47197]) Audit:: * Audit log filter and marker {es-pull}45456[#45456] (issue: {es-issue}47251[#47251]) Authentication:: * Add owner flag parameter to the rest spec {es-pull}48500[#48500] (issue: {es-issue}48499[#48499]) * Add populate_user_metadata in OIDC realm {es-pull}48357[#48357] (issue: {es-issue}48217[#48217]) * Remove unnecessary details logged for OIDC {es-pull}48271[#48271] * Fix AD realm additional metadata {es-pull}47179[#47179] (issue: {es-issue}45848[#45848]) * Fallback to realm authc if ApiKey fails {es-pull}46538[#46538] * PKI realm accept only verified certificates {es-pull}45590[#45590] Authorization:: * Fix security origin for TokenService#findActiveTokensFor... {es-pull}47418[#47418] (issue: {es-issue}47151[#47151]) * Use 'should' clause instead of 'filter' when querying native privileges {es-pull}47019[#47019] * Do not rewrite aliases on remove-index from aliases requests {es-pull}46989[#46989] * Validate index and cluster privilege names when creating a role {es-pull}46361[#46361] (issue: {es-issue}29703[#29703]) * Validate `query` field when creating roles {es-pull}46275[#46275] (issue: {es-issue}34252[#34252]) CCR:: * CCR should auto-retry rejected execution exceptions {es-pull}49213[#49213] * Do not auto-follow closed indices {es-pull}47721[#47721] (issue: {es-issue}47582[#47582]) * Relax maxSeqNoOfUpdates assertion in FollowingEngine {es-pull}47188[#47188] (issue: {es-issue}47137[#47137]) * Handle lower retaining seqno retention lease error {es-pull}46420[#46420] (issues: {es-issue}46013[#46013], {es-issue}46416[#46416]) CRUD:: * Close query cache on index service creation failure {es-pull}48230[#48230] (issue: {es-issue}48186[#48186]) * Use optype CREATE for single auto-id index requests {es-pull}47353[#47353] * Ignore replication for noop updates {es-pull}46458[#46458] (issues: {es-issue}41065[#41065], {es-issue}44603[#44603], {es-issue}46366[#46366]) Client:: * Correct default refresh policy for security APIs {es-pull}46896[#46896] Cluster Coordination:: * Ignore metadata of deleted indices at start {es-pull}48918[#48918] * Omit writing index metadata for non-replicated closed indices on data-only node {es-pull}47285[#47285] (issue: {es-issue}47276[#47276]) * Assert no exceptions during state application {es-pull}47090[#47090] (issue: {es-issue}47038[#47038]) * Remove trailing comma from nodes lists {es-pull}46484[#46484] Distributed:: * Closed shard should never open new engine {es-pull}47186[#47186] (issues: {es-issue}45263[#45263], {es-issue}47060[#47060]) * Fix false positive out of sync warning in synced-flush {es-pull}46576[#46576] (issues: {es-issue}28464[#28464], {es-issue}30244[#30244]) * Suppress warning logs from background sync on relocated primary {es-pull}46247[#46247] (issues: {es-issue}40800[#40800], {es-issue}42241[#42241]) Engine:: * Greedily advance safe commit on new global checkpoint {es-pull}48559[#48559] (issue: {es-issue}48532[#48532]) Features/ILM+SLM:: * Don't halt policy execution on policy trigger exception {es-pull}49128[#49128] * Don't schedule SLM jobs when services have been stopped {es-pull}48658[#48658] (issue: {es-issue}47749[#47749]) * Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48367[#48367] * Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48361[#48361] * Add SLM support to xpack usage and info APIs {es-pull}48096[#48096] (issue: {es-issue}43663[#43663]) * Change policy_id to list type in slm.get_lifecycle {es-pull}47766[#47766] (issue: {es-issue}47765[#47765]) * Throw error retrieving non-existent SLM policy {es-pull}47679[#47679] (issue: {es-issue}47664[#47664]) * Handle partial failure retrieving segments in SegmentCountStep {es-pull}46556[#46556] * Fixes for API specification {es-pull}46522[#46522] Features/Indices APIs:: * Fix Rollover error when alias has closed indices {es-pull}47148[#47148] (issue: {es-issue}47146[#47146]) Features/Ingest:: * Do not wrap ingest processor exception with IAE {es-pull}48816[#48816] (issue: {es-issue}48810[#48810]) * Introduce dedicated ingest processor exception {es-pull}48810[#48810] (issue: {es-issue}48803[#48803]) * Allow dropping documents with auto-generated ID {es-pull}46773[#46773] (issue: {es-issue}46678[#46678]) * Expose cache setting in UserAgentPlugin {es-pull}46533[#46533] Features/Java High Level REST Client:: * fix incorrect comparison {es-pull}48208[#48208] * Fix ILM HLRC Javadoc->Documentation links {es-pull}48083[#48083] * Change HLRC count request to accept a QueryBuilder {es-pull}46904[#46904] (issue: {es-issue}46829[#46829]) * [HLRC] Send min_score as query string parameter to the count API {es-pull}46829[#46829] (issue: {es-issue}46474[#46474]) * HLRC multisearchTemplate forgot params {es-pull}46492[#46492] (issue: {es-issue}46488[#46488]) * Added fields for MultiTermVectors (#42232) {es-pull}42877[#42877] (issue: {es-issue}42232[#42232]) Features/Java Low Level REST Client:: * Update http-core and http-client dependencies {es-pull}46549[#46549] (issues: {es-issue}45379[#45379], {es-issue}45577[#45577], {es-issue}45808[#45808]) Features/Monitoring:: * [Monitoring] Add new cluster privilege now necessary for the stack monitoring ui {es-pull}47871[#47871] * Validating monitoring hosts setting while parsing {es-pull}47246[#47246] (issue: {es-issue}47125[#47125]) Features/Watcher:: * Fix class used to initialize logger in Watcher {es-pull}46467[#46467] * Fix wrong URL encoding in watcher HTTP client {es-pull}45894[#45894] (issue: {es-issue}44970[#44970]) * Prevent deadlock by using separate schedulers {es-pull}48697[#48697] (issues: {es-issue}41451[#41451], {es-issue}47599[#47599]) * Fix cluster alert for watcher/monitoring IndexOutOfBoundsExcep… {es-pull}45308[#45308] (issue: {es-issue}43184[#43184]) Geo:: * Geo: implement proper handling of out of bounds geo points {es-pull}47734[#47734] (issue: {es-issue}43916[#43916]) * Geo: Fixes indexing of linestrings that go around the globe {es-pull}47471[#47471] (issues: {es-issue}43826[#43826], {es-issue}43837[#43837]) * Provide better error when updating geo_shape field mapper settings {es-pull}47281[#47281] (issue: {es-issue}47006[#47006]) * Geo: fix indexing of west to east linestrings crossing the antimeridian {es-pull}46601[#46601] (issue: {es-issue}43775[#43775]) * Reset queryGeometry in ShapeQueryTests {es-pull}45974[#45974] (issue: {es-issue}45628[#45628]) Highlighting:: * Fix highlighting of overlapping terms in the unified highlighter {es-pull}47227[#47227] * Fix highlighting for script_score query {es-pull}46507[#46507] (issue: {es-issue}46471[#46471]) Infra/Core:: * Don't drop user's MaxDirectMemorySize flag on jdk8/windows {es-pull}48657[#48657] (issues: {es-issue}44174[#44174], {es-issue}48365[#48365]) * Warn when MaxDirectMemorySize may be incorrect (Windows/JDK8 only issue) {es-pull}48365[#48365] (issue: {es-issue}47384[#47384]) * Support optional parsers in any order with DateMathParser and roundup {es-pull}46654[#46654] (issue: {es-issue}45284[#45284]) Infra/Logging:: * SearchSlowLog uses a non thread-safe object to escape json {es-pull}48363[#48363] (issues: {es-issue}44642[#44642], {es-issue}48358[#48358]) Infra/Scripting:: * Drop stored scripts with the old style-id {es-pull}48078[#48078] (issue: {es-issue}47593[#47593]) Machine Learning:: * [ML] Fixes for stop datafeed edge cases {es-pull}49191[#49191] (issues: {es-issue}43670[#43670], {es-issue}48931[#48931]) * [ML] Avoid NPE when node load is calculated on job assignment {es-pull}49186[#49186] (issue: {es-issue}49150[#49150]) * Do not throw exceptions resulting from persisting datafeed timing stats. {es-pull}49044[#49044] (issue: {es-issue}49032[#49032]) * [ML] Deduplicate multi-fields for data frame analytics {es-pull}48799[#48799] (issues: {es-issue}48756[#48756], {es-issue}48770[#48770]) * [ML] Prevent fetching multi-field from source {es-pull}48770[#48770] (issue: {es-issue}48756[#48756]) * [ML] Fix detection of syslog-like timestamp in find_file_structure {es-pull}47970[#47970] * Fix serialization of evaluation response. {es-pull}47557[#47557] * [ML] Reinstate ML daily maintenance actions {es-pull}47103[#47103] (issue: {es-issue}47003[#47003]) * [ML] fix two datafeed flush lockup bugs {es-pull}46982[#46982] Network:: * Fix es.http.cname_in_publish_address Deprecation Logging {es-pull}47451[#47451] (issue: {es-issue}47436[#47436]) Recovery:: * Ignore Lucene index in peer recovery if translog corrupted {es-pull}49114[#49114] Reindex:: * Fix issues with serializing BulkByScrollResponse {es-pull}45357[#45357] SQL:: * SQL: Fix issue with mins & hours for DATEDIFF {es-pull}49252[#49252] * SQL: Fix issue with negative literels and parentheses {es-pull}48113[#48113] (issue: {es-issue}48009[#48009]) * SQL: add "format" for "full" date range queries {es-pull}48073[#48073] (issue: {es-issue}48033[#48033]) * SQL: Fix arg verification for DateAddProcessor {es-pull}48041[#48041] * SQL: Fix Nullability of DATEADD {es-pull}47921[#47921] * SQL: Allow whitespaces in escape patterns {es-pull}47577[#47577] (issue: {es-issue}47401[#47401]) * SQL: fix multi full-text functions usage with aggregate functions {es-pull}47444[#47444] (issue: {es-issue}47365[#47365]) * SQL: Check case where the pivot limit is reached {es-pull}47121[#47121] (issue: {es-issue}47002[#47002]) * SQL: Properly handle indices with no/empty mapping {es-pull}46775[#46775] (issue: {es-issue}46757[#46757]) * SQL: improve ResultSet behavior when no rows are available {es-pull}46753[#46753] (issue: {es-issue}46750[#46750]) * SQL: use the correct data type for types conversion {es-pull}46574[#46574] (issue: {es-issue}46090[#46090]) * SQL: Fix issue with common type resolution {es-pull}46565[#46565] (issue: {es-issue}46551[#46551]) * SQL: fix scripting for grouped by datetime functions {es-pull}46421[#46421] (issue: {es-issue}40241[#40241]) * SQL: Use null schema response {es-pull}46386[#46386] (issue: {es-issue}46381[#46381]) * SQL: Fix issue with IIF function when condition folds {es-pull}46290[#46290] (issue: {es-issue}46268[#46268]) * SQL: Fix issue with DataType for CASE with NULL {es-pull}46173[#46173] (issue: {es-issue}46032[#46032]) * SQL: Failing Group By queries due to different ExpressionIds {es-pull}43072[#43072] (issues: {es-issue}33361[#33361], {es-issue}34543[#34543], {es-issue}36074[#36074], {es-issue}37044[#37044], {es-issue}40001[#40001], {es-issue}40240[#40240], {es-issue}41159[#41159], {es-issue}42041[#42041], {es-issue}46316[#46316]) * SQL: wrong number of values for columns {es-pull}42122[#42122] Search:: * Lucene#asSequentialBits gets the leadCost backwards. {es-pull}48335[#48335] * Ensure that we don't call listener twice when detecting a partial failures in _search {es-pull}47694[#47694] * Fix alias field resolution in match query {es-pull}47369[#47369] * Multi-get requests should wait for search active {es-pull}46283[#46283] (issue: {es-issue}27500[#27500]) * Resolve the incorrect scroll_current when delete or close index {es-pull}45226[#45226] * Don't apply the plugin's reader wrapper in can_match phase {es-pull}47816[#47816] (issue: {es-issue}46817[#46817]) Security:: * Remove uniqueness constraint for API key name and make it optional {es-pull}47549[#47549] (issue: {es-issue}46646[#46646]) * Initialize document subset bit set cache used for DLS {es-pull}46211[#46211] (issue: {es-issue}45147[#45147]) Snapshot/Restore:: * Fix RepoCleanup not Removed on Master-Failover {es-pull}49217[#49217] * Make FsBlobContainer Listing Resilient to Concurrent Modifications {es-pull}49142[#49142] (issue: {es-issue}37581[#37581]) * Fix SnapshotShardStatus Reporting for Failed Shard {es-pull}48556[#48556] (issue: {es-issue}48526[#48526]) * Cleanup Concurrent RepositoryData Loading {es-pull}48329[#48329] (issue: {es-issue}48122[#48122]) * Fix Bug in Azure Repo Exception Handling {es-pull}47968[#47968] * Make loadShardSnapshot Exceptions Consistent {es-pull}47728[#47728] (issue: {es-issue}47507[#47507]) * Fix Snapshot Corruption in Edge Case {es-pull}47552[#47552] (issues: {es-issue}46250[#46250], {es-issue}47550[#47550]) * Fix Bug in Snapshot Status Response Timestamps {es-pull}46919[#46919] (issue: {es-issue}46913[#46913]) * Normalize Blob Store Repo Paths {es-pull}46869[#46869] (issue: {es-issue}41814[#41814]) * GCS deleteBlobsIgnoringIfNotExists should catch StorageException {es-pull}46832[#46832] (issue: {es-issue}46772[#46772]) * Execute SnapshotsService Error Callback on Generic Thread {es-pull}46277[#46277] * Make Snapshot Logic Write Metadata after Segments {es-pull}45689[#45689] (issue: {es-issue}41581[#41581]) Store:: * Allow truncation of clean translog {es-pull}47866[#47866] Task Management:: * Fix .tasks index strict mapping: parent_id should be parent_task_id {es-pull}48393[#48393] Transform:: * [Transform] do not fail checkpoint creation due to global checkpoint mismatch {es-pull}48423[#48423] (issue: {es-issue}48379[#48379]) * [7.5][Transform] prevent assignment if any node is older than 7.4 {es-pull}48055[#48055] (issue: {es-issue}48019[#48019]) * [Transform] prevent assignment to nodes older than 7.4 {es-pull}48044[#48044] (issue: {es-issue}48019[#48019]) * [ML][Transforms] fix bwc serialization with 7.3 {es-pull}48021[#48021] * [ML][Transforms] signal listener early on task _stop failure {es-pull}47954[#47954] * [ML][Transform] Use field_caps API for mapping deduction {es-pull}46703[#46703] (issue: {es-issue}46694[#46694]) * [ML-DataFrame] Fix off-by-one error in checkpoint operations_behind {es-pull}46235[#46235] [[regression-7.5.0]] [float] === Regressions Aggregations:: * Implement rounding optimization for fixed offset timezones {es-pull}46670[#46670] (issue: {es-issue}45702[#45702]) Infra/Core:: * [Java.time] Support partial parsing {es-pull}46814[#46814] (issues: {es-issue}45284[#45284], {es-issue}47473[#47473]) * Enable ResolverStyle.STRICT for java formatters {es-pull}46675[#46675] [[upgrade-7.5.0]] [float] === Upgrades Infra/Scripting:: * Update mustache dependency to 0.9.6 {es-pull}46243[#46243] Snapshot/Restore:: * Update AWS SDK for repository-s3 plugin to support IAM Roles for Service Accounts {es-pull}46969[#46969] * Upgrade to Azure SDK 8.4.0 {es-pull}46094[#46094] Store:: * Upgrade to Lucene 8.3. {es-pull}48829[#48829]