[[release-notes-7.0.0-alpha2]] == {es} version 7.0.0-alpha2 [[breaking-7.0.0-alpha2]] [float] === Breaking changes Authentication:: * Enhance Invalidate Token API {es-pull}35388[#35388] (issues: {es-issue}34556[#34556], {es-issue}35115[#35115]) Circuit Breakers:: * Lower fielddata circuit breaker's default limit {es-pull}27162[#27162] (issue: {es-issue}27130[#27130]) CCR:: * Change get autofollow patterns API response format {es-pull}36203[#36203] (issue: {es-issue}36049[#36049]) Index APIs:: * Always enforce cluster-wide shard limit {es-pull}34892[#34892] (issues: {es-issue}20705[#20705], {es-issue}34021[#34021]) Ranking:: * Forbid negative scores in function_score query {es-pull}35709[#35709] (issue: {es-issue}33309[#33309]) Scripting:: * Delete deprecated getValues from ScriptDocValues {es-pull}36183[#36183] (issue: {es-issue}22919[#22919]) Search:: * Remove the deprecated _termvector endpoint. {es-pull}36131[#36131] (issues: {es-issue}36098[#36098], {es-issue}8484[#8484]) * Remove deprecated Graph endpoints {es-pull}35956[#35956] * Validate metadata on `_msearch` {es-pull}35938[#35938] (issue: {es-issue}35869[#35869]) * Make hits.total an object in the search response {es-pull}35849[#35849] (issue: {es-issue}33028[#33028]) * Remove the distinction between query and filter context in QueryBuilders {es-pull}35354[#35354] (issue: {es-issue}35293[#35293]) * Throw a parsing exception when boost is set in span_or query (#28390) {es-pull}34112[#34112] (issue: {es-issue}28390[#28390]) ZenDiscovery:: * Best-effort cluster formation if unconfigured {es-pull}36215[#36215] [[breaking-java-7.0.0-alpha2]] [float] === Breaking Java changes ZenDiscovery:: * Make node field in JoinRequest private {es-pull}36405[#36405] [[deprecation-7.0.0-alpha2]] [float] === Deprecations Core:: * Deprecate use of scientific notation in epoch time parsing {es-pull}36691[#36691] * Add backcompat for joda time formats {es-pull}36531[#36531] Machine Learning:: * Deprecate X-Pack centric ML endpoints {es-pull}36315[#36315] (issue: {es-issue}35958[#35958]) Mapping:: * Deprecate types in index API {es-pull}36575[#36575] (issues: {es-issue}35190[#35190], {es-issue}35790[#35790]) * Deprecate uses of _type as a field name in queries {es-pull}36503[#36503] (issue: {es-issue}35190[#35190]) * Deprecate types in update_by_query and delete_by_query {es-pull}36365[#36365] (issue: {es-issue}35190[#35190]) * For msearch templates, make sure to use the right name for deprecation logging. {es-pull}36344[#36344] * Deprecate types in termvector and mtermvector requests. {es-pull}36182[#36182] * Deprecate types in update requests. {es-pull}36181[#36181] * Deprecate types in document delete requests. {es-pull}36087[#36087] * Deprecate types in get, exists, and multi get. {es-pull}35930[#35930] * Deprecate types in search and multi search templates. {es-pull}35669[#35669] * Deprecate types in explain requests. {es-pull}35611[#35611] * Deprecate types in validate query requests. {es-pull}35575[#35575] * Deprecate types in count and msearch. {es-pull}35421[#35421] (issue: {es-issue}34041[#34041]) Migration:: * Deprecate X-Pack centric Migration endpoints {es-pull}35976[#35976] (issue: {es-issue}35958[#35958]) Monitoring:: * Deprecate /_xpack/monitoring/* in favor of /_monitoring/* {es-pull}36130[#36130] (issue: {es-issue}35958[#35958]) Rollup:: * Re-deprecate xpack rollup endpoints {es-pull}36451[#36451] (issue: {es-issue}36044[#36044]) * Deprecate X-Pack centric rollup endpoints {es-pull}35962[#35962] (issue: {es-issue}35958[#35958]) Scripting:: * Adds deprecation logging to ScriptDocValues#getValues. {es-pull}34279[#34279] (issue: {es-issue}22919[#22919]) * Conditionally use java time api in scripting {es-pull}31441[#31441] Search:: * Remove X-Pack centric graph endpoints {es-pull}36010[#36010] (issue: {es-issue}35958[#35958]) Security:: * Deprecate X-Pack centric license endpoints {es-pull}35959[#35959] (issue: {es-issue}35958[#35958]) * Deprecate /_xpack/security/* in favor of /_security/* {es-pull}36293[#36293] (issue: {es-issue}35958[#35958]) SQL:: * Deprecate X-Pack SQL translate endpoint {es-pull}36030[#36030] * Deprecate X-Pack centric SQL endpoints {es-pull}35964[#35964] (issue: {es-issue}35958[#35958]) Watcher:: * Deprecate X-Pack centric watcher endpoints {es-pull}36218[#36218] (issue: {es-issue}35958[#35958]) [[feature-7.0.0-alpha2]] [float] === New features Analysis:: * Add support for inlined user dictionary in Nori {es-pull}36123[#36123] (issue: {es-issue}35842[#35842]) * Add a prebuilt ICU Analyzer {es-pull}34958[#34958] (issue: {es-issue}34285[#34285]) Java High Level REST Client:: * Add rollup search {es-pull}36334[#36334] (issue: {es-issue}29827[#29827]) Java Low Level REST Client:: * Make warning behavior pluggable per request {es-pull}36345[#36345] * Add PreferHasAttributeNodeSelector {es-pull}36005[#36005] Geo:: * Integrate Lucene's LatLonShape (BKD Backed GeoShapes) as default `geo_shape` indexing approach {es-pull}36751[#36751] (issue: {es-issue}35320[#35320]) * Integrate Lucene's LatLonShape (BKD Backed GeoShapes) as default `geo_shape` indexing approach {es-pull}35320[#35320] (issue: {es-issue}32039[#32039]) Machine Learning:: * Add delayed datacheck to the datafeed job runner {es-pull}35387[#35387] (issue: {es-issue}35131[#35131]) Mapping:: * Make typeless APIs usable with indices whose type name is different from `_doc` {es-pull}35790[#35790] (issue: {es-issue}35190[#35190]) SQL:: * Introduce HISTOGRAM grouping function {es-pull}36510[#36510] (issue: {es-issue}36509[#36509]) * DATABASE() and USER() system functions {es-pull}35946[#35946] (issue: {es-issue}35863[#35863]) * Introduce INTERVAL support {es-pull}35521[#35521] (issue: {es-issue}29990[#29990]) Search:: * Add intervals query {es-pull}36135[#36135] (issues: {es-issue}29636[#29636], {es-issue}32406[#32406]) * Added soft limit to open scroll contexts #25244 {es-pull}36009[#36009] (issue: {es-issue}25244[#25244]) [[enhancement-7.0.0-alpha2]] [float] === Enhancements Aggregations:: * Added keyed response to pipeline percentile aggregations 22302 {es-pull}36392[#36392] (issue: {es-issue}22302[#22302]) * Enforce max_buckets limit only in the final reduction phase {es-pull}36152[#36152] (issues: {es-issue}32125[#32125], {es-issue}35921[#35921]) * Histogram aggs: add empty buckets only in the final reduce step {es-pull}35921[#35921] * Handles exists query in composite aggs {es-pull}35758[#35758] * Added parent validation for auto date histogram {es-pull}35670[#35670] Analysis:: * Allow word_delimiter_graph_filter to not adjust internal offsets {es-pull}36699[#36699] (issues: {es-issue}33710[#33710], {es-issue}34741[#34741]) * Ensure TokenFilters only produce single tokens when parsing synonyms {es-pull}34331[#34331] (issue: {es-issue}34298[#34298]) Audit:: * Add "request.id" to file audit logs {es-pull}35536[#35536] Authentication:: * Invalidate Token API enhancements - HLRC {es-pull}36362[#36362] (issue: {es-issue}35388[#35388]) * Add DEBUG/TRACE logs for LDAP bind {es-pull}36028[#36028] * Add Tests for findSamlRealm {es-pull}35905[#35905] * Add realm information for Authenticate API {es-pull}35648[#35648] * Formal support for "password_hash" in Put User {es-pull}35242[#35242] (issue: {es-issue}34729[#34729]) Authorization:: * Improve exact index matching performance {es-pull}36017[#36017] * `manage_token` privilege for `kibana_system` {es-pull}35751[#35751] * Grant .tasks access to kibana_system role {es-pull}35573[#35573] Build:: * Sounds like typo in exception message {es-pull}35458[#35458] * Allow set section in setup section of REST tests {es-pull}34678[#34678] CCR:: * Add time since last auto follow fetch to auto follow stats {es-pull}36542[#36542] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895]) * Clean followed leader index UUIDs in auto follow metadata {es-pull}36408[#36408] (issue: {es-issue}33007[#33007]) * Change AutofollowCoordinator to use wait_for_metadata_version {es-pull}36264[#36264] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895]) * Refactor AutoFollowCoordinator to track leader indices per remote cluster {es-pull}36031[#36031] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895]) Core:: * Override the JVM DNS cache policy {es-pull}36570[#36570] * Replace usages of AtomicBoolean based block of code by the RunOnce class {es-pull}35553[#35553] (issue: {es-issue}35489[#35489]) * Added wait_for_metadata_version parameter to cluster state api. {es-pull}35535[#35535] * Extract RunOnce into a dedicated class {es-pull}35489[#35489] * Introduce elasticsearch-core jar {es-pull}28191[#28191] (issue: {es-issue}27933[#27933]) * Rename core module to server {es-pull}28180[#28180] (issue: {es-issue}27933[#27933]) CRUD:: * Rename seq# powered optimistic concurrency control parameters to ifSeqNo/ifPrimaryTerm {es-pull}36757[#36757] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148]) * Expose Sequence Number based Optimistic Concurrency Control in the rest layer {es-pull}36721[#36721] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148]) * Add doc's sequence number + primary term to GetResult and use it for updates {es-pull}36680[#36680] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148]) * Add seq no powered optimistic locking support to the index and delete transport actions {es-pull}36619[#36619] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148]) Distributed:: * [Close Index API] Mark shard copy as stale if needed during shard verification {es-pull}36755[#36755] * [Close Index API] Refactor MetadataIndexStateService {es-pull}36354[#36354] (issue: {es-issue}36249[#36249]) * [Close Index API] Add TransportShardCloseAction for pre-closing verifications {es-pull}36249[#36249] * TransportResyncReplicationAction should not honour blocks {es-pull}35795[#35795] (issues: {es-issue}35332[#35332], {es-issue}35597[#35597]) * Expose all permits acquisition in IndexShard and TransportReplicationAction {es-pull}35540[#35540] (issue: {es-issue}33888[#33888]) * [RCI] Check blocks while having index shard permit in TransportReplicationAction {es-pull}35332[#35332] (issue: {es-issue}33888[#33888]) Engine:: * Add sequence numbers based optimistic concurrency control support to Engine {es-pull}36467[#36467] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148]) * Require soft-deletes when access changes snapshot {es-pull}36446[#36446] * Use delCount of SegmentInfos to calculate numDocs {es-pull}36323[#36323] * Always configure soft-deletes field of IndexWriterConfig {es-pull}36196[#36196] (issue: {es-issue}36141[#36141]) * Enable soft-deletes by default on 7.0.0 or later {es-pull}36141[#36141] * Always return false from `refreshNeeded` on ReadOnlyEngine {es-pull}35837[#35837] (issue: {es-issue}35785[#35785]) * Add a `_freeze` / `_unfreeze` API {es-pull}35592[#35592] (issue: {es-issue}34352[#34352]) * [RCI] Add IndexShardOperationPermits.asyncBlockOperations(ActionListener) {es-pull}34902[#34902] (issue: {es-issue}33888[#33888]) Features:: * Simplify deprecation issue levels {es-pull}36326[#36326] Index APIs:: * Add cluster-wide shard limit warnings {es-pull}34021[#34021] (issues: {es-issue}20705[#20705], {es-issue}32856[#32856]) Ingest:: * Grok fix duplicate patterns JAVACLASS and JAVAFILE {es-pull}35886[#35886] * Implement Drop Processor {es-pull}32278[#32278] (issue: {es-issue}23726[#23726]) Java High Level REST Client:: * Add get users action {es-pull}36332[#36332] (issue: {es-issue}29827[#29827]) * Add delete template API {es-pull}36320[#36320] (issue: {es-issue}27205[#27205]) * Implement get-user-privileges API {es-pull}36292[#36292] * Get Deprecation Info API {es-pull}36279[#36279] (issue: {es-issue}29827[#29827]) * Add support for Follow Stats API {es-pull}36253[#36253] (issue: {es-issue}33824[#33824]) * Add support for CCR Stats API {es-pull}36213[#36213] (issue: {es-issue}33824[#33824]) * Put Role {es-pull}36209[#36209] (issue: {es-issue}29827[#29827]) * Add index templates exist API {es-pull}36132[#36132] (issue: {es-issue}27205[#27205]) * Add support for CCR Get Auto Follow Pattern apis {es-pull}36049[#36049] (issue: {es-issue}33824[#33824]) * Add support for CCR Delete Auto Follow Pattern API {es-pull}35981[#35981] (issue: {es-issue}33824[#33824]) * Remove fromXContent from IndexUpgradeInfoResponse {es-pull}35934[#35934] * Add delete expired data API {es-pull}35906[#35906] (issue: {es-issue}29827[#29827]) * Execute watch API {es-pull}35868[#35868] (issue: {es-issue}29827[#29827]) * Add ability to put user with a password hash {es-pull}35844[#35844] (issue: {es-issue}35242[#35242]) * Add ML find file structure API {es-pull}35833[#35833] (issue: {es-issue}29827[#29827]) * Add support for get roles API {es-pull}35787[#35787] (issue: {es-issue}29827[#29827]) * Added support for CCR Put Auto Follow Pattern API {es-pull}35780[#35780] (issue: {es-issue}33824[#33824]) * XPack ML info action {es-pull}35777[#35777] (issue: {es-issue}29827[#29827]) * ML Delete event from Calendar {es-pull}35760[#35760] (issue: {es-issue}29827[#29827]) * Add ML revert model snapshot API {es-pull}35750[#35750] (issue: {es-issue}29827[#29827]) * ML Get Calendar Events {es-pull}35747[#35747] (issue: {es-issue}29827[#29827]) * Add high-level REST client API for `_freeze` and `_unfreeze` {es-pull}35723[#35723] (issue: {es-issue}34352[#34352]) * Fix issue in equals impl for GlobalOperationPrivileges {es-pull}35721[#35721] * ML Delete job from calendar {es-pull}35713[#35713] (issue: {es-issue}29827[#29827]) * ML Add Event To Calendar API {es-pull}35704[#35704] (issue: {es-issue}29827[#29827]) * Add ML update model snapshot API (#35537) {es-pull}35694[#35694] (issue: {es-issue}29827[#29827]) * Add support for CCR Unfollow API {es-pull}35693[#35693] (issue: {es-issue}33824[#33824]) * Clean up PutLicenseResponse {es-pull}35689[#35689] (issue: {es-issue}35547[#35547]) * Clean up StartBasicResponse {es-pull}35688[#35688] (issue: {es-issue}35547[#35547]) * Add support for put privileges API {es-pull}35679[#35679] * ML Add Job to Calendar API {es-pull}35666[#35666] (issue: {es-issue}29827[#29827]) * Add support for CCR Resume Follow API {es-pull}35638[#35638] (issue: {es-issue}33824[#33824]) * Add support for get application privileges API {es-pull}35556[#35556] (issue: {es-issue}29827[#29827]) * Clean up XPackInfoResponse class and related tests {es-pull}35547[#35547] * Add parameters to stopRollupJob API {es-pull}35545[#35545] (issue: {es-issue}34811[#34811]) * Add ML delete model snapshot API {es-pull}35537[#35537] (issue: {es-issue}29827[#29827]) * Add get watch API {es-pull}35531[#35531] (issue: {es-issue}29827[#29827]) * Add ML Update Filter API {es-pull}35522[#35522] (issue: {es-issue}29827[#29827]) * Add ml get filters api {es-pull}35502[#35502] (issue: {es-issue}29827[#29827]) * Add ML get model snapshots API {es-pull}35487[#35487] (issue: {es-issue}29827[#29827]) * Add "_has_privileges" API to Security Client {es-pull}35479[#35479] (issue: {es-issue}29827[#29827]) * Add Delete Privileges API to HLRC {es-pull}35454[#35454] (issue: {es-issue}29827[#29827]) * Add support for CCR Put Follow API {es-pull}35409[#35409] * Add ML delete filter action {es-pull}35382[#35382] (issue: {es-issue}29827[#29827]) * Add delete user action {es-pull}35294[#35294] (issue: {es-issue}29827[#29827]) * HLRC for _mtermvectors {es-pull}35266[#35266] (issues: {es-issue}27205[#27205], {es-issue}33447[#33447]) * Reindex API with wait_for_completion false {es-pull}35202[#35202] (issue: {es-issue}27205[#27205]) * Add watcher stats API {es-pull}35185[#35185] (issue: {es-issue}29827[#29827]) * HLRC support for getTask {es-pull}35166[#35166] (issue: {es-issue}27205[#27205]) * Add GetRollupIndexCaps API {es-pull}35102[#35102] (issue: {es-issue}29827[#29827]) * HLRC: migration api - upgrade {es-pull}34898[#34898] (issue: {es-issue}29827[#29827]) * Add stop rollup job support to HL REST Client {es-pull}34702[#34702] (issue: {es-issue}29827[#29827]) * Bulk Api support for global parameters {es-pull}34528[#34528] (issue: {es-issue}26026[#26026]) * Add delete rollup job support to HL REST Client {es-pull}34066[#34066] (issue: {es-issue}29827[#29827]) * Add support for get license basic/trial status API {es-pull}33176[#33176] (issue: {es-issue}29827[#29827]) * Add machine learning open job {es-pull}32860[#32860] (issue: {es-issue}29827[#29827]) * Add ML HLRC wrapper and put_job API call {es-pull}32726[#32726] * Add Get Snapshots High Level REST API {es-pull}31537[#31537] (issue: {es-issue}27205[#27205]) Java Low Level REST Client:: * On retry timeout add root exception {es-pull}25576[#25576] Monitoring:: * Make Exporters Async {es-pull}35765[#35765] (issue: {es-issue}35743[#35743]) Geo:: * Adds a name of the field to geopoint parsing errors {es-pull}36529[#36529] (issue: {es-issue}15965[#15965]) * Add support to ShapeBuilders for building Lucene geometry {es-pull}35707[#35707] (issue: {es-issue}35320[#35320]) * Add ST_WktToSQL function {es-pull}35416[#35416] (issue: {es-issue}29872[#29872]) License:: * Require acknowledgement to start_trial license {es-pull}30135[#30135] (issue: {es-issue}30134[#30134]) Machine Learning:: * Create the ML annotations index {es-pull}36731[#36731] (issues: {es-issue}26034[#26034], {es-issue}33376[#33376]) * Split in batches and migrate all jobs and datafeeds {es-pull}36716[#36716] (issue: {es-issue}32905[#32905]) * Add cluster setting to enable/disable config migration {es-pull}36700[#36700] (issue: {es-issue}32905[#32905]) * Add audits when deprecation warnings occur with datafeed start {es-pull}36233[#36233] * Add lazy parsing for DatafeedConfig:Aggs,Query {es-pull}36117[#36117] * Add support for lazy nodes (#29991) {es-pull}34538[#34538] (issue: {es-issue}29991[#29991]) Network:: * Unify transport settings naming {es-pull}36623[#36623] * Add sni name to SSLEngine in netty transport {es-pull}33144[#33144] (issue: {es-issue}32517[#32517]) * Add cors support to NioHttpServerTransport {es-pull}30827[#30827] (issue: {es-issue}28898[#28898]) * Reintroduce mandatory http pipelining support {es-pull}30820[#30820] * Make http pipelining support mandatory {es-pull}30695[#30695] (issues: {es-issue}28898[#28898], {es-issue}29500[#29500]) * Add nio http server transport {es-pull}29587[#29587] (issue: {es-issue}28898[#28898]) * Selectors operate on channel contexts {es-pull}28468[#28468] (issue: {es-issue}27260[#27260]) * Unify nio read / write channel contexts {es-pull}28160[#28160] (issue: {es-issue}27260[#27260]) * Create nio-transport plugin for NioTransport {es-pull}27949[#27949] (issue: {es-issue}27260[#27260]) * Add elasticsearch-nio jar for base nio classes {es-pull}27801[#27801] (issue: {es-issue}27802[#27802]) * Add NioGroup for use in different transports {es-pull}27737[#27737] (issue: {es-issue}27260[#27260]) * Add read timeouts to http module {es-pull}27713[#27713] * Implement byte array reusage in `NioTransport` {es-pull}27696[#27696] (issue: {es-issue}27563[#27563]) * Introduce resizable inbound byte buffer {es-pull}27551[#27551] (issue: {es-issue}27563[#27563]) * Decouple nio constructs from the tcp transport {es-pull}27484[#27484] (issue: {es-issue}27260[#27260]) * Remove manual tracking of registered channels {es-pull}27445[#27445] (issue: {es-issue}27260[#27260]) * Remove tcp profile from low level nio channel {es-pull}27441[#27441] (issue: {es-issue}27260[#27260]) * Decouple `ChannelFactory` from Tcp classes {es-pull}27286[#27286] (issue: {es-issue}27260[#27260]) Packaging:: * Introduce Docker images build {es-pull}36246[#36246] * Move creation of temporary directory to Java {es-pull}36002[#36002] (issue: {es-issue}31003[#31003]) Plugins:: * Plugin install: don't print download progress in batch mode {es-pull}36361[#36361] Ranking:: * Vector field {es-pull}33022[#33022] (issue: {es-issue}31615[#31615]) Recovery:: * Exposed engine must include all operations below global checkpoint during rollback {es-pull}36159[#36159] (issue: {es-issue}32867[#32867]) Rollup:: * Add non-X-Pack centric rollup endpoints {es-pull}36383[#36383] (issues: {es-issue}35958[#35958], {es-issue}35962[#35962]) * Add more diagnostic stats to job {es-pull}35471[#35471] * Add `wait_for_completion` option to StopRollupJob API {es-pull}34811[#34811] (issue: {es-issue}34574[#34574]) Scripting:: * Update joda compat methods to use compat class {es-pull}36654[#36654] * [Painless] Add boxed type to boxed type casts for method/return {es-pull}36571[#36571] * [Painless] Add def to boxed type casts {es-pull}36506[#36506] Settings:: * Add user-defined cluster metadata {es-pull}33325[#33325] (issue: {es-issue}33220[#33220]) Search:: * Add copy constructor to SearchRequest {es-pull}36641[#36641] (issue: {es-issue}32125[#32125]) * Add raw sort values to SearchSortValues transport serialization {es-pull}36617[#36617] (issue: {es-issue}32125[#32125]) * Add sort and collapse info to SearchHits transport serialization {es-pull}36555[#36555] (issue: {es-issue}32125[#32125]) * Add default methods to DocValueFormat {es-pull}36480[#36480] * Respect indices options on _msearch {es-pull}35887[#35887] * Allow efficient can_match phases on frozen indices {es-pull}35431[#35431] (issues: {es-issue}34352[#34352], {es-issue}34357[#34357]) * Add a new query type - ScriptScoreQuery {es-pull}34533[#34533] (issues: {es-issue}23850[#23850], {es-issue}27588[#27588], {es-issue}30303[#30303]) Security:: * Make credentials mandatory when launching xpack/migrate {es-pull}36197[#36197] (issues: {es-issue}29847[#29847], {es-issue}33972[#33972]) Snapshot/Restore:: * Allow Parallel Restore Operations {es-pull}36397[#36397] * Repo Creation out of ClusterStateTask {es-pull}36157[#36157] (issue: {es-issue}9488[#9488]) * Add read-only repository verification {es-pull}35731[#35731] (issue: {es-issue}35703[#35703]) SQL:: * Extend the ODBC metric by differentiating between 32 and 64bit platforms {es-pull}36753[#36753] (issue: {es-issue}36740[#36740]) * Fix wrong appliance of StackOverflow limit for IN {es-pull}36724[#36724] (issue: {es-issue}36592[#36592]) * Introduce NOW/CURRENT_TIMESTAMP function {es-pull}36562[#36562] (issue: {es-issue}36534[#36534]) * Move requests' parameters to requests JSON body {es-pull}36149[#36149] (issue: {es-issue}35992[#35992]) * Make INTERVAL millis optional {es-pull}36043[#36043] (issue: {es-issue}36032[#36032]) * Implement data type verification for conditionals {es-pull}35916[#35916] (issue: {es-issue}35907[#35907]) * Implement GREATEST and LEAST functions {es-pull}35879[#35879] (issue: {es-issue}35878[#35878]) * Implement null safe equality operator `<=>` {es-pull}35873[#35873] (issue: {es-issue}35871[#35871]) * SYS COLUMNS returns ODBC specific schema {es-pull}35870[#35870] (issue: {es-issue}35376[#35376]) * Polish grammar for intervals {es-pull}35853[#35853] * Add filtering to SYS TYPES {es-pull}35852[#35852] (issue: {es-issue}35342[#35342]) * Implement NULLIF(expr1, expr2) function {es-pull}35826[#35826] (issue: {es-issue}35818[#35818]) * Lock down JDBC driver {es-pull}35798[#35798] (issue: {es-issue}35437[#35437]) * Implement NVL(expr1, expr2) {es-pull}35794[#35794] (issue: {es-issue}35782[#35782]) * Implement ISNULL(expr1, expr2) {es-pull}35793[#35793] (issue: {es-issue}35781[#35781]) * Implement IFNULL variant of COALESCE {es-pull}35762[#35762] (issue: {es-issue}35749[#35749]) * XPack FeatureSet functionality {es-pull}35725[#35725] (issue: {es-issue}34821[#34821]) * Perform lazy evaluation of mismatched mappings {es-pull}35676[#35676] (issues: {es-issue}35659[#35659], {es-issue}35675[#35675]) * Improve validation of unsupported fields {es-pull}35675[#35675] (issue: {es-issue}35673[#35673]) * Move internals from Joda to java.time {es-pull}35649[#35649] (issue: {es-issue}35633[#35633]) Stats:: * Handle OS pretty name on old OS without OS release {es-pull}35453[#35453] (issue: {es-issue}35440[#35440]) Task Management:: * Periodically try to reassign unassigned persistent tasks {es-pull}36069[#36069] (issue: {es-issue}35792[#35792]) * Only require task permissions {es-pull}35667[#35667] (issue: {es-issue}35573[#35573]) * Retry if task can't be written {es-pull}35054[#35054] (issue: {es-issue}33764[#33764]) ZenDiscovery:: * Add discovery types to cluster stats {es-pull}36442[#36442] * Introduce `zen2` discovery type {es-pull}36298[#36298] * Zen2: Persist cluster states the old way on non-master-eligible nodes {es-pull}36247[#36247] (issue: {es-issue}3[#3]) * [Zen2] Storage layer WriteStateException propagation {es-pull}36052[#36052] * [Zen2] Implement Tombstone REST APIs {es-pull}36007[#36007] * [Zen2] Update default for USE_ZEN2 to true {es-pull}35998[#35998] * [Zen2] Add warning if cluster fails to form fast enough {es-pull}35993[#35993] * [Zen2] Allow Setting a List of Bootstrap Nodes to Wait for {es-pull}35847[#35847] * [Zen2] VotingTombstone class {es-pull}35832[#35832] * [Zen2] PersistedState interface implementation {es-pull}35819[#35819] * [Zen2] Support rolling upgrades from Zen1 {es-pull}35737[#35737] * [Zen2] Add lag detector {es-pull}35685[#35685] * [Zen2] Move ClusterState fields to be persisted to ClusterState.Metadata {es-pull}35625[#35625] * [Zen2] Introduce ClusterBootstrapService {es-pull}35488[#35488] * [Zen2] Introduce vote withdrawal {es-pull}35446[#35446] * Zen2: Add basic Zen1 transport-level BWC {es-pull}35443[#35443] [[bug-7.0.0-alpha2]] [float] === Bug fixes Aggregations:: * fix MultiValuesSourceFieldConfig toXContent {es-pull}36525[#36525] (issue: {es-issue}36474[#36474]) * Cache the score of the parent document in the nested agg {es-pull}36019[#36019] (issues: {es-issue}34555[#34555], {es-issue}35985[#35985]) * Correct implemented interface of ParsedReverseNested {es-pull}35455[#35455] (issue: {es-issue}35449[#35449]) * Handle IndexOrDocValuesQuery in composite aggregation {es-pull}35392[#35392] Audit:: * Fix origin.type for connection_* events {es-pull}36410[#36410] * Fix IndexAuditTrail rolling restart on rollover edge {es-pull}35988[#35988] (issue: {es-issue}33867[#33867]) Authentication:: * Fix kerberos setting registration {es-pull}35986[#35986] (issues: {es-issue}30241[#30241], {es-issue}35942[#35942]) * Add support for Kerberos V5 Oid {es-pull}35764[#35764] (issue: {es-issue}34763[#34763]) Build:: * Use explicit deps on test tasks for check {es-pull}36325[#36325] * Fix jdbc jar pom to not include deps {es-pull}36036[#36036] (issue: {es-issue}32014[#32014]) * Fix official plugins list {es-pull}35661[#35661] (issue: {es-issue}35623[#35623]) CCR:: * Fix follow stats API's follower index filtering feature {es-pull}36647[#36647] * AutoFollowCoordinator should tolerate that auto follow patterns may be removed {es-pull}35945[#35945] (issue: {es-issue}35937[#35937]) * Only auto follow indices when all primary shards have started {es-pull}35814[#35814] (issue: {es-issue}35480[#35480]) * Avoid NPE in follower stats when no tasks metadata {es-pull}35802[#35802] * Fix the names of CCR stats endpoints in usage API {es-pull}35438[#35438] Circuit Breakers:: * Modify `BigArrays` to take name of circuit breaker {es-pull}36461[#36461] (issue: {es-issue}31435[#31435]) Core:: * Fix CompositeBytesReference#slice to not throw AIOOBE with legal offsets. {es-pull}35955[#35955] (issue: {es-issue}35950[#35950]) * Suppress CachedTimeThread in hot threads output {es-pull}35558[#35558] (issue: {es-issue}23175[#23175]) * Upgrade to Joda 2.10.1 {es-pull}35410[#35410] (issue: {es-issue}33749[#33749]) Distributed:: * Combine the execution of an exclusive replica operation with primary term update {es-pull}36116[#36116] (issue: {es-issue}35850[#35850]) * ActiveShardCount should not fail when closing the index {es-pull}35936[#35936] Engine:: * Set Lucene version upon index creation. {es-pull}36038[#36038] (issue: {es-issue}33826[#33826]) * Wrap can_match reader with ElasticsearchDirectoryReader {es-pull}35857[#35857] * Copy checkpoint atomically when rolling generation {es-pull}35407[#35407] Geo:: * More robust handling of ignore_malformed in geoshape parsing {es-pull}35603[#35603] (issues: {es-issue}34047[#34047], {es-issue}34498[#34498]) * Better handling of malformed geo_points {es-pull}35554[#35554] (issue: {es-issue}35419[#35419]) * Enables coerce support in WKT polygon parser {es-pull}35414[#35414] (issue: {es-issue}35059[#35059]) Index APIs:: * Fix duplicate phrase in shrink/split error message {es-pull}36734[#36734] (issue: {es-issue}36729[#36729]) * Raise a 404 exception when document source is not found (#33384) {es-pull}34083[#34083] (issue: {es-issue}33384[#33384]) Ingest:: * Fix on_failure with Drop processor {es-pull}36686[#36686] (issue: {es-issue}36151[#36151]) * Support default pipelines + bulk upserts {es-pull}36618[#36618] (issue: {es-issue}36219[#36219]) * Support default pipeline through an alias {es-pull}36231[#36231] (issue: {es-issue}35817[#35817]) License:: * Do not serialize basic license exp in x-pack info {es-pull}30848[#30848] * Update versions for start_trial after backport {es-pull}30218[#30218] (issue: {es-issue}30135[#30135]) Machine Learning:: * Interrupt Grok in file structure finder timeout {es-pull}36588[#36588] * Prevent stack overflow while copying ML jobs and datafeeds {es-pull}36370[#36370] (issue: {es-issue}36360[#36360]) * Adjust file structure finder parser config {es-pull}35935[#35935] * Fix find_file_structure NPE with should_trim_fields {es-pull}35465[#35465] (issue: {es-issue}35462[#35462]) * Prevent notifications being created on deletion of a non existent job {es-pull}35337[#35337] (issues: {es-issue}34058[#34058], {es-issue}35336[#35336]) * Clear Job#finished_time when it is opened (#32605) {es-pull}32755[#32755] * Fix thread leak when waiting for job flush (#32196) {es-pull}32541[#32541] (issue: {es-issue}32196[#32196]) * Fix CPoissonMeanConjugate sampling error. {ml-pull}335[#335] Network:: * Do not resolve addresses in remote connection info {es-pull}36671[#36671] (issue: {es-issue}35658[#35658]) * Always compress based on the settings {es-pull}36522[#36522] (issue: {es-issue}36399[#36399]) * http.publish_host Should Contain CNAME {es-pull}32806[#32806] (issue: {es-issue}22029[#22029]) * Adjust SSLDriver behavior for JDK11 changes {es-pull}32145[#32145] (issues: {es-issue}32122[#32122], {es-issue}32144[#32144]) * Add TRACE, CONNECT, and PATCH http methods {es-pull}31035[#31035] (issue: {es-issue}31017[#31017]) * Transport client: Don't validate node in handshake {es-pull}30737[#30737] (issue: {es-issue}30141[#30141]) * Fix issue with finishing handshake in ssl driver {es-pull}30580[#30580] * Remove potential nio selector leak {es-pull}27825[#27825] * Fix issue where the incorrect buffers are written {es-pull}27695[#27695] (issue: {es-issue}27551[#27551]) * Do not set SO_LINGER on server channels {es-pull}26997[#26997] * Do not set SO_LINGER to 0 when not shutting down {es-pull}26871[#26871] (issue: {es-issue}26764[#26764]) * Release pipelined http responses on close {es-pull}26226[#26226] Packaging:: * Fix error message when package install fails due to missing Java {es-pull}36077[#36077] (issue: {es-issue}31845[#31845]) * Add missing entries to conffiles {es-pull}35810[#35810] (issue: {es-issue}35691[#35691]) Plugins:: * Ensure that azure stream has socket privileges {es-pull}28751[#28751] (issue: {es-issue}28662[#28662]) Recovery:: * Register ResyncTask.Status as a NamedWriteable {es-pull}36610[#36610] Rollup:: * Fix rollup search statistics {es-pull}36674[#36674] Scripting:: * Properly support no-offset date formatting {es-pull}36316[#36316] (issue: {es-issue}36306[#36306]) * [Painless] Generate Bridge Methods {es-pull}36097[#36097] * Fix serialization bug in painless execute api request {es-pull}36075[#36075] (issue: {es-issue}36050[#36050]) * Actually add joda time back to whitelist {es-pull}35965[#35965] (issue: {es-issue}35915[#35915]) * Add back joda to whitelist {es-pull}35915[#35915] (issue: {es-issue}35913[#35913]) Settings:: * Correctly Identify Noop Updates {es-pull}36560[#36560] (issue: {es-issue}36496[#36496]) SQL:: * Fix translation of LIKE/RLIKE keywords {es-pull}36672[#36672] (issues: {es-issue}36039[#36039], {es-issue}36584[#36584]) * Scripting support for casting functions CAST and CONVERT {es-pull}36640[#36640] (issue: {es-issue}36061[#36061]) * Fix translation to painless for conditionals {es-pull}36636[#36636] (issue: {es-issue}36631[#36631]) * Concat should be always not nullable {es-pull}36601[#36601] (issue: {es-issue}36169[#36169]) * Fix MOD() for long and integer arguments {es-pull}36599[#36599] (issue: {es-issue}36364[#36364]) * Fix issue with complex HAVING and GROUP BY ordinal {es-pull}36594[#36594] (issue: {es-issue}36059[#36059]) * Be lenient for tests involving comparison to H2 but strict for csv spec tests {es-pull}36498[#36498] (issue: {es-issue}36483[#36483]) * Non ISO 8601 versions of DAY_OF_WEEK and WEEK_OF_YEAR functions {es-pull}36358[#36358] (issue: {es-issue}36263[#36263]) * Do not ignore all fields whose names start with underscore {es-pull}36214[#36214] (issue: {es-issue}36206[#36206]) * Fix issue with wrong data type for scripted Grouping keys {es-pull}35969[#35969] (issue: {es-issue}35662[#35662]) * Fix translation of math functions to painless {es-pull}35910[#35910] (issue: {es-issue}35654[#35654]) * Fix jdbc jar to include deps {es-pull}35602[#35602] * Fix query translation for scripted queries {es-pull}35408[#35408] (issue: {es-issue}35232[#35232]) * Clear the cursor if nested inner hits are enough to fulfill the query required limits {es-pull}35398[#35398] (issue: {es-issue}35176[#35176]) * Introduce IsNull node to simplify expressions {es-pull}35206[#35206] (issues: {es-issue}34876[#34876], {es-issue}35171[#35171]) * The SSL default configuration shouldn't override the https protocol if used {es-pull}34635[#34635] (issue: {es-issue}33817[#33817]) * Minor fix for javadoc {es-pull}32573[#32573] (issue: {es-issue}32553[#32553]) Search:: * Inner hits fail to propagate doc-value format. {es-pull}36310[#36310] * Fix custom AUTO issue with Fuzziness#toXContent {es-pull}35807[#35807] (issue: {es-issue}33462[#33462]) * Fix analyzed prefix query in query_string {es-pull}35756[#35756] (issue: {es-issue}31702[#31702]) * Fix problem with MatchNoDocsQuery in disjunction queries {es-pull}35726[#35726] (issue: {es-issue}34708[#34708]) * Fix phrase_slop in query_string query {es-pull}35533[#35533] (issue: {es-issue}35125[#35125]) * Add a More Like This query routing requirement check (#29678) {es-pull}33974[#33974] Security:: * Remove license state listeners on closeables {es-pull}36308[#36308] (issues: {es-issue}33328[#33328], {es-issue}35627[#35627], {es-issue}35628[#35628]) Snapshot/Restore:: * Upgrade GCS Dependencies to 1.55.0 {es-pull}36634[#36634] (issues: {es-issue}35229[#35229], {es-issue}35459[#35459]) * Improve Resilience SnapshotShardService {es-pull}36113[#36113] (issue: {es-issue}32265[#32265]) * Keep SnapshotsInProgress State in Sync with Routing Table {es-pull}35710[#35710] * Ensure that gcs client creation is privileged {es-pull}25938[#25938] (issue: {es-issue}25932[#25932]) * Make calls to CloudBlobContainer#exists privileged {es-pull}25937[#25937] (issue: {es-issue}25931[#25931]) Watcher:: * Watcher accounts constructed lazily {es-pull}36656[#36656] * Only trigger a watch if new or schedule/changed {es-pull}35908[#35908] * Fix Watcher NotificationService's secure settings {es-pull}35610[#35610] (issue: {es-issue}35378[#35378]) * Fix integration tests to ensure correct start/stop of Watcher {es-pull}35271[#35271] (issues: {es-issue}29877[#29877], {es-issue}30705[#30705], {es-issue}33291[#33291], {es-issue}34448[#34448], {es-issue}34462[#34462]) ZenDiscovery:: * [Zen2] Respect the no_master_block setting {es-pull}36478[#36478] * Cancel GetDiscoveredNodesAction when bootstrapped {es-pull}36423[#36423] (issues: {es-issue}36380[#36380], {es-issue}36381[#36381]) * [Zen2] Only elect master-eligible nodes {es-pull}35996[#35996] * [Zen2] Remove duplicate discovered peers {es-pull}35505[#35505] [[regression-7.0.0-alpha2]] [float] === Regressions Scripting:: * Use Number as a return value for BucketAggregationScript {es-pull}35653[#35653] (issue: {es-issue}35351[#35351]) [[upgrade-7.0.0-alpha2]] [float] === Upgrades Ingest:: * Update geolite2 database in ingest geoip plugin {es-pull}33840[#33840] Network:: * Upgrade Netty 4.3.32.Final {es-pull}36102[#36102] (issue: {es-issue}35360[#35360])