2020-02-28 04:35:04 -05:00
[[release-notes-7.7.0]]
== {es} version 7.7.0
2020-04-14 02:30:30 -04:00
Also see <<breaking-changes-7.7,Breaking changes in 7.7>>.
2020-02-28 04:35:04 -05:00
[[breaking-7.7.0]]
[float]
=== Breaking changes
2020-04-14 02:30:30 -04:00
Highlighting::
* Highlighters skip ignored keyword values {pull}53408[#53408] (issue: {issue}43800[#43800])
Infra/Core::
* Remove DEBUG-level default logging from actions {pull}51459[#51459] (issue: {issue}51198[#51198])
2020-02-28 04:35:04 -05:00
Mapping::
* Dynamic mappings in indices created on 8.0 and later have stricter validation at mapping update time and
results in a deprecation warning for indices created in Elasticsearch 7.7.0 and later.
2020-04-14 02:30:30 -04:00
(e.g. incorrect analyzer settings or unknown field types). {pull}51233[#51233] (issues: {issue}17411[#17411], {issue}24419[#24419])
2020-03-05 14:23:39 -05:00
Search::
2020-04-14 02:30:30 -04:00
* Make range query rounding consistent {pull}50237[#50237] (issue: {issue}50009[#50009])
2020-03-25 09:30:12 -04:00
* Pipeline aggregation validation errors that used to return HTTP
500s/Internal Server Errors now return 400/Bad Request {pull}53669[#53669].
As a bonus we now return a list of validation errors rather than returning
the first one we encounter.
2020-04-14 02:30:30 -04:00
[[breaking-java-7.7.0]]
[float]
=== Breaking Java changes
Infra/Core::
* Fix ActionListener.map exception handling {pull}50886[#50886]
Machine Learning::
* Add expected input field type to trained model config {pull}53083[#53083]
Transform::
* Enhance the output of preview to return full destination index details {pull}53572[#53572]
[[deprecation-7.7.0]]
[float]
=== Deprecations
Allocation::
* Deprecated support for delaying state recovery pending master nodes {pull}53646[#53646] (issue: {issue}51806[#51806])
Authentication::
* Add warnings for invalid realm order config (#51195) {pull}51515[#51515]
* Deprecate timeout.tcp_read AD/LDAP realm setting {pull}47305[#47305] (issue: {issue}46028[#46028])
Engine::
* Deprecate translog retention settings {pull}51588[#51588] (issues: {issue}45473[#45473], {issue}50775[#50775])
Features/Features::
* Add cluster.remote.connect to deprecation info API {pull}54142[#54142] (issue: {issue}53924[#53924])
Infra/Core::
* Add deprecation check for listener thread pool {pull}53438[#53438] (issues: {issue}53049[#53049], {issue}53317[#53317])
* Deprecate the logstash enabled setting {pull}53367[#53367]
* Deprecate the listener thread pool {pull}53266[#53266] (issue: {issue}53049[#53049])
* Deprecate creation of dot-prefixed index names except for hidden and system indices {pull}49959[#49959]
Infra/REST API::
* Deprecate undocumented alternatives to the nodes hot threads API (#52640) {pull}52930[#52930] (issue: {issue}52640[#52640])
Machine Learning::
* Renaming inference processor field field_mappings to new name field_map {pull}53433[#53433]
Search::
* Emit deprecation warning when TermsLookup contains a type {pull}53731[#53731] (issue: {issue}41059[#41059])
* Deprecate BoolQueryBuilder's mustNot field {pull}53125[#53125]
[[feature-7.7.0]]
[float]
=== New features
Aggregations::
* Preserve metric types in top_metrics {pull}53288[#53288]
* Support multiple metrics in `top_metrics` agg {pull}52965[#52965] (issue: {issue}51813[#51813])
* Add size support to `top_metrics` {pull}52662[#52662] (issue: {issue}51813[#51813])
* HLRC support for string_stats {pull}52163[#52163]
* Add Boxplot Aggregation {pull}51948[#51948] (issue: {issue}33112[#33112])
Analysis::
* Add nori_number token filter in analysis-nori {pull}53583[#53583]
Authentication::
* Create API Key on behalf of other user {pull}52886[#52886] (issue: {issue}48716[#48716])
Geo::
* Add support for distance queries on shape queries {pull}53468[#53468]
* Add support for distance queries on geo_shape queries {pull}53466[#53466] (issues: {issue}13351[#13351], {issue}39237[#39237])
* Add support for multipoint shape queries {pull}52564[#52564] (issue: {issue}52133[#52133])
* Add support for multipoint geoshape queries {pull}52133[#52133] (issue: {issue}37318[#37318])
Infra/Core::
* Implement hidden indices {pull}50452[#50452] (issues: {issue}50251[#50251], {issue}50665[#50665], {issue}50762[#50762])
Infra/Packaging::
* Introduce aarch64 packaging {pull}53914[#53914]
Machine Learning::
* Implement ILM policy for .ml-state* indices {pull}52356[#52356] (issue: {issue}29938[#29938])
2020-04-16 14:09:37 -04:00
* Add instrumentation to report statistics related to {dfanalytics-jobs} such as
progress, memory usage, etc. {ml-pull}906[#906]
* Multiclass classification {ml-pull}1037[#1037]
2020-04-14 02:30:30 -04:00
Mapping::
* Introduce a `constant_keyword` field. {pull}49713[#49713]
SQL::
* Add `constant_keyword` support {pull}53241[#53241] (issue: {issue}53016[#53016])
* Add optimisations for not-equalities {pull}51088[#51088] (issue: {issue}49637[#49637])
* Add support for passing query parameters in REST API calls {pull}51029[#51029] (issue: {issue}42916[#42916])
Search::
* Add a cluster setting to disallow expensive queries {pull}51385[#51385] (issue: {issue}29050[#29050])
* Add new x-pack endpoints to track the progress of a search asynchronously {pull}49931[#49931] (issue: {issue}49091[#49091])
[[enhancement-7.7.0]]
[float]
=== Enhancements
Aggregations::
* Try to save memory on aggregations {pull}53793[#53793]
* Speed up partial reduce of terms aggregations {pull}53216[#53216] (issue: {issue}51857[#51857])
* Simplify SiblingPipelineAggregator {pull}53144[#53144]
* Add histogram field type support to boxplot aggs {pull}52265[#52265] (issues: {issue}33112[#33112], {issue}52233[#52233])
* Percentiles aggregation validation checks for range {pull}51871[#51871] (issue: {issue}51808[#51808])
* Begin moving date_histogram to offset rounding (take two) {pull}51271[#51271] (issues: {issue}50609[#50609], {issue}50873[#50873])
* Password-protected Keystore Feature Branch PR {pull}51123[#51123] (issues: {issue}32691[#32691], {issue}49340[#49340])
* Implement top_metrics agg {pull}51155[#51155] (issue: {issue}48069[#48069])
* Bucket aggregation circuit breaker optimization. {pull}46751[#46751]
Analysis::
* Removes old Lucene's experimental flag from analyzer documentations {pull}53217[#53217]
Authentication::
* Add exception metadata for disabled features {pull}52811[#52811] (issues: {issue}47759[#47759], {issue}52311[#52311], {issue}55255[#55255])
* Validate role templates before saving role mapping {pull}52636[#52636] (issue: {issue}48773[#48773])
* Add support for secondary authentication {pull}52093[#52093]
* Expose API key name to the ingest pipeline {pull}51305[#51305] (issues: {issue}46847[#46847], {issue}49106[#49106])
* Disallow Password Change when authenticated by Token {pull}49694[#49694] (issue: {issue}48752[#48752])
Authorization::
* Allow kibana_system to create and invalidate API keys on behalf of other users {pull}53824[#53824] (issue: {issue}48716[#48716])
* Add "grant_api_key" cluster privilege {pull}53527[#53527] (issues: {issue}48716[#48716], {issue}52886[#52886])
* Giving kibana user privileges to create custom link index {pull}53221[#53221] (issue: {issue}59305[#59305])
* Allow kibana to collect APM telemetry in background task {pull}52917[#52917] (issue: {issue}50757[#50757])
* Add the new 'maintenance' privilege containing 4 actions (#29998) {pull}50643[#50643]
Cluster Coordination::
* Describe STALE_STATE_CONFIG in ClusterFormationFH {pull}53878[#53878] (issue: {issue}53734[#53734])
Distributed::
* Introduce formal role for remote cluster client {pull}53924[#53924]
* Shortcut query phase using the results of other shards {pull}51852[#51852] (issues: {issue}49601[#49601], {issue}51708[#51708])
* Flush instead of synced-flush inactive shards {pull}49126[#49126] (issues: {issue}31965[#31965], {issue}48430[#48430])
Engine::
* Restore off-heap loading for term dictionary in ReadOnlyEngine {pull}53713[#53713] (issues: {issue}43158[#43158], {issue}51247[#51247])
* Separate translog from index deletion conditions {pull}52556[#52556]
* Always rewrite search shard request outside of the search thread pool {pull}51708[#51708] (issue: {issue}49601[#49601])
* Move the terms index of `_id` off-heap. {pull}52405[#52405] (issue: {issue}42838[#42838])
* Cache completion stats between refreshes {pull}51991[#51991] (issue: {issue}51915[#51915])
* Use local checkpoint to calculate min translog gen for recovery {pull}51905[#51905] (issue: {issue}49970[#49970])
Features/CAT APIs::
* /_cat/shards support path stats {pull}53461[#53461]
* Allow _cat indices & aliases to use indices options {pull}53248[#53248] (issue: {issue}52304[#52304])
Features/Features::
* Enable deprecation checks for removed settings {pull}53317[#53317]
Features/ILM+SLM::
* Hide ILM & SLM history aliases {pull}53564[#53564]
* Avoid race condition in ILMHistorySotre {pull}53039[#53039] (issues: {issue}50353[#50353], {issue}52853[#52853])
* Make FreezeStep retryable {pull}52540[#52540]
* Make DeleteStep retryable {pull}52494[#52494]
* Allow forcemerge in the hot phase for ILM policies {pull}52073[#52073] (issue: {issue}43165[#43165])
* Stop policy on last PhaseCompleteStep instead of TerminalPolicyStep {pull}51631[#51631] (issue: {issue}48431[#48431])
* Convert ILM and SLM histories into hidden indices {pull}51456[#51456]
* Make UpdateSettingsStep retryable {pull}51235[#51235] (issues: {issue}44135[#44135], {issue}48183[#48183])
* Expose master timeout for ILM actions {pull}51130[#51130] (issue: {issue}44136[#44136])
* Wait for active shards on rolled index in a separate step {pull}50718[#50718] (issues: {issue}44135[#44135], {issue}48183[#48183])
* Adding best_compression {pull}49974[#49974]
Features/Indices APIs::
* Add IndexTemplateV2 to MetaData {pull}53753[#53753] (issue: {issue}53101[#53101])
* Add ComponentTemplate to MetaData {pull}53290[#53290] (issue: {issue}53101[#53101])
Features/Ingest::
* Reduce log level for pipeline failure {pull}54097[#54097] (issue: {issue}51459[#51459])
* Support array for all string ingest processors {pull}53343[#53343] (issue: {issue}51087[#51087])
* Add empty_value parameter to CSV processor {pull}51567[#51567]
* Add pipeline name to ingest metadata {pull}50467[#50467] (issue: {issue}42106[#42106])
Features/Java High Level REST Client::
* SourceExists HLRC uses GetSourceRequest instead of GetRequest {pull}51789[#51789] (issue: {issue}50885[#50885])
* Add async_search.submit to HLRC {pull}53592[#53592] (issue: {issue}49091[#49091])
* Add Get Source API to the HLRC {pull}50885[#50885] (issue: {issue}47678[#47678])
Features/Monitoring::
* Secure password for monitoring HTTP exporter {pull}50919[#50919] (issue: {issue}50197[#50197])
* Validate SSL settings at parse time {pull}49196[#49196] (issue: {issue}47711[#47711])
Features/Stats::
* Add analysis components and mapping types to the usage API. {pull}51031[#51031]
Features/Watcher::
* Make watch history indices hidden {pull}52962[#52962] (issue: {issue}50251[#50251])
* Upgrade to the latest OWASP HTML sanitizer {pull}50765[#50765] (issue: {issue}50395[#50395])
Infra/Core::
* Enable helpful null pointer exceptions {pull}54853[#54853]
* Allow keystore add to handle multiple settings {pull}54229[#54229] (issue: {issue}54191[#54191])
* Report parser name and location in XContent deprecation warnings {pull}53805[#53805]
* Report parser name and location in XContent deprecation warnings {pull}53752[#53752]
* Deprecate all variants of a ParseField with no replacement {pull}53722[#53722]
* Allow specifying an exclusive set of fields on ObjectParser {pull}52893[#52893]
* Support joda style date patterns in 7.x {pull}52555[#52555]
* Implement hidden aliases {pull}52547[#52547] (issue: {issue}52304[#52304])
* Allow ObjectParsers to specify required sets of fields {pull}49661[#49661] (issue: {issue}48824[#48824])
Infra/Logging::
* Capture stdout and stderr to log4j log {pull}50259[#50259] (issue: {issue}50156[#50156])
Infra/Packaging::
* Introduce aarch64 Docker image {pull}53936[#53936] (issue: {issue}53914[#53914])
* Introduce jvm.options.d for customizing JVM options {pull}51882[#51882] (issue: {issue}51626[#51626])
Infra/Plugins::
* Allow sha512 checksum without filename for maven plugins {pull}52668[#52668] (issue: {issue}52413[#52413])
Infra/Scripting::
* Scripting: Context script cache unlimited compile {pull}53769[#53769] (issue: {issue}50152[#50152])
* Scripting: Increase ingest script cache defaults {pull}53765[#53765] (issue: {issue}50152[#50152])
* Scripting: Per-context script cache, default off (#52855) {pull}53756[#53756] (issues: {issue}50152[#50152], {issue}52855[#52855])
* Scripting: Per-context script cache, default off {pull}52855[#52855] (issue: {issue}50152[#50152])
* Improve Painless compilation performance for nested conditionals {pull}52056[#52056]
* Scripting: Add char position of script errors {pull}51069[#51069] (issue: {issue}50993[#50993])
Infra/Settings::
* Allow keystore add-file to handle multiple settings {pull}54240[#54240] (issue: {issue}54191[#54191])
* Settings: AffixSettings as validator dependencies {pull}52973[#52973] (issue: {issue}52933[#52933])
License::
* Simplify ml license checking with XpackLicenseState internals {pull}52684[#52684] (issue: {issue}52115[#52115])
* License removal leads back to a basic license {pull}52407[#52407] (issue: {issue}45022[#45022])
* Refactor license checking {pull}52118[#52118] (issue: {issue}51864[#51864])
* Add enterprise mode and refactor {pull}51864[#51864] (issue: {issue}51081[#51081])
Machine Learning::
* Stratified cross validation split for classification {pull}54087[#54087]
* Data frame analytics data counts {pull}53998[#53998]
* Verify that the field is aggregatable before attempting cardinality aggregation {pull}53874[#53874] (issue: {issue}53876[#53876])
* Adds multi-class feature importance support {pull}53803[#53803]
* Data frame analytics analysis stats {pull}53788[#53788]
* Add a model memory estimation endpoint for anomaly detection {pull}53507[#53507] (issue: {issue}53219[#53219])
* Adds new default_field_map field to trained models {pull}53294[#53294]
* Improve DF analytics audits and logging {pull}53179[#53179]
* Add indices_options to datafeed config and update {pull}52793[#52793] (issue: {issue}48056[#48056])
* Parse and report memory usage for DF Analytics {pull}52778[#52778]
* Adds the class_assignment_objective parameter to classification {pull}52763[#52763] (issue: {issue}52427[#52427])
* Add reason to DataFrameAnalyticsTask updateState log message {pull}52659[#52659] (issue: {issue}52654[#52654])
* Add support for multi-value leaves to the tree model {pull}52531[#52531]
* Make ml internal indices hidden {pull}52423[#52423] (issue: {issue}52420[#52420])
* Add _cat/ml/data_frame/analytics API {pull}52260[#52260] (issue: {issue}51413[#51413])
* Adds feature importance option to inference processor {pull}52218[#52218]
* Switch poor categorization audit warning to use status field {pull}52195[#52195] (issues: {issue}50749[#50749], {issue}51146[#51146], {issue}51879[#51879])
* Retry persisting DF Analytics results {pull}52048[#52048]
* Improve multiline_start_pattern for CSV in find_file_structure {pull}51737[#51737]
* Add _cat/ml/trained_models API {pull}51529[#51529] (issue: {issue}51414[#51414])
* Add GET _cat/ml/datafeeds {pull}51500[#51500] (issue: {issue}51411[#51411])
* Use CSV ingest processor in find_file_structure ingest pipeline {pull}51492[#51492] (issue: {issue}56038[#56038])
* Add _cat/ml/anomaly_detectors API {pull}51364[#51364]
* Add tags url param to GET {pull}51330[#51330]
* Add parsers for inference configuration classes {pull}51300[#51300]
* Make datafeeds work with nanosecond time fields {pull}51180[#51180] (issue: {issue}49889[#49889])
* Adds support for a global calendars {pull}50372[#50372] (issue: {issue}45013[#45013])
2020-04-16 14:09:37 -04:00
* Speed up computation of feature importance
{ml-pull}1005[1005]
* Improve initialization of learn rate for better and more stable results in
regression and classification {ml-pull}948[#948]
* Add number of processed training samples to the definition of decision tree
nodes {ml-pull}991[#991]
* Add new model_size_stats fields to instrument categorization
{ml-pull}948[#948], {pull}51879[#51879] (issue: {issue}50794[#50749])
* Improve upfront memory estimation for all data frame analyses, which were
higher than necessary. This will improve the allocation of data frame analyses
to cluster nodes {ml-pull}1003[#1003]
* Upgrade the compiler used on Linux from gcc 7.3 to gcc 7.5, and the binutils
used in the build from version 2.20 to 2.34 {ml-pull}1013[#1013]
* Add instrumentation of the peak memory consumption for {dfanalytics-jobs}
{ml-pull}1022[#1022]
* Remove all memory overheads for computing tree SHAP values {ml-pull}1023[#1023]
* Distinguish between empty and missing categorical fields in classification and
regression model training {ml-pull}1034[#1034]
* Add instrumentation information for supervised learning {dfanalytics-jobs}
{ml-pull}1031[#1031]
* Add instrumentation information for {oldetection} data frame analytics jobs
{ml-pull}1068[#1068]
* Write out feature importance for multi-class models {ml-pull}1071[#1071]
* Enable system call filtering to the native process used with {dfanalytics}
{ml-pull}1098[#1098]
2020-04-14 02:30:30 -04:00
Mapping::
* Wildcard field - add normalizer support {pull}53851[#53851]
* Append index name for the source of the cluster put-mapping task {pull}52690[#52690]
Network::
* Give helpful message on remote connections disabled {pull}53690[#53690]
* Add server name to remote info API {pull}53634[#53634]
* Log when probe succeeds but full connection fails {pull}51304[#51304]
* Encrypt generated key with AES {pull}51019[#51019] (issue: {issue}50843[#50843])
Ranking::
* Adds recall@k metric to rank eval API {pull}52577[#52577] (issue: {issue}51676[#51676])
SQL::
* JDBC debugging enhancement {pull}53880[#53880]
* Transfer version compatibility decision to the server {pull}53082[#53082] (issue: {issue}52766[#52766])
* Use a proper error message for queries directed at empty mapping indices {pull}52967[#52967] (issue: {issue}52865[#52865])
* Use calendar_interval of 1d for HISTOGRAMs with 1 DAY intervals {pull}52749[#52749] (issue: {issue}52713[#52713])
* Use a calendar interval for histograms over 1 month intervals {pull}52586[#52586] (issue: {issue}51538[#51538])
* Make parsing of date more lenient {pull}52137[#52137] (issue: {issue}49379[#49379])
* Enhance timestamp escaped literal parsing {pull}52097[#52097] (issue: {issue}46069[#46069])
* Handle uberjar scenario where the ES jdbc driver file is bundled in another jar {pull}51856[#51856] (issue: {issue}50201[#50201])
* Verify Full-Text Search functions not allowed in SELECT {pull}51568[#51568] (issue: {issue}47446[#47446])
* Extend the optimisations for equalities {pull}50792[#50792] (issue: {issue}49637[#49637])
* Add trace logging for search responses coming from server {pull}50530[#50530]
* Extend DATE_TRUNC to also operate on intervals(elastic - #46632 ) {pull}47720[#47720] (issue: {issue}46632[#46632])
Search::
* HLRC: Don't send defaults for SubmitAsyncSearchRequest {pull}54200[#54200]
* Reduce performance impact of ExitableDirectoryReader {pull}53978[#53978] (issues: {issue}52822[#52822], {issue}53166[#53166], {issue}53496[#53496])
* Add heuristics to compute pre_filter_shard_size when unspecified {pull}53873[#53873] (issue: {issue}39835[#39835])
* Add async_search get and delete APIs to HLRC {pull}53828[#53828] (issue: {issue}49091[#49091])
* Increase step between checks for cancellation {pull}53712[#53712] (issues: {issue}52822[#52822], {issue}53496[#53496])
* Refine SearchProgressListener internal API {pull}53373[#53373]
* Check for query cancellation during rewrite {pull}53166[#53166] (issue: {issue}52822[#52822])
* Implement Cancellable DirectoryReader {pull}52822[#52822]
* Address MinAndMax generics warnings {pull}52642[#52642] (issue: {issue}49092[#49092])
* Clarify when shard iterators get sorted {pull}52633[#52633]
* Generalize how queries on `_index` are handled at rewrite time {pull}52486[#52486] (issues: {issue}49254[#49254], {issue}49713[#49713])
* Remove the query builder serialization from QueryShardException message {pull}51885[#51885] (issues: {issue}48910[#48910], {issue}51843[#51843])
* Short circuited to MatchNone for non-participating slice {pull}51207[#51207]
* Add "did you mean" to unknown queries {pull}51177[#51177]
* Exclude unmapped fields during max clause limit checking for querying {pull}49523[#49523] (issue: {issue}49002[#49002])
Security::
* Add error message in JSON response {pull}54389[#54389]
Snapshot/Restore::
* Use Azure Bulk Deletes in Azure Repository {pull}53919[#53919] (issue: {issue}53865[#53865])
* Only link fd* files during source-only snapshot {pull}53463[#53463] (issue: {issue}50231[#50231])
* Add Blob Download Retries to GCS Repository {pull}52479[#52479] (issues: {issue}46589[#46589], {issue}52319[#52319])
* Better Incrementality for Snapshots of Unchanged Shards {pull}52182[#52182]
* Add Region and Signer Algorithm Overrides to S3 Repos {pull}52112[#52112] (issue: {issue}51861[#51861])
* Allow Parallel Snapshot Restore And Delete {pull}51608[#51608] (issue: {issue}41463[#41463])
Store::
* HybridDirectory should mmap postings. {pull}52641[#52641]
Transform::
* Transition Transforms to using hidden indices for notifcations index {pull}53773[#53773] (issue: {issue}53762[#53762])
* Add processing stats to record the time spent for processing results {pull}53770[#53770]
* Create GET _cat/transforms API Issue {pull}53643[#53643] (issue: {issue}51412[#51412])
* Add support for script in group_by {pull}53167[#53167] (issue: {issue}43152[#43152])
* Implement node.transform to control where to run a transform {pull}52712[#52712] (issues: {issue}48734[#48734], {issue}50033[#50033], {issue}52200[#52200])
* Add support for filter aggregation {pull}52483[#52483] (issue: {issue}52151[#52151])
* Provide exponential_avg* stats for batch transforms {pull}52041[#52041] (issue: {issue}52037[#52037])
* Improve irrecoverable error detection - part 2 {pull}52003[#52003] (issue: {issue}51820[#51820])
* Mark transform API's stable {pull}51862[#51862]
* Improve irrecoverable error detection {pull}51820[#51820] (issue: {issue}50135[#50135])
* Add support for percentile aggs {pull}51808[#51808] (issue: {issue}51663[#51663])
* Disallow fieldnames with a dot at start and/or end {pull}51369[#51369]
* Avoid mapping problems with index templates {pull}51368[#51368] (issue: {issue}51321[#51321])
* Handle permanent bulk indexing errors {pull}51307[#51307] (issue: {issue}50122[#50122])
* Improve force stop robustness in case of an error {pull}51072[#51072]
[[bug-7.7.0]]
[float]
=== Bug fixes
Aggregations::
* Fix date_nanos in composite aggs {pull}53315[#53315] (issue: {issue}53168[#53168])
* Fix composite agg sort bug {pull}53296[#53296] (issue: {issue}52480[#52480])
* Decode max and min optimization more carefully {pull}52336[#52336] (issue: {issue}52220[#52220])
* Fix a DST error in date_histogram {pull}52016[#52016] (issue: {issue}50265[#50265])
* Use #name() instead of #simpleName() when generating doc values {pull}51920[#51920] (issues: {issue}50307[#50307], {issue}51847[#51847])
* Fix a sneaky bug in rare_terms {pull}51868[#51868] (issue: {issue}51020[#51020])
* Support time_zone on composite's date_histogram {pull}51172[#51172] (issues: {issue}45199[#45199], {issue}45200[#45200])
Allocation::
* Improve performance of shards limits decider {pull}53577[#53577] (issue: {issue}53559[#53559])
Analysis::
* Mask wildcard query special characters on keyword queries {pull}53127[#53127] (issue: {issue}46300[#46300])
* Fix caching for PreConfiguredTokenFilter {pull}50912[#50912] (issue: {issue}50734[#50734])
Audit::
* Logfile audit settings validation {pull}52537[#52537] (issues: {issue}47038[#47038], {issue}47711[#47711], {issue}52357[#52357])
Authentication::
* Fix potential bug in concurrent token refresh support {pull}53668[#53668]
* Respect runas realm for ApiKey security operations {pull}52178[#52178] (issue: {issue}51975[#51975])
* Preserve ApiKey credentials for async verification {pull}51244[#51244]
* Don't fallback to anonymous for tokens/apikeys {pull}51042[#51042] (issue: {issue}50171[#50171])
* Fail gracefully on invalid token strings {pull}51014[#51014]
Authorization::
* Explicitly require that delegate API keys have no privileges {pull}53647[#53647]
* Allow _rollup_search with read privilege {pull}52043[#52043] (issue: {issue}50245[#50245])
CCR::
* Put CCR tasks on (data && remote cluster clients) {pull}54146[#54146] (issue: {issue}53924[#53924])
* Handle no such remote cluster exception in ccr {pull}53415[#53415] (issue: {issue}53225[#53225])
* Fix shard follow task cleaner under security {pull}52347[#52347] (issues: {issue}44702[#44702], {issue}51971[#51971])
CRUD::
* Force execution of finish shard bulk request {pull}51957[#51957] (issue: {issue}51904[#51904])
* Return 429 status code when there's a read_only cluster block {pull}50166[#50166] (issue: {issue}49393[#49393])
Cluster Coordination::
* Use special XContent registry for node tool {pull}54050[#54050] (issue: {issue}53549[#53549])
* Allow static cluster.max_voting_config_exclusions {pull}53717[#53717] (issue: {issue}53455[#53455])
* Allow joining node to trigger term bump {pull}53338[#53338] (issue: {issue}53271[#53271])
* Ignore timeouts with single-node discovery {pull}52159[#52159]
Distributed::
* Execute retention lease syncs under system context {pull}53838[#53838] (issues: {issue}48430[#48430], {issue}53751[#53751])
* Exclude nested documents in LuceneChangesSnapshot {pull}51279[#51279]
Engine::
* Fix doc_stats and segment_stats of ReadOnlyEngine {pull}53345[#53345] (issues: {issue}51303[#51303], {issue}51331[#51331])
* Do not wrap soft-deletes reader for segment stats {pull}51331[#51331] (issues: {issue}51192[#51192], {issue}51303[#51303])
* Account soft-deletes in FrozenEngine {pull}51192[#51192] (issue: {issue}50775[#50775])
Features/CAT APIs::
* Fix NPE in RestPluginsAction {pull}52620[#52620] (issue: {issue}45321[#45321])
Features/ILM+SLM::
* Disallow negative TimeValues {pull}53913[#53913] (issue: {issue}54041[#54041])
* Fix null config in SnapshotLifecyclePolicy.toRequest {pull}53328[#53328] (issues: {issue}44465[#44465], {issue}53171[#53171])
* Freeze step retry when not acknowledged {pull}53287[#53287]
* Make the set-single-node-allocation retryable {pull}52077[#52077] (issue: {issue}43401[#43401])
* Fix the init step to actually be retryable {pull}52076[#52076]
Features/Ingest::
* Fix ingest pipeline _simulate api with empty docs never returns a response {pull}52937[#52937] (issue: {issue}52833[#52833])
* Handle errors when evaluating if conditions in processors {pull}52543[#52543] (issue: {issue}52339[#52339])
* Fix delete enrich policy bug {pull}52179[#52179] (issue: {issue}51228[#51228])
* Fix ignore_missing in CsvProcessor {pull}51600[#51600]
* Missing suffix for German Month "Juli" in Grok Pattern MONTH {pull}51591[#51591] (issue: {issue}51579[#51579])
* Don't overwrite target field with SetSecurityUserProcessor {pull}51454[#51454] (issue: {issue}51428[#51428])
Features/Java High Level REST Client::
* Add unsupported parameters to HLRC search request {pull}53745[#53745]
* Fix AbstractBulkByScrollRequest slices parameter via Rest {pull}53068[#53068] (issue: {issue}53044[#53044])
* Send the fields param via body instead of URL params (elastic#42232) {pull}48840[#48840] (issues: {issue}42232[#42232], {issue}42877[#42877])
Features/Java Low Level REST Client::
* Fix roles parsing in client nodes sniffer {pull}52888[#52888] (issue: {issue}52864[#52864])
Features/Monitoring::
* Fix NPE in cluster state collector for monitoring {pull}52371[#52371] (issue: {issue}52317[#52317])
Features/Stats::
* Switch to AtomicLong for "IngestCurrent" metric to prevent negative values {pull}52581[#52581] (issues: {issue}52406[#52406], {issue}52411[#52411])
Features/Watcher::
* Disable Watcher script optimization for stored scripts {pull}53497[#53497] (issue: {issue}40212[#40212])
* The watcher indexing listener didn't handle document level exceptions. {pull}51466[#51466] (issue: {issue}32299[#32299])
Geo::
* Handle properly indexing rectangles that crosses the dateline {pull}53810[#53810]
Highlighting::
* Fix highlighter support in PinnedQuery and added test {pull}53716[#53716] (issue: {issue}53699[#53699])
Infra/Core::
* Fix Joda compatibility in stream protocol {pull}53823[#53823] (issue: {issue}53586[#53586])
* Avoid self-suppression on grouped action listener {pull}53262[#53262] (issue: {issue}53174[#53174])
* Ignore virtual ethernet devices that disappear {pull}51581[#51581] (issue: {issue}49914[#49914])
* Fix ingest timezone logic {pull}51215[#51215] (issue: {issue}51108[#51108])
Infra/Logging::
* Fix LoggingOutputStream to work on windows {pull}51779[#51779] (issue: {issue}51532[#51532])
Infra/Packaging::
* Handle special characters and spaces in JAVA_HOME path in elasticsearch-service.bat {pull}52676[#52676]
* Limit _FILE env var support to specific vars {pull}52525[#52525] (issue: {issue}52503[#52503])
* Always set default ES_PATH_CONF for package scriptlets {pull}51827[#51827] (issues: {issue}50246[#50246], {issue}50631[#50631])
Infra/Plugins::
* Ensure only plugin REST tests are run for plugins {pull}53184[#53184] (issues: {issue}52114[#52114], {issue}53183[#53183])
Machine Learning::
* Fix node serialization on GET df-nalytics stats without id {pull}54808[#54808] (issue: {issue}54807[#54807])
* Allow force stopping failed and stopping DF analytics {pull}54650[#54650]
* Take more care that normalize processes use unique named pipes {pull}54636[#54636] (issue: {issue}43830[#43830])
* Do not fail Evaluate API when the actual and predicted fields' types differ {pull}54255[#54255] (issue: {issue}54079[#54079])
* Get ML filters size should default to 100 {pull}54207[#54207] (issues: {issue}39976[#39976], {issue}54206[#54206])
* Introduce a "starting" datafeed state for lazy jobs {pull}53918[#53918] (issue: {issue}53763[#53763])
* Only retry persistence failures when the failure is intermittent and stop retrying when analytics job is stopping {pull}53725[#53725] (issue: {issue}53687[#53687])
* Fix number inference models returned in x-pack info API {pull}53540[#53540]
* Make classification evaluation metrics work when there is field mapping type mismatch {pull}53458[#53458] (issue: {issue}53485[#53485])
* Perform evaluation in multiple steps when necessary {pull}53295[#53295]
* Specifying missing_field_value value and using it instead of empty_string {pull}53108[#53108] (issue: {issue}1034[#1034])
* Use event.timezone in ingest pipeline from find_file_structure {pull}52720[#52720] (issue: {issue}9458[#9458])
* Better error when persistent task assignment disabled {pull}52014[#52014] (issue: {issue}51956[#51956])
* Fix possible race condition starting datafeed {pull}51646[#51646] (issues: {issue}50886[#50886], {issue}51302[#51302])
* Fix possible race condition when starting datafeed {pull}51302[#51302] (issue: {issue}51285[#51285])
* Address two edge cases for categorization.GrokPatternCreator#findBestGrokMatchFromExamples {pull}51168[#51168]
* Calculate results and snapshot retention using latest bucket timestamps {pull}51061[#51061]
2020-04-16 14:09:37 -04:00
* Use largest ordered subset of categorization tokens for category reverse
search regex {ml-pull}970[#970] (issue: {ml-issue}949[#949])
* Account for the data frame's memory when estimating the peak memory used by
classification and regression model training {ml-pull}996[#996]
* Rename classification and regression parameter maximum_number_trees to
max_trees {ml-pull}1047[#1047]
2020-04-14 02:30:30 -04:00
Mapping::
* Throw better exception on wrong `dynamic_templates` syntax {pull}51783[#51783] (issue: {issue}51486[#51486])
Network::
* Allow proxy mode server name to be updated {pull}54107[#54107]
* Invoke response handler on failure to send {pull}53631[#53631]
* Do not log no-op reconnections at DEBUG {pull}53469[#53469]
* Fix RemoteConnectionManager size() method {pull}52823[#52823] (issue: {issue}52029[#52029])
* Remove seeds dependency for remote cluster settings {pull}52796[#52796]
* Add host address to BindTransportException message {pull}51269[#51269] (issue: {issue}48001[#48001])
Percolator::
* Test percolate queries using `NOW` and sorting {pull}52758[#52758] (issues: {issue}52618[#52618], {issue}52748[#52748])
* Don't index ranges including `NOW` in percolator {pull}52748[#52748] (issue: {issue}52617[#52617])
Reindex::
* Negative TimeValue fix {pull}54057[#54057] (issue: {issue}53913[#53913])
* Allow comma separated source indices {pull}52044[#52044] (issue: {issue}51949[#51949])
SQL::
* Fix NPE for parameterized LIKE/RLIKE {pull}53573[#53573] (issue: {issue}53557[#53557])
* Add support for index aliases for SYS COLUMNS command {pull}53525[#53525] (issue: {issue}31609[#31609])
* Fix issue with LIKE/RLIKE as painless script {pull}53495[#53495] (issue: {issue}53486[#53486])
* Fix column size for IP data type {pull}53056[#53056] (issue: {issue}52762[#52762])
* Fix sql cli sourcing of x-pack-env {pull}52613[#52613] (issue: {issue}47803[#47803])
* Supplement input checks on received request parameters {pull}52229[#52229]
* Fix issue with timezone when paginating {pull}52101[#52101] (issue: {issue}51258[#51258])
* Fix ORDER BY on aggregates and GROUPed BY fields {pull}51894[#51894] (issue: {issue}50355[#50355])
* Fix milliseconds handling in intervals {pull}51675[#51675] (issue: {issue}41635[#41635])
* Fix ORDER BY YEAR() function {pull}51562[#51562] (issue: {issue}51224[#51224])
* Change the way unsupported data types fields are handled {pull}50823[#50823]
* Selecting a literal from grouped by query generates error {pull}41964[#41964] (issues: {issue}41413[#41413], {issue}41951[#41951])
Search::
* Fix Term Vectors with artificial docs and keyword fields {pull}53504[#53504] (issue: {issue}53494[#53494])
* Fix concurrent requests race over scroll context limit {pull}53449[#53449]
* Fix pre-sorting of shards in the can_match phase {pull}53397[#53397]
* Fix potential NPE in FuzzyTermsEnum {pull}53231[#53231] (issue: {issue}52894[#52894])
* Fix inaccurate total hit count in _search/template api {pull}53155[#53155] (issue: {issue}52801[#52801])
* Harden search context id {pull}53143[#53143]
* Correct boost in `script_score` query and error on negative scores {pull}52478[#52478] (issue: {issue}48465[#48465])
Snapshot/Restore::
* Fix Non-Verbose Snapshot List Missing Empty Snapshots {pull}52433[#52433]
* Fix Inconsistent Shard Failure Count in Failed Snapshots {pull}51416[#51416] (issue: {issue}47550[#47550])
* Fix Overly Aggressive Request DeDuplication {pull}51270[#51270] (issue: {issue}51253[#51253])
Store::
* Fix synchronization in ByteSizeCachingDirectory {pull}52512[#52512]
Transform::
* Fixing naming in HLRC and _cat to match API content {pull}54300[#54300] (issue: {issue}53946[#53946])
* Transform optmize date histogram {pull}54068[#54068] (issue: {issue}54254[#54254])
* Add version guards around Transform hidden index settings {pull}54036[#54036] (issue: {issue}53931[#53931])
* Fix NPE in derive stats if shouldStopAtNextCheckpoint is set {pull}52940[#52940]
* Fix mapping deduction for scaled_float {pull}51990[#51990] (issue: {issue}51780[#51780])
* Fix stats can return old state information if security is enabled {pull}51732[#51732] (issue: {issue}51728[#51728])
[[upgrade-7.7.0]]
[float]
=== Upgrades
Authentication::
* Update oauth2-oidc-sdk to 7.0 {pull}52489[#52489] (issue: {issue}48409[#48409])
Engine::
* Upgrade to lucene 8.5.0 release {pull}54077[#54077]
* Upgrade to final lucene 8.5.0 snapshot {pull}53293[#53293]
* Upgrade to Lucene 8.5.0-snapshot-c4475920b08 {pull}52950[#52950]
Features/Ingest::
* Upgrade Tika to 1.24 {pull}54130[#54130] (issue: {issue}52402[#52402])
Infra/Core::
* Upgrade the bundled JDK to JDK 14 {pull}53748[#53748] (issue: {issue}53575[#53575])
* Upgrade to Jackson 2.10.3 {pull}53523[#53523] (issues: {issue}27032[#27032], {issue}45225[#45225])
* Update jackson-databind to 2.8.11.6 {pull}53522[#53522] (issue: {issue}45225[#45225])
Infra/Packaging::
* Upgrade the bundled JDK to JDK 13.0.2 {pull}51511[#51511]
Security::
* Update BouncyCastle to 1.64 {pull}52185[#52185]
Snapshot/Restore::
* Upgrade GCS Dependency to 1.106.0 {pull}54092[#54092]
* Upgrade to AWS SDK 1.11.749 {pull}53962[#53962] (issue: {issue}53191[#53191])
* Upgrade to Azure SDK 8.6.2 {pull}53865[#53865]
* Upgrade GCS SDK to 1.104.0 {pull}52839[#52839]
