2020-03-04 09:46:20 -05:00
[[release-notes-7.6.1]]
== {es} version 7.6.1
Also see <<breaking-changes-7.6,Breaking changes in 7.6>>.
[[bug-7.6.1]]
[float]
=== Bug fixes
Aggregations::
* Decode max and min optimization more carefully {pull}52336[#52336] (issue: {issue}52220[#52220])
* Fix a DST error in date_histogram {pull}52016[#52016] (issue: {issue}50265[#50265])
Audit::
* Logfile audit settings validation {pull}52537[#52537] (issues: {issue}47038[#47038], {issue}47711[#47711], {issue}52357[#52357])
CCR::
* Fix shard follow task cleaner under security {pull}52347[#52347] (issues: {issue}44702[#44702], {issue}51971[#51971])
Features/cat APIs::
* Fix NPE in RestPluginsAction {pull}52620[#52620] (issue: {issue}45321[#45321])
Features/ILM+SLM::
* ILM fix the init step to actually be retryable {pull}52076[#52076]
Features/Ingest::
* Handle errors when evaluating if conditions in processors {pull}52543[#52543] (issue: {issue}52339[#52339])
Features/Monitoring::
* Fix NPE in cluster state collector for monitoring {pull}52371[#52371] (issue: {issue}52317[#52317])
Features/Stats::
* Switch to AtomicLong for "IngestCurrent" metric to prevent negative values {pull}52581[#52581] (issues: {issue}52406[#52406], {issue}52411[#52411])
Infra/Packaging::
* Limit _FILE env var support to specific vars {pull}52525[#52525] (issue: {issue}52503[#52503])
Machine Learning::
* Don't return inflated definition when storing trained models {pull}52573[#52573]
* Validate tree feature index is within range {pull}52460[#52460]
Network::
* Remove seeds dependency for remote cluster settings {pull}52796[#52796]
Reindex::
* Allow comma separated source indices {pull}52044[#52044] (issue: {issue}51949[#51949])
SQL::
* Supplement input checks on received request parameters {pull}52229[#52229]
* Fix issue with timezone when paginating {pull}52101[#52101] (issue: {issue}51258[#51258])
* Fix ORDER BY on aggregates and GROUPed BY fields {pull}51894[#51894] (issue: {issue}50355[#50355])
* Fix milliseconds handling in intervals {pull}51675[#51675] (issue: {issue}41635[#41635])
* Selecting a literal from grouped by query generates error {pull}41964[#41964] (issues: {issue}41413[#41413], {issue}41951[#41951])
Snapshot/Restore::
* Fix Non-Verbose Snapshot List Missing Empty Snapshots {pull}52433[#52433]
Store::
* Fix synchronization in ByteSizeCachingDirectory {pull}52512[#52512]
[[upgrade-7.6.1]]
[float]
=== Upgrades
Authentication::
* Update oauth2-oidc-sdk to 7.0 {pull}52489[#52489] (issue: {issue}48409[#48409])
2020-01-15 14:06:59 -05:00
[[release-notes-7.6.0]]
== {es} version 7.6.0
coming[7.6.0]
Also see <<breaking-changes-7.6,Breaking changes in 7.6>>.
[[breaking-7.6.0]]
[float]
=== Breaking changes
Mapping::
* Add a cluster setting to disallow loading fielddata on _id field {pull}49166[#49166] (issues: {issue}26472[#26472], {issue}43599[#43599])
[[breaking-java-7.6.0]]
[float]
=== Breaking Java changes
Security::
* Support Client and RoleMapping in custom Realms {pull}50534[#50534] (issue: {issue}48369[#48369])
[[deprecation-7.6.0]]
[float]
=== Deprecations
Analysis::
* Deprecate and remove camel-case nGram and edgeNGram tokenizers {pull}50862[#50862] (issue: {issue}50561[#50561])
Authorization::
* Deprecating kibana_user and kibana_dashboard_only_user roles {pull}46456[#46456]
Distributed::
* Deprecate synced flush {pull}50835[#50835] (issue: {issue}50776[#50776])
* Deprecate indices without soft-deletes {pull}50502[#50502]
Features/Indices APIs::
* Emit warnings when index templates have multiple mappings {pull}50982[#50982]
* Ensure we emit a warning when using the deprecated 'template' field. {pull}50831[#50831] (issue: {issue}49460[#49460])
Infra/Core::
* Deprecate the 'local' parameter of /_cat/nodes {pull}50499[#50499] (issue: {issue}50088[#50088])
Reindex::
* Deprecate sorting in reindex {pull}49458[#49458] (issue: {issue}47567[#47567])
Search::
* Update the signature of vector script functions. {pull}48604[#48604]
* Deprecate the sparse_vector field type. {pull}48315[#48315]
* Add a deprecation warning regarding allocation awareness in search request {pull}48351[#48351] (issue: {issue}43453[#43453])
[[feature-7.6.0]]
[float]
=== New features
Aggregations::
* New Histogram field mapper that supports percentiles aggregations. {pull}48580[#48580] (issue: {issue}48578[#48578])
* Implement stats aggregation for string terms {pull}47468[#47468]
Analysis::
* Implement Lucene EstonianAnalyzer, Stemmer {pull}49149[#49149] (issue: {issue}48895[#48895])
Authentication::
* Password Protected Keystore (Feature Branch) {pull}49210[#49210]
Features/ILM+SLM::
* ILM action to wait for SLM policy execution {pull}50454[#50454] (issue: {issue}45067[#45067])
* Add ILM histore store index {pull}50287[#50287] (issue: {issue}49180[#49180])
Features/Ingest::
* CSV processor {pull}49509[#49509] (issue: {issue}49113[#49113])
Machine Learning::
* Implement `precision` and `recall` metrics for classification evaluation {pull}49671[#49671] (issue: {issue}48759[#48759])
2020-02-10 21:06:01 -05:00
* Explain data frame analytics API {pull}49455[#49455]
* Machine learning model inference ingest processor {pull}49052[#49052]
* Implement accuracy metric for multi-class classification {pull}47772[#47772] (issue: {issue}48759[#48759])
2020-03-04 09:46:20 -05:00
* Add feature importance values to classification and regression results (using tree
2020-02-10 21:06:01 -05:00
SHapley Additive exPlanation, or SHAP) {ml-pull}857[#857]
2020-01-15 14:06:59 -05:00
Mapping::
* Add per-field metadata. {pull}49419[#49419] (issue: {issue}33267[#33267])
Search::
* Add fuzzy intervals source {pull}49762[#49762] (issue: {issue}49595[#49595])
* Add a listener to track the progress of a search request locally {pull}49471[#49471] (issue: {issue}49091[#49091])
[[enhancement-7.6.0]]
[float]
=== Enhancements
Aggregations::
* Add reusable HistogramValue object {pull}49799[#49799] (issue: {issue}49683[#49683])
* Optimize composite aggregation based on index sorting {pull}48399[#48399] (issue: {issue}48130[#48130])
Allocation::
* Auto-expand indices according to allocation filtering rules {pull}48974[#48974]
* Do not cancel ongoing recovery for noop copy on broken node {pull}48265[#48265] (issue: {issue}47974[#47974])
* Quieter logging from the DiskThresholdMonitor {pull}48115[#48115] (issue: {issue}48038[#48038])
* Faster access to INITIALIZING/RELOCATING shards {pull}47817[#47817] (issues: {issue}46941[#46941], {issue}48579[#48579])
Analysis::
* Check for deprecations when analyzers are built {pull}50908[#50908] (issue: {issue}42349[#42349])
* Make Multiplexer inherit filter chains analysis mode {pull}50662[#50662] (issue: {issue}50554[#50554])
* Allow custom characters in token_chars of ngram tokenizers {pull}49250[#49250] (issue: {issue}25894[#25894])
Authentication::
* Add Debug/Trace logging for authentication {pull}49575[#49575] (issue: {issue}49473[#49473])
Authorization::
* Increase Size and lower TTL on DLS BitSet Cache {pull}50535[#50535] (issues: {issue}43669[#43669], {issue}49260[#49260])
* Add 'monitor_snapshot' cluster privilege {pull}50489[#50489] (issue: {issue}50210[#50210])
* Remove reserved roles for code search {pull}50068[#50068] (issue: {issue}49842[#49842])
* [Code] Remove code_admin/code_user roles {pull}48164[#48164]
* Resolve the role query and the number of docs lazily {pull}48036[#48036]
CCR::
* Improve error message when pausing index {pull}48915[#48915]
* Use MultiFileTransfer in CCR remote recovery {pull}44514[#44514] (issue: {issue}44468[#44468])
CRUD::
* print id detail when id is too long. {pull}49433[#49433]
* Add preflight check to dynamic mapping updates {pull}48817[#48817] (issue: {issue}35564[#35564])
Cluster Coordination::
* Move metadata storage to Lucene {pull}50907[#50907] (issue: {issue}48701[#48701])
* Remove custom metadata tool {pull}50813[#50813] (issue: {issue}48701[#48701])
Distributed::
* Use retention lease in peer recovery of closed indices {pull}48430[#48430] (issue: {issue}45136[#45136])
Engine::
* Do not force refresh when write indexing buffer {pull}50769[#50769]
* Deleted docs disregarded for if_seq_no check {pull}50526[#50526]
* Allow realtime get to read from translog {pull}48843[#48843]
* Do not warm up searcher in engine constructor {pull}48605[#48605] (issue: {issue}47186[#47186])
* Add a new merge policy that interleaves old and new segments on force merge {pull}48533[#48533] (issue: {issue}37043[#37043])
* Refresh should not acquire readLock {pull}48414[#48414] (issue: {issue}47186[#47186])
Features/ILM+SLM::
* Refresh cached phase policy definition if possible on new poli… {pull}50820[#50820] (issue: {issue}48431[#48431])
* Make the UpdateRolloverLifecycleDateStep retryable {pull}50702[#50702] (issue: {issue}48183[#48183])
* Make InitializePolicyContextStep retryable {pull}50685[#50685] (issue: {issue}48183[#48183])
* ILM retryable async action steps {pull}50522[#50522] (issues: {issue}44135[#44135], {issue}48183[#48183])
* Make the TransportRolloverAction execute in one cluster state update {pull}50388[#50388]
* ILM open/close steps are noop if idx is open/close {pull}48614[#48614]
* ILM Make the `check-rollover-ready` step retryable {pull}48256[#48256] (issue: {issue}44135[#44135])
Features/Ingest::
* Foreach processor - fork recursive call {pull}50514[#50514]
* Sync grok patterns with logstash patterns {pull}50381[#50381]
* Replace required pipeline with final pipeline {pull}49470[#49470] (issue: {issue}49247[#49247])
* Add templating support to enrich processor {pull}49093[#49093]
* Introduce on_failure_pipeline ingest metadata inside on_failure block {pull}49076[#49076] (issue: {issue}44920[#44920])
* Add templating support to pipeline processor. {pull}49030[#49030] (issue: {issue}39955[#39955])
* Add option to split processor for preserving trailing empty fields {pull}48664[#48664] (issue: {issue}48498[#48498])
* Change grok watch dog to be Matcher based instead of thread based. {pull}48346[#48346] (issues: {issue}43673[#43673], {issue}47374[#47374])
* update ingest-user-agent regexes.yml {pull}47807[#47807]
Features/Java High Level REST Client::
* Add remote info to the HLRC {pull}49657[#49657] (issue: {issue}47678[#47678])
* Add delete alias to the HLRC {pull}48819[#48819] (issue: {issue}47678[#47678])
Features/Monitoring::
* Significantly Lower Monitoring HttpExport Memory Footprint {pull}48854[#48854]
* Validate proxy base path at parse time {pull}47912[#47912] (issue: {issue}47711[#47711])
* Validate index name time format setting at parse time {pull}47911[#47911] (issue: {issue}47711[#47711])
* Validate monitoring header overrides at parse time {pull}47848[#47848] (issue: {issue}47711[#47711])
* Validate monitoring username at parse time {pull}47821[#47821] (issue: {issue}47711[#47711])
* Validate monitoring password at parse time {pull}47740[#47740] (issue: {issue}47711[#47711])
Features/Stats::
* Add ingest info to Cluster Stats {pull}48485[#48485] (issue: {issue}46146[#46146])
Features/Watcher::
* Log attachment generation failures {pull}50080[#50080]
* Don't dump a stacktrace for invalid patterns when executing elasticse… {pull}49744[#49744] (issue: {issue}49642[#49642])
Geo::
* "CONTAINS" support for BKD-backed geo_shape and shape fields {pull}50141[#50141] (issue: {issue}41204[#41204])
* Adds support for geo-bounds filtering in geogrid aggregations {pull}50002[#50002]
* Introduce faster approximate sinh/atan math functions {pull}49009[#49009] (issue: {issue}41166[#41166])
* Add IndexOrDocValuesQuery to GeoPolygonQueryBuilder {pull}48449[#48449]
Infra/Core::
* Add "did you mean" to ObjectParser {pull}50938[#50938]
* Consistent case in CLI option descriptions {pull}49635[#49635]
* Improve resiliency to formatting JSON in server {pull}48553[#48553] (issue: {issue}48450[#48450])
* Don't close stderr under `--quiet` {pull}47208[#47208] (issue: {issue}46900[#46900])
Infra/Packaging::
* Respect ES_PATH_CONF on package install {pull}50158[#50158]
* Restrict support for CMS to pre-JDK 14 {pull}49123[#49123] (issue: {issue}46973[#46973])
* Remove parsed JVM settings from general settings in Windows service daemon manager {pull}49061[#49061] (issue: {issue}48796[#48796])
* Package the JDK into jdk.app on macOS {pull}48765[#48765]
* Add UBI-based Docker images {pull}48710[#48710] (issue: {issue}48429[#48429])
Infra/Plugins::
* Report progress of multiple plugin installs {pull}51001[#51001] (issue: {issue}50924[#50924])
* Allow installing multiple plugins as a transaction {pull}50924[#50924] (issue: {issue}50443[#50443])
Infra/Scripting::
* Scripting: ScriptFactory not required by compile {pull}50344[#50344] (issue: {issue}49466[#49466])
* Scripting: Cache script results if deterministic {pull}50106[#50106] (issue: {issue}49466[#49466])
* Scripting: Groundwork for caching script results {pull}49895[#49895] (issue: {issue}49466[#49466])
* Scripting: add available languages & contexts API {pull}49652[#49652] (issue: {issue}49463[#49463])
* Scripting: fill in get contexts REST API {pull}48319[#48319] (issue: {issue}47411[#47411])
* Scripting: get context names REST API {pull}48026[#48026] (issue: {issue}47411[#47411])
Infra/Settings::
* Add parameter to make sure that log of updating IndexSetting be more detailed {pull}49969[#49969] (issue: {issue}49818[#49818])
* Enable dependent settings values to be validated {pull}49942[#49942]
* Do not reference values for filtered settings {pull}48066[#48066]
License::
* Add max_resource_units to enterprise license {pull}50735[#50735]
* Add setting to restrict license types {pull}49418[#49418] (issue: {issue}48508[#48508])
* Support "enterprise" license types {pull}49223[#49223] (issue: {issue}48510[#48510])
Machine Learning::
2020-02-10 21:06:01 -05:00
* Add audit warning for 1000 categories found early in job {pull}51146[#51146] (issue: {issue}50749[#50749])
* Add `num_top_feature_importance_values` param to regression and classification {pull}50914[#50914]
* Implement force deleting a data frame analytics job {pull}50553[#50553] (issue: {issue}48124[#48124])
* Delete unused data frame analytics state {pull}50243[#50243]
2020-01-15 14:06:59 -05:00
* Make each analysis report desired field mappings to be copied {pull}50219[#50219] (issue: {issue}50119[#50119])
2020-02-10 21:06:01 -05:00
* Retry bulk indexing of state docs {pull}50149[#50149] (issue: {issue}50143[#50143])
* Persist/restore state for data frame analytics classification {pull}50040[#50040]
* Introduce `randomize_seed` setting for regression and classification {pull}49990[#49990]
2020-01-15 14:06:59 -05:00
* Pass `prediction_field_type` to C++ analytics process {pull}49861[#49861] (issue: {issue}49796[#49796])
2020-02-10 21:06:01 -05:00
* Add optional source filtering during data frame reindexing {pull}49690[#49690] (issue: {issue}49531[#49531])
* Add default categorization analyzer definition to ML info {pull}49545[#49545]
* Add graceful retry for anomaly detector result indexing failures {pull}49508[#49508] (issue: {issue}45711[#45711])
* Lower minimum model memory limit value for data frame analytics jobs from 1MB to 1kB {pull}49227[#49227] (issue: {issue}49168[#49168])
* Improve `model_memory_limit` user experience for data frame analytics jobs {pull}44699[#44699]
* Improve performance of boosted tree training for both classification and regression {ml-pull}775[#775]
* Reduce the peak memory used by boosted tree training and fix an overcounting bug
estimating maximum memory usage {ml-pull}781[#781]
* Stratified fractional cross validation for regression {ml-pull}784[#784]
* Added `geo_point` supported output for `lat_long` function records {ml-pull}809[#809], {pull}47050[#47050]
2020-03-04 09:46:20 -05:00
* Use a random bag of the data to compute the loss function derivatives for each
2020-02-10 21:06:01 -05:00
new tree which is trained for both regression and classification {ml-pull}811[#811]
* Emit `prediction_probability` field alongside prediction field in ml results {ml-pull}818[#818]
* Reduce memory usage of {ml} native processes on Windows {ml-pull}844[#844]
* Reduce runtime of classification and regression {ml-pull}863[#863]
2020-03-04 09:46:20 -05:00
* Stop early training a classification and regression forest when the validation
2020-02-10 21:06:01 -05:00
error is no longer decreasing {ml-pull}875[#875]
2020-03-04 09:46:20 -05:00
* Emit `prediction_field_name` in data frame analytics results using the type
2020-02-10 21:06:01 -05:00
provided as `prediction_field_type` parameter {ml-pull}877[#877]
* Improve performance updating quantile estimates {ml-pull}881[#881]
2020-03-04 09:46:20 -05:00
* Migrate to use Bayesian optimisation for initial hyperparameter value line
2020-02-10 21:06:01 -05:00
searches and stop early if the expected improvement is too small {ml-pull}903[#903]
2020-03-04 09:46:20 -05:00
* Stop cross-validation early if the predicted test loss has a small chance of
2020-02-10 21:06:01 -05:00
being smaller than for the best parameter values found so far {ml-pull}915[#915]
* Optimize decision threshold for classification to maximize minimum class recall {ml-pull}926[#926]
2020-03-04 09:46:20 -05:00
* Include categorization memory usage in the `model_bytes` field in
`model_size_stats`, so that it is taken into account in node assignment
decisions {ml-pull}927[#927] (issue: {ml-issue}724[#724])
2020-01-15 14:06:59 -05:00
Mapping::
* Add telemetry for flattened fields. {pull}48972[#48972]
Network::
* Add certutil http command {pull}49827[#49827]
* Do not load SSLService in plugin contructor {pull}49667[#49667] (issue: {issue}44536[#44536])
* Netty4: switch to composite cumulator {pull}49478[#49478]
* Add the simple strategy to cluster settings {pull}49414[#49414] (issue: {issue}49067[#49067])
* Deprecate misconfigured SSL server config {pull}49280[#49280] (issue: {issue}45892[#45892])
* Improved diagnostics for TLS trust failures {pull}48911[#48911]
Percolator::
* Refactor percolator's QueryAnalyzer to use QueryVisitors {pull}49238[#49238] (issue: {issue}45639[#45639])
Ranking::
* Support `search_type` in Rank Evaluation API {pull}48542[#48542] (issue: {issue}48503[#48503])
Recovery::
* Use peer recovery retention leases for indices without soft-deletes {pull}50351[#50351] (issues: {issue}45136[#45136], {issue}46959[#46959])
* Recovery buffer size 16B smaller {pull}50100[#50100]
Reindex::
* Reindex sort deprecation warning take 2 {pull}49855[#49855] (issue: {issue}49458[#49458])
SQL::
2020-02-07 16:40:54 -05:00
* SQL: Handle uberjar scenario where the ES jdbc driver file is bundled in another jar {pull}51856[#51856] (issue: {issue}50201[#50201])
* SQL: add trace logging for search responses coming from server {pull}50530[#50530]
2020-01-15 14:06:59 -05:00
* SQL: Add TRUNC alias for TRUNCATE {pull}49571[#49571] (issue: {issue}41195[#41195])
* SQL: binary communication implementation for drivers and the CLI {pull}48261[#48261] (issue: {issue}47785[#47785])
2020-02-07 16:40:54 -05:00
* SQL: Verify Full-Text Search functions not allowed in SELECT {pull}51568[#51568] (issue: {issue}47446[#47446])
2020-01-15 14:06:59 -05:00
Search::
* Add Validation for maxQueryTerms to be greater than 0 for MoreLikeThisQuery {pull}49966[#49966] (issue: {issue}49927[#49927])
* Optimize numeric sort on match_all queries {pull}49717[#49717] (issue: {issue}48804[#48804])
* Pre-sort shards based on the max/min value of the primary sort field {pull}49092[#49092] (issue: {issue}49091[#49091])
* Optimize sort on long field {pull}48804[#48804]
* Search optimisation - add canMatch early aborts for queries on "_index" field {pull}48681[#48681] (issue: {issue}48473[#48473])
* #48475 Pure disjunctions should rewrite to a MatchNoneQueryBuilder {pull}48557[#48557]
* Disable caching when queries are profiled {pull}48195[#48195] (issue: {issue}33298[#33298])
* BlendedTermQuery's equals method should consider boosts {pull}48193[#48193] (issue: {issue}48184[#48184])
* Increase the number of vector dims to 2048 {pull}46895[#46895]
Security::
* Make .async-search-* a restricted namespace {pull}50294[#50294]
* Security should not reload files that haven't changed {pull}50207[#50207] (issue: {issue}50063[#50063])
Snapshot/Restore::
* Use Cluster State to Track Repository Generation {pull}49729[#49729] (issue: {issue}49060[#49060])
* Track Repository Gen. in BlobStoreRepository {pull}48944[#48944] (issues: {issue}38941[#38941], {issue}47520[#47520], {issue}47834[#47834], {issue}49048[#49048])
* Restore from Individual Shard Snapshot Files in Parallel {pull}48110[#48110] (issue: {issue}42791[#42791])
* Track Shard-Snapshot Index Generation at Repository Root {pull}46250[#46250] (issues: {issue}38941[#38941], {issue}45736[#45736])
Store::
* mmap dim files in HybridDirectory {pull}49272[#49272] (issue: {issue}48509[#48509])
Transform::
2020-02-10 21:06:01 -05:00
* Improve force stop robustness in case of an error {pull}51072[#51072]
* Add actual timeout in message {pull}50140[#50140]
* Automatic deletion of old checkpoints {pull}49496[#49496]
* Improve error handling of script errors {pull}48887[#48887] (issue: {issue}48467[#48467])
* Add `wait_for_checkpoint` flag to stop {pull}47935[#47935] (issue: {issue}45293[#45293])
2020-01-15 14:06:59 -05:00
[[bug-7.6.0]]
[float]
=== Bug fixes
Aggregations::
2020-02-07 16:40:54 -05:00
* Use #name() instead of #simpleName() when generating doc values {pull}51920[#51920] (issues: {issue}50307[#50307], {issue}51847[#51847])
* Fix a sneaky bug in rare_terms {pull}51868[#51868] (issue: {issue}51020[#51020])
* Support time_zone on composite's date_histogram {pull}51172[#51172] (issues: {issue}45199[#45199], {issue}45200[#45200])
2020-01-15 14:06:59 -05:00
* Fix format problem in composite of unmapped {pull}50869[#50869] (issue: {issue}50600[#50600])
* SingleBucket aggs need to reduce their bucket's pipelines first {pull}50103[#50103] (issue: {issue}50054[#50054])
* Avoid precision loss in DocValueFormat.RAW#parseLong {pull}49063[#49063] (issue: {issue}38692[#38692])
* Fix ignoring missing values in min/max aggregations {pull}48970[#48970] (issue: {issue}48905[#48905])
Allocation::
* Collect shard sizes for closed indices {pull}50645[#50645] (issue: {issue}33888[#33888])
* Auto-expand replicated closed indices {pull}48973[#48973]
* Ignore dangling indices created in newer versions {pull}48652[#48652] (issue: {issue}34264[#34264])
* Handle negative free disk space in deciders {pull}48392[#48392] (issue: {issue}48380[#48380])
Analysis::
2020-02-07 16:40:54 -05:00
* Fix caching for PreConfiguredTokenFilter {pull}50912[#50912] (issue: {issue}50734[#50734])
2020-01-15 14:06:59 -05:00
* Throw Error on deprecated nGram and edgeNGram custom filters {pull}50376[#50376] (issue: {issue}50360[#50360])
* _analyze api does not correctly use normalizers when specified {pull}48866[#48866] (issue: {issue}48650[#48650])
Audit::
* Audit log filter and marker {pull}45456[#45456] (issue: {issue}47251[#47251])
Authentication::
2020-02-07 16:40:54 -05:00
* Preserve ApiKey credentials for async verification {pull}51244[#51244]
2020-01-22 14:04:36 -05:00
* Don't fallback to anonymous for tokens/apikeys {pull}51042[#51042] (issue: {issue}50171[#50171])
2020-01-15 14:06:59 -05:00
* Populate User metadata with OpenIDConnect collections {pull}50521[#50521] (issue: {issue}50250[#50250])
* Always return 401 for not valid tokens {pull}49736[#49736] (issue: {issue}38866[#38866])
* Fix iterate-from-1 bug in smart realm order {pull}49473[#49473]
* Remove unnecessary details logged for OIDC {pull}48746[#48746]
* Add owner flag parameter to the rest spec {pull}48500[#48500] (issue: {issue}48499[#48499])
Authorization::
* Fix memory leak in DLS bitset cache {pull}50635[#50635] (issue: {issue}49261[#49261])
* Validate field permissions when creating a role {pull}50212[#50212] (issues: {issue}46275[#46275], {issue}48108[#48108])
* Validate field permissions when creating a role {pull}48108[#48108] (issue: {issue}46275[#46275])
CCR::
* CCR should auto-retry rejected execution exceptions {pull}49213[#49213]
CRUD::
* Block too many concurrent mapping updates {pull}51038[#51038] (issue: {issue}50670[#50670])
* Ensure meta and document field maps are never null in GetResult {pull}50112[#50112] (issue: {issue}48215[#48215])
* Replicate write actions before fsyncing them {pull}49746[#49746]
* Do not mutate request on scripted upsert {pull}49578[#49578] (issue: {issue}48670[#48670])
* Fix Transport Stopped Exception {pull}48930[#48930] (issue: {issue}42612[#42612])
* Return consistent source in updates {pull}48707[#48707]
* Close query cache on index service creation failure {pull}48230[#48230] (issue: {issue}48186[#48186])
Cluster Coordination::
* Import replicated closed dangling indices {pull}50649[#50649]
* Ignore metadata of deleted indices at start {pull}48918[#48918]
* Make elasticsearch-node tools custom metadata-aware {pull}48390[#48390]
Discovery-Plugins::
* Make EC2 Discovery Cache Empty Seed Hosts List {pull}50607[#50607] (issue: {issue}50550[#50550])
* Make EC2 Discovery Plugin Retry Requests {pull}50550[#50550] (issue: {issue}50462[#50462])
Distributed::
2020-02-07 16:40:54 -05:00
* Exclude nested documents in LuceneChangesSnapshot {pull}51279[#51279]
2020-01-15 14:06:59 -05:00
* Closed shard should never open new engine {pull}47186[#47186] (issues: {issue}45263[#45263], {issue}47060[#47060])
* Fix meta version of task index mapping {pull}50363[#50363] (issue: {issue}48393[#48393])
Engine::
2020-02-07 16:40:54 -05:00
* Do not wrap soft-deletes reader for segment stats {pull}51331[#51331] (issues: {issue}51192[#51192], {issue}51303[#51303])
* Account soft-deletes in FrozenEngine {pull}51192[#51192] (issue: {issue}50775[#50775])
2020-01-15 14:06:59 -05:00
* Account trimAboveSeqNo in committed translog generation {pull}50205[#50205] (issue: {issue}49970[#49970])
* Greedily advance safe commit on new global checkpoint {pull}48559[#48559] (issue: {issue}48532[#48532])
* Do not ignore exception when trim unreferenced readers {pull}48470[#48470]
Features/Features::
* Fix X-Pack SchedulerEngine Shutdown {pull}48951[#48951]
Features/ILM+SLM::
* Fix SLM check for restore in progress {pull}50868[#50868]
* Handle failure to retrieve ILM policy step better {pull}49193[#49193] (issue: {issue}49128[#49128])
* Don't halt policy execution on policy trigger exception {pull}49128[#49128]
* Re-read policy phase JSON when using ILM's move-to-step API {pull}48827[#48827]
* Don't schedule SLM jobs when services have been stopped {pull}48658[#48658] (issue: {issue}47749[#47749])
* Ensure SLM stats does not block an in-place upgrade from 7.4 {pull}48367[#48367]
* Ensure SLM stats does not block an in-place upgrade from 7.4 {pull}48361[#48361]
* Add SLM support to xpack usage and info APIs {pull}48096[#48096] (issue: {issue}43663[#43663])
* Change policy_id to list type in slm.get_lifecycle {pull}47766[#47766] (issue: {issue}47765[#47765])
Features/Ingest::
2020-01-31 11:39:43 -05:00
* Fix ignore_missing in CsvProcessor {pull}51600[#51600]
* Don't overwrite target field with SetSecurityUserProcessor {pull}51454[#51454] (issue: {issue}51428[#51428])
2020-01-15 14:06:59 -05:00
* Fix ingest simulate response document order if processor executes async {pull}50244[#50244]
* Allow list of IPs in geoip ingest processor {pull}49573[#49573] (issue: {issue}46193[#46193])
* Do not wrap ingest processor exception with IAE {pull}48816[#48816] (issue: {issue}48810[#48810])
* Introduce dedicated ingest processor exception {pull}48810[#48810] (issue: {issue}48803[#48803])
Features/Java High Level REST Client::
* Support es7 node http publish_address format {pull}49279[#49279] (issue: {issue}48950[#48950])
* Add slices to delete and update by query in HLRC {pull}48420[#48420]
* fix incorrect comparison {pull}48208[#48208]
* Fix HLRC parsing of CancelTasks response {pull}47017[#47017]
* Prevent deadlock by using separate schedulers {pull}48697[#48697] (issues: {issue}41451[#41451], {issue}47599[#47599])
Features/Java Low Level REST Client::
* Improve warning value extraction performance in Response {pull}50208[#50208] (issue: {issue}24114[#24114])
Features/Monitoring::
* Validate exporter type is HTTP for HTTP exporter {pull}49992[#49992] (issues: {issue}47246[#47246], {issue}47711[#47711], {issue}49942[#49942])
* APM system_user {pull}47668[#47668] (issues: {issue}2708[#2708], {issue}40876[#40876])
Geo::
* Guard against null geoBoundingBox {pull}50506[#50506] (issue: {issue}50505[#50505])
* Geo: Switch generated GeoJson type names to camel case (#50285) {pull}50400[#50400] (issue: {issue}49568[#49568])
* Geo: Switch generated WKT to upper case {pull}50285[#50285] (issue: {issue}49568[#49568])
* Fix typo when assigning null_value in GeoPointFieldMapper {pull}49645[#49645]
* Fix handling of circles in legacy geo_shape queries {pull}49410[#49410] (issue: {issue}49296[#49296])
2020-01-22 14:04:36 -05:00
* GEO: intersects search for geo_shape return wrong result {pull}49017[#49017]
2020-01-15 14:06:59 -05:00
* Geo: improve handling of out of bounds points in linestrings {pull}47939[#47939] (issue: {issue}43916[#43916])
Highlighting::
* Fix invalid break iterator highlighting on keyword field {pull}49566[#49566]
Infra/Core::
2020-01-31 11:39:43 -05:00
* Ignore virtual ethernet devices that disappear {pull}51581[#51581] (issue: {issue}49914[#49914])
2020-01-15 14:06:59 -05:00
* Guess root cause support unwrap {pull}50525[#50525] (issue: {issue}50417[#50417])
* Allow parsing timezone without fully provided time {pull}50178[#50178] (issue: {issue}49351[#49351])
* [Java.time] Retain prefixed date pattern in formatter {pull}48703[#48703] (issue: {issue}48698[#48698])
* Don't drop user's MaxDirectMemorySize flag on jdk8/windows {pull}48657[#48657] (issues: {issue}44174[#44174], {issue}48365[#48365])
* Warn when MaxDirectMemorySize may be incorrect (Windows/JDK8 only issue) {pull}48365[#48365] (issue: {issue}47384[#47384])
* [Java.time] Calculate week of a year with ISO rules {pull}48209[#48209] (issues: {issue}41670[#41670], {issue}42588[#42588], {issue}43275[#43275], {issue}43652[#43652])
Infra/Logging::
* Slow log must use separate underlying logger for each index {pull}47234[#47234] (issue: {issue}42432[#42432])
Infra/Packaging::
* Extend systemd timeout during startup {pull}49784[#49784] (issue: {issue}49593[#49593])
Infra/REST API::
* Return 400 when handling invalid JSON {pull}49552[#49552] (issue: {issue}49428[#49428])
* Slash missed in indices.put_mapping url {pull}49468[#49468]
Machine Learning::
2020-02-10 21:06:01 -05:00
* Fix 2 digit year regex in find_file_structure {pull}51469[#51469]
* Validate classification `dependent_variable` cardinality is at least two {pull}51232[#51232]
2020-01-22 14:04:36 -05:00
* Do not copy mapping from dependent variable to prediction field in regression analysis {pull}51227[#51227]
2020-02-10 21:06:01 -05:00
* Handle nested and aliased fields correctly when copying mapping {pull}50918[#50918] (issue: {issue}50787[#50787])
* Fix off-by-one error in `ml_classic` tokenizer end offset {pull}50655[#50655]
* Improve uniqueness of result document IDs {pull}50644[#50644] (issue: {issue}50613[#50613])
* Fix accuracy metric in multi-class confusion matrix {pull}50310[#50310] (issue: {issue}48759[#48759])
2020-01-15 14:06:59 -05:00
* Fix race condition when stopping a data frame analytics jobs immediately after starting it {pull}50276[#50276] (issues: {issue}49680[#49680], {issue}50177[#50177])
2020-02-10 21:06:01 -05:00
* Apply source query on data frame analytics memory estimation {pull}49517[#49517] (issue: {issue}49454[#49454])
* Fix r_squared eval when variance is 0 {pull}49439[#49439]
* Blacklist a number of prediction field names {pull}49371[#49371] (issue: {issue}48808[#48808])
* Make data frame analytics more robust for very short-lived analyses {pull}49282[#49282] (issue: {issue}49095[#49095])
* Fixes potential memory corruption when determining seasonality {ml-pull}852[#852]
* Prevent `prediction_field_name` clashing with other fields in {ml} results {ml-pull}861[#861]
2020-03-04 09:46:20 -05:00
* Include out-of-order as well as in-order terms in categorization reverse searches {ml-pull}950[#950] (issue: {ml-issue}949[#949])
2020-01-15 14:06:59 -05:00
Mapping::
* Ensure that field collapsing works with field aliases. {pull}50722[#50722] (issues: {issue}32648[#32648], {issue}50121[#50121])
* Improve DateFieldMapper `ignore_malformed` handling {pull}50090[#50090] (issues: {issue}46675[#46675], {issue}50081[#50081])
* Annotated text type should extend TextFieldType {pull}49555[#49555] (issue: {issue}49289[#49289])
* Ensure parameters are updated when merging flattened mappings. {pull}48971[#48971] (issue: {issue}48907[#48907])
2020-01-31 11:39:43 -05:00
Network::
* Fix TransportMasterNodeAction not Retrying NodeClosedException {pull}51325[#51325]
2020-01-15 14:06:59 -05:00
Percolator::
* Correctly handle MSM for nested disjunctions {pull}50669[#50669] (issue: {issue}50305[#50305])
* Fix query analyzer logic for mixed conjunctions of terms and ranges {pull}49803[#49803] (issue: {issue}49684[#49684])
Recovery::
* Check allocation id when failing shard on recovery {pull}50656[#50656] (issue: {issue}50508[#50508])
* Migrate peer recovery from translog to retention lease {pull}49448[#49448] (issue: {issue}45136[#45136])
* Ignore Lucene index in peer recovery if translog corrupted {pull}49114[#49114]
Reindex::
* Reindex and friends fail on RED shards {pull}45830[#45830] (issues: {issue}42612[#42612], {issue}45739[#45739])
SQL::
2020-02-07 16:40:54 -05:00
* SQL: Fix milliseconds handling in intervals {pull}51675[#51675] (issue: {issue}41635[#41635])
* SQL: Fix ORDER BY YEAR() function {pull}51562[#51562] (issue: {issue}51224[#51224])
* SQL: change the way unsupported data types fields are handled {pull}50823[#50823]
2020-01-15 14:06:59 -05:00
* SQL: Optimisation fixes for conjunction merges {pull}50703[#50703] (issue: {issue}49637[#49637])
* SQL: Fix issue with CAST and NULL checking. {pull}50371[#50371] (issue: {issue}50191[#50191])
* SQL: fix NPE for JdbcResultSet.getDate(param, Calendar) calls {pull}50184[#50184] (issue: {issue}50174[#50174])
* SQL: COUNT DISTINCT returns 0 instead of NULL for no matching docs {pull}50037[#50037] (issue: {issue}50013[#50013])
* Fix LOCATE function optional parameter handling {pull}49666[#49666] (issue: {issue}49557[#49557])
* Fix NULL handling for FLOOR and CEIL functions {pull}49644[#49644] (issue: {issue}49556[#49556])
* Handle NULL arithmetic operations with INTERVALs {pull}49633[#49633] (issue: {issue}49297[#49297])
* Fix issue with GROUP BY YEAR() {pull}49559[#49559] (issue: {issue}49386[#49386])
* Fix issue with CASE/IIF pre-calculating results {pull}49553[#49553] (issue: {issue}49388[#49388])
* Fix issue with folding of CASE/IIF {pull}49449[#49449] (issue: {issue}49387[#49387])
* Fix issues with WEEK/ISO_WEEK/DATEDIFF {pull}49405[#49405] (issues: {issue}48209[#48209], {issue}49376[#49376])
* SQL: Fix issue with mins & hours for DATEDIFF {pull}49252[#49252]
* SQL: Failing Group By queries due to different ExpressionIds {pull}43072[#43072] (issues: {issue}33361[#33361], {issue}34543[#34543], {issue}36074[#36074], {issue}37044[#37044], {issue}40001[#40001], {issue}40240[#40240], {issue}41159[#41159], {issue}42041[#42041], {issue}46316[#46316])
Search::
* Fix upgrade of custom similarity {pull}50851[#50851] (issue: {issue}50763[#50763])
* Fix NPE bug inner_hits {pull}50709[#50709] (issue: {issue}50539[#50539])
* Collect results in a local list when notifying partial results {pull}49828[#49828] (issue: {issue}49778[#49778])
* Fixes a bug in interval filter serialization {pull}49793[#49793] (issue: {issue}49519[#49519])
* Correctly handle duplicates in unordered interval matching {pull}49775[#49775]
* Correct rewritting of script_score query {pull}48425[#48425] (issue: {issue}48081[#48081])
* Do not throw errors on unknown types in SearchAfterBuilder {pull}48147[#48147] (issue: {issue}48074[#48074])
Security::
* Always consume the body in has privileges {pull}50298[#50298] (issue: {issue}50288[#50288])
Snapshot/Restore::
2020-01-22 14:04:36 -05:00
* Fix Overly Aggressive Request DeDuplication {pull}51270[#51270] (issue: {issue}51253[#51253])
2020-01-15 14:06:59 -05:00
* Guard Repository#getRepositoryData for exception throw {pull}50970[#50970]
* Fix Index Deletion During Partial Snapshot Create {pull}50234[#50234] (issues: {issue}50200[#50200], {issue}50202[#50202])
* Fix Index Deletion during Snapshot Finalization {pull}50202[#50202] (issues: {issue}45689[#45689], {issue}50200[#50200])
* Fix RepoCleanup not Removed on Master-Failover {pull}49217[#49217]
* Make FsBlobContainer Listing Resilient to Concurrent Modifications {pull}49142[#49142] (issue: {issue}37581[#37581])
* Fix SnapshotShardStatus Reporting for Failed Shard {pull}48556[#48556] (issue: {issue}48526[#48526])
* Cleanup Concurrent RepositoryData Loading {pull}48329[#48329] (issue: {issue}48122[#48122])
Transform::
2020-02-10 21:06:01 -05:00
* Fix mapping deduction for scaled_float {pull}51990[#51990] (issue: {issue}51780[#51780])
* Fix stats can return old state information if security is enabled {pull}51732[#51732] (issue: {issue}51728[#51728])
* Fail to start/put on missing pipeline {pull}50701[#50701] (issue: {issue}50135[#50135])
2020-01-15 14:06:59 -05:00
* Fix possible audit logging disappearance after rolling upgrade {pull}49731[#49731] (issue: {issue}49730[#49730])
2020-02-10 21:06:01 -05:00
* Do not fail checkpoint creation due to global checkpoint mismatch {pull}48423[#48423] (issue: {issue}48379[#48379])
2020-01-15 14:06:59 -05:00
[[upgrade-7.6.0]]
[float]
=== Upgrades
Engine::
* Upgrade to Lucene 8.4.0. {pull}50518[#50518]
2020-01-31 11:39:43 -05:00
Infra/Packaging::
* Upgrade the bundled JDK to JDK 13.0.2 {pull}51511[#51511]
