Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/extensions-core
History
Gian Merlino 8211379de6
MSQ: Change default clusterStatisticsMergeMode to SEQUENTIAL. (#14310) 
* MSQ: Change default clusterStatisticsMergeMode to SEQUENTIAL.

This is an undocumented parameter that controls how cluster-by statistics
are merged. In PARALLEL mode, statistics are gathered from workers all
at once. In SEQUENTIAL mode, statistics are gathered time chunk by time
chunk. This improves accuracy for jobs with many time chunks, and reduces
memory usage.

The main downside of SEQUENTIAL is that it can take longer, but in most
situations I've seen, PARALLEL is only really usable in cases where the
sketches are small enough that SEQUENTIAL would also run relatively
quickly. So it seems like SEQUENTIAL is a better default.

* Switch off-test from SEQUENTIAL to PARALLEL.

* Fix sequential merge for situations where there are no time chunks at all.

* Add a couple more tests.
 		2023-06-26 10:54:28 -07:00
..
avro-extensions Upgrade Avro to latest version (#14440) 2023-06-24 14:51:30 +05:30
azure-extensions Account for data format and compression in MSQ auto taskAssignment (#14307) 2023-06-01 12:53:49 -07:00
datasketches SQL OperatorConversions: Introduce.aggregatorBuilder, allow CAST-as-literal. (#14249) 2023-06-23 16:25:04 -07:00
druid-aws-rds-extensions Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
druid-basic-security Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
druid-bloom-filter Fix `EARLIEST_BY`/`LATEST_BY` signature and include function name in signature. (#14352) 2023-06-06 09:41:05 -07:00
druid-catalog Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
druid-kerberos Update Hadoop3 as default build version (#14005) 2023-04-26 12:52:51 +05:30
druid-pac4j Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
druid-ranger-security Update Hadoop3 as default build version (#14005) 2023-04-26 12:52:51 +05:30
ec2-extensions Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
google-extensions return task status reported by peon (#14040) 2023-04-24 12:05:39 -07:00
hdfs-storage fix hdfs initialization issue (#14276) 2023-05-30 12:41:54 -07:00
histogram Fix `EARLIEST_BY`/`LATEST_BY` signature and include function name in signature. (#14352) 2023-06-06 09:41:05 -07:00
kafka-extraction-namespace Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
kafka-indexing-service fix kafka input format reader schema discovery and partial schema discovery (#14421) 2023-06-15 00:11:04 -07:00
kinesis-indexing-service Do not retry INSERT task into metadata if max_allowed_packet limit is violated (#14271) 2023-06-10 12:15:44 +05:30
kubernetes-extensions Make LoggingEmitter more useful by using Markers (#14121) 2023-04-27 15:06:06 -07:00
lookups-cached-global Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
lookups-cached-single Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
multi-stage-query MSQ: Change default clusterStatisticsMergeMode to SEQUENTIAL. (#14310) 2023-06-26 10:54:28 -07:00
mysql-metadata-storage Do not retry INSERT task into metadata if max_allowed_packet limit is violated (#14271) 2023-06-10 12:15:44 +05:30
orc-extensions Account for data format and compression in MSQ auto taskAssignment (#14307) 2023-06-01 12:53:49 -07:00
parquet-extensions Upgrade parquet-mr version (#14070) 2023-06-07 08:54:54 -07:00
postgresql-metadata-storage Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
protobuf-extensions Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
s3-extensions S3: Attach SSE key to doesObjectExist calls. (#14290) 2023-06-23 15:23:59 -07:00
simple-client-sslcontext Bump up the version in pom to 27.0.0 in preparation of release (#14051) 2023-04-10 14:56:59 +05:30
stats Add `TYPE_NAME` to the complex serde classes and replace the hardcoded names. (#14317) 2023-05-23 00:54:47 -05:00
testing-tools SQL OperatorConversions: Introduce.aggregatorBuilder, allow CAST-as-literal. (#14249) 2023-06-23 16:25:04 -07:00