Commit Graph

14052 Commits

Author SHA1 Message Date
Zoltan Haindrich e7e119b559 reduce copypaste 2024-05-16 13:33:27 +00:00
Zoltan Haindrich fc9a6c7740 move/etc 2024-05-16 13:23:45 +00:00
Zoltan Haindrich cabf2a31c3 fix 2024-05-16 13:19:30 +00:00
Zoltan Haindrich 1d2a79f5be cleanup 2024-05-16 13:01:53 +00:00
Zoltan Haindrich 1fb9fac159 remove cl 2024-05-16 12:59:20 +00:00
Zoltan Haindrich 76ffbfb7cf cl 2024-05-16 12:50:38 +00:00
Zoltan Haindrich e2986ae612 cleanup 2024-05-16 12:49:10 +00:00
Zoltan Haindrich f4c73e1499 make old defaults to overides 2024-05-16 11:31:28 +00:00
Zoltan Haindrich 59be71c068 add other 2024-05-16 11:23:26 +00:00
Zoltan Haindrich 607ef174c5 indent 2024-05-16 11:18:54 +00:00
Zoltan Haindrich 3658ab24c3 remove f 2024-05-16 11:18:24 +00:00
Zoltan Haindrich bec1f38a0e move sqlmodule down 2024-05-16 11:17:05 +00:00
Zoltan Haindrich 688611eab3 undo 2024-05-16 11:11:55 +00:00
Zoltan Haindrich 93892b6524 undo some 2024-05-16 11:11:03 +00:00
Zoltan Haindrich b63a80e5b7 passes basic test 2024-05-16 11:01:39 +00:00
Zoltan Haindrich 118eb61939 there - with 1 boot 2024-05-16 10:31:38 +00:00
Zoltan Haindrich 28ea884e19 almost ready? 2024-05-16 10:01:22 +00:00
Zoltan Haindrich 27735f2621 move disco 2024-05-16 09:50:10 +00:00
Zoltan Haindrich cab3d945be up 2024-05-16 09:48:18 +00:00
Zoltan Haindrich c9638b7836 update 2024-05-16 09:44:16 +00:00
Zoltan Haindrich 7e10df1ffa ... 2024-05-16 09:33:51 +00:00
Zoltan Haindrich 4a47b0229e no roles 2024-05-16 09:31:21 +00:00
Zoltan Haindrich 5f552a2997 c 2024-05-16 09:30:41 +00:00
Zoltan Haindrich 074161dfde add some service crap 2024-05-16 05:53:42 +00:00
Zoltan Haindrich 55b2051f9d workinhg stuff 2024-05-15 16:23:11 +00:00
Zoltan Haindrich 8ee41f58d0 it does work 2024-05-15 15:14:43 +00:00
Zoltan Haindrich d4b052a579 stuff 2024-05-15 11:57:13 +00:00
Zoltan Haindrich 73011267af triaks 2024-05-15 10:34:48 +00:00
Zoltan Haindrich a16f982699 remove crap 2024-05-14 16:04:19 +00:00
Zoltan Haindrich 43fd8af63c Revert "add"
This reverts commit 3fbb3cb853.
2024-05-14 09:39:04 +00:00
Zoltan Haindrich 3fbb3cb853 add 2024-05-14 09:39:02 +00:00
Zoltan Haindrich b7b73fa7fe fix context key order 2024-05-14 08:54:53 +00:00
Zoltan Haindrich 9578953678 Merge remote-tracking branch 'apache/master' into quidem-runner-extension-submit 2024-05-14 07:36:48 +00:00
Zoltan Haindrich 3132c12781 remove unnecessary \\ 2024-05-14 07:36:07 +00:00
Adarsh Sanjeev 18a4722d11
Resolve a bug where datasketches would not downsample sketches sufficiently (#16119)
* Fix sketch memory issue

* Rename function

* Add unit test

* Revert downsampling change
2024-05-14 10:23:57 +05:30
Sree Charan Manamala b8dd7478d0
Custom Calcite Rule to remove redundant references (#16402)
Custom calcite rule mimicking AggregateProjectMergeRule to extend support to expressions.
The current calcite rule return null in such cases.
In addition, this removes the redundant references.
2024-05-14 06:38:05 +02:00
Vadim Ogievetsky 760e449875
Web console: Fix order-by-delta in explore view table (#16417)
* change to using measure name

* Implment order by delta

* less paring, stricter types

* safeDivide0

* fix no query

* new DTQ alows parsing JSON_VALUE(...RETURNING...)
2024-05-13 19:03:46 -07:00
Akshat Jain d1100a6f63
Add retries for building S3 client (#16438)
* Add retries for building S3 client

* Use S3Utils instead of RetryUtils

* Add test
2024-05-13 16:32:06 -07:00
Zoltan Haindrich e36c46a85a fix import
style fixes

clenaup
2024-05-13 15:52:03 +00:00
Laksh Singla 4bfc186153
Support sorting on complex columns in MSQ (#16322)
MSQ sorts the columns in a highly specialized manner by byte comparisons. As such the values are serialized differently. This works well for the primitive types and primitive arrays, however complex types cannot be serialized specially.

This PR adds the support for sorting the complex columns by deserializing the value from the field and comparing it via the type strategy. This is a lot slower than the byte comparisons, however, it's the only way to support sorting on complex columns that can have arbitrary serialization not optimized for MSQ.

The primitives and the arrays are still compared via the byte comparison, therefore this doesn't affect the performance of the queries supported before the patch. If there's a sorting key with mixed complex and primitive/primitive array types, for example: longCol1 ASC, longCol2 ASC, complexCol1 DESC, complexCol2 DESC, stringCol1 DESC, longCol3 DESC, longCol4 ASC, the comparison will happen like:

    longCol1, longCol2 (ASC) - Compared together via byte-comparison, since both are byte comparable and need to be sorted in ascending order
    complexCol1 (DESC) - Compared via deserialization, cannot be clubbed with any other field
    complexCol2 (DESC) - Compared via deserialization, cannot be clubbed with any other field, even though the prior field was a complex column with the same order
    stringCol1, longCol3 (DESC) - Compared together via byte-comparison, since both are byte comparable and need to be sorted in descending order
    longCol4 (ASC) - Compared via byte-comparison, couldn't be coalesced with the previous fields as the direction was different

This way, we only deserialize the field wherever required
2024-05-13 15:07:05 +05:30
Akshat Jain bacdb4c48d
Update integration tests related documentation for better clarity (#16313) 2024-05-13 11:27:21 +05:30
Sensor 1601a0f8f8
add ignore path (#16429) 2024-05-11 17:54:52 +08:00
aho135 9459722ebf
Use canonical hostname instead of ip by default (#16386)
Co-authored-by: Andrew Ho <a.ho@salesforce.com>
2024-05-11 17:53:22 +08:00
Alberic Liu 811dcd1726
update protobuf.md (#16434) 2024-05-11 17:52:54 +08:00
Zoltan Haindrich e13d560b6e Enable quidem shadowing for decoupled testcases
* Altered `QueryTestBuilder` to be able to switch to a backing quidem test
* added a small crc to ensure that the shadow testcase does not deviate from the original one
* Packaged all decoupled related things into a a single `DecoupledExtension` to reduce copy-paste
* `DecoupledTestConfig#quidemReason` must describe why its being used
* `DecoupledTestConfig#separateDefaultModeTest` can be used to make multiple case files based on `NullHandling` state
* fixed a cosmetic bug during decoupled join translation
* enhanced `!druidPlan` to report the final logical plan in non-decoupled mode as well
* add check to ensure that only supported params are present in a druidtest uri
* enabled shadow testcases for previously disabled testcases
2024-05-10 13:38:54 +00:00
Benedict Jin cb7c2c1e37
Downgrade the version of Apache Curator from 5.5.0 to 5.3.0 to avoid a bug in the new version (#16425) 2024-05-10 15:08:33 +05:30
Kashif Faraz 3b84751233
Remove unused task action SegmentLockReleaseAction (#16422)
Changes:
- Remove `SegmentLockReleaseAction` as it is not used anywhere.
It is not even registered as a known sub-type of `TaskAction`.
- Minor refactor in `TaskLockbox`. No functional change.
- Remove `ExpectedException` from `TaskLockboxTest`
2024-05-10 06:38:29 +05:30
Igor Berman d0f3fdab37
Allow using different lock types for kill task, remove markAsUnused parameter (#16362)
Changes:
- Remove deprecated `markAsUnused` parameter from `KillUnusedSegmentsTask`
- Allow `kill` task to use `REPLACE` lock when `useConcurrentLocks` is true
- Use `EXCLUSIVE` lock by default
2024-05-10 06:37:36 +05:30
Charles Smith 2d0b4e5f1e
Update sidebar to organize tutorials + other minor improvements (#16184)
Co-authored-by: 317brian <53799971+317brian@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
2024-05-09 08:57:43 -07:00
Adarsh Sanjeev 30f3cf5017
Add more info in MSQ export log message (#16363) 2024-05-09 13:02:19 +05:30