Commit Graph

14214 Commits

Author SHA1 Message Date
Zoltan Haindrich 652cc20597 use lower_camel for config names 2024-05-17 07:00:57 +00:00
George Shiqi Wu ed9881df88
Cleanup logic from handoff API (#16457)
* Cleanup logic from handoff API

* Fix test

* Fix checkstyle

* Update docs
2024-05-16 08:42:44 -07:00
Zoltan Haindrich 94f93865e8 Merge remote-tracking branch 'apache/master' into quidem-runner-extension-submit 2024-05-16 14:22:03 +00:00
Zoltan Haindrich e7e119b559 reduce copypaste 2024-05-16 13:33:27 +00:00
Zoltan Haindrich fc9a6c7740 move/etc 2024-05-16 13:23:45 +00:00
Zoltan Haindrich cabf2a31c3 fix 2024-05-16 13:19:30 +00:00
Zoltan Haindrich 1d2a79f5be cleanup 2024-05-16 13:01:53 +00:00
Zoltan Haindrich 1fb9fac159 remove cl 2024-05-16 12:59:20 +00:00
Zoltan Haindrich 76ffbfb7cf cl 2024-05-16 12:50:38 +00:00
Zoltan Haindrich e2986ae612 cleanup 2024-05-16 12:49:10 +00:00
Zoltan Haindrich f4c73e1499 make old defaults to overides 2024-05-16 11:31:28 +00:00
Zoltan Haindrich 59be71c068 add other 2024-05-16 11:23:26 +00:00
Zoltan Haindrich 607ef174c5 indent 2024-05-16 11:18:54 +00:00
Zoltan Haindrich 3658ab24c3 remove f 2024-05-16 11:18:24 +00:00
Zoltan Haindrich bec1f38a0e move sqlmodule down 2024-05-16 11:17:05 +00:00
Zoltan Haindrich 688611eab3 undo 2024-05-16 11:11:55 +00:00
Zoltan Haindrich 93892b6524 undo some 2024-05-16 11:11:03 +00:00
Zoltan Haindrich b63a80e5b7 passes basic test 2024-05-16 11:01:39 +00:00
Zoltan Haindrich 118eb61939 there - with 1 boot 2024-05-16 10:31:38 +00:00
Zoltan Haindrich 28ea884e19 almost ready? 2024-05-16 10:01:22 +00:00
Zoltan Haindrich 27735f2621 move disco 2024-05-16 09:50:10 +00:00
Zoltan Haindrich cab3d945be up 2024-05-16 09:48:18 +00:00
Zoltan Haindrich c9638b7836 update 2024-05-16 09:44:16 +00:00
Zoltan Haindrich 7e10df1ffa ... 2024-05-16 09:33:51 +00:00
Zoltan Haindrich 4a47b0229e no roles 2024-05-16 09:31:21 +00:00
Zoltan Haindrich 5f552a2997 c 2024-05-16 09:30:41 +00:00
Zoltan Haindrich 074161dfde add some service crap 2024-05-16 05:53:42 +00:00
Vadim Ogievetsky 435b58f101
Web console: fix Druid doctor check to accept Java 17 (#16250)
* fix Druid doctor check

* fix doc link

* Update web-console/src/dialogs/doctor-dialog/doctor-checks.tsx

Co-authored-by: Abhishek Radhakrishnan <abhishek.rb19@gmail.com>

---------

Co-authored-by: Abhishek Radhakrishnan <abhishek.rb19@gmail.com>
2024-05-15 20:37:15 -07:00
Zoltan Haindrich 55b2051f9d workinhg stuff 2024-05-15 16:23:11 +00:00
Zoltan Haindrich 8ee41f58d0 it does work 2024-05-15 15:14:43 +00:00
Zoltan Haindrich d4b052a579 stuff 2024-05-15 11:57:13 +00:00
Zoltan Haindrich 73011267af triaks 2024-05-15 10:34:48 +00:00
Gian Merlino 0fb09445a5
Fix ExpressionPredicateIndexSupplier numeric replace-with-default behavior. (#16448)
* Fix ExpressionPredicateIndexSupplier numeric replace-with-default behavior.

In replace-with-default mode, null numeric values from the index should be
interpreted as zeroes by expressions. This makes the index supplier more
consistent with the behavior of the selectors created by the expression
virtual column.

* Fix test case.
2024-05-15 15:11:47 +05:30
Vadim Ogievetsky c419ae5f73
use objectGlob (#16452)
Catching up to a change introduced in #13027
2024-05-15 15:11:11 +05:30
Akshat Jain ddfd62d9a9
Disable loading lookups by default in CompactionTask (#16420)
This PR updates CompactionTask to not load any lookups by default, unless transformSpec is present.

If transformSpec is present, we will make the decision based on context values, loading all lookups by default. This is done to ensure backward compatibility since transformSpec can reference lookups.
If transform spec is not present and no context value is passed, we donot load any lookup.

This behavior can be overridden by supplying lookupLoadingMode and lookupsToLoad in the task context.
2024-05-15 11:39:23 +05:30
kaisun2000 91cd07d892
Add logging to reveal reason to persist the hydrants (#16409) 2024-05-15 08:39:29 +05:30
Zoltan Haindrich a16f982699 remove crap 2024-05-14 16:04:19 +00:00
Codegass 621525a5cb
Refactor: Clean up `DecimalParquetInputTest` using Assume (#16436) 2024-05-14 21:13:07 +05:30
Gian Merlino 72432c2e78
Speed up SQL IN using SCALAR_IN_ARRAY. (#16388)
* Speed up SQL IN using SCALAR_IN_ARRAY.

Main changes:

1) DruidSqlValidator now includes a rewrite of IN to SCALAR_IN_ARRAY, when the size of
   the IN is above inFunctionThreshold. The default value of inFunctionThreshold
   is 100. Users can restore the prior behavior by setting it to Integer.MAX_VALUE.

2) SearchOperatorConversion now generates SCALAR_IN_ARRAY when converting to a regular
   expression, when the size of the SEARCH is above inFunctionExprThreshold. The default
   value of inFunctionExprThreshold is 2. Users can restore the prior behavior by setting
   it to Integer.MAX_VALUE.

3) ReverseLookupRule generates SCALAR_IN_ARRAY if the set of reverse-looked-up values is
   greater than inFunctionThreshold.

* Revert test.

* Additional coverage.

* Update docs/querying/sql-query-context.md

Co-authored-by: Benedict Jin <asdf2014@apache.org>

* New test.

---------

Co-authored-by: Benedict Jin <asdf2014@apache.org>
2024-05-14 08:09:27 -07:00
George Shiqi Wu c1bf4fed90
API for stopping streaming tasks early (#16310)
* Try stopping task early

* Fix checkstyle

* Add unit test

* Add a couple more tests

* PR changes

* Use notice

* fix checkstyle

* PR changes

* Update indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java

Co-authored-by: Suneet Saldanha <suneet@apache.org>

* Update indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/supervisor/SeekableStreamSupervisor.java

Co-authored-by: Suneet Saldanha <suneet@apache.org>

* Change payload

* Remove quotes

---------

Co-authored-by: Suneet Saldanha <suneet@apache.org>
2024-05-14 06:39:50 -07:00
Zoltan Haindrich 43fd8af63c Revert "add"
This reverts commit 3fbb3cb853.
2024-05-14 09:39:04 +00:00
Zoltan Haindrich 3fbb3cb853 add 2024-05-14 09:39:02 +00:00
Gian Merlino cdf78ecccd
Fix IndexSpec in SqlBenchmark to use stringEncodingStrategy (#16336) 2024-05-14 14:59:15 +05:30
Zoltan Haindrich b7b73fa7fe fix context key order 2024-05-14 08:54:53 +00:00
Zoltan Haindrich 9578953678 Merge remote-tracking branch 'apache/master' into quidem-runner-extension-submit 2024-05-14 07:36:48 +00:00
Zoltan Haindrich 3132c12781 remove unnecessary \\ 2024-05-14 07:36:07 +00:00
Adarsh Sanjeev 18a4722d11
Resolve a bug where datasketches would not downsample sketches sufficiently (#16119)
* Fix sketch memory issue

* Rename function

* Add unit test

* Revert downsampling change
2024-05-14 10:23:57 +05:30
Sree Charan Manamala b8dd7478d0
Custom Calcite Rule to remove redundant references (#16402)
Custom calcite rule mimicking AggregateProjectMergeRule to extend support to expressions.
The current calcite rule return null in such cases.
In addition, this removes the redundant references.
2024-05-14 06:38:05 +02:00
Vadim Ogievetsky 760e449875
Web console: Fix order-by-delta in explore view table (#16417)
* change to using measure name

* Implment order by delta

* less paring, stricter types

* safeDivide0

* fix no query

* new DTQ alows parsing JSON_VALUE(...RETURNING...)
2024-05-13 19:03:46 -07:00
Akshat Jain d1100a6f63
Add retries for building S3 client (#16438)
* Add retries for building S3 client

* Use S3Utils instead of RetryUtils

* Add test
2024-05-13 16:32:06 -07:00