Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
14,473 Commits 115 Branches 507 Tags 746 MiB
Commit Graph

14473 Commits

Author SHA1 Message Date
Zoltan Haindrich 5bc32d5678 explore failure 2024-08-06 20:04:58 +00:00
Zoltan Haindrich 8a92ec6b2e Merge remote-tracking branch 'apache/master' into quidem-msq 2024-08-06 18:46:39 +00:00
Edgar Melendrez ebea34a814
[Docs] Batch06: starting string functions (#16838) 
* batch06, starting string functions

* addind space after Syntax

* quick change

* correcting spelling

* Update docs/querying/sql-functions.md

* Update sql-functions.md

* applying suggestions

* Update docs/querying/sql-functions.md

* Update docs/querying/sql-functions.md

---------

Co-authored-by: Benedict Jin <asdf2014@apache.org>
Co-authored-by: Charles Smith <techdocsmith@gmail.com>
 2024-08-06 11:32:26 -07:00
Adarsh Sanjeev 739068469c
General Druid refactors (#16708) 
Some general refactors across Druid.

    Switch to DruidExceptions
    Add javadocs
    Fix a bug in IntArrayColumns
    Add a class for LongArrayColumns
    Remove wireTransferable since it would never be called
    Refactor DictionaryWriter to return the index written as a return value from write.
 2024-08-06 11:47:08 -05:00
Zoltan Haindrich dbe2674971 remove/cleanup/etc 2024-08-06 16:45:43 +00:00
Zoltan Haindrich 23c6f3bd96 use other authmapper 2024-08-06 16:33:16 +00:00
Adarsh Sanjeev 2b81c18fd7
Refactor SemanticCreator (#16700) 
Refactors the SemanticCreator annotation.

    Moves the interface to the semantic package.
    Create a SemanticUtils to hold logic for storing semantic maps.
    Add FrameMaker interface.
 2024-08-06 11:29:38 -05:00
Zoltan Haindrich 7740832995 undo 2024-08-06 16:14:44 +00:00
Zoltan Haindrich 3e2b59f808 Revert "shared tries" 
This reverts commit 34651e70e5.
 2024-08-06 16:14:16 +00:00
Zoltan Haindrich 34651e70e5 shared tries 2024-08-06 16:14:12 +00:00
Zoltan Haindrich 449a7f3a73 move stuff 2024-08-06 16:13:56 +00:00
Zoltan Haindrich 69a39a42da Revert "connection supplies properties approach" 
This reverts commit 2700557a55.
 2024-08-06 15:28:58 +00:00
Zoltan Haindrich 2700557a55 connection supplies properties approach 2024-08-06 15:28:56 +00:00
Zoltan Haindrich 42cc5d62a8 apidoc 2024-08-06 15:28:36 +00:00
Vishesh Garg 593c3b2150
Do not support non-idempotent aggregator in MSQ compaction (#16846) 
This PR adds checks for verification of DataSourceCompactionConfig and CompactionTask with msq engine to ensure:

each aggregator in metricsSpec is idempotent
metricsSpec is non-null when rollup is set to true
Unit tests and existing compaction ITs have been updated accordingly.
 2024-08-06 20:58:08 +05:30
Zoltan Haindrich d5b82af4a9 cleanup 2024-08-06 14:38:30 +00:00
Zoltan Haindrich 21016a28a2 remove ifs 2024-08-06 14:21:28 +00:00
Zoltan Haindrich 3f507d8648 ignore duplicate queries 2024-08-06 14:20:42 +00:00
Zoltan Haindrich 19fe5867b1 fix one fixme 2024-08-06 14:13:50 +00:00
Kashif Faraz aa49be61ea
Do not create ZK paths if not needed (#16816) 
Background:
ZK-based segment loading has been completely disabled in #15705 .
ZK `servedSegmentsPath` has been deprecated since Druid 0.7.1, #1182 .
This legacy path has been replaced by the `liveSegmentsPath` and is not used in the code anymore.

Changes:
- Never create ZK loadQueuePath as it is never used.
- Never create ZK servedSegmentsPath as it is never used.
- Do not create ZK liveSegmentsPath if announcement on ZK is disabled
- Fix up tests
 2024-08-06 19:29:13 +05:30
Zoltan Haindrich 941c39aae5 it does work 2024-08-06 13:59:13 +00:00
Zoltan Haindrich 00ee182d75 add fixme/etc 2024-08-06 13:55:23 +00:00
Gian Merlino de40d81b29
SQL: Add ProjectableFilterableTable to SegmentsTable. (#16841) 
* SQL: Add ProjectableFilterableTable to SegmentsTable.

This allows us to skip serialization of expensive fields such as
shard_spec, dimensions, metrics, and last_compaction_state, if those
fields are not actually being queried.

* Restructure logic to avoid unnecessary toString() as well.
 2024-08-06 06:40:21 -07:00
Zoltan Haindrich 91d5d14bf1 remove builtintypes 2024-08-06 11:44:02 +00:00
Zoltan Haindrich 29b2b559d9 Merge remote-tracking branch 'apache/master' into quidem-msq 2024-08-06 11:42:04 +00:00
Zoltan Haindrich 6d38e8f075 clenaup 2024-08-06 11:41:54 +00:00
Akshat Jain c3aa033e14
MSQ window functions: Fix query correctness issues when using multiple workers (#16804) 
This PR fixes query correctness issues for MSQ window functions when using more than 1 worker (that is, maxNumTasks > 2).

Currently, we were keeping the shuffle spec of the previous stage when we didn't have any partition columns for window stage. This PR changes it to override the shuffle spec of the previous stage to MixShuffleSpec (if we have a window function with empty over clause) so that the window stage gets a single partition to work on.

A test has been added for a query which returned incorrect results prior to this change when using more than 1 workers.
 2024-08-06 16:11:18 +05:30
Zoltan Haindrich f867db774a fix pom 2024-08-06 10:31:32 +00:00
Zoltan Haindrich 61c3b16b17 checkstyle 2024-08-06 09:44:27 +00:00
Zoltan Haindrich 130252bb5e fix; move class 2024-08-06 09:20:13 +00:00
Zoltan Haindrich 3b77784e6e add test 2024-08-06 08:13:25 +00:00
Sree Charan Manamala ed6b547481
Handle default bounds correctly in WINDOW clause (#16833) 
When a window is defined as WINDOW W AS <DEF> and using a syntax of (PARTITION BY col1 ORDER BY col2 ROWS x PRECEDING), we would need to default the other bound to CURRENT ROW

We already have implemented this earlier, but when defined as WINDOW W AS <DEF>, Calcite takes a different route to validate the window.
 2024-08-06 09:58:44 +02:00
Zoltan Haindrich 22d8a4b872 add compositemodule 2024-08-06 07:37:24 +00:00
Zoltan Haindrich 34ab911399 fix intellij errors 2024-08-06 07:25:42 +00:00
Zoltan Haindrich 5e5c94d6d8 cleanup 2024-08-06 07:23:08 +00:00
Zoltan Haindrich 93457c6b3e cleanup 2024-08-06 05:50:39 +00:00
Zoltan Haindrich 12cfde805e update 2024-08-06 05:50:11 +00:00
Vadim Ogievetsky aeace28ccb
Web console: Add columnMapping information to the Explain dialog (#16598) 
* Add columnMapping information in the Explain dialog

* use arrow char
 2024-08-05 13:21:51 -07:00
Alberic Liu 461727de12
Fix Druid Console cannot open submit supervisor dialog (#16736) 2024-08-05 10:44:11 -07:00
Zoltan Haindrich c8f9147810 minor fixes 2024-08-05 14:23:54 +00:00
Zoltan Haindrich 6d339d1706 rename class 2024-08-05 14:21:25 +00:00
Zoltan Haindrich 181458c873 mask more 2024-08-05 14:19:52 +00:00
Zoltan Haindrich 4c722f271f Revert "this doesnt work" 
This reverts commit 1063948749.
 2024-08-05 14:15:06 +00:00
Zoltan Haindrich 1063948749 this doesnt work 2024-08-05 14:15:02 +00:00
Zoltan Haindrich c40474285c updates 2024-08-05 13:49:08 +00:00
Zoltan Haindrich f4af51ef7f extend/cleanup/etc 2024-08-05 13:41:53 +00:00
Zoltan Haindrich bc70443c7f update few more 2024-08-05 13:20:13 +00:00
Zoltan Haindrich 841ab462dd Merge branch 'quidem-record' into quidem-msq 2024-08-05 13:00:59 +00:00
Zoltan Haindrich fda0d63e44 Merge remote-tracking branch 'apache/master' into quidem-record 2024-08-05 13:00:50 +00:00
Zoltan Haindrich 929e68c11a undo unrelated 2024-08-05 12:59:50 +00:00