Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
14,799 Commits 114 Branches 506 Tags 741 MiB
Commit Graph

14799 Commits

Author SHA1 Message Date
Zoltan Haindrich 4e84219724 removals 2024-12-07 16:56:24 +00:00
Zoltan Haindrich 8f286b376e a 2024-12-07 16:51:07 +00:00
Zoltan Haindrich a830e97c90 uipdate 2024-12-07 16:50:18 +00:00
Zoltan Haindrich fa96b15f05 fix? 2024-12-07 16:37:18 +00:00
Zoltan Haindrich 48032cec43 fixup 2024-12-07 16:35:47 +00:00
Zoltan Haindrich 034aeedaad some progress 2024-12-07 16:30:22 +00:00
Zoltan Haindrich adfdbde922 Revert "try to fix unnest outputColumn" 
This reverts commit e195135452.
 2024-12-07 15:59:13 +00:00
Zoltan Haindrich e195135452 try to fix unnest outputColumn 2024-12-07 15:59:10 +00:00
Akshat Jain b114807560
Fix cron job ITs by using jdk17 as the runtime_jdk (#17544) 
This PR changes runtime_jdk to 17 from 21.0.4 to fix the cron job ITs.
 2024-12-06 14:36:27 -08:00
zachjsh 3b6a3ae222
Add taskStatus dimension to service/heartbeat metric (#17488) 
* SQL syntax error should target USER persona

* * revert change to queryHandler and related tests, based on review comments

* * add test

* * add taskStatus dimension to `service/heartbeat` metric

* * address review comments

* * fix compilation error from merge

* * improve test coverage

* Address review comments

* * remove unuused import

* * address remaining comments
 2024-12-06 17:18:59 -05:00
George Shiqi Wu 7736228f37
Separate stop/start logic for LeaderLatch (#17546) 2024-12-06 16:01:28 -05:00
Virushade f61ec0af85
Reduce occurrences of failed IT builds (#17543) 
Reduce occurrences of failed IT builds: break up the setup command and add a few retries to improve resiliency.
 2024-12-06 09:57:38 -08:00
Abhishek Radhakrishnan 3a2220c68d
Refactor: Move some classes from `sql` to `processing` & `server` for reusability (#17542) 
This PR contains non-functional / refactoring changes of the following classes in the sql module:

1. Move ExplainPlan and ExplainAttributes fromsql/src/main/java/org/apache/druid/sql/http to processing/src/main/java/org/apache/druid/query/explain
2. Move sql/src/main/java/org/apache/druid/sql/SqlTaskStatus.java -> processing/src/main/java/org/apache/druid/query/http/SqlTaskStatus.java
3. Add a new class processing/src/main/java/org/apache/druid/query/http/ClientSqlQuery.java that is effectively a thin POJO version of SqlQuery in the sql module but without any of the Calcite functionality and business logic.
4. Move BrokerClient, BrokerClientImpl and Broker classes from sql/src/main/java/org/apache/druid/sql/client to server/src/main/java/org/apache/druid/client/broker.
5. Remove BrokerServiceModule that provided the BrokerClient. The functionality is now contained in ServiceClientModule in the server package itself which provides all the clients as well.

This is done so that we can reuse the said classes in #17353 without brining in Calcite and other dependencies to the Overlord.
 2024-12-06 09:32:03 -08:00
TessaIO 93c123a482
docs: fix cached lookup module documentation (#17527) 
* docs: fix loading lookup documentation

Signed-off-by: TessaIO <ahmedgrati1999@gmail.com>

* docs: fix indentation and punctuation

Signed-off-by: TessaIO <ahmedgrati1999@gmail.com>

---------

Signed-off-by: TessaIO <ahmedgrati1999@gmail.com>
 2024-12-06 00:09:37 -08:00
Zoltan Haindrich 928637dc49 add 2024-12-05 12:52:00 +00:00
Zoltan Haindrich c024d1e564 indent 2024-12-05 12:49:33 +00:00
Zoltan Haindrich 844b1f28f6 remove tmp tests 2024-12-05 10:07:18 +00:00
Zoltan Haindrich 1fd2addc6e cleanup 2024-12-05 10:03:22 +00:00
Zoltan Haindrich e72d54b4a2 cleanup 2024-12-05 09:59:57 +00:00
Zoltan Haindrich b7dcbf6e8c cleanup 2024-12-05 09:56:21 +00:00
Kashif Faraz 3de46746ca
Fix NPE in segment allocation when reduceMetadataIO is true (#17537) 2024-12-05 12:58:47 +05:30
Zoltan Haindrich 627f4a80d9 up 2024-12-04 17:52:07 +00:00
Zoltan Haindrich f584ab0597 convert early 2024-12-04 17:46:34 +00:00
Zoltan Haindrich 7bb3d7a17f convert early 2024-12-04 17:42:37 +00:00
Zoltan Haindrich 12c82dd8d5 more w 2024-12-04 17:34:21 +00:00
Zoltan Haindrich 3f3335f6fe updates 2024-12-04 17:31:01 +00:00
Zoltan Haindrich 6d577f8468 some stuf 2024-12-04 17:09:42 +00:00
Zoltan Haindrich 285d178f49 dont care about filter; it only references unnest col 2024-12-04 17:09:23 +00:00
Zoltan Haindrich 2c71133981 x 2024-12-04 16:28:14 +00:00
Zoltan Haindrich e7afacea94 reduce 2024-12-04 15:37:08 +00:00
Zoltan Haindrich 8cb1178782 its ok 2024-12-04 15:31:58 +00:00
Zoltan Haindrich d536217624 renames 2024-12-04 15:13:25 +00:00
Karan Kumar 0eb8d733d4
Adding leader and not being leader logging on the overlord. (#17519) 2024-12-03 22:36:53 +05:30
Clint Wylie 9ef46fc92d
suppress kafka cve for ranger extension (#17531) 2024-12-02 21:25:39 -08:00
Zoltan Haindrich 34426e184e remove ds2 2024-12-03 03:51:43 +00:00
Zoltan Haindrich e67b609eb6 Merge branch 'rename-d1-dbl1' into unnest-relfieldtrimmer-unnestfieldtype 2024-12-03 03:45:04 +00:00
Zoltan Haindrich 1ad828986e Merge remote-tracking branch 'apache/master' into rename-d1-dbl1 2024-12-03 03:44:42 +00:00
Zoltan Haindrich c1ef38b052
Minor fixes and enhancements in UnionQuery handling (#17483) 
* plan consistently with either UnionDataSource or UnionQuery for decoupled mode
* expose errors
* move decoupled related setting from PlannerConfig to QueryContexts
 2024-11-28 10:05:12 +01:00
Vadim Ogievetsky ddbb985369
Web console: refactor and improve the segment timeline (try 2) (#17521) 
* refactor and improve the segment timeline

* us consistent state

* type cleanup

* add shpitz

* better bubble

* Update web-console/src/components/segment-timeline/segment-bar-chart-render.tsx

Co-authored-by: Clint Wylie <cjwylie@gmail.com>

---------

Co-authored-by: Clint Wylie <cjwylie@gmail.com>
 2024-11-27 19:30:40 -08:00
Charles Smith 0325f62af2
[Docs] Remove ambiguous advice regarding TopN correctness (#17522) 2024-11-27 11:41:28 -08:00
Vadim Ogievetsky f3e1f1e586
Revert "Web console: refactor and improve the segment timeline (#17508)" (#17520) 
This reverts commit 09432c099b.
 2024-11-27 09:38:48 -08:00
Vadim Ogievetsky 09432c099b
Web console: refactor and improve the segment timeline (#17508) 
* refactor and improve the segment timeline

* us consistent state

* type cleanup

* add shpitz

* better bubble
 2024-11-27 09:37:01 -08:00
Vishesh Garg 1b9a6dde9f
Fix compilation error for MSQCompactionRunnerTest (#17516) 2024-11-27 12:46:30 +01:00
Gian Merlino 80d6763e39
ServerSelector: Synchronize getAllServers(). (#17499) 
This method was missing some required synchronization. This patch also
adds GuardedBy annotations to historicalServers and realtimeServers, which
would have caught it.
 2024-11-27 13:31:00 +05:30
Vishesh Garg 5333c53d71
Support non time order in MSQ compaction (#17318) 
This patch supports sorting segments by non-time columns (added in #16849) to MSQ compaction.
Specifically, if `forceSegmentSortByTime` is set in the data schema, either via the user-supplied
compaction config or in the inferred schema, the following steps are taken:
- Skip adding `__time` explicitly as the first column to the dimension schema since it already comes
as part of the schema
- Ensure column mappings propagate `__time` in the order specified by the schema
- Set `forceSegmentSortByTime` in the MSQ context.
 2024-11-27 13:26:10 +05:30
Clint Wylie 2831d79871
update kafka dependency version to 3.9.0 (#17513) 
* update kafka dependency version to 3.9.0

* update licenses.yaml
 2024-11-27 12:14:05 +05:30
Akshat Jain dd46c7722d
Remove pre-java-11 profile (#17511) 
We have removed support for Java 8 in #17466. This PR removes an unused profile pre-java-11 which activated for JDK < 11.
 2024-11-26 08:43:20 +01:00
Kashif Faraz 207ad16f07
Reduce metadata IO during segment allocation (#17496) 
Changes
---------
- Add Overlord runtime property `druid.indexer.tasklock.batchAllocationReduceMetadataIO`
- Setting this flag to true (default value) allows the Overlord to fetch only necessary segment
payloads during segment allocation
- Setting this flag to false restores original segment allocation behaviour
 2024-11-26 11:40:09 +05:30
Clint Wylie ede9e4077a
add support for aggregate only projections (#17484) 2024-11-25 09:22:46 -08:00
Zoltan Haindrich 20aea29a51
Rename d1/d2 columns in tests (#17471) 2024-11-22 14:58:56 +01:00