druid/docs
Gian Merlino cccf13ea82
Reverse, pull up lookups in the SQL planner. (#15626)
* Reverse, pull up lookups in the SQL planner.

Adds two new rules:

1) ReverseLookupRule, which eliminates calls to LOOKUP by doing
   reverse lookups.

2) AggregatePullUpLookupRule, which pulls up calls to LOOKUP above
   GROUP BY, when the lookup is injective.

Adds configs `sqlReverseLookup` and `sqlPullUpLookup` to control whether
these rules fire. Both are enabled by default.

To minimize the chance of performance problems due to many keys mapping to
the same value, ReverseLookupRule refrains from reversing a lookup if there
are more keys than `inSubQueryThreshold`. The rationale for using this setting
is that reversal works by generating an IN, and the `inSubQueryThreshold`
describes the largest IN the user wants the planner to create.

* Add additional line.

* Style.

* Remove commented-out lines.

* Fix tests.

* Add test.

* Fix doc link.

* Fix docs.

* Add one more test.

* Fix tests.

* Logic, test updates.

* - Make FilterDecomposeConcatRule more flexible.

- Make CalciteRulesManager apply reduction rules til fixpoint.

* Additional tests, simplify code.
2024-01-12 00:06:31 -08:00
..
api-reference Add api for Retrieving unused segments (#15415) 2023-12-11 16:32:18 -05:00
assets Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
comparisons remove ref to plywood repo (#12809) 2022-07-26 10:12:13 +08:00
configuration Enable query request queuing by default when total laning is turned on. (#15440) 2024-01-09 07:54:26 +05:30
data-management docs: Anchor link checker (#15624) 2024-01-08 15:19:05 -08:00
design docs: Fix broken anchor links (#15621) 2024-01-03 15:28:27 -08:00
development Reverse, pull up lookups in the SQL planner. (#15626) 2024-01-12 00:06:31 -08:00
ingestion docs: Anchor link checker (#15624) 2024-01-08 15:19:05 -08:00
misc Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
multi-stage-query docs: Anchor link checker (#15624) 2024-01-08 15:19:05 -08:00
operations Enable query request queuing by default when total laning is turned on. (#15440) 2024-01-09 07:54:26 +05:30
querying Reverse, pull up lookups in the SQL planner. (#15626) 2024-01-12 00:06:31 -08:00
release-info docs: Anchor link checker (#15624) 2024-01-08 15:19:05 -08:00
tutorials Doc fixes for query from deep storage and MSQ (#15313) 2023-11-03 10:52:20 +05:30