druid/docs/multi-stage-query
Gian Merlino d1877e41ec
Use lookup memory footprint in MSQ memory computations. (#13271)
* Use lookup memory footprint in MSQ memory computations.

Two main changes:

1) Add estimateHeapFootprint to LookupExtractor.

2) Use this in MSQ's IndexerWorkerContext when determining the total
   amount of available memory. It's taken off the top.

This prevents MSQ tasks from running out of memory when there are lookups
defined in the cluster.

* Updates from code review.
2022-11-03 07:36:54 -07:00
..
api.md Add task start status to worker report (#13263) 2022-10-28 12:00:15 +05:30
concepts.md Use lookup memory footprint in MSQ memory computations. (#13271) 2022-11-03 07:36:54 -07:00
examples.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
index.md fix: follow naming convention for msq task engine (#13127) 2022-09-21 18:46:06 -07:00
known-issues.md msq: update known issue about GROUPING SETS and COUNT DISTINCT (#13185) 2022-10-05 19:47:03 -07:00
reference.md MSQ: Add support for indexSpec. (#13275) 2022-10-28 14:27:50 -07:00
security.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00