druid/docs/design
Abhishek Radhakrishnan 96be82a3e6
Clean up duty for non-overlapping eternity tombstones (#15281)
* Add initial draft of MarkDanglingTombstonesAsUnused duty.

* Use overshadowed segments instead of all used segments.

* Add unit test for MarkDanglingSegmentsAsUnused duty.

* Add mock call

* Simplify code.

* Docs

* shorter lines formatting

* metric doc

* More tests, refactor and fix up some logic.

* update javadocs; other review comments.

* Make numCorePartitions as 0 in the TombstoneShardSpec.

* fix up test

* Add tombstone core partition tests

* Update docs/design/coordinator.md

Co-authored-by: 317brian <53799971+317brian@users.noreply.github.com>

* review comment

* Minor cleanup

* Only consider tombstones with 0 core partitions

* Need to register the test shard type to make jackson happy

* test comments

* checkstyle

* fixup misc typos in comments

* Update logic to use overshadowed segments

* minor cleanup

* Rename duty to eternity tombstone instead of dangling. Add test for full eternity tombstone.

* Address review feedback.

---------

Co-authored-by: 317brian <53799971+317brian@users.noreply.github.com>
2023-12-11 08:57:15 -08:00
..
extensions-contrib Adding `"segment/scan/active" metric for processing thread pool. (#15060) 2023-09-29 12:34:28 -07:00
architecture.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
broker.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
coordinator.md Clean up duty for non-overlapping eternity tombstones (#15281) 2023-12-11 08:57:15 -08:00
deep-storage.md docs: query from deep storage (#14609) 2023-08-04 11:10:08 +05:30
historical.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
index.md Update slack text (#14578) 2023-07-12 12:08:48 -07:00
indexer.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
indexing-service.md API reference refactor (#14372) 2023-06-26 15:48:54 -07:00
metadata-storage.md docs: suggest metadata store with instant ADD COLUMN semantics (#15334) 2023-11-09 12:56:30 -08:00
middlemanager.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
overlord.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
peons.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
router.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
segments.md enable sql compatible null handling mode by default (#14792) 2023-08-21 20:07:13 -07:00
storage.md Revamp design page (#15486) 2023-12-08 11:40:24 -08:00
zookeeper.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00