druid/docs/operations
Lucas Capistrant 9c124f2cde
Add a configurable bufferPeriod between when a segment is marked unused and deleted by KillUnusedSegments duty (#12599)
* Add new configurable buffer period to create gap between mark unused and kill of segment

* Changes after testing

* fixes and improvements

* changes after initial self review

* self review changes

* update sql statement that was lacking last_used

* shore up some code in SqlMetadataConnector after self review

* fix derby compatibility and improve testing/docs

* fix checkstyle violations

* Fixes post merge with master

* add some unit tests to improve coverage

* ignore test coverage on new UpdateTools cli tool

* another attempt to ignore UpdateTables in coverage check

* change column name to used_flag_last_updated

* fix a method signature after column name switch

* update docs spelling

* Update spelling dictionary

* Fixing up docs/spelling and integrating altering tasks table with my alteration code

* Update NULL values for used_flag_last_updated in the background

* Remove logic to allow segs with null used_flag_last_updated to be killed regardless of bufferPeriod

* remove unneeded things now that the new column is automatically updated

* Test new background row updater method

* fix broken tests

* fix create table statement

* cleanup DDL formatting

* Revert adding columns to entry table by default

* fix compilation issues after merge with master

* discovered and fixed metastore inserts that were breaking integration tests

* fixup forgotten insert by using pattern of sharing now timestamp across columns

* fix issue introduced by merge

* fixup after merge with master

* add some directions to docs in the case of segment table validation issues
2023-08-17 19:32:51 -05:00
..
alerts.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
auth-ldap.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
auth.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
basic-cluster-tuning.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
clean-metadata-store.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
deep-storage-migration.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
dump-segment.md Improve memory efficiency of WrappedRoaringBitmap. (#13889) 2023-03-09 15:48:02 -08:00
durable-storage.md docs: query from deep storage (#14609) 2023-08-04 11:10:08 +05:30
dynamic-config-provider.md Docs: Splits Kafka topic. Adds detailed example for kafka inputFormat (#11912) 2021-11-12 13:02:23 -08:00
export-metadata.md Update Kafka loading docs to use the streaming data loader (#8544) 2019-09-22 15:00:52 -07:00
high-availability.md fixes web console introduction and addresses linking issues (#11609) 2021-08-18 08:37:05 -07:00
http-compression.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
insert-segment-to-db.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
java.md Claim full support for Java 17. (#14384) 2023-07-07 12:52:35 -07:00
kubernetes.md Update kubernetes.md (#13858) 2023-02-28 11:20:24 -08:00
metadata-migration.md fixed init commands for both mysql and postgresql (#13713) 2023-02-01 18:07:31 -08:00
metrics.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
migrate-from-firehose-ingestion.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
mixed-workloads.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
other-hadoop.md Removes support for Hadoop 2 (#14763) 2023-08-09 17:47:52 +05:30
password-provider.md Security overview documentation (#10339) 2020-11-19 15:24:58 -08:00
pull-deps.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
request-logging.md Add sql planning time metric (#12923) 2022-08-22 11:09:44 +05:30
reset-cluster.md Update reset-cluster.md (#10990) 2021-03-29 20:38:35 -07:00
rolling-updates.md add links to release notes, light refactor of landing page (#11051) 2021-05-07 14:26:47 -07:00
rule-configuration.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
security-overview.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
security-user-auth.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
segment-optimization.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
single-server.md Docs: reword single server page (#13659) 2023-01-11 21:12:52 -08:00
tls-support.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
upgrade-prep.md Add a configurable bufferPeriod between when a segment is marked unused and deleted by KillUnusedSegments duty (#12599) 2023-08-17 19:32:51 -05:00
use_sbt_to_build_fat_jar.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
web-console.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00