druid/docs/operations
Kashif Faraz 9f6ce6ddc0
Remove task action audit logging and druid_taskLog metadata table (#16309)
Description:
Task action audit logging was first deprecated and disabled by default in Druid 0.13, #6368.

As called out in the original discussion #5859, there are several drawbacks to persisting task action audit logs. 
- Only usage of the task audit logs is to serve the API `/indexer/v1/task/{taskId}/segments`
which returns the list of segments created by a task.
- The use case is really narrow and no prod clusters really use this information.
- There can be better ways of obtaining this information, such as the metric
`segment/added/bytes` which reports both the segment ID and task ID
when a segment is committed by a task. We could also include committed segment IDs in task reports.
- A task persisting several segments would bloat up the audit logs table putting unnecessary strain
on metadata storage.

Changes:
- Remove `TaskAuditLogConfig`
- Remove method `TaskAction.isAudited()`. No task action is audited anymore.
- Remove `SegmentInsertAction` as it is not used anymore. `SegmentTransactionalInsertAction`
is the new incarnation which has been in use for a while.
- Deprecate `MetadataStorageActionHandler.addLog()` and `getLogs()`. These are not used anymore
but need to be retained for backward compatibility of extensions.
- Do not create `druid_taskLog` metadata table anymore.
2024-07-17 17:09:00 +05:30
..
alerts.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
auth-ldap.md docs: LDAP trust store property clarification (#15028) 2023-11-02 13:00:08 -07:00
auth.md Link fix (#16596) 2024-06-14 11:40:53 -07:00
basic-cluster-tuning.md Link fix (#16596) 2024-06-14 11:40:53 -07:00
clean-metadata-store.md Remove task action audit logging and druid_taskLog metadata table (#16309) 2024-07-17 17:09:00 +05:30
deep-storage-migration.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
dump-segment.md update the doc for dump-segment tool when using jdk11+ (#15971) 2024-02-28 09:40:10 +08:00
durable-storage.md Web console: more robust durable storage setting detection (#16493) 2024-05-22 15:47:20 -07:00
dynamic-config-provider.md [Docs] Refactor streaming ingestion section (#15591) 2024-02-12 13:52:42 -08:00
export-metadata.md Update Kafka loading docs to use the streaming data loader (#8544) 2019-09-22 15:00:52 -07:00
high-availability.md fixes web console introduction and addresses linking issues (#11609) 2021-08-18 08:37:05 -07:00
http-compression.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
insert-segment-to-db.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
java.md Claim full support for Java 17. (#14384) 2023-07-07 12:52:35 -07:00
kubernetes.md Update kubernetes.md (#13858) 2023-02-28 11:20:24 -08:00
metadata-migration.md Clean up after add kill bufferPeriod (#14868) 2023-08-19 00:00:04 +05:30
metrics.md Emit metrics for S3UploadThreadPool (#16616) 2024-06-21 11:36:47 +05:30
migrate-from-firehose-ingestion.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
mixed-workloads.md Enable query request queuing by default when total laning is turned on. (#15440) 2024-01-09 07:54:26 +05:30
other-hadoop.md Removes support for Hadoop 2 (#14763) 2023-08-09 17:47:52 +05:30
password-provider.md Security overview documentation (#10339) 2020-11-19 15:24:58 -08:00
pull-deps.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
request-logging.md Add sql planning time metric (#12923) 2022-08-22 11:09:44 +05:30
reset-cluster.md Update reset-cluster.md (#10990) 2021-03-29 20:38:35 -07:00
rolling-updates.md docs: clean up some rolling updates stuff (#15762) 2024-01-26 14:10:53 -08:00
rule-configuration.md Update retention rules doc (#15439) 2023-12-05 09:53:17 -08:00
security-overview.md remove references to Jupyter notebooks within the Druid repo (#15143) 2023-11-01 13:17:06 -07:00
security-user-auth.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
segment-optimization.md Docs: Fix spelling of 5 GB. (#16040) 2024-03-04 22:37:38 -08:00
single-server.md Docs: reword single server page (#13659) 2023-01-11 21:12:52 -08:00
tls-support.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
use_sbt_to_build_fat_jar.md upgrade mysql:mysql-connector-java to 8.2.0 (#16024) 2024-05-06 21:58:37 +08:00
web-console.md docs: Anchor link checker (#15624) 2024-01-08 15:19:05 -08:00