druid/extensions-core
zachjsh 65cadbe42a
Fix bad lookup config fails task (#12021)
This PR fixes an issue in which if a lookup is configured incorreclty; does not serialize properly when being pulled by peon node, it causes the task to fail. The failure occurs because the peon and other leaf nodes (broker, historical), have retry logic that continues to retry the lookup loading for 3 minutes by default. The http listener thread on the peon task is not started until lookup loading completes, by default, the overlord waits 1 minute by default, to communicate with the peon task to get the task status, after which is orders the task to shut down, causing the ingestion task to fail.

To fix the issue, we catch the exception serialization error, and do not retry. Also fixed an issue in which a bad lookup config interferes with any other good lookup configs from being loaded.
2021-12-07 00:55:34 -05:00
..
avro-extensions Support for hadoop 3 via maven profiles (#11794) 2021-10-30 22:46:24 +05:30
azure-extensions Migrate File.mkdirs to FileUtils.mkdirp. (#11879) 2021-11-09 11:10:49 -08:00
datasketches Code cleanup from query profile project (#11822) 2021-11-30 11:35:38 -08:00
druid-aws-rds-extensions bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
druid-basic-security Fix classNotFoundException when connecting to secure LDAP (#11978) 2021-12-03 12:08:19 +05:30
druid-bloom-filter restore and deprecate AggregatorFactory methods (#11917) 2021-11-19 15:59:35 -08:00
druid-kerberos Support for hadoop 3 via maven profiles (#11794) 2021-10-30 22:46:24 +05:30
druid-pac4j bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
druid-ranger-security Support for hadoop 3 via maven profiles (#11794) 2021-10-30 22:46:24 +05:30
ec2-extensions bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
google-extensions Migrate File.mkdirs to FileUtils.mkdirp. (#11879) 2021-11-09 11:10:49 -08:00
hdfs-storage Migrate File.mkdirs to FileUtils.mkdirp. (#11879) 2021-11-09 11:10:49 -08:00
histogram restore and deprecate AggregatorFactory methods (#11917) 2021-11-19 15:59:35 -08:00
kafka-extraction-namespace TestKafkaExtractionCluster: Shut down Kafka, ZK in @After. (#11963) 2021-11-20 15:17:05 -08:00
kafka-indexing-service Enhancements to IndexTaskClient. (#12011) 2021-12-03 09:14:32 -08:00
kinesis-indexing-service Enhancements to IndexTaskClient. (#12011) 2021-12-03 09:14:32 -08:00
kubernetes-extensions Remove CloseQuietly and migrate its usages to other methods. (#10247) 2021-10-23 17:03:21 -07:00
lookups-cached-global Fix bad lookup config fails task (#12021) 2021-12-07 00:55:34 -05:00
lookups-cached-single bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
mysql-metadata-storage bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
orc-extensions Upgrade ORC to 1.7.1 (#11919) 2021-11-15 09:13:03 -08:00
parquet-extensions vectorize logical operators and boolean functions (#11184) 2021-12-02 16:40:23 -08:00
postgresql-metadata-storage bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
protobuf-extensions bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
s3-extensions AWS "Data read has a different length than the expected" error should reset stream and try again (#11941) 2021-11-26 12:45:34 -07:00
simple-client-sslcontext bump version to 0.23.0-SNAPSHOT (#11670) 2021-09-08 15:56:04 -07:00
stats restore and deprecate AggregatorFactory methods (#11917) 2021-11-19 15:59:35 -08:00
testing-tools complex typed expressions (#11853) 2021-11-08 00:33:06 -08:00