druid/extensions-core
Clint Wylie 2d3bee8545
various nested column (and other) fixes (#13732)
changes:
* modified druid schema column type compution to special case COMPLEX<json> handling to choose COMPLEX<json> if any column in any segment is COMPLEX<json>
* NestedFieldVirtualColumn can now work correctly on any type of column, returning either a column selector if a root path, or nil selector if not
* fixed a random bug with NilVectorSelector when using a vector size larger than the default and druid.generic.useDefaultValueForNull=false would have the nulls vector set to all false instead of true
* fixed an overly aggressive check in ExprEval.ofType when handling complex types which would try to treat any string as base64 without gracefully falling back if it was not in fact base64 encoded, along with special handling for complex<json>
* added ExpressionVectorSelectors.castValueSelectorToObject and ExpressionVectorSelectors.castObjectSelectorToNumeric as convience methods to cast vector selectors using cast expressions without the trouble of constructing an expression. the polymorphic nature of the non-vectorized engine (and significantly larger overhead of non-vectorized expression processing) made adding similar methods for non-vectorized selectors less attractive and so have not been added at this time
* fix inconsistency between nested column indexer and serializer in handling values (coerce non primitive and non arrays of primitives using asString)
* ExprEval best effort mode now handles byte[] as string
* added test for ExprEval.bestEffortOf, and add missing conversion cases that tests uncovered
* more tests more better
2023-02-06 19:48:02 -08:00
..
avro-extensions Fixing incorrect filtering of nulls in an array when ingesting for JSON and Avro (#13712) 2023-02-01 04:15:08 -08:00
azure-extensions Revert "Add filter in cloud object input source for backward compatibility (#13437)" (#13450) 2022-11-30 16:33:05 +05:30
datasketches Fallback virtual column (#13739) 2023-02-06 19:36:50 -08:00
druid-aws-rds-extensions Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
druid-basic-security Validate response headers and fix exception logging (#13609) 2023-01-05 14:15:15 -08:00
druid-bloom-filter various nested column (and other) fixes (#13732) 2023-02-06 19:48:02 -08:00
druid-catalog Much improved table functions (#13627) 2023-01-17 08:41:57 -08:00
druid-kerberos Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
druid-pac4j Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
druid-ranger-security Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
ec2-extensions Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
google-extensions Add InputStats to track bytes processed by a task (#13520) 2022-12-13 18:54:42 +05:30
hdfs-storage Add InputStats to track bytes processed by a task (#13520) 2022-12-13 18:54:42 +05:30
histogram SQL test framework extensions (#13426) 2022-12-02 09:11:59 -08:00
kafka-extraction-namespace Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
kafka-indexing-service discover nested columns when using nested column indexer for schemaless ingestion (#13672) 2023-01-18 12:57:28 -08:00
kinesis-indexing-service Kinesis: More robust default fetch settings. (#13539) 2023-01-13 11:03:54 +05:30
kubernetes-extensions update org.bouncycastle:bcprov-jdk15on 1.68 to 1.69 (#13440) 2022-11-30 21:57:38 +05:30
lookups-cached-global Quote and escape literals in JDBC lookup to allow reserved identifiers. (#13632) 2023-01-10 12:11:54 +05:30
lookups-cached-single Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
multi-stage-query Fix NPE in postCleanupStage if stage doesn't exist (#13742) 2023-02-06 19:13:39 +05:30
mysql-metadata-storage Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
orc-extensions discover nested columns when using nested column indexer for schemaless ingestion (#13672) 2023-01-18 12:57:28 -08:00
parquet-extensions discover nested columns when using nested column indexer for schemaless ingestion (#13672) 2023-01-18 12:57:28 -08:00
postgresql-metadata-storage Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
protobuf-extensions discover nested columns when using nested column indexer for schemaless ingestion (#13672) 2023-01-18 12:57:28 -08:00
s3-extensions Allow using composed storage for SuperSorter intermediate data (#13368) 2023-01-24 01:02:03 +05:30
simple-client-sslcontext Prepare master branch for next release, 26.0.0 (#13401) 2022-11-22 15:31:01 +05:30
stats SQL test framework extensions (#13426) 2022-12-02 09:11:59 -08:00
testing-tools SQL test framework extensions (#13426) 2022-12-02 09:11:59 -08:00