druid/extensions-core
Didip Kerabat 56d5c9780d
Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027)
* Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects.

Removed:

import org.apache.commons.io.FilenameUtils;

Add:

import java.nio.file.FileSystems;
import java.nio.file.PathMatcher;
import java.nio.file.Paths;

* Forgot to update CloudObjectInputSource as well.

* Fix tests.

* Removed unused exceptions.

* Able to reduced user mistakes, by removing the protocol and the bucket on filter.

* add 1 more test.

* add comment on filterWithoutProtocolAndBucket

* Fix lint issue.

* Fix another lint issue.

* Replace all mention of filter -> objectGlob per convo here:

https://github.com/apache/druid/pull/13027#issuecomment-1266410707

* fix 1 bad constructor.

* Fix the documentation.

* Don’t do anything clever with the object path.

* Remove unused imports.

* Fix spelling error.

* Fix incorrect search and replace.

* Addressing Gian’s comment.

* add filename on .spelling

* Fix documentation.

* fix documentation again

Co-authored-by: Didip Kerabat <didip@apple.com>
2022-11-10 23:46:40 -08:00
..
avro-extensions introduce a "tree" type to the flattenSpec (#12177) 2022-11-01 14:49:30 +08:00
azure-extensions Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027) 2022-11-10 23:46:40 -08:00
datasketches fix complex_decode_base64 function, add SQL bindings (#13332) 2022-11-09 23:40:25 -08:00
druid-aws-rds-extensions Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
druid-basic-security Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
druid-bloom-filter Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
druid-kerberos Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
druid-pac4j Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
druid-ranger-security Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
ec2-extensions Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
google-extensions Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027) 2022-11-10 23:46:40 -08:00
hdfs-storage Lazy initialization of segment killers, movers and archivers (#13170) 2022-10-04 15:55:46 +05:30
histogram Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
kafka-extraction-namespace Dependency cleanup (#13194) 2022-10-10 20:34:38 +08:00
kafka-indexing-service Add taskActionType dimension to task/action/run/time. (#13333) 2022-11-11 12:00:08 +05:30
kinesis-indexing-service Add taskActionType dimension to task/action/run/time. (#13333) 2022-11-11 12:00:08 +05:30
kubernetes-extensions Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
lookups-cached-global Use lookup memory footprint in MSQ memory computations. (#13271) 2022-11-03 07:36:54 -07:00
lookups-cached-single Use lookup memory footprint in MSQ memory computations. (#13271) 2022-11-03 07:36:54 -07:00
multi-stage-query Add a OverlordHelper that cleans up durable storage objects in MSQ (#13269) 2022-11-09 17:23:35 +05:30
mysql-metadata-storage Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
orc-extensions introduce a "tree" type to the flattenSpec (#12177) 2022-11-01 14:49:30 +08:00
parquet-extensions fix issue with parquet list conversion of nullable lists with complex nullable elements (#13294) 2022-11-04 05:25:42 -07:00
postgresql-metadata-storage Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
protobuf-extensions Add inline descriptor Protobuf bytes decoder (#13192) 2022-10-11 13:37:28 -05:00
s3-extensions Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027) 2022-11-10 23:46:40 -08:00
simple-client-sslcontext Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
stats Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
testing-tools more consistent expression error messages (#12995) 2022-09-06 23:21:38 -07:00