Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/extensions-core
History
Gian Merlino 6517fc2796
Save a metadata call when reading files from CloudObjectInputSource. (#14677) 
* Save a metadata call when reading files from CloudObjectInputSource.

The call to createSplits(inputFormat, null) in formattableReader would
use the default split hint spec, MaxSizeSplitHintSpec, which makes
getObjectMetadata calls in order to compute its splits. This isn't
necessary; we're just trying to unpack the files inside the input
source.

To fix this, use FilePerSplitHintSpec to extract files without any
funny business.

* Adjust call.

* Fix constant.

* Test coverage.
 		2023-07-28 13:31:03 -07:00
..
avro-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
azure-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
datasketches add equality, null, and range filter (#14542) 2023-07-18 12:15:22 -07:00
druid-aws-rds-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
druid-basic-security Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
druid-bloom-filter add equality, null, and range filter (#14542) 2023-07-18 12:15:22 -07:00
druid-catalog Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
druid-kerberos Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
druid-pac4j Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
druid-ranger-security Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
ec2-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
google-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
hdfs-storage Clean up the core API required for Iceberg extension (#14614) 2023-07-21 13:01:33 +05:30
histogram add equality, null, and range filter (#14542) 2023-07-18 12:15:22 -07:00
kafka-extraction-namespace Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
kafka-indexing-service Add ingest/input/bytes metric and Kafka consumer metrics. (#14582) 2023-07-20 10:56:22 +08:00
kinesis-indexing-service Add ingest/input/bytes metric and Kafka consumer metrics. (#14582) 2023-07-20 10:56:22 +08:00
kubernetes-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
lookups-cached-global Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
lookups-cached-single Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
multi-stage-query Save a metadata call when reading files from CloudObjectInputSource. (#14677) 2023-07-28 13:31:03 -07:00
mysql-metadata-storage Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
orc-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
parquet-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
postgresql-metadata-storage Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
protobuf-extensions Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
s3-extensions Speed up kill tasks by deleting segments in batch (#14131) 2023-07-27 15:34:44 -07:00
simple-client-sslcontext Prepare master branch for next release, 28.0.0 (#14595) 2023-07-18 09:22:30 +05:30
stats add equality, null, and range filter (#14542) 2023-07-18 12:15:22 -07:00
testing-tools add equality, null, and range filter (#14542) 2023-07-18 12:15:22 -07:00