Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,747 Commits 111 Branches 503 Tags 721 MiB
Commit Graph

13 Commits

Author SHA1 Message Date
Tejaswini Bandlamudi 7103cb4b9d
Removes FiniteFirehoseFactory and its implementations (#12852) 
The FiniteFirehoseFactory and InputRowParser classes were deprecated in 0.17.0 (#8823) in favor of InputSource & InputFormat. This PR removes the FiniteFirehoseFactory and all its implementations along with classes solely used by them like Fetcher (Used by PrefetchableTextFilesFirehoseFactory). Refactors classes including tests using FiniteFirehoseFactory to use InputSource instead.
Removing InputRowParser may not be as trivial as many classes that aren't deprecated depends on it (with no alternatives), like EventReceiverFirehoseFactory. Hence FirehoseFactory, EventReceiverFirehoseFactory, and Firehose are marked deprecated.
 2023-03-02 18:07:17 +05:30
Charles Smith 7ed46800c3
Docs: Add multi-dimension partitioning doc; refactor native batch and separate into smaller topics. (#11983) 
Adds documentation for multi-dimension partitioning. cc: @kfaraz
Refactors the native batch partitioning topic as follows:

Native batch ingestion covers parallel-index
Native batch simple task indexing covers index
Native batch input sources covers ioSource
Native batch ingestion with firehose covers deprecated firehose
 2021-12-03 16:37:14 +05:30
Clint Wylie ec334a641b
MySQL extension with MariaDB connector docs (#11608) 
* add docs for mariadb support via mysql extensions

* add logging so you know what druid knows

* homogenize

* spelling

* missed a couple
 2021-08-19 01:52:26 -07:00
Will Salisbury cda9f41e69
s/S3/GCS/g (#9700) 
fix typo [ at least I hope this was a typo… ]
 2020-04-14 18:39:54 -07:00
zachjsh f707064bed
Add Azure config options for segment prefix and max listing length (#9356) 
* Add Azure config options for segment prefix and max listing length

Added configuration options to allow the user to specify the prefix
within the segment container to store the segment files. Also
added a configuration option to allow the user to specify the
maximum number of input files to stream for each iteration.

* * Fix test failures

* * Address review comments

* * add dependency explicitly to pom

* * update docs

* * Address review comments

* * Address review comments
 2020-02-21 14:12:03 -08:00
Suneet Saldanha 93167188ea Update docs for extensions (#9218) 
* Update docs for s3 and avro extensions

* More doc updates - google + cleanup
 2020-01-19 12:49:33 -08:00
Jihoon Son 153495068b Doc update for the new input source and the new input format (#9171) 
* Doc update for new input source and input format.

- The input source and input format are promoted in all docs under docs/ingestion
- All input sources including core extension ones are located in docs/ingestion/native-batch.md
- All input formats and parsers including core extension ones are localted in docs/ingestion/data-formats.md
- New behavior of the parallel task with different partitionsSpecs are documented in docs/ingestion/native-batch.md

* parquet

* add warning for range partitioning with sequential mode

* hdfs + s3, gs

* add fs impl for gs

* address comments

* address comments

* gcs
 2020-01-17 15:52:05 -08:00
singh 936b9bdfd0 add deets about the keyfile (#9209) 2020-01-17 11:24:49 -08:00
Jonathan Wei aa539177ec De-incubation cleanup in code, docs, packaging (#9108) 
* De-incubation cleanup in code, docs, packaging

* remove unused docs script
 2020-01-03 12:33:19 -05:00
Clint Wylie 5ecdf94d83
add 'prefixes' support to google input source (#8930) 
* add prefixes support to google input source, making it symmetrical-ish with s3

* docs

* more better, and tests

* unused

* formatting

* javadoc

* dependencies

* oops

* review comments

* better javadoc
 2019-12-04 21:01:10 -08:00
Clint Wylie 074a45219d add google cloud storage InputSource for native batch (#8907) 
* add google cloud storage InputSource for native batch

* rename

* checkstyle

* fix

* fix spelling

* review comments
 2019-11-19 19:49:43 -08:00
Kamal Gurala 3ed5f9698a gcs prefix doc fix (#8699) 2019-10-21 08:29:54 -07:00
Clint Wylie 75978e5b98 move google ext docs from contrib to core (#8512) 
* move google ext docs from contrib to core

* fix links

* revert unintended change

* more links, add note to example ext doc that it was removed, unlink from sidebar
 2019-09-12 09:40:39 -07:00