Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,622 Commits 111 Branches 503 Tags 728 MiB
Commit Graph

19 Commits

Author SHA1 Message Date
Jihoon Son 56ab4363ea
Native parallel batch indexing without shuffle (#5492) 
* Native parallel indexing without shuffle

* fix build

* fix ci

* fix ingestion without intervals

* fix retry

* fix retry

* add it test

* use chat handler

* fix build

* add docs

* fix ITUnionQueryTest

* fix failures

* disable metrics reporting

* working

* Fix split of static-s3 firehose

* Add endpoints to supervisor task and a unit test for endpoints

* increase timeout in test

* Added doc

* Address comments

* Fix overlapping locks

* address comments

* Fix static s3 firehose

* Fix test

* fix build

* fix test

* fix typo in docs

* add missing maxBytesInMemory to doc

* address comments

* fix race in test

* fix test

* Rename to ParallelIndexSupervisorTask

* fix teamcity

* address comments

* Fix license

* addressing comments

* addressing comments

* indexTaskClient-based segmentAllocator instead of CountingActionBasedSegmentAllocator

* Fix race in TaskMonitor and move HTTP endpoints to supervisorTask from runner

* Add more javadocs

* use StringUtils.nonStrictFormat for logging

* fix typo and remove unused class

* fix tests

* change package

* fix strict build

* tmp

* Fix overlord api according to the recent change in master

* Fix it test
 2018-08-06 23:59:42 -07:00
Atul Mohan 1b9611a60e Local indexing from RDBMS (#5441) 
* Local indexing from RDBMS

*  Fix content

* Remove pom changes

* Remove extraneous space

* Add tests and update documentation

* Fix comments

* Fix docs

*  Fix build related issue

*  Handle invalid strings

* Make target database independent of metadata storage

* Add firehose connector

* Fix accessibility

* Add docs

* Remove unused def

* Remove lazy instantiation of jsoniterator

* Move unused changes

* Move unused changes

* Fix build

* Make Sqlfirehose method private
 2018-05-22 12:33:01 +09:00
Jihoon Son 5f3c863d5e Add compaction task (#4985) 
* Add compaction task

* added doc

* use combining aggregators

* address comments

* add support for dimensionsSpec

* fix getUniqueDims and getUniqueMetics

* find unique dimensionsSpec

* fix compilation

* add unit test

* fix test

* fix test

* test for different dimension orderings and types, and doc for type and ordering

* add control for custom ordering and type

* update doc

* fix compile

* fix compile

* add segments param

* fix serde error

* fix build
 2017-11-03 21:55:27 -06:00
Jihoon Son 11b7b1bea6 Add support for HttpFirehose (#4297) 
* Add support for HttpFirehose

* Fix document

* Add documents
 2017-05-25 16:13:04 -05:00
Nishant 0ac1b27d53 Allow manually setting of shutoffTime for EventReceiverFirehose (#2803) 
* Allow dynamically setting of shutoffTime for EventReceiverFirehose

Allow dynamically setting shutoffTime for EventReceiverFirehose

review comments and tests

* shut down exec on close
 2016-05-24 07:24:00 -07:00
fjy 943cbe6e76 refactor extensions into their own docs 2016-03-22 18:54:10 -07:00
fjy e3e932a4d4 refactor extensions into core and contrib 2016-03-08 17:12:09 -08:00
Charles Allen 1fe277ee29 Merge pull request #2367 from se7entyse7en/feature-rackspace-cloud-files-static-firehose 
Adds support to use Rackspace's cloudfiles as static firehose
 2016-02-25 17:31:06 -08:00
fjy 6fc5bcb1ef fix docs 2016-02-08 13:40:53 -08:00
Lou Marvin Caraig 9de57eb1c8 Added documentation 2016-02-02 14:32:12 +01:00
lvjq 2237a8cf0f kafka 8 simple consumer firehose 2015-08-27 20:50:46 -05:00
sahner 3def847e28 add documentation about TimedShutoff firehose 2015-08-24 20:41:42 -05:00
fjy 012fff6616 fix firehose docs 2015-08-04 09:52:23 -07:00
sahner 4801de62a2 make "announce" the chathandler default in realtime node, 
remove doc references to chathandler type "announce" since it is the default now,
 2015-07-27 12:14:28 -05:00
Charles Allen e051e93d19 Merge pull request #1518 from RealROI/more-azure-features 
Azure Blob Store support for Firehose and Indexing Service Logs
 2015-07-17 16:10:22 -07:00
Zak Kristjanson 0bda7af52c Add more support for Azure Blob Store 
Azure Blob Store support for Task Logs and a firehose for data ingestion
 2015-07-17 15:38:21 -07:00
sahner acd20e8c00 say explicitly that local firehose searches directories recursively for files 2015-07-05 14:46:44 -05:00
ravishrathod 9213fd3801 updating doc for rabbitmq firehose 2015-06-22 02:40:11 -04:00
Himanshu Gupta 8edc2aaca3 renaming all *.md filenames to only have lowercase and dashes 
so that they are editable on case-insensitive os as well
 2015-05-29 20:55:42 -05:00