Apache Druid: a high performance real-time analytics database.
Go to file
Jihoon Son 56ab4363ea
Native parallel batch indexing without shuffle (#5492)
* Native parallel indexing without shuffle

* fix build

* fix ci

* fix ingestion without intervals

* fix retry

* fix retry

* add it test

* use chat handler

* fix build

* add docs

* fix ITUnionQueryTest

* fix failures

* disable metrics reporting

* working

* Fix split of static-s3 firehose

* Add endpoints to supervisor task and a unit test for endpoints

* increase timeout in test

* Added doc

* Address comments

* Fix overlapping locks

* address comments

* Fix static s3 firehose

* Fix test

* fix build

* fix test

* fix typo in docs

* add missing maxBytesInMemory to doc

* address comments

* fix race in test

* fix test

* Rename to ParallelIndexSupervisorTask

* fix teamcity

* address comments

* Fix license

* addressing comments

* addressing comments

* indexTaskClient-based segmentAllocator instead of CountingActionBasedSegmentAllocator

* Fix race in TaskMonitor and move HTTP endpoints to supervisorTask from runner

* Add more javadocs

* use StringUtils.nonStrictFormat for logging

* fix typo and remove unused class

* fix tests

* change package

* fix strict build

* tmp

* Fix overlord api according to the recent change in master

* Fix it test
2018-08-06 23:59:42 -07:00
.idea Prohibit Lists.newArrayList() with a single argument (#6068) 2018-07-31 20:09:10 -07:00
api Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
aws-common Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
benchmarks Order rows during incremental index persist when rollup is disabled. (#6107) 2018-08-06 14:17:48 -07:00
ci Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
codestyle Part 2 of changes for SQL Compatible Null Handling (#5958) 2018-08-02 08:20:25 -07:00
common Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
distribution Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
docs Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
examples Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
extendedset Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
extensions-contrib Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
extensions-core Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
hll Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
indexing-hadoop Part 2 of changes for SQL Compatible Null Handling (#5958) 2018-08-02 08:20:25 -07:00
indexing-service Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
integration-tests Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
java-util Part 2 of changes for SQL Compatible Null Handling (#5958) 2018-08-02 08:20:25 -07:00
processing Order rows during incremental index persist when rollup is disabled. (#6107) 2018-08-06 14:17:48 -07:00
publications Changes to lambda architecture paper required for HICSS (#3382) 2016-09-06 21:32:21 -07:00
server Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
services Native parallel batch indexing without shuffle (#5492) 2018-08-06 23:59:42 -07:00
sql Part 2 of changes for SQL Compatible Null Handling (#5958) 2018-08-02 08:20:25 -07:00
.gitignore git ignore dependency-reduced-pom.xml (#4711) 2017-08-23 10:10:50 -07:00
.travis.yml Part 2 of changes for SQL Compatible Null Handling (#5958) 2018-08-02 08:20:25 -07:00
CONTRIBUTING.md Replace dev list references in docs. (#5723) 2018-04-30 11:25:45 -07:00
DruidCorporateCLA.pdf fix CLA email / mailing address 2014-04-17 15:26:28 -07:00
DruidIndividualCLA.pdf fix CLA email / mailing address 2014-04-17 15:26:28 -07:00
INTELLIJ_SETUP.md Prohibit and remove unused declarations in the processing module (#4930) 2017-11-09 09:27:27 -08:00
LICENSE Clean up README and license 2015-02-18 23:09:28 -08:00
NOTICE Extension points for authentication/authorization (#4271) 2017-09-15 23:45:48 -07:00
README.md Add IRC#druid-dev shields.io into README (#6002) 2018-07-21 13:31:35 -07:00
druid_intellij_formatting.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
eclipse.importorder Merge pull request #2905 from javasoze/eclipse_formatting 2016-04-29 18:42:03 -07:00
eclipse_formatting.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
intellij-sdk-config.jpg Prohibit and remove unused declarations in the processing module (#4930) 2017-11-09 09:27:27 -08:00
pom.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
upload.sh upload.sh: Use awscli if s3cmd is not available. (#3114) 2016-06-08 17:01:46 -07:00

README.md

Build Status Inspections Status Coverage Status IRC#druid-dev

Apache Druid (incubating)

Apache Druid (incubating) is a high performance analytics data store for event-driven data.

Disclaimer: Apache Druid is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

License

Apache License, Version 2.0

More Information

More information about Druid can be found on http://www.druid.io.

Documentation

You can find the documentation for the latest Druid release on the project website.

If you would like to contribute documentation, please do so under /docs/content in this repository and submit a pull request.

Getting Started

You can get started with Druid with our quickstart.

Reporting Issues

If you find any bugs, please file a GitHub issue.

Community

The Druid community is in the process of migrating to Apache by way of the Apache Incubator. Eventually, as we proceed along this path, our site will move from http://druid.io/ to https://druid.apache.org/.

Community support is available on the druid-user mailing list(druid-user@googlegroups.com), which is hosted at Google Groups.

Development discussions occur on dev@druid.apache.org, which you can subscribe to by emailing dev-subscribe@druid.apache.org.

We also have a couple people hanging out on IRC in #druid-dev on irc.freenode.net.

Contributing

Please follow the guidelines listed here.