Apache Druid: a high performance real-time analytics database.
Go to file
Gian Merlino a517f8ce49 Coordinator: Allow dropping all segments. (#7447)
Removes the coordinator sanity check that prevents it from dropping all
segments. It's useful to get rid of this, since the behavior is
unintuitive for dev/testing clusters where users might regularly want
to drop all their data to get back to a clean slate.

But the sanity check was there for a reason: to prevent a race condition
where the coordinator might drop all segments if it ran before the
first metadata store poll finished. This patch addresses that concern
differently, by allowing methods in MetadataSegmentManager to return
null if a poll has not happened yet, and canceling coordinator runs
in that case.

This patch also makes the "dataSources" reference in
SQLMetadataSegmentManager volatile. I'm not sure why it wasn't volatile
before, but it seems necessary to me: it's not final, and it's dereferenced
from multiple threads without synchronization.
2019-04-11 08:45:38 -07:00
.github Remove [PROPOSAL] from Proposal issue template; Add 'Other' template for convenience (#7364) 2019-03-28 18:40:43 +08:00
.idea Make 'field can be final' inspection a warning in IntelliJ config (#7301) 2019-03-26 20:45:03 -03:00
benchmarks Update scan benchmark for time ordering (#7385) 2019-03-30 11:36:25 -07:00
ci Add Kafka integration test for transactional topics (#7295) 2019-03-22 13:39:05 -07:00
cloud Move GCP to a core extension (#6953) 2019-03-27 09:00:43 -07:00
codestyle Prohibit Throwables.propagate() (#7121) 2019-03-14 18:28:33 -03:00
core Add "REVERSE" / "REPEAT" / "RIGHT" / "LEFT" functions (#7334) 2019-04-10 11:46:29 +08:00
distribution 'core' ORC extension (#7138) 2019-04-09 09:03:26 -07:00
docs Coordinator: Allow dropping all segments. (#7447) 2019-04-11 08:45:38 -07:00
examples Deprecate NoneShardSpec and drop support for automatic segment merge (#6883) 2019-03-15 23:29:25 -07:00
extendedset Set version to 0.15.0-incubating-SNAPSHOT (#7014) 2019-02-07 14:02:52 -08:00
extensions-contrib 'core' ORC extension (#7138) 2019-04-09 09:03:26 -07:00
extensions-core Support Kafka supervisor adopting running tasks between versions (#7212) 2019-04-10 18:16:38 -07:00
hll Densify swapped hll buffer (#6865) 2019-03-06 14:50:04 -08:00
indexing-hadoop Fix some IntelliJ inspections (#7273) 2019-03-25 21:11:01 -03:00
indexing-service Support Kafka supervisor adopting running tasks between versions (#7212) 2019-04-10 18:16:38 -07:00
integration-tests refactor lookups to be more chill to router (#7222) 2019-04-05 14:49:41 -07:00
licenses Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
processing Allow max rows and max segments for time-ordered scans to be overridden using the scan query JSON spec (#7413) 2019-04-07 20:12:52 -07:00
publications add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
server Coordinator: Allow dropping all segments. (#7447) 2019-04-11 08:45:38 -07:00
services add auth check exclusion for console-config.js added in #7414 (#7442) 2019-04-10 21:44:26 -07:00
sql Remove select execution code from SQL planner (#7416) 2019-04-10 22:32:57 -07:00
web-console Add time taken by last query in SQL view (#7421) 2019-04-10 23:35:47 -07:00
.dockerignore Add docker container for druid (#6896) 2019-02-08 12:12:28 +00:00
.gitignore Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
.travis.yml add travis check to make sure -Pdist works (#7418) 2019-04-07 20:12:23 -07:00
CONTRIBUTING.md add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
DISCLAIMER add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
INTELLIJ_SETUP.md change propertyBase in ServerViewModule (#6774) 2019-01-02 16:44:02 +08:00
LABELS.md Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
LICENSE Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
LICENSE.BINARY Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
NOTICE Fix 0.14.0 rc1 voting issues (#7284) 2019-03-18 14:16:21 -07:00
NOTICE.BINARY Fix 0.14.0 rc1 voting issues (#7284) 2019-03-18 14:16:21 -07:00
README.md Fix 0.14.0 rc1 voting issues (#7284) 2019-03-18 14:16:21 -07:00
druid_intellij_formatting.xml Add IntelliJ codestyle setting for "blank lines before package". (#6766) 2018-12-20 10:13:03 -08:00
eclipse.importorder Add checkstyle rules about imports and empty lines between members (#6543) 2018-11-20 12:42:15 +01:00
eclipse_formatting.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
intellij-sdk-config.jpg Prohibit and remove unused declarations in the processing module (#4930) 2017-11-09 09:27:27 -08:00
pom.xml 'core' ORC extension (#7138) 2019-04-09 09:03:26 -07:00
upload.sh Adding licenses and enable apache-rat-plugin. (#6215) 2018-09-18 08:39:26 -07:00

README.md

Build Status Inspections Status Coverage Status IRC#druid-dev

Apache Druid (incubating)

Apache Druid (incubating) is a high performance analytics data store for event-driven data.

Disclaimer: Apache Druid is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

License

Apache License, Version 2.0

More Information

More information about Druid can be found on http://www.druid.io.

Documentation

You can find the documentation for the latest Druid release on the project website.

If you would like to contribute documentation, please do so under /docs/content in this repository and submit a pull request.

Getting Started

You can get started with Druid with our quickstart.

Reporting Issues

If you find any bugs, please file a GitHub issue.

Community

The Druid community is in the process of migrating to Apache by way of the Apache Incubator. Eventually, as we proceed along this path, our site will move from http://druid.io/ to https://druid.apache.org/.

Community support is available on the druid-user mailing list(druid-user@googlegroups.com), which is hosted at Google Groups.

Development discussions occur on dev@druid.apache.org, which you can subscribe to by emailing dev-subscribe@druid.apache.org.

We also have a couple people hanging out on IRC in #druid-dev on irc.freenode.net.

Building From Source

Please note that JDK 8 is required to build Druid.

For instructions on building Druid from source, see docs/content/development/build.md

Contributing

Please follow the guidelines listed here.