Apache Druid: a high performance real-time analytics database.
Go to file
Gian Merlino ce7298b51e BaseAppenderatorDriver: Fix potentially overeager segment cleanup. (#7558)
* BaseAppenderatorDriver: Fix potentially overeager segment cleanup.

Here is a thing that I think can go wrong:

1. We push some segments, then try to publish them transactionally.
2. The segments are actually published, but the 200 OK response gets
   lost (connection dropped, whatever).
3. We try again, and on the second try, the publish fails (because
   the transaction baseline start metadata no longer matches).
4. Because the publish failed, we delete the pushed segments.
5. But this is bad, because the publish didn't really fail, it actually
   succeeded in step 2.

I haven't seen this in the wild, but thought about it while
reviewing #7537.

This patch also cleans up logging a bit, making it more accurate and
somewhat less chatty.

* Avoid wrapping exceptions when not necessary.
2019-04-29 09:55:04 -07:00
.github Remove [PROPOSAL] from Proposal issue template; Add 'Other' template for convenience (#7364) 2019-03-28 18:40:43 +08:00
.idea Make JavaScript and XML errors non-TeamCity errors; Update JavaScript language level to ES6 in IntelliJ settings (#7541) 2019-04-25 11:21:58 -07:00
benchmarks Update scan benchmark for time ordering (#7385) 2019-03-30 11:36:25 -07:00
ci Move dev-related files and instructions to dev/ directory; add committer's instructions (#7279) 2019-04-17 15:27:14 +02:00
cloud Move GCP to a core extension (#6953) 2019-03-27 09:00:43 -07:00
codestyle Prohibit Throwables.propagate() (#7121) 2019-03-14 18:28:33 -03:00
core Java 9 compatible specialized class compilation (#7477) 2019-04-29 18:44:28 +02:00
dev Move dev-related files and instructions to dev/ directory; add committer's instructions (#7279) 2019-04-17 15:27:14 +02:00
distribution Contributing Moving-Average Query to open source. (#6430) 2019-04-26 17:07:48 -07:00
docs SQL: Remove "useFallback" feature. (#7567) 2019-04-28 18:26:44 -07:00
examples Deprecate NoneShardSpec and drop support for automatic segment merge (#6883) 2019-03-15 23:29:25 -07:00
extendedset Set version to 0.15.0-incubating-SNAPSHOT (#7014) 2019-02-07 14:02:52 -08:00
extensions-contrib Contributing Moving-Average Query to open source. (#6430) 2019-04-26 17:07:48 -07:00
extensions-core handle empty sketches (#7526) 2019-04-25 14:28:41 -07:00
hll Densify swapped hll buffer (#6865) 2019-03-06 14:50:04 -08:00
indexing-hadoop Pass in segmentTable correctly (#7492) 2019-04-17 20:07:22 -07:00
indexing-service Fix encoded taskId check in chatHandlerResource (#7520) 2019-04-20 18:08:34 -07:00
integration-tests refactor lookups to be more chill to router (#7222) 2019-04-05 14:49:41 -07:00
licenses Fix some bundled license files (#7516) 2019-04-19 16:07:44 -07:00
processing Java 9 compatible specialized class compilation (#7477) 2019-04-29 18:44:28 +02:00
publications add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
server BaseAppenderatorDriver: Fix potentially overeager segment cleanup. (#7558) 2019-04-29 09:55:04 -07:00
services add auth check exclusion for console-config.js added in #7414 (#7442) 2019-04-10 21:44:26 -07:00
sql SQL: Remove "useFallback" feature. (#7567) 2019-04-28 18:26:44 -07:00
web-console Fix history dialog styling (#7536) 2019-04-25 07:59:34 -07:00
.dockerignore Add docker container for druid (#6896) 2019-02-08 12:12:28 +00:00
.gitignore Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
.travis.yml add travis check to make sure -Pdist works (#7418) 2019-04-07 20:12:23 -07:00
CONTRIBUTING.md Move dev-related files and instructions to dev/ directory; add committer's instructions (#7279) 2019-04-17 15:27:14 +02:00
DISCLAIMER add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
LABELS.md Update LICENSE and NOTICE files (#7026) 2019-03-04 18:45:22 -08:00
LICENSE Java 9 compatible ByteBuffer unmap operation (#7466) 2019-04-15 09:03:18 -07:00
LICENSE.BINARY fix LICENSE.BINARY to have correct datasketches version (#7557) 2019-04-25 22:00:13 -07:00
NOTICE Fix 0.14.0 rc1 voting issues (#7284) 2019-03-18 14:16:21 -07:00
NOTICE.BINARY Fix 0.14.0 rc1 voting issues (#7284) 2019-03-18 14:16:21 -07:00
README.md Fix 0.14.0 rc1 voting issues (#7284) 2019-03-18 14:16:21 -07:00
pom.xml Contributing Moving-Average Query to open source. (#6430) 2019-04-26 17:07:48 -07:00
upload.sh Adding licenses and enable apache-rat-plugin. (#6215) 2018-09-18 08:39:26 -07:00

README.md

Build Status Inspections Status Coverage Status IRC#druid-dev

Apache Druid (incubating)

Apache Druid (incubating) is a high performance analytics data store for event-driven data.

Disclaimer: Apache Druid is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

License

Apache License, Version 2.0

More Information

More information about Druid can be found on http://www.druid.io.

Documentation

You can find the documentation for the latest Druid release on the project website.

If you would like to contribute documentation, please do so under /docs/content in this repository and submit a pull request.

Getting Started

You can get started with Druid with our quickstart.

Reporting Issues

If you find any bugs, please file a GitHub issue.

Community

The Druid community is in the process of migrating to Apache by way of the Apache Incubator. Eventually, as we proceed along this path, our site will move from http://druid.io/ to https://druid.apache.org/.

Community support is available on the druid-user mailing list(druid-user@googlegroups.com), which is hosted at Google Groups.

Development discussions occur on dev@druid.apache.org, which you can subscribe to by emailing dev-subscribe@druid.apache.org.

We also have a couple people hanging out on IRC in #druid-dev on irc.freenode.net.

Building From Source

Please note that JDK 8 is required to build Druid.

For instructions on building Druid from source, see docs/content/development/build.md

Contributing

Please follow the guidelines listed here.