Apache Druid: a high performance real-time analytics database.
Go to file
Gian Merlino 3aa7017975 Remove some unnecessary task storage internal APIs. (#6058)
* Remove some unnecessary task storage internal APIs.

- Remove MetadataStorageActionHandler's getInactiveStatusesSince and getActiveEntriesWithStatus.
- Remove TaskStorage's getCreatedDateTimeAndDataSource.
- Remove TaskStorageQueryAdapter's getCreatedTime, and getCreatedDateAndDataSource.
- Migrated all callers to getActiveTaskInfo and getCompletedTaskInfo.

This has one side effect: since getActiveTaskInfo (new) warns and continues when it
sees unreadable tasks, but getActiveEntriesWithStatus threw an exception when it
encountered those, it means that after this patch bad tasks will be ignored when
syncing from metadata storage rather than causing an exception to be thrown.

IMO, this is an improvement, since the most likely reason for bad tasks is either:

- A new version introduced an additional validation, and a pre-existing task doesn't
  pass it.
- You are rolling back from a newer version to an older version.

In both cases, I believe you would want to skip tasks that can't be deserialized,
rather than blocking overlord startup.

* Remove unused import.

* Fix formatting.

* Fix formatting.
2018-07-30 18:35:06 -07:00
.idea Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
api Remove some unnecessary task storage internal APIs. (#6058) 2018-07-30 18:35:06 -07:00
aws-common Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
benchmarks Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
ci Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
codestyle Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
common Remove some unnecessary task storage internal APIs. (#6058) 2018-07-30 18:35:06 -07:00
distribution Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
docs Add definition of 'NONE' to queryGranularity in ingestion.index doc (#6073) 2018-07-30 14:07:33 -07:00
examples Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
extendedset Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
extensions-contrib Remove some unnecessary task storage internal APIs. (#6058) 2018-07-30 18:35:06 -07:00
extensions-core Fix ClassNotFoundException in druid-kerberos extension (#4776) 2018-07-27 16:23:09 -07:00
hll Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
indexing-hadoop Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
indexing-service Remove some unnecessary task storage internal APIs. (#6058) 2018-07-30 18:35:06 -07:00
integration-tests Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
java-util Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
processing Fix a bug in GroupByQueryEngine (#6062) 2018-07-30 14:39:38 -07:00
publications Changes to lambda architecture paper required for HICSS (#3382) 2016-09-06 21:32:21 -07:00
server Remove some unnecessary task storage internal APIs. (#6058) 2018-07-30 18:35:06 -07:00
services Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
sql Remove redundant type parameters and enforce some other style and inspection rules (#5980) 2018-07-27 16:56:49 -05:00
.gitignore git ignore dependency-reduced-pom.xml (#4711) 2017-08-23 10:10:50 -07:00
.travis.yml skip travis on doc only changes (#6061) 2018-07-30 13:36:49 -07:00
CONTRIBUTING.md Replace dev list references in docs. (#5723) 2018-04-30 11:25:45 -07:00
DruidCorporateCLA.pdf fix CLA email / mailing address 2014-04-17 15:26:28 -07:00
DruidIndividualCLA.pdf fix CLA email / mailing address 2014-04-17 15:26:28 -07:00
INTELLIJ_SETUP.md Prohibit and remove unused declarations in the processing module (#4930) 2017-11-09 09:27:27 -08:00
LICENSE Clean up README and license 2015-02-18 23:09:28 -08:00
NOTICE Extension points for authentication/authorization (#4271) 2017-09-15 23:45:48 -07:00
README.md Add IRC#druid-dev shields.io into README (#6002) 2018-07-21 13:31:35 -07:00
druid_intellij_formatting.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
eclipse.importorder Merge pull request #2905 from javasoze/eclipse_formatting 2016-04-29 18:42:03 -07:00
eclipse_formatting.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
intellij-sdk-config.jpg Prohibit and remove unused declarations in the processing module (#4930) 2017-11-09 09:27:27 -08:00
pom.xml Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
upload.sh upload.sh: Use awscli if s3cmd is not available. (#3114) 2016-06-08 17:01:46 -07:00

README.md

Build Status Inspections Status Coverage Status IRC#druid-dev

Apache Druid (incubating)

Apache Druid (incubating) is a high performance analytics data store for event-driven data.

Disclaimer: Apache Druid is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

License

Apache License, Version 2.0

More Information

More information about Druid can be found on http://www.druid.io.

Documentation

You can find the documentation for the latest Druid release on the project website.

If you would like to contribute documentation, please do so under /docs/content in this repository and submit a pull request.

Getting Started

You can get started with Druid with our quickstart.

Reporting Issues

If you find any bugs, please file a GitHub issue.

Community

The Druid community is in the process of migrating to Apache by way of the Apache Incubator. Eventually, as we proceed along this path, our site will move from http://druid.io/ to https://druid.apache.org/.

Community support is available on the druid-user mailing list(druid-user@googlegroups.com), which is hosted at Google Groups.

Development discussions occur on dev@druid.apache.org, which you can subscribe to by emailing dev-subscribe@druid.apache.org.

We also have a couple people hanging out on IRC in #druid-dev on irc.freenode.net.

Contributing

Please follow the guidelines listed here.