Apache Druid: a high performance real-time analytics database.
Go to file
Gian Merlino 0ce406bdf1
Introduce "transformSpec" at ingest-time. (#4890)
* Introduce "transformSpec" at ingest-time.

It accepts a "filter" (standard query filter object) and "transforms" (a
list of objects with "name" and "expression"). These can be used to do
filtering and single-row transforms without need for a separate data
processing job.

The "expression" fields use the same expression language as other
expression-based feature.

* Remove forbidden api.

* Fix compile error.

* Fix tests.

* Some more changes.

- Add nullable annotation to Firehose.nextRow.
- Add tests for index task, realtime task, kafka task, hadoop mapper,
  and ingestSegment firehose.

* Fix bad merge.

* Adjust imports.

* Adjust whitespace.

* Make Transform into an interface.

* Add missing annotation.

* Switch logger.

* Switch logger.

* Adjust test.

* Adjustment to handling for DatasourceIngestionSpec.

* Fix test.

* CR comments.

* Remove unused method.

* Add javadocs.

* More javadocs, and always decorate.

* Fix bug in TransformingStringInputRowParser.

* Fix bad merge.

* Fix ISFF tests.

* Fix DORC test.
2017-10-30 17:38:52 -07:00
.idea Add checkstyle and intellij rule to prohibit unnecessary qualifiers in interfaces (#4958) 2017-10-13 07:56:19 -07:00
api Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
aws-common Refactoring PrefetchableTextFilesFirehoseFactory (#4836) 2017-10-13 21:39:28 -05:00
benchmarks Refactor ColumnSelectorFactory; Rely on ColumnValueSelector's polymorphism (#4886) 2017-10-13 21:44:17 -05:00
bytebuffer-collections Add checkstyle and intellij rule to prohibit unnecessary qualifiers in interfaces (#4958) 2017-10-13 07:56:19 -07:00
ci Run integration tests on travis (#4344) 2017-05-31 18:27:34 -07:00
codestyle Add checkstyle and intellij rule to prohibit unnecessary qualifiers in interfaces (#4958) 2017-10-13 07:56:19 -07:00
common Reduce code duplication between test ExprMacroTables. (#4979) 2017-10-18 15:57:49 -05:00
distribution Bump versions in master to 0.11.1-SNAPSHOT. (#4878) 2017-09-28 17:09:51 -05:00
docs Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
examples Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
extendedset Add checkstyle and intellij rule to prohibit unnecessary qualifiers in interfaces (#4958) 2017-10-13 07:56:19 -07:00
extensions-contrib Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
extensions-core Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
hll Bump versions in master to 0.11.1-SNAPSHOT. (#4878) 2017-09-28 17:09:51 -05:00
indexing-hadoop Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
indexing-service Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
integration-tests Use ubuntu image with pre-installed java 8 for IT docker (#4970) 2017-10-18 09:33:27 -05:00
java-util Optional segment load/drop management without zookeeper using http (#4966) 2017-10-19 12:41:23 -07:00
processing Fix improper handling of empty arrays in StringDimensionIndexer. (#5012) 2017-10-27 14:21:48 -07:00
publications Changes to lambda architecture paper required for HICSS (#3382) 2016-09-06 21:32:21 -07:00
server Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
services Introduce "transformSpec" at ingest-time. (#4890) 2017-10-30 17:38:52 -07:00
sql Filter unauthorized datasources in INFORMATION_SCHEMA queries (#4998) 2017-10-26 12:36:47 -07:00
.gitignore git ignore dependency-reduced-pom.xml (#4711) 2017-08-23 10:10:50 -07:00
.travis.yml Try to improve CI reliability. (#4787) 2017-09-12 22:24:45 -05:00
CONTRIBUTING.md Update git workflow (#4418) 2017-06-16 19:27:46 -07:00
DruidCorporateCLA.pdf fix CLA email / mailing address 2014-04-17 15:26:28 -07:00
DruidIndividualCLA.pdf fix CLA email / mailing address 2014-04-17 15:26:28 -07:00
INTELLIJ_SETUP.md Add INTELLIJ_SETUP.md (#4261) 2017-05-17 01:26:16 +09:00
LICENSE Clean up README and license 2015-02-18 23:09:28 -08:00
NOTICE Extension points for authentication/authorization (#4271) 2017-09-15 23:45:48 -07:00
README.md Add TeamCity inspections badge (#4351) 2017-06-06 20:53:25 -04:00
druid_intellij_formatting.xml Make formatting IntelliJ 2016 friendly (#2978) 2016-05-18 12:42:21 -07:00
eclipse.importorder Merge pull request #2905 from javasoze/eclipse_formatting 2016-04-29 18:42:03 -07:00
eclipse_formatting.xml Merge pull request #2905 from javasoze/eclipse_formatting 2016-04-29 18:42:03 -07:00
pom.xml Upgrade fastutil to 8.1.0 (#4988) 2017-10-19 23:37:43 -05:00
upload.sh upload.sh: Use awscli if s3cmd is not available. (#3114) 2016-06-08 17:01:46 -07:00

README.md

Build Status Inspections Status Coverage Status

Druid

Druid is a distributed, column-oriented, real-time analytics data store that is commonly used to power exploratory dashboards in multi-tenant environments.

Druid excels as a data warehousing solution for fast aggregate queries on petabyte sized data sets. Druid supports a variety of flexible filters, exact calculations, approximate algorithms, and other useful calculations.

Druid can load both streaming and batch data and integrates with Samza, Kafka, Storm, Spark, and Hadoop.

License

Apache License, Version 2.0

More Information

More information about Druid can be found on http://www.druid.io.

Documentation

You can find the documentation for the latest Druid release on the project website.

If you would like to contribute documentation, please do so under /docs/content in this repository and submit a pull request.

Getting Started

You can get started with Druid with our quickstart.

Reporting Issues

If you find any bugs, please file a GitHub issue.

Community

Community support is available on the druid-user mailing list(druid-user@googlegroups.com).

Development discussions occur on the druid-development list(druid-development@googlegroups.com).

We also have a couple people hanging out on IRC in #druid-dev on irc.freenode.net.

Contributing

Please follow the guidelines listed here.