Commit Graph

5131 Commits

Author SHA1 Message Date
nishantmonu51 3ec4a30ab5 initial commit
review comments

more refactoring and cleaning of redundant code

add UT + docs + more refactoring

fixes + review comments

more cleanup

end points to fetch history

review comments

remove unnecessary changes

review comments rename header name

review comments + add test for MetadataRulesManager

review comments docs
2015-03-12 22:50:29 +05:30
Xavier Léauté 127b6fd857 Merge pull request #1172 from himanshug/segment_metadata_eager
force eager the processing of segment metadata query on the processing executor
2015-03-12 10:19:48 -07:00
Fangjin Yang 199b11ad0b Merge pull request #1196 from metamx/kafka-update
update to kafka 0.8.2.1, because it's better™
2015-03-12 10:19:29 -07:00
Xavier Léauté 11b3230602 update to kafka 0.8.2.1, because it's better™ 2015-03-12 09:59:24 -07:00
Himanshu Gupta 23545fc01c correctly parse recentlyFinishedThreshold from config 2015-03-12 09:46:57 -05:00
Fangjin Yang 43d263930d Merge pull request #1194 from metamx/add-coverage-badge
add coverage badge to readme
2015-03-11 20:40:54 -07:00
Xavier Léauté 963b701e87 add coverage badge 2015-03-11 20:35:56 -07:00
Xavier Léauté fc613771d2 move test output to file for cleaner build logs
- removes the need for special test log4j2.xml
2015-03-11 17:56:19 -07:00
Xavier Léauté 75e92fd4dc Merge pull request #1192 from metamx/fix-bad-rebase
fix file missing from previous PR rebase
2015-03-11 17:44:17 -07:00
Xavier Léauté 0a5a3fe2dc fix file missing from rebase 2015-03-11 17:30:11 -07:00
Fangjin Yang a1d38f8526 Merge pull request #1159 from metamx/time-extraction
Add time extraction functions to project time as a dimension
2015-03-11 16:50:02 -07:00
Xavier Léauté e01ed16030 serde tests + equals/hashCode fixes for extraction functions 2015-03-11 16:48:28 -07:00
Xavier Léauté d3f5bddc5c Add ability to apply extraction functions to the time dimension
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
2015-03-11 16:45:42 -07:00
Himanshu Gupta 55ebf0cfdf force eager the processing of segment metadata query on the processing threadpool by using ChainedExecutionQueryRunner in SegmentMetadataQueryRunnerFactory.mergeRunners(..) 2015-03-11 12:58:58 -05:00
Xavier Léauté c97fbdf616 Merge pull request #1044 from metamx/groupby-postagg-naming-bug
Ensure unique names for aggregators / post-aggregators + optimize groupBy post-aggregators
2015-03-10 20:25:28 -07:00
Xavier Léauté 9944c288af Merge pull request #1189 from gianm/iam
Need a null check for iamProfile.
2015-03-10 17:53:52 -07:00
Gian Merlino b00c243786 Need a null check for iamProfile. 2015-03-10 17:52:15 -07:00
Xavier Léauté 909b8fd67f Merge pull request #1188 from gianm/iam
EC2AutoScaler: Allow setting "iamProfile".
2015-03-10 17:48:25 -07:00
Gian Merlino b810cdfe58 EC2AutoScaler: Allow setting "iamProfile". 2015-03-10 17:41:35 -07:00
Gian Merlino d102a89760 Fix license on EC2AutoScalerSerdeTest. 2015-03-10 17:31:30 -07:00
Xavier Léauté 217e674063 Handling aggregators and post aggregators with duplicate names
* add test for same-name groupBy hyperUniques post-agg
* add test for same-name post-agg in groupby with approx histogram
* Fixes https://github.com/druid-io/druid/issues/1045
* Throws an error if post aggs and aggs do not have unique names
* Add more groupBy tests for Having filters
2015-03-10 17:10:43 -07:00
Xavier Léauté 9f242ed1ba Merge pull request #1182 from druid-io/better-docs
Rework the druid docs and fix many mistakes
2015-03-10 14:23:38 -07:00
fjy 064d65a009 rework the druid docs and fix many mistakes 2015-03-10 14:19:19 -07:00
Fangjin Yang 0b467624ec Merge pull request #694 from druid-io/arithmetic-op-strategies
normal division & configurable ordering for ArithmeticPostAggregator
2015-03-10 13:48:27 -07:00
Fangjin Yang 2d79c6e5b9 Merge pull request #1187 from metamx/update-design-diagram
updates Realtime node's dataflow connection, s/historical/deep storage; ...
2015-03-10 13:46:21 -07:00
Fangjin Yang fa2c431589 Merge pull request #1186 from metamx/dataFormatDocsUpdate
Update Data_formats.md to match arguments used in 0.7.x
2015-03-10 13:45:37 -07:00
Igal Levy 705a7b3f23 updates Realtime node's dataflow connection, s/historical/deep storage; a bit more information on how Realtime nodes drop segments based on said segments' uptake by Historicals 2015-03-10 13:44:36 -07:00
Xavier Léauté 9992cc93f3 Merge pull request #1185 from gianm/subnets
EC2AutoScaler: Support for setting subnetId.
2015-03-10 13:41:32 -07:00
Charles Allen 2ac610771e Update Data_formats.md to match arguments used in 0.7.x 2015-03-10 13:41:11 -07:00
Gian Merlino 9235b45063 EC2AutoScaler: Support for setting subnetId. 2015-03-10 11:29:56 -07:00
Fangjin Yang c7ec8ba15b Merge pull request #1184 from metamx/docs-event-receiver-firehose
fix docs and add docs for event receiver firehose
2015-03-10 10:23:19 -07:00
nishantmonu51 425ad98261 fix docs and add docs for event receiver firehose 2015-03-10 21:29:57 +05:30
Fangjin Yang cee7e12cb7 Merge pull request #1183 from metamx/update-design-diagram
updates diagram: s/MySql/metadata storage
2015-03-09 16:54:03 -07:00
Igal Levy f98e168ed5 updates diagram: s/MySql/metadata storage' 2015-03-09 16:41:21 -07:00
Fangjin Yang e9b38f4abe Merge pull request #1181 from metamx/coveralls-coverage
add code coverage report using coveralls.io
2015-03-09 15:39:53 -07:00
Xavier Léauté ef842b2eae add test coverage 2015-03-09 14:32:13 -07:00
Fangjin Yang 2abdce1dc0 Merge pull request #1180 from metamx/logging-groupBy-NPE
add null check early to catch root cause for groupBy NPE while running bySegment query
2015-03-09 09:16:33 -07:00
nishantmonu51 704f463dbf fix property name in doc 2015-03-09 21:19:29 +05:30
nishantmonu51 6e935cca0a add null check early to catch root cause 2015-03-09 21:10:28 +05:30
Fangjin Yang 88a1d1e048 Merge pull request #1179 from himanshug/batch_ingest_no_data
fail early if there is no input data found for batch hadoop indexing
2015-03-07 11:00:52 -08:00
Himanshu Gupta 6a0405de20 fail early if there is no input data for batch hadoop indexing 2015-03-07 12:45:57 -06:00
Fangjin Yang a54f93ea42 Merge pull request #1178 from himanshug/doc_fix
simple typo fix on Concepts-and-Terminology.md
2015-03-07 09:55:30 -08:00
Himanshu Gupta cb5ed4942c simple typo fix on Concepts-and_Terminology.md to correct navigation to spec file info 2015-03-07 11:29:24 -06:00
Xavier Léauté e161021902 Merge pull request #1171 from druid-io/fix-rt-task
Add more metrics and fail when realtime tasks fail to persist and merge
2015-03-06 16:42:23 -08:00
fjy 86a0a3cab8 add more metrics and fail when realtime tasks fail to persist and merge 2015-03-06 11:00:34 -08:00
Xavier Léauté bfe61703f5 Merge pull request #1167 from himanshug/servlet_filter_holder2
feature to add servlet filters in a druid node via extension modules
2015-03-06 09:53:01 -08:00
Himanshu Gupta 956361dbbd Refactoring: Moved BaseJettyServerInitializer.java to JettyServerInitUtils.java and changed it from abstract class to a utils class containing static methods
And, moved jetty stuff to its own package io.druid.server.initialization.jetty
2015-03-05 19:33:27 -06:00
Xavier Léauté 3c787eb213 Merge pull request #1174 from himanshug/java-util-update
updating java-util version to 0.26.15
2015-03-05 16:46:58 -08:00
Xavier Léauté a98af90398 Merge pull request #1173 from himanshug/druid-api-update
updating druid-api version to 0.3.5
2015-03-05 16:29:53 -08:00
Himanshu Gupta 492148c837 updating java-util version to 0.26.15 2015-03-05 18:29:50 -06:00