Eric Tschetter
4de6ef5025
1) Remove the requirement on the segmentsPath zk property.
2012-11-28 11:54:59 -06:00
Gian Merlino
5902ccd0cb
DruidMasterSegmentMerger: Clearer method names and more tests
2012-11-27 15:46:03 -08:00
Gian Merlino
cc8a14d5a1
IndexGeneratorTask: Log metrics when complete
2012-11-27 15:46:03 -08:00
Eric Tschetter
1e35913579
1) add a log line on plumber creation to make it easier to know what rejection policy is being used.
2012-11-27 11:12:28 -06:00
Eric Tschetter
790ba59244
1) Merge-n-push should only happen after messages have been seen such that it can happen.
2012-11-27 10:48:02 -06:00
Eric Tschetter
63c5b8c790
1) Camel case for consistency
2012-11-27 10:34:25 -06:00
Eric Tschetter
3c9f031759
1) Default the rejectionPolicy to server time
2012-11-27 10:33:20 -06:00
Eric Tschetter
253125cb25
1) Adjust RealtimePlumberSchool to take a configurable rejection policy that lets you switch between server time and message time for rejections.
2012-11-27 10:32:30 -06:00
Eric Tschetter
0da9075ff2
1) Better class-level javadoc for Firehose
2012-11-26 12:29:59 -06:00
Eric Tschetter
c929153a6c
1) Fix bug in random example introduced by case sensitivities
2012-11-26 11:41:29 -06:00
Eric Tschetter
0390e7fa5c
[maven-release-plugin] prepare for next development iteration
2012-11-21 22:13:15 -06:00
Eric Tschetter
93a9affa45
[maven-release-plugin] prepare release druid-0.1.6
2012-11-21 22:13:08 -06:00
Eric Tschetter
e2da8df3f4
1) Fix build
2012-11-21 19:15:08 -06:00
Eric Tschetter
9c732e75a1
1) Add new SearchQueryDimFilter/SearchQueryFilter that will do a filter using the same queries that can be used for SearchQuery
2012-11-21 19:06:32 -06:00
Eric Tschetter
3a9591bda6
Merge branch 'master' of github.com:metamx/druid
2012-11-21 18:39:09 -06:00
Eric Tschetter
228b223509
1) Fix bug with Sinks that causes Realtime it to overwrite the first chunk of data when creating a segment to hand off to compute nodes.
...
2) Fix bug with RealtimePlumberSchool that can cause it to miss some previously-persisted segments when directory naming changes
3) Have the various runnables in RealtimePlumberSchool name the threads to make it a bit easier to debug
2012-11-21 18:38:57 -06:00
Gian Merlino
5e447937e2
[maven-release-plugin] prepare for next development iteration
2012-11-21 16:09:14 -08:00
Gian Merlino
32d46a3eec
[maven-release-plugin] prepare release druid-0.1.5
2012-11-21 16:09:08 -08:00
Gian Merlino
09669b6a2e
TaskConsumer: Don't tell the queue we're done if we have been shut down
2012-11-21 12:20:38 -08:00
Eric Tschetter
06b8e4230c
1) Fix PostAggregations with GroupBy ( Fixes #24 )
...
2) Add GroupByTimeseriesQueryRunnerTest which wraps a GroupByQueryRunner to look like a TimeseriesQueryRunner and leverages the tests there to help verify behavior (#8 )
2012-11-21 12:51:43 -06:00
Eric Tschetter
7497a31943
1) Revert emr hadoop version that was accidentally commited in pom.
2012-11-20 16:14:22 -06:00
Eric Tschetter
0f63cb4f00
1) Have IndexGeneratorJob write the descriptors for each of the segments it creates to a path in the temporary working directory (generally HDFS)
...
2) Have the DbUpdaterJob read descriptors from the temporary working directory instead of looking in the final segment output location (often the eventually consistent S3)
3) 1 and 2 Fixes #30
2012-11-20 15:30:50 -06:00
Eric Tschetter
9cbffa287f
Merge branch 'master' of github.com:metamx/druid
2012-11-20 10:13:49 -06:00
Eric Tschetter
a48b67c917
1) Remove -Djava.net.preferIPv4Stack=true from the install script, not sure why it's there.
2012-11-20 10:13:33 -06:00
cheddar
6107bb7b80
Merge pull request #32 from metamx/fjy
...
Fixes to indexing service to handle large merges better
2012-11-19 15:51:07 -08:00
Fangjin Yang
4131063049
Merge branch 'master' into fjy
2012-11-19 15:07:00 -08:00
Fangjin Yang
b228c053e5
bug fix for too much data to indexer
2012-11-19 15:06:46 -08:00
Eric Tschetter
c657969243
Merge branch 'master' of github.com:metamx/druid
2012-11-19 17:01:33 -06:00
Eric Tschetter
701cc9562b
1) Adjust the StorageAdapters to lowercase names of metrics and dimensions before looking them up.
...
2) Add some docs to InputRow/Row to indicate that column names passed into the methods are *always* lowercase and that the rows need to act accordingly. (fixes #29 , or at least clarifies the behavior...)
2012-11-19 17:01:17 -06:00
cheddar
cdda8c2b7c
Merge pull request #31 from tralfamadude/master
...
doc/data_flow* diagrams added
2012-11-19 14:55:47 -08:00
Gian Merlino
16835a1f84
Master: Add segment limit to merge selection algo
...
If we attempt to merge too many segments at once, we risk creating an
oversized indexing task.
2012-11-19 14:46:45 -08:00
Paul Baclace
b7d43a6622
doc/data_flow* diagrams added
2012-11-15 21:32:56 -08:00
Eric Tschetter
aa073e4e73
1) Add verification of memory settings to initialization. ( Fixes #21 )
2012-11-14 15:37:11 -06:00
Fangjin Yang
cf1c741f8a
[maven-release-plugin] prepare for next development iteration
2012-11-13 15:10:12 -08:00
Fangjin Yang
06bd77fca7
[maven-release-plugin] prepare release druid-0.1.4
2012-11-13 15:10:00 -08:00
cheddar
06ed0e7448
Merge pull request #28 from metamx/fjy
...
Some modifications on how to register things in Druid
2012-11-13 15:02:14 -08:00
Fangjin Yang
cd1a812fff
construct registering nodes with lists
2012-11-13 15:00:55 -08:00
Fangjin Yang
0ef40171a8
nodes no longer inherit from interfaces but instead extend classes
2012-11-13 13:18:31 -08:00
Fangjin Yang
24564d73e1
register subtypes for reducer
2012-11-12 16:41:34 -08:00
Fangjin Yang
7eccd76e9a
add missing headers
2012-11-12 16:34:48 -08:00
Fangjin Yang
0d697ed104
fix rename of this node
2012-11-12 16:17:51 -08:00
Fangjin Yang
57468d39ef
reverting some of the last changes
2012-11-12 16:14:48 -08:00
Fangjin Yang
c20dccd0f4
modifying the way registering serdes works to hopefully be a bit easier to use
2012-11-12 13:58:43 -08:00
cheddar
c30f04e0d4
Merge pull request #27 from marshallpierce/master
...
Remove duplicate copies of servlet-api from dependency tree
2012-11-12 08:49:31 -08:00
Marshall Pierce
447dfc0cc6
Switch to using javax.servlet:servlet-api:2.5 instead of two different versions of jetty's servlet-api distribution
2012-11-09 17:31:03 -08:00
Fangjin Yang
dd17992172
[maven-release-plugin] prepare for next development iteration
2012-11-09 15:50:24 -08:00
Fangjin Yang
47e71080db
[maven-release-plugin] prepare release druid-0.1.3
2012-11-09 15:50:16 -08:00
Fangjin Yang
e668660a9c
fix strategy check in indexing coordinator
2012-11-09 15:48:26 -08:00
Fangjin Yang
5859599365
[maven-release-plugin] prepare for next development iteration
2012-11-09 13:41:04 -08:00
Fangjin Yang
56f2c15e21
[maven-release-plugin] prepare release druid-0.1.2
2012-11-09 13:40:57 -08:00