Eric Tschetter
6c73de68d8
1) Work around Jackson bug with constructor parameters and setters.
2012-12-01 09:53:52 -06:00
Fangjin Yang
91cd9e9536
fix broken UT
2012-11-30 13:17:14 -08:00
Fangjin Yang
e1527a44d4
Merge branch 'master' into fjy
2012-11-30 11:37:02 -08:00
Fangjin Yang
1fb3bf5cd8
remove defaults for druid tiers
2012-11-30 11:32:02 -08:00
Fangjin Yang
aa8fb7b9a3
abstract the assign and drop logic; cleanups everywhere; http endpoints for getting and assigning rules
2012-11-30 11:28:10 -08:00
cheddar
25a4caac62
Merge pull request #37 from Benky/master
...
RemoteTaskRunner#run should fail on task with taskId from tasks.keys set
2012-11-29 09:21:41 -08:00
Richard Benkovsky
e950c6333d
RemoteTaskRunner#run should fail on task with taskId from tasks.keys set
2012-11-29 09:42:28 +01:00
Fangjin Yang
2e5e1ce989
first commit of tiers for compute nodes; working UT at this point
2012-11-28 17:37:08 -08:00
xvrl
7d2778fae6
fix TimeBoundaryQuery to properly handle timestamps prior to 1970
2012-11-28 13:12:38 -08:00
Eric Tschetter
09a31e5995
Tests should build.
2012-11-28 12:35:24 -06:00
Eric Tschetter
b85c54d8a3
Merge branch 'master' of github.com:metamx/druid
2012-11-28 11:55:25 -06:00
Eric Tschetter
4de6ef5025
1) Remove the requirement on the segmentsPath zk property.
2012-11-28 11:54:59 -06:00
Gian Merlino
5902ccd0cb
DruidMasterSegmentMerger: Clearer method names and more tests
2012-11-27 15:46:03 -08:00
Gian Merlino
cc8a14d5a1
IndexGeneratorTask: Log metrics when complete
2012-11-27 15:46:03 -08:00
Eric Tschetter
1e35913579
1) add a log line on plumber creation to make it easier to know what rejection policy is being used.
2012-11-27 11:12:28 -06:00
Eric Tschetter
790ba59244
1) Merge-n-push should only happen after messages have been seen such that it can happen.
2012-11-27 10:48:02 -06:00
Eric Tschetter
63c5b8c790
1) Camel case for consistency
2012-11-27 10:34:25 -06:00
Eric Tschetter
3c9f031759
1) Default the rejectionPolicy to server time
2012-11-27 10:33:20 -06:00
Eric Tschetter
253125cb25
1) Adjust RealtimePlumberSchool to take a configurable rejection policy that lets you switch between server time and message time for rejections.
2012-11-27 10:32:30 -06:00
Eric Tschetter
0da9075ff2
1) Better class-level javadoc for Firehose
2012-11-26 12:29:59 -06:00
Eric Tschetter
c929153a6c
1) Fix bug in random example introduced by case sensitivities
2012-11-26 11:41:29 -06:00
Eric Tschetter
0390e7fa5c
[maven-release-plugin] prepare for next development iteration
2012-11-21 22:13:15 -06:00
Eric Tschetter
93a9affa45
[maven-release-plugin] prepare release druid-0.1.6
2012-11-21 22:13:08 -06:00
Eric Tschetter
e2da8df3f4
1) Fix build
2012-11-21 19:15:08 -06:00
Eric Tschetter
9c732e75a1
1) Add new SearchQueryDimFilter/SearchQueryFilter that will do a filter using the same queries that can be used for SearchQuery
2012-11-21 19:06:32 -06:00
Eric Tschetter
3a9591bda6
Merge branch 'master' of github.com:metamx/druid
2012-11-21 18:39:09 -06:00
Eric Tschetter
228b223509
1) Fix bug with Sinks that causes Realtime it to overwrite the first chunk of data when creating a segment to hand off to compute nodes.
...
2) Fix bug with RealtimePlumberSchool that can cause it to miss some previously-persisted segments when directory naming changes
3) Have the various runnables in RealtimePlumberSchool name the threads to make it a bit easier to debug
2012-11-21 18:38:57 -06:00
Gian Merlino
5e447937e2
[maven-release-plugin] prepare for next development iteration
2012-11-21 16:09:14 -08:00
Gian Merlino
32d46a3eec
[maven-release-plugin] prepare release druid-0.1.5
2012-11-21 16:09:08 -08:00
Gian Merlino
09669b6a2e
TaskConsumer: Don't tell the queue we're done if we have been shut down
2012-11-21 12:20:38 -08:00
Eric Tschetter
06b8e4230c
1) Fix PostAggregations with GroupBy ( Fixes #24 )
...
2) Add GroupByTimeseriesQueryRunnerTest which wraps a GroupByQueryRunner to look like a TimeseriesQueryRunner and leverages the tests there to help verify behavior (#8 )
2012-11-21 12:51:43 -06:00
Eric Tschetter
7497a31943
1) Revert emr hadoop version that was accidentally commited in pom.
2012-11-20 16:14:22 -06:00
Eric Tschetter
0f63cb4f00
1) Have IndexGeneratorJob write the descriptors for each of the segments it creates to a path in the temporary working directory (generally HDFS)
...
2) Have the DbUpdaterJob read descriptors from the temporary working directory instead of looking in the final segment output location (often the eventually consistent S3)
3) 1 and 2 Fixes #30
2012-11-20 15:30:50 -06:00
Eric Tschetter
9cbffa287f
Merge branch 'master' of github.com:metamx/druid
2012-11-20 10:13:49 -06:00
Eric Tschetter
a48b67c917
1) Remove -Djava.net.preferIPv4Stack=true from the install script, not sure why it's there.
2012-11-20 10:13:33 -06:00
cheddar
6107bb7b80
Merge pull request #32 from metamx/fjy
...
Fixes to indexing service to handle large merges better
2012-11-19 15:51:07 -08:00
Fangjin Yang
4131063049
Merge branch 'master' into fjy
2012-11-19 15:07:00 -08:00
Fangjin Yang
b228c053e5
bug fix for too much data to indexer
2012-11-19 15:06:46 -08:00
Eric Tschetter
c657969243
Merge branch 'master' of github.com:metamx/druid
2012-11-19 17:01:33 -06:00
Eric Tschetter
701cc9562b
1) Adjust the StorageAdapters to lowercase names of metrics and dimensions before looking them up.
...
2) Add some docs to InputRow/Row to indicate that column names passed into the methods are *always* lowercase and that the rows need to act accordingly. (fixes #29 , or at least clarifies the behavior...)
2012-11-19 17:01:17 -06:00
cheddar
cdda8c2b7c
Merge pull request #31 from tralfamadude/master
...
doc/data_flow* diagrams added
2012-11-19 14:55:47 -08:00
Gian Merlino
16835a1f84
Master: Add segment limit to merge selection algo
...
If we attempt to merge too many segments at once, we risk creating an
oversized indexing task.
2012-11-19 14:46:45 -08:00
Paul Baclace
b7d43a6622
doc/data_flow* diagrams added
2012-11-15 21:32:56 -08:00
Eric Tschetter
aa073e4e73
1) Add verification of memory settings to initialization. ( Fixes #21 )
2012-11-14 15:37:11 -06:00
Fangjin Yang
cf1c741f8a
[maven-release-plugin] prepare for next development iteration
2012-11-13 15:10:12 -08:00
Fangjin Yang
06bd77fca7
[maven-release-plugin] prepare release druid-0.1.4
2012-11-13 15:10:00 -08:00
cheddar
06ed0e7448
Merge pull request #28 from metamx/fjy
...
Some modifications on how to register things in Druid
2012-11-13 15:02:14 -08:00
Fangjin Yang
cd1a812fff
construct registering nodes with lists
2012-11-13 15:00:55 -08:00
Fangjin Yang
0ef40171a8
nodes no longer inherit from interfaces but instead extend classes
2012-11-13 13:18:31 -08:00
Fangjin Yang
24564d73e1
register subtypes for reducer
2012-11-12 16:41:34 -08:00