Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,852 Commits 111 Branches 503 Tags 721 MiB
Commit Graph

4852 Commits

Author SHA1 Message Date
Fangjin Yang aa8fb7b9a3 abstract the assign and drop logic; cleanups everywhere; http endpoints for getting and assigning rules 2012-11-30 11:28:10 -08:00
cheddar 25a4caac62 Merge pull request #37 from Benky/master 
RemoteTaskRunner#run should fail on task with taskId from tasks.keys set
 2012-11-29 09:21:41 -08:00
Richard Benkovsky e950c6333d RemoteTaskRunner#run should fail on task with taskId from tasks.keys set 2012-11-29 09:42:28 +01:00
Fangjin Yang 2e5e1ce989 first commit of tiers for compute nodes; working UT at this point 2012-11-28 17:37:08 -08:00
xvrl 7d2778fae6 fix TimeBoundaryQuery to properly handle timestamps prior to 1970 2012-11-28 13:12:38 -08:00
Eric Tschetter 09a31e5995 Tests should build. 2012-11-28 12:35:24 -06:00
Eric Tschetter b85c54d8a3 Merge branch 'master' of github.com:metamx/druid 2012-11-28 11:55:25 -06:00
Eric Tschetter 4de6ef5025 1) Remove the requirement on the segmentsPath zk property. 2012-11-28 11:54:59 -06:00
Gian Merlino 5902ccd0cb DruidMasterSegmentMerger: Clearer method names and more tests 2012-11-27 15:46:03 -08:00
Gian Merlino cc8a14d5a1 IndexGeneratorTask: Log metrics when complete 2012-11-27 15:46:03 -08:00
Eric Tschetter 1e35913579 1) add a log line on plumber creation to make it easier to know what rejection policy is being used. 2012-11-27 11:12:28 -06:00
Eric Tschetter 790ba59244 1) Merge-n-push should only happen after messages have been seen such that it can happen. 2012-11-27 10:48:02 -06:00
Eric Tschetter 63c5b8c790 1) Camel case for consistency 2012-11-27 10:34:25 -06:00
Eric Tschetter 3c9f031759 1) Default the rejectionPolicy to server time 2012-11-27 10:33:20 -06:00
Eric Tschetter 253125cb25 1) Adjust RealtimePlumberSchool to take a configurable rejection policy that lets you switch between server time and message time for rejections. 2012-11-27 10:32:30 -06:00
Eric Tschetter 0da9075ff2 1) Better class-level javadoc for Firehose 2012-11-26 12:29:59 -06:00
Eric Tschetter c929153a6c 1) Fix bug in random example introduced by case sensitivities 2012-11-26 11:41:29 -06:00
Eric Tschetter 0390e7fa5c [maven-release-plugin] prepare for next development iteration 2012-11-21 22:13:15 -06:00
Eric Tschetter 93a9affa45 [maven-release-plugin] prepare release druid-0.1.6 2012-11-21 22:13:08 -06:00
Eric Tschetter e2da8df3f4 1) Fix build 2012-11-21 19:15:08 -06:00
Eric Tschetter 9c732e75a1 1) Add new SearchQueryDimFilter/SearchQueryFilter that will do a filter using the same queries that can be used for SearchQuery 2012-11-21 19:06:32 -06:00
Eric Tschetter 3a9591bda6 Merge branch 'master' of github.com:metamx/druid 2012-11-21 18:39:09 -06:00
Eric Tschetter 228b223509 1) Fix bug with Sinks that causes Realtime it to overwrite the first chunk of data when creating a segment to hand off to compute nodes. 
2) Fix bug with RealtimePlumberSchool that can cause it to miss some previously-persisted segments when directory naming changes
3) Have the various runnables in RealtimePlumberSchool name the threads to make it a bit easier to debug
 2012-11-21 18:38:57 -06:00
Gian Merlino 5e447937e2 [maven-release-plugin] prepare for next development iteration 2012-11-21 16:09:14 -08:00
Gian Merlino 32d46a3eec [maven-release-plugin] prepare release druid-0.1.5 2012-11-21 16:09:08 -08:00
Gian Merlino 09669b6a2e TaskConsumer: Don't tell the queue we're done if we have been shut down 2012-11-21 12:20:38 -08:00
Eric Tschetter 06b8e4230c 1) Fix PostAggregations with GroupBy (Fixes #24) 
2) Add GroupByTimeseriesQueryRunnerTest which wraps a GroupByQueryRunner to look like a TimeseriesQueryRunner and leverages the tests there to help verify behavior (#8)
 2012-11-21 12:51:43 -06:00
Eric Tschetter 7497a31943 1) Revert emr hadoop version that was accidentally commited in pom. 2012-11-20 16:14:22 -06:00
Eric Tschetter 0f63cb4f00 1) Have IndexGeneratorJob write the descriptors for each of the segments it creates to a path in the temporary working directory (generally HDFS) 
2) Have the DbUpdaterJob read descriptors from the temporary working directory instead of looking in the final segment output location (often the eventually consistent S3)
3) 1 and 2 Fixes #30
 2012-11-20 15:30:50 -06:00
Eric Tschetter 9cbffa287f Merge branch 'master' of github.com:metamx/druid 2012-11-20 10:13:49 -06:00
Eric Tschetter a48b67c917 1) Remove -Djava.net.preferIPv4Stack=true from the install script, not sure why it's there. 2012-11-20 10:13:33 -06:00
cheddar 6107bb7b80 Merge pull request #32 from metamx/fjy 
Fixes to indexing service to handle large merges better
 2012-11-19 15:51:07 -08:00
Fangjin Yang 4131063049 Merge branch 'master' into fjy 2012-11-19 15:07:00 -08:00
Fangjin Yang b228c053e5 bug fix for too much data to indexer 2012-11-19 15:06:46 -08:00
Eric Tschetter c657969243 Merge branch 'master' of github.com:metamx/druid 2012-11-19 17:01:33 -06:00
Eric Tschetter 701cc9562b 1) Adjust the StorageAdapters to lowercase names of metrics and dimensions before looking them up. 
2) Add some docs to InputRow/Row to indicate that column names passed into the methods are *always* lowercase and that the rows need to act accordingly. (fixes #29, or at least clarifies the behavior...)
 2012-11-19 17:01:17 -06:00
cheddar cdda8c2b7c Merge pull request #31 from tralfamadude/master 
doc/data_flow* diagrams added
 2012-11-19 14:55:47 -08:00
Gian Merlino 16835a1f84 Master: Add segment limit to merge selection algo 
If we attempt to merge too many segments at once, we risk creating an
oversized indexing task.
 2012-11-19 14:46:45 -08:00
Paul Baclace b7d43a6622 doc/data_flow* diagrams added 2012-11-15 21:32:56 -08:00
Eric Tschetter aa073e4e73 1) Add verification of memory settings to initialization. (Fixes #21) 2012-11-14 15:37:11 -06:00
Fangjin Yang cf1c741f8a [maven-release-plugin] prepare for next development iteration 2012-11-13 15:10:12 -08:00
Fangjin Yang 06bd77fca7 [maven-release-plugin] prepare release druid-0.1.4 2012-11-13 15:10:00 -08:00
cheddar 06ed0e7448 Merge pull request #28 from metamx/fjy 
Some modifications on how to register things in Druid
 2012-11-13 15:02:14 -08:00
Fangjin Yang cd1a812fff construct registering nodes with lists 2012-11-13 15:00:55 -08:00
Fangjin Yang 0ef40171a8 nodes no longer inherit from interfaces but instead extend classes 2012-11-13 13:18:31 -08:00
Fangjin Yang 24564d73e1 register subtypes for reducer 2012-11-12 16:41:34 -08:00
Fangjin Yang 7eccd76e9a add missing headers 2012-11-12 16:34:48 -08:00
Fangjin Yang 0d697ed104 fix rename of this node 2012-11-12 16:17:51 -08:00
Fangjin Yang 57468d39ef reverting some of the last changes 2012-11-12 16:14:48 -08:00
Fangjin Yang c20dccd0f4 modifying the way registering serdes works to hopefully be a bit easier to use 2012-11-12 13:58:43 -08:00