Commit Graph

352 Commits

Author SHA1 Message Date
xvrl a2090411a3 modify cacheBroker interface to implement bulk-get 2013-01-16 14:49:50 -08:00
Gian Merlino 6fc350bfba YeOldePlumberSchool: Populate dimension metadata in segment descriptor 2013-01-16 11:30:24 -08:00
Gian Merlino 7b42ee6a6e Rework DeterminePartitionsJob in the hadoop indexer
- Can handle non-rolled-up input (by grouping input rows using an additional MR stage)
- Can select its own partitioning dimension, if none is supplied
- Can detect and avoid oversized shards due to bad dimension value distribution
- Shares input parsing code with IndexGeneratorJob
2013-01-16 08:15:01 -08:00
Eric Tschetter 538d00e75e Merge branch 'master' of github.com:metamx/druid 2013-01-16 10:02:01 -06:00
Eric Tschetter 8b31d8db9f 1) Adjust IndexMerger to create convert the indexes it creates from the old format to the new. This is done quite sub-optimally, but it will work for now... 2013-01-16 10:01:46 -06:00
Gian Merlino 616415cb7e UniformGranularitySpec: Only return bucketInterval for timestamps that legitimately
overlap our input intervals
2013-01-15 22:30:17 -08:00
Gian Merlino 86277d1114 StringInputRowParser: Treat dimensionExclusions case-insensitively 2013-01-15 22:30:17 -08:00
Fangjin Yang 3c0880fe28 Merge branch 'master' into autoscaling 2013-01-15 13:36:39 -08:00
Fangjin Yang 7e074e8158 fix pom breakage 2013-01-15 12:04:12 -08:00
Fangjin Yang 47ac36d3e4 Merge branch 'master' of github.com:metamx/druid into autoscaling 2013-01-15 12:02:32 -08:00
Eric Tschetter 998f0bf3c8 1) Better error message when aggregators want more memory than is available. 2013-01-14 18:00:51 -06:00
Fangjin Yang ae76097bc8 Merge branch 'master' into autoscaling 2013-01-14 14:55:29 -08:00
Fangjin Yang d1f4317af7 updates to autoscaling config based on code review comments 2013-01-14 14:55:04 -08:00
Eric Tschetter 135474e49e Merge branch 'master' of github.com:metamx/druid 2013-01-14 15:01:32 -06:00
Eric Tschetter 3de62b34b6 1) Should be on 0.2.0 with the recent API changes for StorageAdapters 2013-01-14 15:00:28 -06:00
Fangjin Yang 4c2da93389 bug fixes with ec2 auto scaling 2013-01-09 14:51:35 -08:00
Fangjin Yang 3685839376 Merge branch 'master' into autoscaling
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
2013-01-07 18:04:14 -08:00
xvrl 700ce24106 fix JVM optimizing out the benchmarking code 2013-01-07 16:54:35 -08:00
Fangjin Yang 79e9ff94a6 add missing headers 2013-01-07 14:07:47 -08:00
Fangjin Yang aff4a05ca3 db based configs for indexer workers 2013-01-07 13:41:26 -08:00
Eric Tschetter 4ef31de62d 1) Fix stray import, take 2... yay IntelliJ 2013-01-07 13:11:28 -08:00
Eric Tschetter b62bdf915b 1) Fix stray import... yay IntelliJ 2013-01-07 10:09:19 -08:00
Eric Tschetter 72db507cf8 1) Update java-util version to be a non-SNAPSHOT version 2013-01-06 23:37:52 -08:00
Eric Tschetter b184c46ae0 1) Introduce idea of value types and generic columns to the serialization format
2) Create SegmentLoader interface for the loading of segments!
3) Setup serialization of new format and conversion function inside IndexIO
4) Make some adjustments to the twitter demo to make it make a bit more sense based on some email feedback from someone kicking the tires.
2013-01-04 18:12:49 -06:00
Eric Tschetter 4f5087b386 Merge branch 'master' of github.com:metamx/druid 2013-01-04 11:28:35 -06:00
xvrl 9627fdcd1c [maven-release-plugin] prepare for next development iteration 2013-01-03 10:09:52 -08:00
xvrl f2c2d3f4cf [maven-release-plugin] prepare release druid-0.1.25 2013-01-03 10:09:43 -08:00
cheddar 6318abb0bd Merge pull request #50 from metamx/postagg-dependencies
postAggregators now return field dependencies
2013-01-03 10:05:14 -08:00
xvrl 824997eb43 simplify code 2013-01-03 10:01:42 -08:00
cheddar 04492b43f2 Merge pull request #49 from metamx/rule-timestamp-fix
Use explicit timestamp for time based load/drop rules
2013-01-03 09:55:32 -08:00
xvrl 41edec62ce remove unused imports 2013-01-02 18:46:07 -08:00
xvrl 6525d818ad postAggregators now return field dependencies 2013-01-02 18:36:03 -08:00
xvrl a9b8d8f1ce fix end of month bug in PeriodDropRule as well 2013-01-02 16:10:23 -08:00
xvrl 0543322c56 tested timestamps should be deterministic 2013-01-02 14:31:51 -08:00
xvrl 19c3fd3363 make reference timestamp explicit for time based rules 2013-01-02 14:27:34 -08:00
xvrl 2a188996cd [maven-release-plugin] prepare for next development iteration 2012-12-31 14:56:10 -08:00
xvrl 6cdcc2becc [maven-release-plugin] prepare release druid-0.1.24 2012-12-31 14:56:03 -08:00
xvrl d0290b1975 fix flawed interval overlap rule test
fails around month end
2012-12-31 14:52:42 -08:00
xvrl db08640efc reenable daylight saving test, now that we use joda-time 2 2012-12-31 14:10:43 -08:00
Eric Tschetter 3bfbcbe95c 1) Create DirectClientQuerySegmentWalker to make it a bit easier to embed and use DirectDruidClient as a client. 2012-12-28 10:50:40 -06:00
cheddar 93924d8895 Merge pull request #47 from metamx/queue-metrics
query/wait and exec/backlog metrics
2012-12-27 14:22:07 -08:00
cheddar 438b85d2dd Merge pull request #46 from metamx/short-alerts
Merger: De-parameterize alert messages
2012-12-27 14:08:02 -08:00
Gian Merlino 5c1b2360d6 - Add optional query/wait metric to MetricsEmittingQueryRunner
- Add MetricsEmittingExecutorService decorator, and use it on compute nodes
2012-12-20 16:11:08 -08:00
Fangjin Yang 5137af0750 [maven-release-plugin] prepare for next development iteration 2012-12-18 16:17:44 -08:00
Fangjin Yang c579ba5a42 [maven-release-plugin] prepare release druid-0.1.23 2012-12-18 16:17:38 -08:00
Fangjin Yang 00ecf9d028 sorted db datasources for rules; smaller time boundary range 2012-12-18 16:16:03 -08:00
Fangjin Yang 090a5a105d [maven-release-plugin] prepare for next development iteration 2012-12-18 14:19:09 -08:00
Fangjin Yang fb8f4f1f41 [maven-release-plugin] prepare release druid-0.1.22 2012-12-18 14:19:02 -08:00
xvrl 2a7214089e fix NPE in segmentMetadata query for null dimension values 2012-12-18 14:10:01 -08:00
Fangjin Yang 75d465aed0 [maven-release-plugin] prepare for next development iteration 2012-12-18 10:37:16 -08:00