73 Commits

Author SHA1 Message Date
cheddar
b42c5743c9 Merge pull request #177 from nebrera/master
Postgresql adaptation
2013-07-05 16:42:57 -07:00
fjy
fde874ea56 fix according to code review 2013-07-02 16:11:12 -07:00
Pablo Nebrera
e9ce6b596c PostgresSQL integration with druid 2013-06-28 12:49:24 +02:00
fjy
15a4dae2b1 bunch of issue fixes 2013-06-26 10:45:54 -07:00
fjy
bd9e6fecc1 fix day 1 issue with VIT 2013-05-28 14:26:49 -07:00
Gian Merlino
343af872b5 DbConnectorConfig: Serialization is hard 2013-05-14 14:39:29 -07:00
fjy
43d3c53806 fix order by double sum agg 2013-05-08 10:14:40 -07:00
cheddar
3c04f1635c 1) Fix bug with same name on multiple JSON properties 2013-05-02 18:00:50 -05:00
cheddar
60b279b0d3 1) Add support for storing segments in HDFS 2013-04-30 12:47:43 -05:00
cheddar
43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
Gian Merlino
dbfa045df0 DbConnector: SQL and validation query tweaks 2013-04-19 14:51:22 -07:00
Gian Merlino
1a6594524f Merger: Tweaks to DB tables. Create tables automatically. 2013-04-19 14:07:27 -07:00
Gian Merlino
1dfe133554 DbConnector: Optional validation query (default off for now) 2013-04-19 14:07:27 -07:00
xvrl
66a52ed282 javascript aggregator now uses column selector 2013-04-16 09:33:50 -07:00
xvrl
b66f69def6 specify javascript aggregator functions individually to support getCombiningFactory() 2013-04-16 09:33:50 -07:00
xvrl
c83631928c object column selectors 2013-04-16 09:33:50 -07:00
xvrl
0c68bd1b1d rename MetricSelectorFactory to ColumnSelectorFactory 2013-04-16 09:33:49 -07:00
Eric Tschetter
55648c47a7 1) Adjust the GroupByQuery to also be able to merge results on the local node. Fixes #116
2) Make the GroupByQuery operate in a multi-threaded fashion by default (this is configurable via druid.query.groupBy.singleThreaded).  Fixes #96
3) Fix up some post aggregation computation stuff.  I believe #72 is fixed
4) Fix case sensitivity issue with post aggregations on GroupBy queries
2013-04-09 19:13:08 -07:00
René Scheibe
6c27cd2e8e cleanup - removed unused imports 2013-04-07 23:31:22 +02:00
René Scheibe
a6dc29cf85 cleanup - removed extra empty lines
- there should not be any adjacent empty lines
2013-04-07 14:32:09 +02:00
xvrl
8eec41f934 squigglies ftw 2013-03-20 11:42:17 -07:00
xvrl
c68bd66945 add close method to aggregators 2013-03-19 16:03:48 -07:00
Eric Tschetter
39449e6a3e Merge branch 'master' of github.com:metamx/druid 2013-03-14 16:45:54 -05:00
Gian Merlino
df8e4d4061 Merge branch 'master' into realtime-index-task 2013-03-13 22:43:01 -07:00
Eric Tschetter
1e0f2c2d92 1) Make log a bit more descriptive 2013-03-13 19:26:22 -05:00
Eric Tschetter
fa66e1d2cc 1) SQL is hard 2013-03-13 16:29:34 -05:00
Gian Merlino
3fa46988f5 Realtime:
- MetadataUpdater now built from SegmentAnnouncer, SegmentPublisher instances.
- Sinks can take a version instead of always using interval.start. The realtime
  plumber selects a version using a VersioningPolicy.
- Plumbers gained a startJob method.
- Realtime plumbers gained an implementation for finishJob.
2013-03-11 11:14:51 -07:00
Nelson Ray
a470f3fa6a change name of druid.indexer.configTable to druid.database.configTable to be consistent 2013-03-08 10:35:13 -08:00
Eric Tschetter
f70f71243d 1) Stop polling in ConfigManager when stop is called
2) Remove WorkSetupManager in favor of just using ConfigManager
2013-03-07 17:45:57 -06:00
Eric Tschetter
1c3ef48f34 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable
2) Use new ConfigManager to pull out a whitelist for the Master
2013-03-07 17:45:57 -06:00
Gian Merlino
f862d9205d Merge branch 'master' into hadoop-index-task
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
2013-02-27 06:53:06 -08:00
Gian Merlino
14cf506c43 DefaultObjectMapper: Add GuavaModule 2013-02-25 17:05:01 -08:00
Eric Tschetter
f8c54a72c2 1) Changes to allow for local storage 2013-02-21 15:47:01 -06:00
Eric Tschetter
dc3459d3f9 1) Initial commit of refactorings on top of housejester's to simplify the zipping and simplify the creation of other methods of loading data 2013-02-21 15:47:01 -06:00
Deep Ganguli
60da9ffddb Merge branch 'master' into hadoop-index-task
Conflicts:
	common/src/main/java/com/metamx/druid/utils/JodaUtils.java
	indexer/src/main/java/com/metamx/druid/indexer/DbUpdaterJob.java
	indexer/src/main/java/com/metamx/druid/indexer/HadoopDruidIndexerConfig.java
	indexer/src/main/java/com/metamx/druid/indexer/IndexGeneratorJob.java
2013-02-15 13:22:31 -08:00
Deep Ganguli
e042c29173 Fixed typos in comments, changed prefix on s3Paths to s3n from s3://, cleaned
up umbrellaIntervals code in JodaUtils, modified the DbUpdater to push segment
meta-data to the database in batches.
2013-02-15 11:39:49 -08:00
xvrl
1b85eaad3e simplify query toolchest interface 2013-02-13 21:25:16 -08:00
Eric Tschetter
c5b78e75cf 1) Move up to Jackson 2.1
2) Some bugs were fixed, but they ended up getting mixed in with the Jackson upgrade :(
2013-02-13 18:51:32 -08:00
xvrl
e10025c841 filter out unneeded segments for TimeBoundary query 2013-02-11 13:21:37 -08:00
Eric Tschetter
6708029043 1) Remove class level comments auto-created by IntelliJ 2013-02-11 13:13:52 -06:00
Jae Hyeon Bae
4f70bbc687 adding linear shard spec and ACL for s3 bucket 2013-02-04 10:27:09 -08:00
Eric Tschetter
7439a2e820 1) Make tests pass 2013-01-28 16:42:51 -06:00
Deep Ganguli
fc07bc315e Added umbrellaInterval method, which takes an Iterable of intervals and returns
a single interval spanning the entire range of input intervals.
2013-01-23 18:59:51 -08:00
xvrl
55ae4c87dd timezone support in groupby query 2013-01-23 08:51:02 -08:00
Fangjin Yang
ac31afbce5 remove redundant index for primary key in config table 2013-01-18 16:45:23 -08:00
Fangjin Yang
38b2041ad9 key/value config table 2013-01-17 14:56:48 -08:00
Fangjin Yang
d1f4317af7 updates to autoscaling config based on code review comments 2013-01-14 14:55:04 -08:00
Fangjin Yang
4c2da93389 bug fixes with ec2 auto scaling 2013-01-09 14:51:35 -08:00
Fangjin Yang
3685839376 Merge branch 'master' into autoscaling
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
2013-01-07 18:04:14 -08:00
Fangjin Yang
aff4a05ca3 db based configs for indexer workers 2013-01-07 13:41:26 -08:00