Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-03-01 14:59:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,342 Commits 116 Branches 508 Tags
Commit Graph

121 Commits

Author SHA1 Message Date
cheddar
f68df7ab69 1) Make tests work and continue trying to make the DruidMaster start up with just Guice 2013-06-07 12:01:46 -07:00
cheddar
9df458a065 1) Initial commit of conversion to using Guice modules for bootstrapping. Things don't actually completely work yet. 2013-06-06 15:43:15 -07:00
fjy
bd9e6fecc1 fix day 1 issue with VIT 2013-05-28 14:26:49 -07:00
Gian Merlino
343af872b5 DbConnectorConfig: Serialization is hard 2013-05-14 14:39:29 -07:00
fjy
43d3c53806 fix order by double sum agg 2013-05-08 10:14:40 -07:00
cheddar
3c04f1635c 1) Fix bug with same name on multiple JSON properties 2013-05-02 18:00:50 -05:00
cheddar
60b279b0d3 1) Add support for storing segments in HDFS 2013-04-30 12:47:43 -05:00
cheddar
43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers 
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
 2013-04-26 19:19:23 -05:00
Gian Merlino
dbfa045df0 DbConnector: SQL and validation query tweaks 2013-04-19 14:51:22 -07:00
Gian Merlino
1a6594524f Merger: Tweaks to DB tables. Create tables automatically. 2013-04-19 14:07:27 -07:00
Gian Merlino
1dfe133554 DbConnector: Optional validation query (default off for now) 2013-04-19 14:07:27 -07:00
xvrl
66a52ed282 javascript aggregator now uses column selector 2013-04-16 09:33:50 -07:00
xvrl
b66f69def6 specify javascript aggregator functions individually to support getCombiningFactory() 2013-04-16 09:33:50 -07:00
xvrl
c83631928c object column selectors 2013-04-16 09:33:50 -07:00
xvrl
0c68bd1b1d rename MetricSelectorFactory to ColumnSelectorFactory 2013-04-16 09:33:49 -07:00
Eric Tschetter
55648c47a7 1) Adjust the GroupByQuery to also be able to merge results on the local node. Fixes #116 
2) Make the GroupByQuery operate in a multi-threaded fashion by default (this is configurable via druid.query.groupBy.singleThreaded).  Fixes #96
3) Fix up some post aggregation computation stuff.  I believe #72 is fixed
4) Fix case sensitivity issue with post aggregations on GroupBy queries
 2013-04-09 19:13:08 -07:00
René Scheibe
6c27cd2e8e cleanup - removed unused imports 2013-04-07 23:31:22 +02:00
René Scheibe
a6dc29cf85 cleanup - removed extra empty lines 
- there should not be any adjacent empty lines
 2013-04-07 14:32:09 +02:00
xvrl
8eec41f934 squigglies ftw 2013-03-20 11:42:17 -07:00
xvrl
c68bd66945 add close method to aggregators 2013-03-19 16:03:48 -07:00
Eric Tschetter
39449e6a3e Merge branch 'master' of github.com:metamx/druid 2013-03-14 16:45:54 -05:00
Gian Merlino
df8e4d4061 Merge branch 'master' into realtime-index-task 2013-03-13 22:43:01 -07:00
Eric Tschetter
1e0f2c2d92 1) Make log a bit more descriptive 2013-03-13 19:26:22 -05:00
Eric Tschetter
fa66e1d2cc 1) SQL is hard 2013-03-13 16:29:34 -05:00
Gian Merlino
3fa46988f5 Realtime: 
- MetadataUpdater now built from SegmentAnnouncer, SegmentPublisher instances.
- Sinks can take a version instead of always using interval.start. The realtime
  plumber selects a version using a VersioningPolicy.
- Plumbers gained a startJob method.
- Realtime plumbers gained an implementation for finishJob.
 2013-03-11 11:14:51 -07:00
Nelson Ray
a470f3fa6a change name of druid.indexer.configTable to druid.database.configTable to be consistent 2013-03-08 10:35:13 -08:00
Eric Tschetter
f70f71243d 1) Stop polling in ConfigManager when stop is called 
2) Remove WorkSetupManager in favor of just using ConfigManager
 2013-03-07 17:45:57 -06:00
Eric Tschetter
1c3ef48f34 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable 
2) Use new ConfigManager to pull out a whitelist for the Master
 2013-03-07 17:45:57 -06:00
Gian Merlino
f862d9205d Merge branch 'master' into hadoop-index-task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
 2013-02-27 06:53:06 -08:00
Gian Merlino
14cf506c43 DefaultObjectMapper: Add GuavaModule 2013-02-25 17:05:01 -08:00
Eric Tschetter
f8c54a72c2 1) Changes to allow for local storage 2013-02-21 15:47:01 -06:00
Eric Tschetter
dc3459d3f9 1) Initial commit of refactorings on top of housejester's to simplify the zipping and simplify the creation of other methods of loading data 2013-02-21 15:47:01 -06:00
Deep Ganguli
60da9ffddb Merge branch 'master' into hadoop-index-task 
Conflicts:
	common/src/main/java/com/metamx/druid/utils/JodaUtils.java
	indexer/src/main/java/com/metamx/druid/indexer/DbUpdaterJob.java
	indexer/src/main/java/com/metamx/druid/indexer/HadoopDruidIndexerConfig.java
	indexer/src/main/java/com/metamx/druid/indexer/IndexGeneratorJob.java
 2013-02-15 13:22:31 -08:00
Deep Ganguli
e042c29173 Fixed typos in comments, changed prefix on s3Paths to s3n from s3://, cleaned 
up umbrellaIntervals code in JodaUtils, modified the DbUpdater to push segment
meta-data to the database in batches.
 2013-02-15 11:39:49 -08:00
xvrl
1b85eaad3e simplify query toolchest interface 2013-02-13 21:25:16 -08:00
Eric Tschetter
c5b78e75cf 1) Move up to Jackson 2.1 
2) Some bugs were fixed, but they ended up getting mixed in with the Jackson upgrade :(
 2013-02-13 18:51:32 -08:00
xvrl
e10025c841 filter out unneeded segments for TimeBoundary query 2013-02-11 13:21:37 -08:00
Eric Tschetter
6708029043 1) Remove class level comments auto-created by IntelliJ 2013-02-11 13:13:52 -06:00
Jae Hyeon Bae
4f70bbc687 adding linear shard spec and ACL for s3 bucket 2013-02-04 10:27:09 -08:00
Eric Tschetter
7439a2e820 1) Make tests pass 2013-01-28 16:42:51 -06:00
Deep Ganguli
fc07bc315e Added umbrellaInterval method, which takes an Iterable of intervals and returns 
a single interval spanning the entire range of input intervals.
 2013-01-23 18:59:51 -08:00
xvrl
55ae4c87dd timezone support in groupby query 2013-01-23 08:51:02 -08:00
Fangjin Yang
ac31afbce5 remove redundant index for primary key in config table 2013-01-18 16:45:23 -08:00
Fangjin Yang
38b2041ad9 key/value config table 2013-01-17 14:56:48 -08:00
Fangjin Yang
d1f4317af7 updates to autoscaling config based on code review comments 2013-01-14 14:55:04 -08:00
Fangjin Yang
4c2da93389 bug fixes with ec2 auto scaling 2013-01-09 14:51:35 -08:00
Fangjin Yang
3685839376 Merge branch 'master' into autoscaling 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
 2013-01-07 18:04:14 -08:00
Fangjin Yang
aff4a05ca3 db based configs for indexer workers 2013-01-07 13:41:26 -08:00
Eric Tschetter
b184c46ae0 1) Introduce idea of value types and generic columns to the serialization format 
2) Create SegmentLoader interface for the loading of segments!
3) Setup serialization of new format and conversion function inside IndexIO
4) Make some adjustments to the twitter demo to make it make a bit more sense based on some email feedback from someone kicking the tires.
 2013-01-04 18:12:49 -06:00
xvrl
6525d818ad postAggregators now return field dependencies 2013-01-02 18:36:03 -08:00