Commit Graph

4961 Commits

Author SHA1 Message Date
Xavier Léauté 10aa8a2d56 add explicit type names 2014-11-06 17:07:24 -08:00
Fangjin Yang 6c77f66ecd Merge pull request #824 from metamx/compress-defaults
prefer druid.curator.compress to druid.indexer.runner.compressZnodes
2014-11-06 17:15:14 -07:00
Igal Levy 20562492de clarified that dimension and metric can be String too, not just object 2014-11-06 15:16:36 -08:00
Igal Levy ec0accf0b1 clarified that dimensions and metrics are given in String arrays 2014-11-06 15:13:30 -08:00
Igal Levy 8f0b675e23 Added info to better explain how to use pagingSpec 2014-11-06 14:50:01 -08:00
Charles Allen 57e0c8f9be Merge branch 'druid-0.7.x' of github.com:metamx/druid into druid-0.7.x-fastTopN-rebase 2014-11-06 14:43:20 -08:00
Xavier Léauté 4b6438537e fix missing service name/port bindings for peons 2014-11-06 11:57:08 -08:00
Charles Allen d52530e0de Update logging to https://github.com/druid-io/druid-api/pull/27 2014-11-06 11:43:25 -08:00
Xavier Léauté 9bc20ef8bf prefer druid.curator.compress to druid.indexer.runner.compressZnodes 2014-11-06 11:28:51 -08:00
Igal Levy 5a98fcf5b9 typo: s/metric_value/metric_name/ and added quotes 2014-11-06 11:18:30 -08:00
Igal Levy 73226f20cc typo: s/metric_value/metric_name/ 2014-11-06 11:01:31 -08:00
Xavier Léauté 350bb09605 refactor sql storage to abstract task storage 2014-11-05 17:19:37 -08:00
Charles Allen ee019872f7 TopN performance improvements
Re-factor scanAndAggregate in PooledTopN

* Loops are now a little bit tighter when looping over aggregates. This will hopefully assist in loop execution optimization.
* Pre-calculated the aggregate offsets instead of shifting them during runtime.
* Cursor loop could use some TLC, but would require a massive refactoring on how TopN queries are executed.
  * Any potential modifications to query workflow need to account for Stream vs Batch data, and that not all data will be array backed that comes in.

Change data storage type in TopNNumericResultBuilder.

  * Use PriorityQueue to store
  * Checks to see if should even bother adding to Queue before adding.
  * Re-orders Queue on build() call.
  * Ideally the order would be directly preserved on build(), but this is a close second.

Updates to CompressedObjectStrategy to support more compression types

 * Compression types are not yet dynamically configurable.
 * Added a benchmarking system for topN to test the compression
 * Updated pom.xml to include junit benchmarking
 * added an Uncompressed option
2014-11-05 11:10:37 -08:00
fjy 253009d208 initial commit for roaring bitmaps 2014-11-04 17:04:40 -08:00
Xavier Léauté 253c0a70b3 simplify interface + more tests 2014-11-04 15:03:13 -08:00
Xavier Léauté b453922319 add tests for task and task status storage 2014-11-04 14:35:39 -08:00
Fangjin Yang df4604c392 Merge pull request #822 from metamx/fix-query-docs
Fix query docs
2014-11-04 14:53:23 -07:00
Igal Levy 81227b63a7 Merge branch 'master' into fix-query-docs 2014-11-04 11:09:13 -08:00
Xavier Léauté adb4fec264 properly serialize task timestamps, fixes #819 2014-11-04 11:06:34 -08:00
xvrl 2c62b9e6e3 Merge pull request #821 from metamx/minor-fix
Some minor fixes in docs and change jetty defaults
2014-11-04 10:18:57 -08:00
fjy c6d555e1f3 better default 2014-11-04 10:18:27 -08:00
fjy 42cf20c9f1 some minor fixes in docs and change jetty defaults 2014-11-04 10:08:50 -08:00
Xavier Léauté 5041aaa108 upgrade mysql connector for bug with recent MySQL version 2014-11-03 21:12:13 -08:00
Xavier Léauté 3676ec2d89 fix missing service name/port bindings for peons 2014-11-03 21:11:49 -08:00
Xavier Léauté f56d026d7d fix realtime module + cleaner metadata abstraction
- better metadata abstractions
- more db->metadata renaming
2014-11-03 16:40:23 -08:00
Igal Levy c58fc503d9 Clarified sort as optional, object 2014-11-03 11:59:04 -08:00
Igal Levy b416c3ff5c added quotes to clarify string value; added example of numeric filter 2014-11-03 11:57:52 -08:00
Xavier Léauté 48e6bef250 update documentation with new property names 2014-11-03 09:25:39 -08:00
Xavier Léauté 2269d09019 add comment 2014-10-31 17:04:19 -07:00
Xavier Léauté 47eb9c100e ensure ANSI_QUOTES on every MySQL connection 2014-10-31 16:54:20 -07:00
Xavier Léauté 3468163dcd remove unused imports 2014-10-31 16:25:52 -07:00
Xavier Léauté cad4d22f35 better derby test database 2014-10-31 16:25:36 -07:00
Xavier Léauté 80c72eb486 minor test adjustments 2014-10-31 15:44:09 -07:00
Xavier Léauté 1872b8f979 make it easier to test 2014-10-31 14:49:07 -07:00
Xavier Léauté 0bd9ac1154 default to Derby + remove DBI injection
- default to Derby, but still fail if the given
  metadata storage type does not exit
- use SQLMetadataConnector injection instead of DBI injection
  to simplify code
2014-10-31 14:37:37 -07:00
Xavier Léauté 696c9ba944 fix formatting 2014-10-31 13:32:18 -07:00
jisookim0513 6d501008b8 moved MetadataConnector test to metadata package 2014-10-31 13:13:19 -07:00
jisookim0513 a6016d70fc added deleted classes back 2014-10-31 13:10:09 -07:00
jisookim0513 01f2b3482c merging 2014-10-31 12:52:53 -07:00
jisookim0513 df7566701d fixed syntax error in creating index statements; added a test for MetadataConnector 2014-10-31 12:52:15 -07:00
Xavier Léauté cbe6ea67ee more druid.db -> druid.metadata.storage and allow multiple storage extensions loaded at once 2014-10-31 12:03:04 -07:00
Igal Levy e07b02f54b fixed typo and added info that union can take any number of dataSources 2014-10-31 11:07:55 -07:00
Xavier Léauté 97a2f5af4a rename db->metadata 2014-10-31 10:54:33 -07:00
Xavier Léauté 9c06db021f rename db->metadata postgres->postgresql 2014-10-31 10:30:27 -07:00
Xavier Léauté f77b810f36 fix imports 2014-10-31 10:01:58 -07:00
Xavier Léauté 9fea34be4b simplify connectors even further 2014-10-31 09:59:34 -07:00
Xavier Léauté df0af894f4 fix factory binding + remove unused imports 2014-10-30 22:35:37 -07:00
Xavier Léauté fb4d41cedb make the injection gods happy 2014-10-30 21:16:36 -07:00
Xavier Léauté 377151beda better abstraction for metadatastorage 2014-10-30 18:23:35 -07:00
Igal Levy 0906b21079 Merge branch 'master' into fix-datasource-doc 2014-10-30 16:26:16 -07:00