Charles Allen
5aad149b24
Make some variables in PooledTopNAlgorithm final
2014-11-10 12:19:04 -08:00
Charles Allen
febaf56b8b
Merge branch 'druid-0.7.x' of github.com:metamx/druid into druid-0.7.x-fastTopN-rebase
2014-11-10 11:37:27 -08:00
Xavier Léauté
f956fdad2e
fix injection once more
2014-11-07 14:26:03 -08:00
Xavier Léauté
0498df25df
override metadata storage injection in CliHadoopIndexer
2014-11-07 13:44:56 -08:00
Xavier Léauté
70f49538dd
i swear injection is fixed now
2014-11-07 12:04:09 -08:00
Xavier Léauté
aeb194ad12
fix injection for real
2014-11-07 11:43:53 -08:00
Xavier Léauté
50a191425c
fix injection on MetadataStorageUpdaterJob
2014-11-07 11:11:14 -08:00
Fangjin Yang
2336e6c167
Merge pull request #758 from metamx/jisoo-metadata
...
make metadata storage pluggable
2014-11-07 11:30:11 -07:00
Charles Allen
8d1a8564c4
Merge pull request #829 from metamx/default-servicenames
...
provide proper defaults for indexing service name
2014-11-07 10:06:46 -08:00
xvrl
18b9c5cd2f
db -> metadata
2014-11-06 21:46:35 -08:00
Xavier Léauté
d8bab70647
provide proper defaults for indexing service name
2014-11-06 18:16:01 -08:00
Xavier Léauté
20a9aef96a
fix test
2014-11-06 17:27:05 -08:00
Xavier Léauté
a5f98be457
remove unused code
2014-11-06 17:18:40 -08:00
Xavier Léauté
f69f3cfc5a
run MetadataSegmentManagerTest against Derby
2014-11-06 17:08:54 -08:00
Xavier Léauté
5bda4ee1dd
global task entry type
2014-11-06 17:08:20 -08:00
Xavier Léauté
ac753ed0f0
always use validation query
2014-11-06 17:08:01 -08:00
Xavier Léauté
10aa8a2d56
add explicit type names
2014-11-06 17:07:24 -08:00
Fangjin Yang
6c77f66ecd
Merge pull request #824 from metamx/compress-defaults
...
prefer druid.curator.compress to druid.indexer.runner.compressZnodes
2014-11-06 17:15:14 -07:00
Charles Allen
57e0c8f9be
Merge branch 'druid-0.7.x' of github.com:metamx/druid into druid-0.7.x-fastTopN-rebase
2014-11-06 14:43:20 -08:00
Xavier Léauté
4b6438537e
fix missing service name/port bindings for peons
2014-11-06 11:57:08 -08:00
Xavier Léauté
9bc20ef8bf
prefer druid.curator.compress to druid.indexer.runner.compressZnodes
2014-11-06 11:28:51 -08:00
Xavier Léauté
350bb09605
refactor sql storage to abstract task storage
2014-11-05 17:19:37 -08:00
Charles Allen
ee019872f7
TopN performance improvements
...
Re-factor scanAndAggregate in PooledTopN
* Loops are now a little bit tighter when looping over aggregates. This will hopefully assist in loop execution optimization.
* Pre-calculated the aggregate offsets instead of shifting them during runtime.
* Cursor loop could use some TLC, but would require a massive refactoring on how TopN queries are executed.
* Any potential modifications to query workflow need to account for Stream vs Batch data, and that not all data will be array backed that comes in.
Change data storage type in TopNNumericResultBuilder.
* Use PriorityQueue to store
* Checks to see if should even bother adding to Queue before adding.
* Re-orders Queue on build() call.
* Ideally the order would be directly preserved on build(), but this is a close second.
Updates to CompressedObjectStrategy to support more compression types
* Compression types are not yet dynamically configurable.
* Added a benchmarking system for topN to test the compression
* Updated pom.xml to include junit benchmarking
* added an Uncompressed option
2014-11-05 11:10:37 -08:00
Xavier Léauté
253c0a70b3
simplify interface + more tests
2014-11-04 15:03:13 -08:00
Xavier Léauté
b453922319
add tests for task and task status storage
2014-11-04 14:35:39 -08:00
Xavier Léauté
adb4fec264
properly serialize task timestamps, fixes #819
2014-11-04 11:06:34 -08:00
Xavier Léauté
5041aaa108
upgrade mysql connector for bug with recent MySQL version
2014-11-03 21:12:13 -08:00
Xavier Léauté
3676ec2d89
fix missing service name/port bindings for peons
2014-11-03 21:11:49 -08:00
Xavier Léauté
f56d026d7d
fix realtime module + cleaner metadata abstraction
...
- better metadata abstractions
- more db->metadata renaming
2014-11-03 16:40:23 -08:00
Xavier Léauté
48e6bef250
update documentation with new property names
2014-11-03 09:25:39 -08:00
Xavier Léauté
2269d09019
add comment
2014-10-31 17:04:19 -07:00
Xavier Léauté
47eb9c100e
ensure ANSI_QUOTES on every MySQL connection
2014-10-31 16:54:20 -07:00
Xavier Léauté
3468163dcd
remove unused imports
2014-10-31 16:25:52 -07:00
Xavier Léauté
cad4d22f35
better derby test database
2014-10-31 16:25:36 -07:00
Xavier Léauté
80c72eb486
minor test adjustments
2014-10-31 15:44:09 -07:00
Xavier Léauté
1872b8f979
make it easier to test
2014-10-31 14:49:07 -07:00
Xavier Léauté
0bd9ac1154
default to Derby + remove DBI injection
...
- default to Derby, but still fail if the given
metadata storage type does not exit
- use SQLMetadataConnector injection instead of DBI injection
to simplify code
2014-10-31 14:37:37 -07:00
Xavier Léauté
696c9ba944
fix formatting
2014-10-31 13:32:18 -07:00
jisookim0513
6d501008b8
moved MetadataConnector test to metadata package
2014-10-31 13:13:19 -07:00
jisookim0513
a6016d70fc
added deleted classes back
2014-10-31 13:10:09 -07:00
jisookim0513
01f2b3482c
merging
2014-10-31 12:52:53 -07:00
jisookim0513
df7566701d
fixed syntax error in creating index statements; added a test for MetadataConnector
2014-10-31 12:52:15 -07:00
Xavier Léauté
cbe6ea67ee
more druid.db -> druid.metadata.storage and allow multiple storage extensions loaded at once
2014-10-31 12:03:04 -07:00
Xavier Léauté
97a2f5af4a
rename db->metadata
2014-10-31 10:54:33 -07:00
Xavier Léauté
9c06db021f
rename db->metadata postgres->postgresql
2014-10-31 10:30:27 -07:00
Xavier Léauté
f77b810f36
fix imports
2014-10-31 10:01:58 -07:00
Xavier Léauté
9fea34be4b
simplify connectors even further
2014-10-31 09:59:34 -07:00
Xavier Léauté
df0af894f4
fix factory binding + remove unused imports
2014-10-30 22:35:37 -07:00
Xavier Léauté
fb4d41cedb
make the injection gods happy
2014-10-30 21:16:36 -07:00
Xavier Léauté
377151beda
better abstraction for metadatastorage
2014-10-30 18:23:35 -07:00
