Eric Tschetter
c8cb96b006
1) Remove vast majority of usages of IndexIO.mapDir() and deprecated it. IndexIO.loadIndex() is the new IndexIO.mapDir()
...
2) Fix bug with IndexMerger and null columns
3) Add QueryableIndexIndexableAdapter so that QueryableIndexes can be merged
4) Adjust twitter example to have multiple values for each hash tag
5) Adjusted GroupByQueryEngine to just drop dimensions that don't exist instead of throwing an NPE
2013-01-16 17:10:33 -06:00
Eric Tschetter
8b31d8db9f
1) Adjust IndexMerger to create convert the indexes it creates from the old format to the new. This is done quite sub-optimally, but it will work for now...
2013-01-16 10:01:46 -06:00
Nelson Ray
e847faf02f
change name of MAX_SEGMENTS_TO_MOVE since it's not a final
2013-01-15 11:29:46 -08:00
Nelson Ray
ef9e077d9a
remove getConfig method from DruidMaster
2013-01-14 16:01:29 -08:00
Eric Tschetter
998f0bf3c8
1) Better error message when aggregators want more memory than is available.
2013-01-14 18:00:51 -06:00
Nelson Ray
5f40dc6d9c
put BalancerCostAnalyzer into params
2013-01-10 10:27:43 -08:00
Nelson Ray
617907d85b
move empty server holder list check outside of loop
2013-01-08 16:12:16 -08:00
Nelson Ray
4549c3a8c3
add some finals, reorganize
2013-01-08 09:07:43 -08:00
Nelson Ray
2b4dbdde03
lots of changes
2013-01-07 17:28:53 -08:00
Nelson Ray
6fda5330fd
finish making MAX_SEGMENTS_TO_MOVE a config item
2013-01-07 16:56:55 -08:00
Nelson Ray
ba82fe746a
put MAX_SEGMENTS_TO_MOVE in the config
2013-01-07 16:28:27 -08:00
Eric Tschetter
4ef31de62d
1) Fix stray import, take 2... yay IntelliJ
2013-01-07 13:11:28 -08:00
Nelson Ray
d2ff88e923
add more stats to be emitted
2013-01-07 13:09:18 -08:00
Nelson Ray
a7553776fa
make sampling of segments uniformly at random and add unit test
2013-01-07 12:51:51 -08:00
Eric Tschetter
b62bdf915b
1) Fix stray import... yay IntelliJ
2013-01-07 10:09:19 -08:00
Nelson Ray
2ea164acd9
get rid of extraneous analyzer.inits
2013-01-07 09:09:56 -08:00
Eric Tschetter
b184c46ae0
1) Introduce idea of value types and generic columns to the serialization format
...
2) Create SegmentLoader interface for the loading of segments!
3) Setup serialization of new format and conversion function inside IndexIO
4) Make some adjustments to the twitter demo to make it make a bit more sense based on some email feedback from someone kicking the tires.
2013-01-04 18:12:49 -06:00
Nelson Ray
402ddbf261
update
2013-01-04 11:20:06 -08:00
Nelson Ray
117cac2795
update
2013-01-03 14:12:10 -08:00
Nelson Ray
bb31fa7b68
update
2013-01-03 10:48:05 -08:00
Nelson Ray
5441662cb8
Merge remote-tracking branch 'origin/master' into new_balancer
2013-01-03 09:10:48 -08:00
xvrl
a9b8d8f1ce
fix end of month bug in PeriodDropRule as well
2013-01-02 16:10:23 -08:00
xvrl
0543322c56
tested timestamps should be deterministic
2013-01-02 14:31:51 -08:00
xvrl
19c3fd3363
make reference timestamp explicit for time based rules
2013-01-02 14:27:34 -08:00
xvrl
d0290b1975
fix flawed interval overlap rule test
...
fails around month end
2012-12-31 14:52:42 -08:00
Nelson Ray
72758e1345
update
2012-12-31 13:55:48 -08:00
Nelson Ray
3eda9dc5f2
working balancercostanalyzer
2012-12-31 11:08:37 -08:00
Nelson Ray
366216f9f3
initial cost analyzer commit
2012-12-28 16:30:21 -08:00
Gian Merlino
5c1b2360d6
- Add optional query/wait metric to MetricsEmittingQueryRunner
...
- Add MetricsEmittingExecutorService decorator, and use it on compute nodes
2012-12-20 16:11:08 -08:00
Fangjin Yang
00ecf9d028
sorted db datasources for rules; smaller time boundary range
2012-12-18 16:16:03 -08:00
xvrl
2a7214089e
fix NPE in segmentMetadata query for null dimension values
2012-12-18 14:10:01 -08:00
Fangjin Yang
db556102db
fix typo
2012-12-15 00:50:28 -08:00
Fangjin Yang
585a812f6e
bug fixes again in load and drop
2012-12-15 00:43:16 -08:00
Fangjin Yang
76807ae00e
fix overloading of segments
2012-12-14 22:55:12 -08:00
Fangjin Yang
884da334b2
fix for master getting stuck when assigning
2012-12-14 22:06:19 -08:00
Fangjin Yang
6a11e99681
bug fixes for dropping segments and logging
2012-12-14 21:27:18 -08:00
Fangjin Yang
74a977504e
bug fix for dropping segments in master
2012-12-14 17:06:03 -08:00
Eric Tschetter
da137a4883
1) Optimize imports a bit
2012-12-14 11:34:23 -06:00
cheddar
7670c8483b
Merge pull request #45 from metamx/fjy
...
bug fixes for exceptions in rules
2012-12-14 09:32:37 -08:00
Fangjin Yang
18692a1214
better error emitting for mismatched rules
2012-12-14 09:25:39 -08:00
Fangjin Yang
8c7fd3bc49
more specific checks in rule test
2012-12-14 09:12:02 -08:00
Fangjin Yang
aa69ed5251
alert when no rules match; exceptions in rules no longer block
2012-12-14 09:05:25 -08:00
xvrl
5dcf962eaa
register SegmentMetadataQueryRunnerFactory in ServerInit
2012-12-12 13:45:15 -08:00
xvrl
bfc9b63931
segment metadata query
2012-12-12 13:45:12 -08:00
Marshall Pierce
1a0ef0d5c3
Fix direct memory vm option name in warning message
2012-12-11 11:15:09 -08:00
Fangjin Yang
4695fbfcd9
fix bug with comparing historical servers
2012-12-07 17:49:18 -08:00
Fangjin Yang
404f6322c6
bug fix for checking if a segment exists on a node
2012-12-07 15:16:34 -08:00
Fangjin Yang
5a511cbef0
bug fix for missing quotations creating default datasource
2012-12-07 14:47:38 -08:00
Fangjin Yang
f6519744e6
bug fix for using configurable default for datasource
2012-12-07 14:35:49 -08:00
Fangjin Yang
6028273332
defaults for rules to make startup a bit easier
2012-12-07 10:54:38 -08:00
