xvrl
dcaa77a883
implement bulk get test
2013-01-16 19:15:43 -08:00
Eric Tschetter
5b1e03530c
1) Fix some bugs found by external test suite
2013-01-16 21:06:57 -06:00
Fangjin Yang
21613bc73b
initial commit to hard delete segments
2013-01-16 17:31:01 -08:00
xvrl
e2788187fb
don't let timeout skew benchmark stats
2013-01-16 16:02:51 -08:00
Eric Tschetter
c8cb96b006
1) Remove vast majority of usages of IndexIO.mapDir() and deprecated it. IndexIO.loadIndex() is the new IndexIO.mapDir()
...
2) Fix bug with IndexMerger and null columns
3) Add QueryableIndexIndexableAdapter so that QueryableIndexes can be merged
4) Adjust twitter example to have multiple values for each hash tag
5) Adjusted GroupByQueryEngine to just drop dimensions that don't exist instead of throwing an NPE
2013-01-16 17:10:33 -06:00
xvrl
a2090411a3
modify cacheBroker interface to implement bulk-get
2013-01-16 14:49:50 -08:00
Gian Merlino
6fc350bfba
YeOldePlumberSchool: Populate dimension metadata in segment descriptor
2013-01-16 11:30:24 -08:00
Gian Merlino
7b42ee6a6e
Rework DeterminePartitionsJob in the hadoop indexer
...
- Can handle non-rolled-up input (by grouping input rows using an additional MR stage)
- Can select its own partitioning dimension, if none is supplied
- Can detect and avoid oversized shards due to bad dimension value distribution
- Shares input parsing code with IndexGeneratorJob
2013-01-16 08:15:01 -08:00
Eric Tschetter
538d00e75e
Merge branch 'master' of github.com:metamx/druid
2013-01-16 10:02:01 -06:00
Eric Tschetter
8b31d8db9f
1) Adjust IndexMerger to create convert the indexes it creates from the old format to the new. This is done quite sub-optimally, but it will work for now...
2013-01-16 10:01:46 -06:00
Gian Merlino
616415cb7e
UniformGranularitySpec: Only return bucketInterval for timestamps that legitimately
...
overlap our input intervals
2013-01-15 22:30:17 -08:00
Gian Merlino
86277d1114
StringInputRowParser: Treat dimensionExclusions case-insensitively
2013-01-15 22:30:17 -08:00
Fangjin Yang
3c0880fe28
Merge branch 'master' into autoscaling
2013-01-15 13:36:39 -08:00
Fangjin Yang
7e074e8158
fix pom breakage
2013-01-15 12:04:12 -08:00
Fangjin Yang
47ac36d3e4
Merge branch 'master' of github.com:metamx/druid into autoscaling
2013-01-15 12:02:32 -08:00
Nelson Ray
e847faf02f
change name of MAX_SEGMENTS_TO_MOVE since it's not a final
2013-01-15 11:29:46 -08:00
Nelson Ray
ef9e077d9a
remove getConfig method from DruidMaster
2013-01-14 16:01:29 -08:00
Eric Tschetter
998f0bf3c8
1) Better error message when aggregators want more memory than is available.
2013-01-14 18:00:51 -06:00
Fangjin Yang
ae76097bc8
Merge branch 'master' into autoscaling
2013-01-14 14:55:29 -08:00
Fangjin Yang
d1f4317af7
updates to autoscaling config based on code review comments
2013-01-14 14:55:04 -08:00
Eric Tschetter
135474e49e
Merge branch 'master' of github.com:metamx/druid
2013-01-14 15:01:32 -06:00
Eric Tschetter
3de62b34b6
1) Should be on 0.2.0 with the recent API changes for StorageAdapters
2013-01-14 15:00:28 -06:00
Nelson Ray
5f40dc6d9c
put BalancerCostAnalyzer into params
2013-01-10 10:27:43 -08:00
Fangjin Yang
4c2da93389
bug fixes with ec2 auto scaling
2013-01-09 14:51:35 -08:00
Nelson Ray
617907d85b
move empty server holder list check outside of loop
2013-01-08 16:12:16 -08:00
Nelson Ray
4549c3a8c3
add some finals, reorganize
2013-01-08 09:07:43 -08:00
Fangjin Yang
3685839376
Merge branch 'master' into autoscaling
...
Conflicts:
merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
2013-01-07 18:04:14 -08:00
Nelson Ray
2b4dbdde03
lots of changes
2013-01-07 17:28:53 -08:00
Nelson Ray
6fda5330fd
finish making MAX_SEGMENTS_TO_MOVE a config item
2013-01-07 16:56:55 -08:00
xvrl
700ce24106
fix JVM optimizing out the benchmarking code
2013-01-07 16:54:35 -08:00
Nelson Ray
ba82fe746a
put MAX_SEGMENTS_TO_MOVE in the config
2013-01-07 16:28:27 -08:00
Fangjin Yang
79e9ff94a6
add missing headers
2013-01-07 14:07:47 -08:00
Fangjin Yang
aff4a05ca3
db based configs for indexer workers
2013-01-07 13:41:26 -08:00
Eric Tschetter
4ef31de62d
1) Fix stray import, take 2... yay IntelliJ
2013-01-07 13:11:28 -08:00
Nelson Ray
d2ff88e923
add more stats to be emitted
2013-01-07 13:09:18 -08:00
Nelson Ray
a7553776fa
make sampling of segments uniformly at random and add unit test
2013-01-07 12:51:51 -08:00
Eric Tschetter
b62bdf915b
1) Fix stray import... yay IntelliJ
2013-01-07 10:09:19 -08:00
Nelson Ray
2ea164acd9
get rid of extraneous analyzer.inits
2013-01-07 09:09:56 -08:00
Eric Tschetter
72db507cf8
1) Update java-util version to be a non-SNAPSHOT version
2013-01-06 23:37:52 -08:00
Eric Tschetter
b184c46ae0
1) Introduce idea of value types and generic columns to the serialization format
...
2) Create SegmentLoader interface for the loading of segments!
3) Setup serialization of new format and conversion function inside IndexIO
4) Make some adjustments to the twitter demo to make it make a bit more sense based on some email feedback from someone kicking the tires.
2013-01-04 18:12:49 -06:00
Nelson Ray
402ddbf261
update
2013-01-04 11:20:06 -08:00
Eric Tschetter
4f5087b386
Merge branch 'master' of github.com:metamx/druid
2013-01-04 11:28:35 -06:00
Nelson Ray
117cac2795
update
2013-01-03 14:12:10 -08:00
Nelson Ray
bb31fa7b68
update
2013-01-03 10:48:05 -08:00
xvrl
9627fdcd1c
[maven-release-plugin] prepare for next development iteration
2013-01-03 10:09:52 -08:00
xvrl
f2c2d3f4cf
[maven-release-plugin] prepare release druid-0.1.25
2013-01-03 10:09:43 -08:00
cheddar
6318abb0bd
Merge pull request #50 from metamx/postagg-dependencies
...
postAggregators now return field dependencies
2013-01-03 10:05:14 -08:00
xvrl
824997eb43
simplify code
2013-01-03 10:01:42 -08:00
cheddar
04492b43f2
Merge pull request #49 from metamx/rule-timestamp-fix
...
Use explicit timestamp for time based load/drop rules
2013-01-03 09:55:32 -08:00
Nelson Ray
5441662cb8
Merge remote-tracking branch 'origin/master' into new_balancer
2013-01-03 09:10:48 -08:00