Charles Allen
581e6830d5
Merge pull request #840 from metamx/powers-of-2-buffers
...
make buffer size a power of 2 and optimize buffer lookup
2014-11-11 19:54:00 -08:00
Xavier Léauté
60e98c35d7
workaround for annotations requiring class literals
2014-11-11 18:48:49 -08:00
Xavier Léauté
b580269f6d
Distinguish between default and legacy bitmaps
2014-11-11 18:35:45 -08:00
fjy
bc5c56e441
fix default impl
2014-11-11 18:00:46 -08:00
fjy
63ca2375a3
remove dead code and cleanup some defaults
2014-11-11 17:57:24 -08:00
fjy
5629307548
address a few more comments on roaring
2014-11-11 17:50:03 -08:00
Charles Allen
a89b539b4f
Merge pull request #823 from metamx/roaring
...
Configurable bitmap indexes: roaring and concise
2014-11-11 17:26:38 -08:00
Xavier Léauté
007e57f876
make buffer size a power of 2 and optimize
2014-11-11 16:24:37 -08:00
fjy
1cc162727b
address code review
2014-11-11 14:05:37 -08:00
Xavier Léauté
3f5449d40a
loop unrolling provides no benefit for timeseries
2014-11-11 10:58:37 -08:00
Xavier Léauté
e817db8b6c
unroll timeseries aggregations + naming
2014-11-11 10:09:37 -08:00
fjy
e6b7b03b5b
fix conversion
2014-11-10 17:13:28 -08:00
fjy
eb457c280e
revert change
2014-11-10 17:00:53 -08:00
fjy
336c73bdc2
cleanup dead code
2014-11-10 16:53:13 -08:00
fjy
df886fac1b
fix
2014-11-10 16:49:27 -08:00
fjy
d68bc3bdea
cleanup unused imports
2014-11-10 16:15:28 -08:00
Charles Allen
92e71be864
Change TopNQueryRunnerBenchmark to use a ByteBuffer as per OffheapBufferPool
2014-11-10 15:40:54 -08:00
Charles Allen
a093f3728a
Reformat on TopNNumericResultBuilder
2014-11-10 15:26:09 -08:00
Charles Allen
2b0f4534bf
Modify formatting in TopNQueryRunnerBenchmark
2014-11-10 15:17:26 -08:00
Charles Allen
fc78f215c4
Aggressive dimValue unrolling in PooledTopNAlgorithm
2014-11-10 15:14:45 -08:00
fjy
6188315293
Merge branch 'master' into druid-0.7.x
...
Conflicts:
processing/src/test/java/io/druid/query/search/SearchQueryRunnerTest.java
2014-11-10 14:52:10 -08:00
Xavier Léauté
49e878cf1a
unroll multi-value dimensions
2014-11-10 14:21:56 -08:00
fjy
df9be030db
remove more legacy code
2014-11-10 14:09:00 -08:00
Charles Allen
dbb6401fbe
Aggressive unrolling in PooledTopNAlgorithm
2014-11-10 14:04:37 -08:00
fjy
72c355e8ae
remove crazy handler code
2014-11-10 13:58:23 -08:00
fjy
fc34858e95
fix things for real-time ingestion
2014-11-10 13:48:21 -08:00
fjy
c5cc826998
make things actually work with roaring
2014-11-10 13:42:26 -08:00
fjy
358b2add17
make things actually work with roaring
2014-11-10 13:42:06 -08:00
Charles Allen
9ac8589143
Merge remote-tracking branch 'origin/druid-0.7.x-fastTopN-rebase' into druid-0.7.x-fastTopN-rebase
2014-11-10 12:55:08 -08:00
Xavier Léauté
70468400bf
stupid mistake
2014-11-10 12:54:48 -08:00
Charles Allen
bfc9d9f283
Merge remote-tracking branch 'origin/druid-0.7.x-fastTopN-rebase' into druid-0.7.x-fastTopN-rebase
2014-11-10 12:52:36 -08:00
Xavier Léauté
17d32a2561
try to benefit from out of order execution
2014-11-10 12:50:10 -08:00
Charles Allen
5aad149b24
Make some variables in PooledTopNAlgorithm final
2014-11-10 12:19:04 -08:00
nishantmonu51
0ca60e0334
skip timestamp checking, remove duplicate code
...
1) No need compare all timestamps when all the values are within range
2) remove redundant code.
2014-11-10 22:36:07 +05:30
fjy
3c21f62afd
a whole bunch of fixes and some ugly conversion code
2014-11-07 16:03:22 -08:00
Charles Allen
7131cde710
Code reformat in CompressedObjectStrategy
2014-11-07 11:19:32 -08:00
Charles Allen
8bd6cf0d07
Updates to CompressedObjectStrategy to support more compression types
...
* Compression types are not yet dynamically configurable.
* Added a benchmarking system for topN to test the compression
* Updated pom.xml to include junit benchmarking
* added an Uncompressed option
2014-11-07 11:14:46 -08:00
Charles Allen
f5f48c7756
Moved pom version for reals this time
2014-11-07 11:09:57 -08:00
Charles Allen
6af18931e5
Moveed processing/pom version into master pom
2014-11-07 11:08:23 -08:00
Charles Allen
75c79e7562
Added comments in TopNNumericResultBuilder
2014-11-07 11:01:46 -08:00
Charles Allen
b4893b4490
Pre allocate LinkedHashMap in TopNNumericResultBuilder
2014-11-07 10:56:49 -08:00
Charles Allen
bc92de233c
Update dim name comparator in TopNNumericResultBuilder to better handle nulls
2014-11-07 10:54:10 -08:00
Charles Allen
0a562ebd77
Removed CompressedObjectStrategy from this pull request. will submit a new one later
2014-11-07 10:42:28 -08:00
Charles Allen
228614ddb5
Changed TopNNumericResultBuilder imports to not use package.*, but instead pulls all in explicitly
2014-11-07 10:34:28 -08:00
Charles Allen
956bdf80dd
Removed negating comparator in TopNNumericResultBuilder
2014-11-07 10:29:06 -08:00
nishantmonu51
fd8eb7742b
handle union query on realtime node
2014-11-07 23:27:50 +05:30
nishantmonu51
8bebb24fd5
Union Queries move merge to historical
2014-11-07 18:05:16 +05:30
Charles Allen
ee019872f7
TopN performance improvements
...
Re-factor scanAndAggregate in PooledTopN
* Loops are now a little bit tighter when looping over aggregates. This will hopefully assist in loop execution optimization.
* Pre-calculated the aggregate offsets instead of shifting them during runtime.
* Cursor loop could use some TLC, but would require a massive refactoring on how TopN queries are executed.
* Any potential modifications to query workflow need to account for Stream vs Batch data, and that not all data will be array backed that comes in.
Change data storage type in TopNNumericResultBuilder.
* Use PriorityQueue to store
* Checks to see if should even bother adding to Queue before adding.
* Re-orders Queue on build() call.
* Ideally the order would be directly preserved on build(), but this is a close second.
Updates to CompressedObjectStrategy to support more compression types
* Compression types are not yet dynamically configurable.
* Added a benchmarking system for topN to test the compression
* Updated pom.xml to include junit benchmarking
* added an Uncompressed option
2014-11-05 11:10:37 -08:00
fjy
253009d208
initial commit for roaring bitmaps
2014-11-04 17:04:40 -08:00
fjy
3e158f00ef
fix random lowercasing in test
2014-10-30 10:56:39 -07:00
