Charles Allen
956bdf80dd
Removed negating comparator in TopNNumericResultBuilder
2014-11-07 10:29:06 -08:00
Charles Allen
ee019872f7
TopN performance improvements
...
Re-factor scanAndAggregate in PooledTopN
* Loops are now a little bit tighter when looping over aggregates. This will hopefully assist in loop execution optimization.
* Pre-calculated the aggregate offsets instead of shifting them during runtime.
* Cursor loop could use some TLC, but would require a massive refactoring on how TopN queries are executed.
* Any potential modifications to query workflow need to account for Stream vs Batch data, and that not all data will be array backed that comes in.
Change data storage type in TopNNumericResultBuilder.
* Use PriorityQueue to store
* Checks to see if should even bother adding to Queue before adding.
* Re-orders Queue on build() call.
* Ideally the order would be directly preserved on build(), but this is a close second.
Updates to CompressedObjectStrategy to support more compression types
* Compression types are not yet dynamically configurable.
* Added a benchmarking system for topN to test the compression
* Updated pom.xml to include junit benchmarking
* added an Uncompressed option
2014-11-05 11:10:37 -08:00
fjy
253009d208
initial commit for roaring bitmaps
2014-11-04 17:04:40 -08:00
fjy
3e158f00ef
fix random lowercasing in test
2014-10-30 10:56:39 -07:00
fjy
75da039396
fix search with same value in multiple columns
2014-10-30 10:43:42 -07:00
fjy
41ebdd2bae
Merge branch 'druid-0.7.x' into fix-test
...
Conflicts:
processing/pom.xml
processing/src/main/java/io/druid/segment/IndexMerger.java
processing/src/main/java/io/druid/segment/MetricHolder.java
processing/src/main/java/io/druid/segment/data/CompressedObjectStrategy.java
processing/src/test/java/io/druid/query/groupby/GroupByQueryRunnerTest.java
processing/src/test/java/io/druid/segment/SchemalessTestFull.java
server/src/test/java/io/druid/client/CachingClusteredClientTest.java
services/src/main/java/io/druid/cli/CliHistorical.java
2014-10-24 11:07:52 -07:00
fjy
bef74104d9
merge with 0.7.x and resolve any conflicts
2014-10-23 17:24:06 -07:00
fjy
f790a05bd7
Merge branch 'master' into fix-test
...
Conflicts:
pom.xml
2014-10-23 14:39:51 -07:00
fjy
1b3921faad
fix for long columns
2014-10-23 14:33:25 -07:00
fjy
3b29e77866
[maven-release-plugin] prepare for next development iteration
2014-10-22 16:25:32 -07:00
fjy
dcab2997f2
[maven-release-plugin] prepare release druid-0.6.160
2014-10-22 16:25:27 -07:00
fjy
94da2b6ad3
more logging for potential NPE because of segment unmapping
2014-10-22 16:16:10 -07:00
Xavier Léauté
4ec1e6ef13
simplify code a bit
2014-10-22 14:25:59 -07:00
nishantmonu51
0785baf54c
review comments
2014-10-22 21:28:31 +05:30
nishantmonu51
6cb6ec39cf
add support for not filter and add test
2014-10-22 10:25:24 +05:30
Xavier Léauté
e24a6d222f
we even have tests now
2014-10-21 17:46:24 -07:00
Xavier Léauté
23a6ab19b0
cleanup and add missing methods
2014-10-21 17:00:39 -07:00
nishantmonu51
56912adccb
avoid typecasts
2014-10-21 16:47:50 -07:00
nishantmonu51
10db94101f
skip value lookup
...
compare ids instead of values
2014-10-21 16:47:49 -07:00
Xavier Léauté
71831e49d9
rudimentary filtered aggregator
2014-10-21 16:47:49 -07:00
fjy
bb90432862
Updated druid-api version to always sort dimension names, these tests needed fixing
2014-10-15 12:27:21 -04:00
Xavier Léauté
5b194ee5fe
fix groupBy ordering casing bug
2014-10-15 12:16:17 -04:00
nishantmonu51
bce388fb27
merge changes from 0.7.x branch
2014-10-14 18:46:02 +05:30
fjy
a4c8f04409
[maven-release-plugin] prepare for next development iteration
2014-10-13 12:50:45 -07:00
fjy
7fd1747ffa
[maven-release-plugin] prepare release druid-0.6.159
2014-10-13 12:50:41 -07:00
Xavier Léauté
592611f2ee
fix cardinality aggregator serde
2014-10-09 17:06:29 -07:00
fjy
d0fbd5f729
[maven-release-plugin] prepare for next development iteration
2014-10-09 14:24:53 -07:00
fjy
dada60a301
[maven-release-plugin] prepare release druid-0.6.158
2014-10-09 14:24:48 -07:00
Xavier Léauté
290107ce7b
remove unused jsonspec content type
2014-10-09 10:26:47 -07:00
fjy
8a4b32c482
[maven-release-plugin] prepare for next development iteration
2014-10-07 14:30:26 -07:00
fjy
96e29c2fdd
[maven-release-plugin] prepare release druid-0.6.157
2014-10-07 14:30:20 -07:00
Xavier Léauté
30183d3b4d
update druid-api for json parsing improvements
2014-10-07 13:25:02 -07:00
fjy
fde510bbfc
Merge pull request #779 from metamx/fix-histo
...
Fix groupBy with histograms
2014-10-07 11:53:24 -06:00
fjy
d4217f1588
Merge pull request #777 from metamx/initialized-endpoint
...
Historical endpoints accessible while loading + new loadstatus endpoint
2014-10-06 17:35:58 -06:00
fjy
c7b4d5b7b4
Merge branch 'master' into druid-0.7.x
...
Conflicts:
processing/src/test/java/io/druid/segment/filter/SpatialFilterTest.java
2014-10-02 18:12:10 -07:00
fjy
816986f914
cleanup according to cr
2014-10-02 17:51:33 -07:00
fjy
1a67d6cb2e
some tests for broken approx histo
2014-10-01 15:10:23 -07:00
nishantmonu51
09c41afb5b
license header
2014-10-01 17:52:57 +05:30
nishantmonu51
ad75a21040
separate offheapIncrementalIndex implementation
2014-10-01 13:58:51 +05:30
fjy
267e861162
fix search
2014-09-30 13:36:55 -07:00
fjy
0f96a09939
use multi-val dims for metrics
2014-09-30 13:36:01 -07:00
nishantmonu51
358ff915bb
fix merge conflicts
2014-09-30 22:19:18 +05:30
nishantmonu51
63fcd11864
fix compilation
2014-09-30 22:12:06 +05:30
nishantmonu51
2789536bed
merge changes from druid-0.7.x
2014-09-30 22:05:49 +05:30
nishantmonu51
7ba914d379
review comments
2014-09-30 18:26:43 +05:30
nishantmonu51
61c7fd2e6e
make ingestOffheap tuneable
2014-09-30 15:30:02 +05:30
Gian Merlino
a3a2c8b86f
Merge pull request #765 from metamx/fix-spatial
...
fix spatial indexing with multiple spatial dims
2014-09-29 17:23:29 -07:00
fjy
e1c1e8997a
address cr
2014-09-29 17:22:58 -07:00
fjy
b57ac513bd
Fixes #761
2014-09-29 14:56:43 -07:00
fjy
2b5ce89554
fix spatial indexing with multi spatial dims
2014-09-29 12:07:27 -07:00
nishantmonu51
3f66d3c167
review comments + mapdb deadlock fix
2014-09-29 21:49:12 +05:30
nishantmonu51
adb4a65e0a
Merge branch 'offheap-incremental-index' into mapdb-branch
2014-09-29 12:38:31 +05:30
fjy
eaf0a48b92
Merge branch 'master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
processing/src/main/java/io/druid/guice/PropertiesModule.java
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
services/pom.xml
2014-09-26 11:39:24 -07:00
Xavier Léauté
77c9afe92f
try to make javadoc happy
2014-09-23 18:53:29 -07:00
Xavier Léauté
7cfe86b7bc
[maven-release-plugin] prepare for next development iteration
2014-09-23 16:31:25 -07:00
Xavier Léauté
80166314d9
[maven-release-plugin] prepare release druid-0.6.156
2014-09-23 16:31:21 -07:00
fjy
4235e14fc6
[maven-release-plugin] prepare for next development iteration
2014-09-23 16:12:43 -07:00
fjy
576e9b8a84
[maven-release-plugin] prepare release druid-0.6.155
2014-09-23 16:12:39 -07:00
fjy
0187c7f1c3
Merge pull request #748 from metamx/fix-columnschema-access
...
fix column selector on varying incr index schema
2014-09-23 11:25:46 -06:00
fjy
01bb7de3aa
Merge pull request #756 from metamx/dimdim-comments
...
add some comments about string interning
2014-09-23 11:24:11 -06:00
nishantmonu51
f51ab84386
merge changes from druid-0.7.x
2014-09-22 23:48:45 +05:30
nishantmonu51
443e5788fb
make OffheapIncrementalIndex tuneable
2014-09-22 19:26:10 +05:30
nishantmonu51
59aa8dc368
Merge branch 'offheap-incremental-index' into mapdb-branch
2014-09-19 23:09:35 +05:30
nishantmonu51
8c16377e9e
add custom serializer
...
add custom serializers
2014-09-19 23:09:31 +05:30
nishantmonu51
8eb6466487
revert buffer size and add back rowFlushBoundary
2014-09-19 23:06:04 +05:30
Xavier Léauté
e5a13544a0
fix column selector on varying incr index schema
2014-09-17 10:36:05 -07:00
fjy
a17794a516
[maven-release-plugin] prepare for next development iteration
2014-09-16 15:22:55 -07:00
fjy
f9c91ace3f
[maven-release-plugin] prepare release druid-0.6.154
2014-09-16 15:22:49 -07:00
fjy
cada14586a
fix tests
2014-09-16 14:16:49 -07:00
fjy
8b5c2fcd82
fix compile error
2014-09-16 14:10:02 -07:00
xvrl
ff3163516f
Merge pull request #744 from metamx/fix-select
...
fix select for non existant dimensions and metrics
2014-09-16 14:03:51 -07:00
fjy
9e0a2fd487
fix select for non existant dimensions and metrics
2014-09-16 14:01:21 -07:00
Xavier Léauté
0c35fe2cf4
properly close reader
2014-09-15 13:00:06 -07:00
Xavier Léauté
c8b8e3f6e9
negating compare is bad
2014-09-15 13:00:06 -07:00
Xavier Léauté
137ad50bf1
classes that should be static
2014-09-15 13:00:06 -07:00
Xavier Léauté
e57e2d97ba
make constants final
2014-09-15 12:53:40 -07:00
Xavier Léauté
d4795ce927
fix missing charsets
2014-09-15 12:53:40 -07:00
Xavier Léauté
cfa92e8217
fix incorrect nullable annotations
2014-09-15 12:13:52 -07:00
fjy
257fb3f18e
fix retry logic
2014-09-12 15:47:41 -07:00
nishantmonu51
19bc77134a
use hash map and in memory sort during index generation
...
use hash map and in memory sort during index generation
2014-09-12 23:39:02 +05:30
nishantmonu51
b94c5f0bd6
use putIfAbsent instead of get and put
...
use putIfAbsent instead of get and put. reduce no. of calls to mapdb
decreases latency.
2014-09-12 22:32:40 +05:30
fjy
469ccbbe5e
Merge branch 'master' into druid-0.7.x
...
Conflicts:
cassandra-storage/pom.xml
common/pom.xml
examples/pom.xml
hdfs-storage/pom.xml
histogram/pom.xml
indexing-hadoop/pom.xml
indexing-service/pom.xml
kafka-eight/pom.xml
kafka-seven/pom.xml
pom.xml
processing/pom.xml
processing/src/main/java/io/druid/query/FinalizeResultsQueryRunner.java
processing/src/main/java/io/druid/query/UnionQueryRunner.java
processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactory.java
processing/src/main/java/io/druid/query/topn/TopNQueryEngine.java
processing/src/main/java/io/druid/query/topn/TopNQueryRunnerFactory.java
rabbitmq/pom.xml
s3-extensions/pom.xml
server/pom.xml
server/src/test/java/io/druid/server/initialization/JettyTest.java
services/pom.xml
2014-09-11 16:20:50 -07:00
fjy
e0c167753e
Merge branch 'offheap-incremental-index' into mapdb-branch
2014-09-11 11:03:01 -07:00
nishantmonu51
c39eaf870b
TimeAndDims optimise to store indexes
2014-09-11 16:13:37 +05:30
Xavier Léauté
32e256a842
[maven-release-plugin] prepare for next development iteration
2014-09-10 17:24:15 -07:00
Xavier Léauté
f7dc13d240
[maven-release-plugin] prepare release druid-0.6.153
2014-09-10 17:24:11 -07:00
fjy
fec7b43fcb
make making v9 segments something completely configurable
2014-09-10 15:28:30 -07:00
nishantmonu51
2e3be39048
Merge branch 'offheap-incremental-index' into mapdb-branch
2014-09-10 11:06:54 +05:30
fjy
351afb8be7
allow legacy index generator
2014-09-09 17:04:35 -07:00
nishantmonu51
2b3ad4d742
append a random UUID to map name
...
avoid collision with dimension name
2014-09-09 23:20:19 +05:30
nishantmonu51
e7a5a01f7b
cache size locally
2014-09-09 16:02:50 +05:30
nishantmonu51
178f002f05
indexing working with mapdb
2014-09-09 15:59:33 +05:30
Xavier Léauté
22553b0b28
[maven-release-plugin] prepare for next development iteration
2014-09-05 11:07:22 -07:00
Xavier Léauté
570a7a07bf
[maven-release-plugin] prepare release druid-0.6.152
2014-09-05 11:07:14 -07:00
Xavier Léauté
c255bd76a9
add a test for the previous fix
2014-09-05 11:03:35 -07:00
Xavier Léauté
5dd23b19c3
fix interval start before end in TimewarpOperator
2014-09-05 10:55:45 -07:00
fjy
e24be03a38
[maven-release-plugin] prepare for next development iteration
2014-09-04 14:10:13 -07:00
fjy
a933ea1866
[maven-release-plugin] prepare release druid-0.6.151
2014-09-04 14:10:09 -07:00
xvrl
c4c54f7bc9
Merge pull request #721 from metamx/fix-union-query
...
fix Union Query result merging
2014-09-04 12:20:19 -07:00
nishantmonu51
0dec5826ed
remove unused imports
2014-09-05 00:07:42 +05:30