Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,029 Commits 113 Branches 505 Tags 726 MiB
Commit Graph

657 Commits

Author SHA1 Message Date
nishantmonu51 178f002f05 indexing working with mapdb 2014-09-09 15:59:33 +05:30
Xavier Léauté c255bd76a9 add a test for the previous fix 2014-09-05 11:03:35 -07:00
Xavier Léauté 5dd23b19c3 fix interval start before end in TimewarpOperator 2014-09-05 10:55:45 -07:00
xvrl c4c54f7bc9 Merge pull request #721 from metamx/fix-union-query 
fix Union Query result merging
 2014-09-04 12:20:19 -07:00
nishantmonu51 0dec5826ed remove unused imports 2014-09-05 00:07:42 +05:30
nishantmonu51 90632ecf3a review comment - have separate methods 2014-09-05 00:03:36 +05:30
fjy f473e62f1f Merge pull request #714 from metamx/cleanup-javadocs 
Cleanup javadocs
 2014-09-04 12:28:10 -06:00
nishantmonu51 2772a78b3b review comments - move merging to tool chest 2014-09-04 11:31:04 +05:30
nishantmonu51 268a42bd79 fix Union Query result merging 2014-09-03 16:38:02 +05:30
nishantmonu51 c056960082 fix nested group by with hyperuniques 2014-09-01 10:50:09 +05:30
Xavier Léauté 75134335de fix last merge from master not being forward-compatible 2014-08-30 22:45:36 -07:00
Xavier Léauté 508e982190 Merge remote-tracking branch 'origin/master' into druid-0.7.x 
Conflicts:
	cassandra-storage/pom.xml
	common/pom.xml
	examples/config/historical/runtime.properties
	examples/config/overlord/runtime.properties
	examples/config/realtime/runtime.properties
	examples/pom.xml
	hdfs-storage/pom.xml
	histogram/pom.xml
	indexing-hadoop/pom.xml
	indexing-service/pom.xml
	kafka-eight/pom.xml
	kafka-seven/pom.xml
	pom.xml
	processing/pom.xml
	rabbitmq/pom.xml
	s3-extensions/pom.xml
	server/pom.xml
	server/src/main/java/io/druid/server/ClientQuerySegmentWalker.java
	services/pom.xml
 2014-08-30 22:42:36 -07:00
xvrl 068a5fe2aa Merge pull request #715 from metamx/aggregator-factory-equals-hashcode 
AggregatorFactory equals() and hashCode() methods.
 2014-08-29 15:22:00 -07:00
Gian Merlino 879e615314 AggregatorFactory equals() and hashCode() methods. 2014-08-29 15:02:04 -07:00
Xavier Léauté 58ab759fc6 remove unused imports 2014-08-29 14:03:47 -07:00
Xavier Léauté ac05836833 make Java 8 javadoc happy 2014-08-29 13:58:50 -07:00
Xavier Léauté 674e7b0447 add tests for timeboundary timewarp 2014-08-28 17:59:56 -07:00
Xavier Léauté 743a9bfdac fix offset and nulls 2014-08-28 17:35:26 -07:00
Xavier Léauté 9f742a87a6 fix timewarp with different bounds 2014-08-28 17:15:45 -07:00
Xavier Léauté b0b39d6ec0 fix maxTime caching for individual bounds 2014-08-28 17:14:25 -07:00
Gian Merlino 661e467d71 Fix groupBy/timeseries test, follow up to #705. 2014-08-26 22:36:08 -07:00
Xavier Léauté d15cd8fde7 add some comments about string interning 2014-08-26 21:33:38 -07:00
Gian Merlino 0eea1dc08d Test for desired timeseries zero-filling behavior. 2014-08-26 18:52:08 -07:00
Gian Merlino da48a713ae Fix overzealous timeseries zero-filling. 
When the index's maxTime is not aligned with the query granularity, gran.next
can cause an time extra bucket to get zero-filled. Truncating first prevents
that.
 2014-08-26 18:52:08 -07:00
Gian Merlino 28e3191503 Merge pull request #699 from metamx/postprocessing-operators 
query post-processing operators
 2014-08-26 17:23:37 -07:00
Xavier Léauté e39b6975fa rename t to now 2014-08-26 17:16:09 -07:00
Xavier Léauté a1c8b23ba7 fix duration granularity with non-zero origin 2014-08-26 11:47:07 -07:00
Xavier Léauté 7537cf4fb1 fix compound period granularity for exact periods 2014-08-26 10:34:08 -07:00
Xavier Léauté eb7dd6dc74 add documentation and tests 2014-08-26 09:53:46 -07:00
Xavier Léauté b52869ff28 default to noop 2014-08-25 17:17:35 -07:00
Xavier Léauté 047f793cb7 query post-processing operators 
- Allows post-processing of query results
- Example timewarp post-processing operator
 2014-08-25 16:55:46 -07:00
Xavier Léauté 3261fd879a fix groupBy deserialization 2014-08-22 13:43:56 -07:00
Xavier Léauté 72eb64a40c fix HLL equals when comparing sparse and dense 2014-08-22 13:42:46 -07:00
fjy 172d0b6291 fix cache bug with group by query and uniques 2014-08-22 08:26:06 -07:00
fjy 197c80a694 fix logging 2014-08-21 13:40:55 -07:00
fjy 64ff5f0880 add back broken synch 2014-08-21 13:20:23 -07:00
fjy e5d1c390fa add extra logging 2014-08-21 13:17:29 -07:00
nishantmonu51 c216eb7340 remove ThreadSafeAggregator 2014-08-21 23:56:07 +05:30
nishantmonu51 67f4bbae74 fixes from review comments 
fix sync of aggs,
fix NPE in sink.isFull,
RealtimeTuningConfig lower the bufferSize to 256m
 2014-08-21 09:24:14 +05:30
Xavier Léauté 8933685884 log allocation of conversionBuf 2014-08-20 12:41:47 -07:00
fjy fd09b1b5f1 cleanup things according to cr 2014-08-20 09:49:21 -07:00
nishantmonu51 33354cf7fe replace maxRowsInMemory with BufferSize 2014-08-20 20:59:44 +05:30
nishantmonu51 e525562767 review comments - cleanup ColumnSelectorFactory 2014-08-20 15:04:43 +05:30
nishantmonu51 60906c3244 Revert "make valueType configurable" 
This reverts commit 6f60a3f604.
 2014-08-20 11:55:26 +05:30
nishantmonu51 0c77f549ff Revert "return correct valueType" 
This reverts commit 0b42ca4c75.
 2014-08-20 11:54:20 +05:30
fjy 88a904e0b3 address cr about progress ind 2014-08-19 12:59:01 -07:00
fjy 0facb4202d cleanup 2014-08-18 17:22:44 -07:00
fjy 3933af79a0 fix small bug 2014-08-18 17:13:06 -07:00
nishantmonu51 4dd01d4eae review comments 2014-08-18 19:34:56 +05:30
fjy 8fabc541f0 Merge branch 'druid-0.7.x' into offheap-incremental-index 2014-08-14 11:39:44 -07:00
Xavier Léauté 603152eb18 fix compilation with Java 8 2014-08-14 11:37:47 -07:00
fjy 18d3acd3a8 fix all manners of brokenness from nulls and empty strings 2014-08-14 11:11:57 -07:00
nishantmonu51 0b42ca4c75 return correct valueType 2014-08-13 18:34:00 +05:30
nishantmonu51 6f60a3f604 make valueType configurable 2014-08-13 14:37:57 +05:30
nishantmonu51 03d7ec04be make tests pass 2014-08-13 10:55:20 +05:30
nishantmonu51 1b0a72751b Add support for LongColumn 2014-08-13 08:52:36 +05:30
fjy 1adec23126 some better null handling for MV 2014-08-12 16:40:02 -07:00
Xavier Léauté b448deeca0 fix compilation with Java 8 2014-08-12 14:02:08 -07:00
Xavier Léauté 161c2f0fff Merge branch 'master' into druid-0.7.x 
Conflicts:
	cassandra-storage/pom.xml
	common/pom.xml
	examples/config/historical/runtime.properties
	examples/config/overlord/runtime.properties
	examples/config/realtime/runtime.properties
	examples/pom.xml
	hdfs-storage/pom.xml
	histogram/pom.xml
	indexing-hadoop/pom.xml
	indexing-service/pom.xml
	kafka-eight/pom.xml
	kafka-seven/pom.xml
	pom.xml
	processing/pom.xml
	rabbitmq/pom.xml
	s3-extensions/pom.xml
	server/pom.xml
	services/pom.xml
 2014-08-12 14:00:21 -07:00
fjy d4014c6a4e Merge pull request #675 from metamx/slimmer-column-cache 
reduce object count overhead of column cache
 2014-08-12 14:16:33 -06:00
fjy 578e0b4fb6 add more logging for groupby caching 2014-08-12 12:35:39 -07:00
nishantmonu51 f36d030ef2 fix NPE while indexing 2014-08-13 00:54:31 +05:30
nishantmonu51 c6712739dc merge changes from druid-0.7.x 2014-08-12 15:47:42 +05:30
Xavier Léauté a1bcff49c5 disable column cache by default 2014-08-11 18:10:33 -07:00
Xavier Léauté 69f4c2677f formatting 2014-08-11 18:10:19 -07:00
Xavier Léauté da399724eb add approximate object overhead 2014-08-11 17:07:10 -07:00
Xavier Léauté aecf4491be reduce object count overhead of column cache 2014-08-11 15:25:14 -07:00
fjy b740987381 Merge pull request #616 from metamx/jisoo 
add retry feature on broker side; modify QueryRunner inferface and tests
 2014-08-11 15:36:16 -06:00
fjy 2ecd55bae5 Merge branch 'druid-0.7.x' into new-init 
Conflicts:
	examples/config/historical/runtime.properties
	examples/config/overlord/runtime.properties
	examples/config/realtime/runtime.properties
 2014-08-11 12:47:38 -07:00
fjy 70b86c5551 Merge branch 'master' into druid-0.7.x 
Conflicts:
	cassandra-storage/pom.xml
	common/pom.xml
	examples/pom.xml
	hdfs-storage/pom.xml
	histogram/pom.xml
	indexing-hadoop/pom.xml
	indexing-service/pom.xml
	kafka-eight/pom.xml
	kafka-seven/pom.xml
	pom.xml
	processing/pom.xml
	rabbitmq/pom.xml
	s3-extensions/pom.xml
	server/pom.xml
	services/pom.xml
 2014-08-11 12:35:47 -07:00
fjy 8998700760 prepare for next release 2014-08-08 16:19:45 -07:00
Xavier Léauté d198959c60 fix test harness 2014-08-08 14:05:10 -07:00
fjy ab5c529ad6 Merge branch 'druid-0.7.x' into new-init 2014-08-08 13:45:37 -07:00
fjy 4af6a05378 Merge pull request #632 from metamx/lz4-compression 
Change default column compression from LZF to LZ4
 2014-08-08 14:24:00 -06:00
fjy f3970bb1d8 Merge branch 'master' into new-init 
Conflicts:
	examples/config/historical/runtime.properties
	examples/config/overlord/runtime.properties
	examples/config/realtime/runtime.properties
 2014-08-08 12:44:29 -07:00
Gian Merlino 889c85c64f Fix OrderByColumnSpec cacheKey. 2014-08-07 06:53:34 -07:00
Xavier Léauté 6fa611c262 refactor FixedSizeCompressedObjectStrategy 2014-08-06 16:13:39 -07:00
Xavier Léauté 991e1828b0 make LZ4 the default compression strategy 
- LZ4 is now hardwired to be the default strategy
- Rework tests to test all available compression strategies
 2014-08-06 15:50:07 -07:00
fjy 7624bb5ea3 Merge branch 'master' into new-init 
Conflicts:
	examples/config/historical/runtime.properties
	examples/config/overlord/runtime.properties
	examples/config/realtime/runtime.properties
	processing/src/main/java/io/druid/guice/PropertiesModule.java
	server/src/main/java/io/druid/initialization/Initialization.java
 2014-08-06 15:47:22 -07:00
fjy 4d4c6b891e address cr 2014-08-05 15:58:42 -07:00
fjy d73492bf0f add missing final 2014-08-05 15:51:56 -07:00
fjy 8097e04938 fix naming 2014-08-05 15:48:30 -07:00
fjy 3a78960e65 Fix how metrics are emitted from servermanager 2014-08-05 15:47:30 -07:00
fjy 66225d698f fix stupidness with spatial indexing 2014-08-05 15:07:56 -07:00
jisookim0513 6f58cd1156 fix merge conflcts; change test files 2014-08-04 17:45:56 -07:00
fjy 37f3cb38db fix to string error 2014-07-31 17:23:56 -07:00
fjy a5bc6fc706 fix to string error 2014-07-31 17:08:08 -07:00
nishantmonu51 32b9290723 fix compilation 2014-07-31 16:20:58 +05:30
nishantmonu51 637bd35785 merge changes from druid-0.7.x 2014-07-31 16:07:22 +05:30
xvrl d21e377a20 Merge pull request #651 from metamx/rewrite-async 
rewrite router async logic
 2014-07-29 13:56:01 -07:00
fjy 2ad1bd3f44 add back metrics 2014-07-29 10:22:55 -07:00
Xavier Léauté df7a39a682 fix index out of bounds 2014-07-28 09:59:21 -07:00
fjy 45e443bedb a few slight tweaks and bumping up curator version 2014-07-25 16:07:40 -07:00
fjy 8ef380b3f9 Merge pull request #638 from metamx/rejigger-cache 
Rejiggering the cache
 2014-07-17 15:19:23 -06:00
fjy bc650a1c80 Merge pull request #627 from metamx/druid-firehose 
Functionality to ingest a Druid segment and change the schema
 2014-07-17 13:41:16 -06:00
nishantmonu51 e59c9ebdbc minor fixes 
fix IndexOutOfBoundsException
fix ingestFirehose
 2014-07-17 17:24:57 +05:30
fjy b70a6b1061 address code review comments 2014-07-16 13:52:06 -07:00
fjy 2f90bfcf9a rejiggering the cache for groupBy and select 2014-07-15 12:12:33 -07:00
nishantmonu51 f5f05e3a9b Sync changes from branch new-ingestion PR #599 
Sync and Resolve Conflicts
 2014-07-11 16:15:10 +05:30
jisookim0513 c4397bd65a fixed merge conflicts 2014-07-07 11:26:11 -07:00
Xavier Léauté c40a315c81 initial support for LZ4 compression 2014-07-07 11:01:08 -07:00
fjy d37527ca79 make histos work with groupby maybe 2014-07-01 16:46:58 -07:00
fjy 92bc340099 Merge branch 'master' into more-tests 2014-06-30 18:40:00 -07:00
fjy afa73a2d3a fix one of the TODOs and add test case 2014-06-30 17:29:19 -07:00
Xavier Léauté 1499ee6458 add toString method for JavascriptDimExtractionFn 2014-06-25 10:47:57 -06:00
jisookim0513 cc8a4d0847 revert changes to RetryQueryRunnerConfig 2014-06-20 13:49:33 -07:00
jisookim0513 5e7dfaf298 change retry tests 2014-06-20 13:45:04 -07:00
jisookim0513 3418291333 add a test for retrying multiple times 2014-06-20 13:15:46 -07:00
jisookim0513 1cb3fc250e change missigSegments to a static variable 2014-06-19 18:29:00 -07:00
jisookim0513 0244172ccb change missigSegments to a static variable 2014-06-19 18:22:36 -07:00
jisookim0513 4e2b5b743f add more unit tests 2014-06-19 18:18:58 -07:00
jisookim0513 bdb35e2d7e fix retry logic and change the default value of retry to 0 2014-06-19 17:50:50 -07:00
Xavier Léauté 0602a45200 add column config test (disabled by default) 2014-06-19 14:48:51 -07:00
fjy 4c40e71e54 address cr 2014-06-19 14:48:46 -07:00
fjy a870fe5cbe inject column config 2014-06-19 14:47:57 -07:00
jisookim0513 ff980091c5 delete an unused flag in IncrementalIndexSegment 2014-06-19 14:43:58 -07:00
Xavier Léauté c2e2391e3a fix thread local initial value 2014-06-19 14:43:03 -07:00
Xavier Léauté 09346b0a3c make column cache configurable 2014-06-19 14:43:03 -07:00
Xavier Léauté 8840af5977 make GenericIndexed release cache resources on close 2014-06-19 14:42:08 -07:00
jisookim0513 c4048d06dd delete an unused flag in QueryableIndexSegment 2014-06-19 14:42:04 -07:00
jisookim0513 35e080bbc1 fix concurrency issue with the map; introduce new exception; add incomplete retry query runner test 2014-06-19 14:14:54 -07:00
Xavier Léauté be25d67894 add comments 2014-06-19 14:12:40 -07:00
Xavier Léauté 618afd9976 optimize single value lookup 2014-06-19 14:12:39 -07:00
Xavier Léauté 7a351dfde3 optimize lookups by caching bytebuffer copy 2014-06-19 14:12:39 -07:00
Xavier Léauté be92c322e3 make ObjectStrategy cacheable 2014-06-19 14:12:39 -07:00
jisookim0513 8515a11787 change the signature of run() 2014-06-18 18:05:09 -07:00
jisookim0513 f4b1dc032b change the way to use RetryQueryRunnerConfig 2014-06-18 17:15:04 -07:00
jisookim0513 00856f0fec add retry feature on broker side; modify QueryRunner inferface and tests 2014-06-18 16:55:33 -07:00
fjy 0bc1915067 Merge pull request #578 from metamx/new-guava 
Update guava, java-util, and druid-api
 2014-06-18 14:23:32 -06:00
Xavier Léauté 9b03f5b13a fix timeout test race condition 2014-06-17 09:00:07 -07:00
Gian Merlino 3db07d2a55 Make TimeBoundaryQuery buildResult no longer static. 2014-06-16 16:54:31 -07:00
fjy ce61e60ee8 all manners of new tests 2014-06-16 16:19:26 -07:00
fjy c2149f8a00 add more tests for time boundary and caching 2014-06-16 15:32:28 -07:00
fjy a71f7152a5 fix broken UT 2014-06-16 14:53:26 -07:00
fjy 5aa46d08a8 address cr 2014-06-16 14:24:36 -07:00
fjy 9ca4f564ee address cr 2014-06-16 14:20:16 -07:00
fjy 08c88e8fb7 address cr 2014-06-16 14:07:10 -07:00
fjy d2cf7d3f0a address cr 2014-06-16 14:00:01 -07:00
fjy d4a47fe6e8 enable tb to return just max or min time 2014-06-16 13:45:32 -07:00
nishantmonu51 2d03888a2c Merge branch 'master' into offheap-incremental-index 
Conflicts:
	processing/src/main/java/io/druid/query/groupby/GroupByQueryHelper.java

processing/src/main/java/io/druid/query/groupby/GroupByQueryQueryToolChe
st.java

processing/src/main/java/io/druid/segment/incremental/IncrementalIndex.j
ava
 2014-06-16 20:43:17 +05:30
nishantmonu51 0629be622c remove unnecessary changes & fix index closing subquery 2014-06-16 18:50:49 +05:30
nishantmonu51 a9c09ec8a7 fix compilation 2014-06-16 17:55:43 +05:30
fjy d5d2873d3c Merge pull request #593 from metamx/fix-groupyb 
Support all standard Druid functions in GroupBy and nested groupBy
 2014-06-13 15:37:55 -06:00
Xavier Léauté 93f97a5d86 fix bysegment-query-runner 2014-06-13 13:20:14 -07:00
fjy 8246d42715 Merge branch 'master' into new-guava 2014-06-13 11:44:05 -07:00
Xavier Léauté 294a9ba78f fix same race condition in other test 2014-06-13 11:42:19 -07:00
fjy 332ba3ef20 fix bad merge 2014-06-13 11:36:36 -07:00
fjy 4cc0353be2 Merge branch 'master' of github.com:metamx/druid into new-guava 2014-06-13 11:30:07 -07:00
fjy 5bd4ad3f0f address code review 2014-06-13 11:29:49 -07:00
Xavier Léauté 4c4047165f fix query cancellation test race condition 2014-06-13 11:28:48 -07:00
fjy a63cda3281 Merge branch 'master' into new-guava 
Conflicts:
	server/src/main/java/io/druid/server/QueryResource.java
 2014-06-13 10:08:10 -07:00
nishantmonu51 49d3bd94da Merge branch 'master' into offheap-incremental-index 2014-06-13 15:39:34 +05:30
nishantmonu51 0ddaf4c307 fix race while index closing and querying 2014-06-13 15:36:57 +05:30
Xavier Léauté 8f7c82d351 avoid closing yielder prematurely 2014-06-12 16:00:06 -07:00
Xavier Léauté bfa3caa589 js/cardinality/hyperUnique happy groupBy family 2014-06-12 15:19:01 -07:00
Xavier Léauté fd47efd59e fix cardinality combining factory 2014-06-12 15:19:01 -07:00
Xavier Léauté 150480bdf9 complexmetricserde workaround for groupby 2014-06-12 15:19:01 -07:00
fjy e84bcca40f rename method 2014-06-12 13:36:40 -07:00
fjy 4a4cccf10e Merge branch 'master' into fix-groupyb 
Conflicts:
	processing/src/main/java/io/druid/query/timeseries/TimeseriesQueryEngine.java
 2014-06-12 13:24:16 -07:00
fjy 403962fe0b add some failing tests for groupBy 2014-06-12 11:36:53 -07:00
Xavier Léauté 22e368e79b add dimension/column selector to incremental index 2014-06-12 11:25:22 -07:00
nishantmonu51 025814cfff Merge branch 'master' into offheap-incremental-index 
Conflicts:
	processing/src/main/java/io/druid/query/GroupByParallelQueryRunner.java

processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactor
y.java

processing/src/main/java/io/druid/segment/incremental/IncrementalIndexSt
orageAdapter.java
 2014-06-12 20:02:27 +05:30
nishantmonu51 a7e19ad892 configure buffer sizes 2014-06-12 19:32:37 +05:30
fjy cde86d81e2 make having and limitspec work for nested queries 2014-06-10 15:50:13 -07:00
Xavier Léauté a541029b41 segmentMetadata query cancellation 2014-06-10 11:51:07 -07:00
Xavier Léauté 6550cb1776 groupBy query cancellation 2014-06-10 11:51:06 -07:00
Xavier Léauté 8f7fd93491 add comments 2014-06-10 10:36:39 -07:00
Xavier Léauté b84884ab76 remove methods used only for testing 2014-06-10 10:36:39 -07:00
Xavier Léauté c08002aa4d interrupt queries on incremental indexer 2014-06-10 10:36:39 -07:00
Xavier Léauté 99c9a2cf05 make sure to close yielder in MetricsEmittingQueryRunner 2014-06-10 10:36:39 -07:00
Xavier Léauté 97d5455f3a properly kill timed out queries 2014-06-10 10:36:38 -07:00
Xavier Léauté d0f9c438f8 proper query cancellation tests 2014-06-10 10:36:38 -07:00
Xavier Léauté 855c66c9ad less stack traces when cancelling queries 2014-06-10 10:36:38 -07:00
Xavier Léauté d2c729adec return proper json errors to propagate query cancellation and timeout 2014-06-10 10:36:38 -07:00
Xavier Léauté a56a655eae proper query exceptions and add support for query timeout 2014-06-10 10:36:38 -07:00
Xavier Léauté 1183c68ce4 formatting 2014-06-10 10:36:38 -07:00
Xavier Léauté 4f1e157639 pass through errors from computes in DirectDruidClient 2014-06-10 10:36:38 -07:00
Xavier Léauté 32f6243be0 proper closing of resources in case of query cancellation 2014-06-10 10:36:38 -07:00
Xavier Léauté 1be85af320 handle query interruption at cursor level 2014-06-10 10:36:37 -07:00
Xavier Léauté d6f38827db initial query cancellation commit 2014-06-10 10:36:28 -07:00
fjy 5955ecf032 fix bugs wtih js and card aggs 2014-06-09 22:31:30 -07:00
fjy 187b2beb47 cleaner way of implementing things 2014-06-09 22:27:33 -07:00
fjy 32b65d9c5b remove commented out code 2014-06-09 18:26:37 -07:00
fjy 6adc3011fa fix post aggs with group by in #472 2014-06-09 18:25:10 -07:00
nishantmonu51 bf09f979bd fix segment metadataquery 2014-06-05 20:35:57 +05:30
nishantmonu51 5bdc4a761a close IncrementalIndex properly and free up buffer 2014-06-05 19:41:43 +05:30
nishantmonu51 01e8a713b6 unit tests passing with offheap-indexing 2014-06-05 17:42:53 +05:30
fjy 77ec4df797 update guava, java-util, and druid-api 2014-06-03 13:43:38 -07:00
fjy 7be93a770a make all firehoses work with tasks, add a lot more documentation about configuration 2014-05-28 16:33:59 -07:00
fjy c56f3fd1af Merge pull request #565 from metamx/add-hll-test 
test for correct HLL bytebuffer folding
 2014-05-28 12:12:34 -06:00
xvrl 18685542ec Merge pull request #568 from metamx/fix-topn 
Fix inverted lexicographic topns and topns with dim extraction dimension specs
 2014-05-28 10:47:10 -07:00
fjy 642897dca3 fix inverted logic 2014-05-28 10:43:03 -07:00
fjy 2ee1defce9 better handle dim extraction regex cases 2014-05-28 10:27:00 -07:00
fjy 8bcf4bc60e address code review comments 2014-05-27 19:47:13 -07:00
fjy 9f62589d71 fix bug with previousStop not being respected for inverse lexi topN 2014-05-27 19:39:55 -07:00
fjy b9015cee34 fix brokeness with dim extraction dim specs 2014-05-27 17:25:00 -07:00
fjy 07a95a0e05 Fix inverted lexicographic topNs 2014-05-27 17:02:28 -07:00
Xavier Léauté d423ba1b27 minor optimizations 2014-05-27 11:03:12 -07:00
Xavier Léauté 5844c45956 fix issue when offset changes folding maxOverflow 2014-05-27 11:03:12 -07:00
Xavier Léauté c273298ad4 don't discard current maxOverflow if offset is high enough 2014-05-27 11:03:12 -07:00
Xavier Léauté d96d82252d test fold permutations with various maxOverflow / offsets 2014-05-27 11:03:12 -07:00
Xavier Léauté df3fb07e51 test for correct bytebuffer folding 2014-05-22 17:48:19 -07:00
fjy 2906544c30 add a context to force 2 pass algorithm for topNs 2014-05-20 10:42:37 -07:00
Xavier Léauté 9ec7c71e0f fix compilation error with updated druid-api 2014-05-19 14:06:23 -07:00
fjy 77289a4148 Merge pull request #531 from metamx/listenable-prioritized-executorservice 
make prioritized executor service listenable
 2014-05-16 16:59:04 -06:00
Xavier Léauté 3223d46c1a simplify chained sequence operations 2014-05-16 13:49:40 -07:00
Xavier Léauté 07b2a0efa6 replace iterables with sequences, fixes #128 2014-05-16 13:22:53 -07:00
Xavier Léauté d8282d0126 add JavascriptAggregatorBenchmark 2014-05-16 10:41:54 -07:00
Gian Merlino 4fbd6c7c36 JavaScriptAggregator comment explaining why primitive wrapping is anti-helpful. 2014-05-16 09:47:59 -07:00
Gian Merlino 918ee8741a More JS aggregator tests. 2014-05-15 23:08:56 -07:00
Gian Merlino d389fbc961 More consistent ObjectColumnSelectors. JS aggregator tests for nulls. 2014-05-15 23:02:44 -07:00
Gian Merlino cb028f490a JavaScriptAggregator: Context.newArray makes nicer arrays than Context.javaToJS. 2014-05-15 20:02:36 -07:00
Gian Merlino c2137e8416 ObjectColumnSelector/JS aggregator support for multi-valued columns. 2014-05-15 19:34:22 -07:00
nishantmonu51 ce3d461e7d add header 2014-05-16 04:30:58 +05:30
nishantmonu51 e06b29edb9 add sanity unit tests 2014-05-16 03:15:35 +05:30
nishantmonu51 ddc36c89cc union query fix and a broken test 2014-05-15 23:10:40 +05:30
Xavier Léauté 0912a2a09a use Guava's ForwardingExecutorService instead of DelegatingExecutorService 2014-05-09 23:24:45 -07:00
Xavier Léauté 4280b4e8fa make MetricsEmittingExecutorService listenable 2014-05-09 23:24:38 -07:00
fjy 2709a8b0b6 revert changes to hyperUnique 2014-05-07 12:33:42 -07:00
fjy 9d35490cdf Revert "Merge pull request #495 from metamx/dim-extraction-null-values" 
This reverts commit 76437379d7, reversing
changes made to 79e6d4eb56.

Conflicts:
	pom.xml
 2014-05-07 12:32:51 -07:00
Xavier Léauté 4fa6de4c6c support null dimension values in HyperUniquesSerde 2014-05-07 11:07:48 -07:00
fjy b6fb4245aa Merge branch 'master' into new-schema 
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDriverConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfig.java
	indexing-hadoop/src/main/java/io/druid/indexer/HadoopDruidIndexerConfigBuilder.java
	pom.xml
	server/src/main/java/io/druid/segment/realtime/RealtimeManager.java
	server/src/main/java/io/druid/segment/realtime/firehose/EventReceiverFirehoseFactory.java
 2014-05-06 14:32:51 -07:00
fjy 76437379d7 Merge pull request #495 from metamx/dim-extraction-null-values 
Support null values in DimExtractionFn in topN and groupBy
 2014-05-06 14:17:55 -06:00
fjy 79e6d4eb56 Merge pull request #528 from metamx/union-query-source 
Union query source
 2014-05-06 14:13:33 -06:00
nishantmonu51 66450ca6ed review comments 
remove toShortString
minor other changes
 2014-05-07 00:54:17 +05:30
fjy a747ed0011 fix broken UT 2014-05-05 16:13:01 -07:00
fjy b1bd6eb0f2 Merge pull request #512 from metamx/cardinality 
Cardinality aggregator
 2014-05-05 17:10:24 -06:00
fjy 8af927e2a7 Merge pull request #516 from metamx/alphanumeric-topn 
Alpha-numeric sorting for topN
 2014-05-05 17:09:24 -06:00
Xavier Léauté ea318f01ee allow forcing all tasks to be prioritized 2014-05-05 11:42:30 -07:00
nishantmonu51 f2725994b7 refactor method 2014-05-05 19:57:32 +05:30
nishantmonu51 477e01daf7 review comments 2014-05-02 15:21:06 +05:30
Xavier Léauté dab30395d5 make prioritized executor service listenable 2014-05-01 15:51:59 -07:00
nishantmonu51 1b6137504c Add toString for better logging 2014-05-01 21:32:27 +05:30
nishantmonu51 92ebe69fd9 remove unwanted loggings 2014-05-01 21:16:42 +05:30
nishantmonu51 1d67e39949 Fixes 
fix NPE in select query, calculating cache key
remove unwanted logging
fix ds in topNQuery
 2014-05-01 21:04:47 +05:30
nishantmonu51 728a606d32 Add support for union queries 2014-05-01 01:54:52 +05:30
Xavier Léauté bb62a44e24 alphanumeric topN 2014-04-28 09:42:43 -07:00
fjy e30accbbf5 reducing bloat 2014-04-25 15:25:54 -07:00
Xavier Léauté 5ae848ab14 fix formatting 2014-04-25 15:09:47 -07:00
Xavier Léauté c1e6f6d83e formatting changes 2014-04-25 14:54:17 -07:00
Xavier Léauté de5b1749bc minor changes to address code review 2014-04-25 14:54:17 -07:00
fjy 76e0a48527 Merge branch 'master' into new-schema 
Conflicts:
	indexing-hadoop/src/main/java/io/druid/indexer/DbUpdaterJob.java
	indexing-hadoop/src/test/java/io/druid/indexer/HadoopDruidIndexerConfigTest.java
	indexing-service/src/main/java/io/druid/indexing/common/task/HadoopIndexTask.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumber.java
	server/src/main/java/io/druid/segment/realtime/plumber/RealtimePlumberSchool.java
 2014-04-25 14:03:28 -07:00
Xavier Léauté 3c9b8dc999 cardinality aggregator 2014-04-24 22:08:25 -07:00
fjy c4cefb667e prepare for next release 2014-04-24 11:45:25 -07:00
fjy 90e600bad6 Merge pull request #511 from metamx/fix-hll-buffer-and-swap 
HLL: avoid direct buffers + fix swap target buffer
 2014-04-24 12:03:54 -06:00
Xavier Léauté 30d1a5db75 HLL: avoid direct buffers + fix swap target buffer 2014-04-24 10:49:53 -07:00
fjy f1d705cb73 proper toStrings of filters 2014-04-22 14:46:19 -07:00
fjy fcc1366712 remove test main 2014-04-22 12:54:16 -07:00
fjy 8fd39c63d5 Better handle null adapters and NPEs in the CQE 2014-04-22 12:47:53 -07:00
xvrl d17abedae3 Merge pull request #499 from metamx/fix-pull-from-cache 
Fix pull from cache
 2014-04-22 11:19:57 -07:00
Xavier Léauté 3bac366013 handle NaN / Infinity values 2014-04-22 10:42:44 -07:00
nishantmonu51 4721ba3f1e add test + small fix for other test 2014-04-22 23:03:48 +05:30
nishantmonu51 65c71a40bb fix more issues and add test 
1) Add test for caching and calculation of dependent post-aggs for
TimeSeries and TopN
2) Fix more NPEs while calculating dependent postAggs, passing
baseHolder was wrong as it does not contain post-aggs during computing
dependent ones.
 2014-04-22 22:05:17 +05:30
nishantmonu51 3fb42251d9 calculate postAggs while pulling from cache 2014-04-22 11:25:21 +05:30
nishantmonu51 7bafb71841 Revert "fix npe in topNBinaryFn with post aggs" 
This reverts commit bbedde3418.
 2014-04-22 11:10:55 +05:30
fjy c44cdba65e Merge pull request #496 from metamx/fix-topN-postagg-npe 
fix npe in topNBinaryFn with post aggs
 2014-04-21 23:22:07 -06:00
Xavier Léauté bbedde3418 fix npe in topNBinaryFn with post aggs 2014-04-21 22:20:41 -07:00
fjy 07aab28325 clean up topnbinaryfn 2014-04-21 20:30:18 -07:00
Xavier Léauté 48590862cb support for null values in group-by 2014-04-21 17:58:44 -07:00
Xavier Léauté 44bd4339b5 support for null values in DimExtractionFn 2014-04-21 15:16:56 -07:00
nishantmonu51 f20d3b2895 merge changes from master 2014-04-21 21:43:44 +05:30
nishantmonu51 e8b993b765 fix by segment results 
1) fix class cast in by segment results
2) exclude old netty version coming from curator
 2014-04-21 21:26:34 +05:30
fjy e3fbbff237 clean up code 2014-04-18 17:41:47 -07:00
Xavier Léauté a0c8d9d413 restore previous behavior of not optimizing Timeseries post-aggregators 2014-04-18 16:45:06 -07:00
Xavier Léauté 597e55ab50 don't override context when not finalizing 2014-04-18 16:26:21 -07:00
nishantmonu51 68e8cda2da fix post aggregator 2014-04-19 04:24:07 +05:30
fjy c00fb1d08e Merge pull request #445 from metamx/hadoop-version-update 
Hadoop version update
 2014-04-17 19:16:44 -06:00
fjy 399efe7dc4 make uniques work for groupby 2014-04-17 14:41:17 -07:00
nishantmonu51 2b5fec1dcf review comments 2014-04-16 17:12:27 +05:30
nishantmonu51 6da2272076 fix NPE in aggregatrFirstTopnAlgo 2014-04-16 09:12:34 +05:30
fjy 228be3acb0 Merge pull request #467 from metamx/optimize-postAgg-calculation 
Optimize post agg calculation
 2014-04-15 15:18:01 -06:00
nishantmonu51 36f6f8ab5a Add testOutOfOrderPruneDependentPostAgg 2014-04-16 00:49:56 +05:30
nishantmonu51 6217c67027 complete javadoc, add comment, use Lists.reverse 2014-04-15 22:55:40 +05:30
nishantmonu51 3eb8160b51 review comments 2014-04-15 21:06:30 +05:30
nishantmonu51 d66ae5ac10 fix dependent PostAggregators 2014-04-15 13:37:31 +05:30
fjy a46c4592b4 a few cleanups 2014-04-14 09:53:29 -07:00
fjy 7a8b9c2160 fix select serde 2014-04-10 15:35:55 -07:00
Xavier Léauté be30d450d7 support dimension extraction functions in group by 2014-04-09 17:17:01 -07:00
nishantmonu51 ecfa6bd1b1 fix casing and add comment 2014-04-08 17:26:51 +05:30
nishantmonu51 22c3296aa3 Merge branch 'master' into optimize-postAgg-calculation 
Conflicts:
	server/src/test/java/io/druid/client/CachingClusteredClientTest.java
 2014-04-08 03:35:56 +05:30
nishantmonu51 c322f44863 time series post Aggregation improved 
move post aggregation to finalise results
 2014-04-08 03:17:15 +05:30
fjy 6a26f7684f fix context on CQE 2014-04-07 14:36:13 -07:00
nishantmonu51 4bb36dd453 fix tests 2014-04-08 02:37:57 +05:30
fjy bae0fdf936 add context serde tests and deprecate backwards compatible methods 2014-04-07 13:18:55 -07:00
fjy 93349b5d07 fix broken unit tests 2014-04-07 10:56:38 -07:00
nishantmonu51 db35009acd Compute postage only when required 2014-04-07 23:17:25 +05:30
fjy 98c3faa767 cleanup 2014-04-06 09:23:59 -07:00
fjy 1267fbb7f5 fix context to be backwards compat 2014-04-06 09:20:58 -07:00
Hagen Rother e0e43deaec fix a NPE leading to broker 500 response 2014-04-04 13:07:52 +02:00
fjy 9ebdf16ed6 make last commit a final var 2014-03-27 17:56:25 -07:00
fjy cb1798c520 fix bug with reference closing that I swore we fixed 2014-03-27 17:55:03 -07:00
Xavier Léauté 0be29df8ae make hll tests deterministic 2014-03-27 16:15:32 -07:00
Xavier Léauté 5f0ada925d add HLL maxOverflow tests 2014-03-27 16:01:40 -07:00
Xavier Léauté 03c51518bc don't assume bytebuffer limit is set 2014-03-27 15:58:34 -07:00
Xavier Léauté 11f08b3895 benchmark more closely matches actual implementation 2014-03-26 22:18:26 -07:00
Xavier Léauté c92fd6f45d folding into direct buffers is faster 2014-03-26 17:13:41 -07:00
Xavier Léauté 83ac1d323e one more final variable for good measure 2014-03-26 16:50:24 -07:00
Xavier Léauté 2580a9c7f1 mark long-running tests as @Ignore + docs 2014-03-26 16:49:55 -07:00
Xavier Léauté f42b850d60 clean up + header 2014-03-26 09:31:45 -07:00
nishantmonu51 a9a6682a0e Upgrade to Hadoop 2.3.0 2014-03-26 11:43:31 +05:30