1420 Commits

Author	SHA1	Message	Date
Fangjin Yang	14229ba0f2	Merge pull request #1922 from metamx/jsonIgnoresFinalFields ... Change DefaultObjectMapper to NOT overwrite final fields unless explicitly asked to	2015-12-18 15:38:32 -08:00
Fangjin Yang	71f554bf80	Merge pull request #2101 from himanshug/fix_extraction_dim_filter_cache_key ... add extractionFn bytes to cache key in ExtractionDimFilter	2015-12-18 12:05:43 -08:00
Fangjin Yang	9e6874cc7e	Merge pull request #2084 from binlijin/master ... minor optimize IndexMerger's MMappedIndexRowIterable	2015-12-18 11:42:55 -08:00
Bingkun	cc21a5fac7	Merge pull request #1999 from himanshug/remove_min_max_aggs ... remove min/max aggregator factory	2015-12-18 13:38:52 -06:00
jon-wei	356b07c6c3	More efficient SegmentMetadataQuery	2015-12-17 12:46:23 -08:00
Jonathan Wei	f8cf84f466	Merge pull request #1995 from himanshug/num_rows_seg_metadata_query ... add numRows to segment metadata query response	2015-12-17 12:23:46 -08:00
Himanshu Gupta	82ea348003	add extractionFn bytes to cache key in ExtractionDimFilter	2015-12-16 14:00:38 -06:00
Himanshu	628643d80e	Merge pull request #2091 from rasahner/noDefaultForGroupbyHaving ... take away default for groupBy/having	2015-12-16 01:07:40 -06:00
sahner	3441cf3110	take away default for groupBy/having	2015-12-15 10:32:45 -06:00
Fangjin Yang	e7f06cf61c	Merge pull request #2075 from jon-wei/regex_extract ... Configurable value replacement on match failure for RegexExtractionFn	2015-12-14 19:10:50 -08:00
jon-wei	c88f75df7c	Configurable value replacement on match failure for RegexExtractionFn	2015-12-14 17:57:41 -08:00
binlijin	362bea1090	minor optimize IndexMerger's MMappedIndexRowIterable	2015-12-11 15:04:46 +08:00
Xavier Léauté	d531e69d1a	Merge pull request #2079 from binlijin/master ... reduce bytearray copy to minimal optimize VSizeIndexedWriter	2015-12-10 21:30:09 -08:00
Slim Bouguerra	77afdf25e3	adding Bound Filter	2015-12-10 08:47:21 -06:00
Slim Bouguerra	ee1a39801a	adding bulk lookup and reverse lookup	2015-12-10 08:29:41 -06:00
binlijin	0eafbd55b2	reduce bytearray copy to minimal optimize VSizeIndexedWriter	2015-12-10 16:34:39 +08:00
Fangjin Yang	f4ba13a1ac	Merge pull request #2029 from b-slim/add_reverse_fn ... Adding reverse lookup function to LookupExtractor.	2015-12-09 12:50:13 -08:00
Xavier Léauté	9015a68c03	Merge pull request #2002 from navis/DRUID-2001 ... fixed #2001 GenericIndexed.fromIterable compares all values even when it's not sorted	2015-12-09 08:56:49 -08:00
Slim Bouguerra	85f339b687	introduction and implem of reverse lookup function unApply.	2015-12-09 10:02:57 -06:00
Nishant	6c23d8edb4	Merge pull request #2043 from mangeshpardeshiyahoo/master ... Add dimension selector support for groupby/having filters	2015-12-08 12:08:53 +05:30
Mangesh Pardeshi	d7ce120929	Add dimension selector support for groupby/having quries	2015-12-08 01:51:11 +00:00
Himanshu Gupta	431469e9c1	remove min/max aggregator factory which are replaced by double[min/max] aggregator factories	2015-12-05 22:36:49 -06:00
Himanshu Gupta	62ba9ade37	unifying license header in all java files	2015-12-05 22:16:23 -06:00
Gian Merlino	d21a640695	Merge pull request #2034 from b-slim/fix_cache_key ... Fix getCacheKey for DimFilters	2015-12-04 09:13:06 -08:00
Slim Bouguerra	fb4ff3cf54	fix getCacheKey	2015-12-04 08:07:08 -06:00
Charles Allen	9d02f47201	Update IncrementalIndexTest copyright notice	2015-12-03 18:03:08 -08:00
Charles Allen	be8c6fafb0	Merge pull request #2017 from tubemogul/issue/63 ... fixes issue #63	2015-12-03 18:01:11 -08:00
Gian Merlino	045df54404	Merge pull request #1961 from metamx/druidMetricsVersion ... Add the druid artifact version to metrics when emitted	2015-12-03 17:34:57 -08:00
Michael Schiff	b6cc2428e1	fixes issue #63	2015-12-03 17:30:47 -08:00
Himanshu	0eab8417cb	Merge pull request #2008 from codingwhatever/regex-search-query ... Regex search query	2015-12-03 09:57:34 -06:00
Sam Groth	596b7ebd9a	Adding RegexSearchQuerySpec	2015-12-03 09:16:02 -06:00
Himanshu	d02be6194d	Merge pull request #1967 from metamx/realtime-metrics-improvements ... Add datasource and taskId to metrics emitted by peons	2015-12-02 23:48:13 -06:00
Himanshu	00c6027777	Merge pull request #1986 from metamx/substring ... fixes #1874 adding a substring extraction function, tests, and documentation	2015-12-02 23:45:47 -06:00
Clint Wylie	68ef5f437a	fixes #1874 adding a substring extraction function, tests, and documentation	2015-12-01 23:50:32 -08:00
navis.ryu	87357a0534	fixed #2001 GenericIndexed.fromIterable compares all values even when it's not sorted	2015-12-02 15:11:14 +09:00
Nishant	1eb8211346	Add datasource and taskId to metrics emitted by peons ... This PR adds the datasource and taskId to the jvm and sys metrics emitted by the peons. fix spelling review comment review comment	2015-12-01 23:20:59 +05:30
Gian Merlino	cd2cff24ff	Fix serde for FragmentSearchQuerySpec and add some tests.	2015-11-30 17:34:35 -08:00
navis.ryu	c73418c181	fixed #2003 ColumnSelectorBitmapIndexSelector throws NPE for dimension not supporting bitmap	2015-11-24 10:45:36 +09:00
Himanshu Gupta	7a89b2e1a6	add numRows to segment metadata query response	2015-11-20 01:25:02 -06:00
Himanshu	d93640bfcb	Merge pull request #1974 from jon-wei/dim_order_merge ... Allow IndexMerger to use non-lexicographic dim order when merging indexes	2015-11-18 19:51:34 -06:00
Xavier Léauté	e3e6159336	Merge pull request #1985 from metamx/FixLookupCacheKey ... Change LookupExtractionFn cache key to be unique	2015-11-18 10:13:55 -08:00
Charles Allen	7abe999418	Change LookupExtractionFn cache key to be unique	2015-11-17 18:02:40 -08:00
jon-wei	4afc62be29	Allow IndexMerger to use non-lexicographic dim order when merging indexes	2015-11-17 13:02:31 -08:00
Xavier Léauté	d7eb2f717e	enable query caching on intermediate realtime persists	2015-11-17 10:58:00 -08:00
Gian Merlino	57f213d536	Better toString for groupBy, segmentMetadata queries.	2015-11-16 12:54:59 -08:00
jon-wei	cdceaf2d26	Fix IncrementalIndexAdapter getRows() Iterable	2015-11-12 13:10:42 -08:00
Charles Allen	af34e9c8cb	Add the druid artifact version to metrics when emitted	2015-11-12 12:11:27 -08:00
binlijin	286b8f8c6f	optimize index merge	2015-11-12 11:08:54 +08:00
Xavier Léauté	fa6142e217	cleanup and remove unused imports	2015-11-11 12:25:21 -08:00
dclim	fd0935ecb9	fix spatial dimension transformer to work with hadoop	2015-11-10 19:16:51 -07:00
Slim Bouguerra	c511273efd	adding in filter	2015-11-06 16:23:24 -06:00
Charles Allen	929b981710	Change DefaultObjectMapper to NOT overwrite final fields unless explicitly asked to	2015-11-05 18:10:13 -08:00
fjy	8f231fd3e3	cleanup druid codebase	2015-11-04 13:59:53 -08:00
Gian Merlino	8defe29270	Merge pull request #1901 from guobingkun/fix_typo_and_rename ... Fix metadata typo and rename default extension directory	2015-11-03 14:02:11 -08:00
Bingkun Guo	962f65cc76	fix metadata typo and rename default extension directory	2015-11-03 14:50:42 -06:00
Fangjin Yang	cec09a9967	Merge pull request #1804 from himanshug/objectify_index_creators ... static to non-static conversion for methods in Index[Merger/Maker/IO]	2015-11-03 11:25:32 -08:00
Himanshu Gupta	8b67417ac8	make methods in Index[Merger,Maker,IO] non-static so that they can have ... appropriate ObjectMapper injected instead of creating one statically	2015-11-02 23:24:26 -06:00
navis.ryu	e03fc2032f	changed equals/hashCode implementation	2015-11-02 17:21:35 +09:00
navis.ryu	69c86716d6	addressed comments	2015-11-02 14:23:13 +09:00
navis.ryu	032c3e986d	Make 'search' filter have a case sensitive option(#1878)	2015-10-30 16:38:54 +09:00
Fangjin Yang	25a0eb7ed5	Merge pull request #1799 from dclim/nested-groupby-aggregator-fix ... Support multiple outer aggregators of same type and provide more help…	2015-10-29 18:01:31 -07:00
Xavier Léauté	59872bd0cd	Merge pull request #1809 from metamx/fifoPriorityExecutorService ... Make PrioritizedExecutorService optionally FIFO	2015-10-27 15:19:32 -07:00
Charles Allen	060402a216	Merge pull request #1855 from himanshug/fix_having_specs ... fix [GreaterThan,LessThan,Equals] HavingSpecs	2015-10-27 14:46:04 -07:00
Charles Allen	ecdafa87c5	Make PrioritizedExecutorService optionally FIFO	2015-10-27 14:16:22 -07:00
Himanshu Gupta	a71c7270b9	making [GreaterThan,LessThan,Equals] HavingSpecs more robust by carefully using long vs float for comparison	2015-10-27 13:15:13 -05:00
Fangjin Yang	5a082b2f5e	Merge pull request #1824 from metamx/UniformGranularitySpecHashEquals ... Add hashCode and equals to UniformGranularitySpec	2015-10-26 09:34:01 -07:00
Fangjin Yang	5f23703216	Merge pull request #1638 from guobingkun/remove_maven_client_code ... Remove Maven client at runtime + Provide a way to load Druid extensions through local file system	2015-10-26 09:30:05 -07:00
Nishant	7cecc55045	Add segment merge time as a metric ... Add merge and persist cpu time Fix typo review comment move cpu time measuring to VMUtils review comments.	2015-10-22 12:28:03 +05:30
Bingkun Guo	4914925d65	New extension loading mechanism ... 1) Remove maven client from downloading extensions at runtime. 2) Provide a way to load Druid extensions and hadoop dependencies through file system. 3) Refactor pull-deps so that it can download extensions into extension directories. 4) Add documents on how to use this new extension loading mechanism. 5) Change the way how Druid tarball is generated. Now all the extensions + hadoop-client 2.3.0 are packaged within the Druid tarball.	2015-10-21 14:22:36 -05:00
Xavier Léauté	e4ac78e43d	bump next snapshot to 0.9.0	2015-10-20 13:46:13 -07:00
dclim	46ecdfa757	add comment explaining logic	2015-10-15 16:04:06 -06:00
Xavier Léauté	4c2c7a2c37	update version to 0.8.3	2015-10-14 21:40:55 -07:00
Charles Allen	f432b8e3f9	Add hashCode and equals to UniformGranularitySpec ... * Also add hashCode != 0 to AllGranularity and NoneGranularity	2015-10-13 16:42:21 -07:00
Gian Merlino	c9d6994040	Merge pull request #1821 from himanshug/storage_adapter_update ... cache max data timestamp in QueryableIndexStorageAdapter	2015-10-13 10:52:43 -07:00
Himanshu Gupta	490de1f98a	support multiple non-consecutive intervals in outer query of nested group-by	2015-10-13 10:16:06 -05:00
Himanshu Gupta	fbba30eb60	cache max data timestamp in QueryableIndexStorageAdapter so that TimestampCheckingOffset ... does not have to get it per cursor.	2015-10-12 15:34:22 -05:00
Charles Allen	8ed5d2c06a	Add hashCode and equals to stock lookups	2015-10-12 10:29:39 -07:00
Himanshu Gupta	2737fd83f5	in the IndexSizeExceededException put maxRowCount to confirm if it is correctly picked up from configuration	2015-10-06 15:23:14 -05:00
Himanshu Gupta	8654732ef6	make IndexSizeExceededException constructor take formatString and arguments than just fixed String ... like ISE, IAE etc	2015-10-06 13:44:22 -05:00
dclim	f4e0a76820	Support multiple outer aggregators of same type and provide more helpful exception when the same inner aggregator is referenced by multiple types of outer aggregators	2015-10-01 15:15:12 -06:00
Gian Merlino	774765dc40	GroupByQueryRunnerTest for hyperUnique finalizing post aggregators	2015-10-01 00:09:29 -04:00
Gian Merlino	e3bb93e8c7	Revert "Merge pull request #1781 from dclim/nested-groupby-multiple-same-aggregator-fix-v2" ... This reverts commit dae488b7c0, reversing changes made to 397be4b897.	2015-10-01 00:05:59 -04:00
dclim	8e20a1e1f3	Use DoubleSumAggregatorFactory instead of CountAggregatorFactory, add test for non-integers	2015-09-30 17:11:39 -06:00
David Lim	70ae5ca922	Fix failure in nested groupBy with multiple aggregators with same fieldName ... Version 2 - Throws an exception if an outer query references an aggregator that doesn't exist in the inner query, and then uses the inner query aggregator names to form the columns for the intermediate incremental index. Also deleted all the getRequiredColumns() methods which are no longer being used. We do something wacky by adding an aggregator factory for the post aggregators when building the intermediate incremental index, otherwise queries on post aggregate results fail because the data isn't in the incremental index. Closes #1419	2015-09-30 15:43:11 -06:00
Charles Allen	8199ecf1a4	Merge pull request #1782 from jon-wei/smq_cachekey ... Add analysisTypes to SegmentMetadataQuery cache key	2015-09-29 15:51:35 -07:00
jon-wei	41ff271339	Add analysisTypes to SegmentMetadataQuery cache key	2015-09-29 14:33:35 -07:00
Charles Allen	2d847ad654	Merge pull request #1730 from metamx/union-queries-fix ... fix #1727 - Union bySegment queries fix	2015-09-29 12:23:25 -07:00
Nishant	573aa96bd6	fix #1727 - Union bySegment queries fix ... Fixes #1727. revert to doing merging for results for union queries on broker. revert unrelated changes Add test for union query runner Add test remove unused imports fix imports fix renamed file fix test update docs.	2015-09-29 23:32:36 +05:30
Gian Merlino	62d4ced4dd	Separate ListColumnIncluderator cache key parts with nul bytes	2015-09-29 13:59:58 -04:00
jon-wei	e6a6284ebd	Allow SegmentMetadataQuery to skip cardinality and size calculations	2015-09-22 13:51:55 -07:00
Gian Merlino	aaa8a88464	Merge pull request #1739 from jon-wei/segment_realtime ... Allow SegmentAnalyzer to read columns from StorageAdapter, allow SegmentMetadataQuery to query IncrementalIndexSegments on realtime node	2015-09-17 18:36:53 -07:00
Charles Allen	df4c2bab10	Soften concurrency requirements on IncrementalIndexTest	2015-09-17 15:51:07 -07:00
jon-wei	367c50d4ba	Allow SegmentAnalyzer to read columns from StorageAdapter, allow SegmentMetadataQuery to query IncrementalIndexSegments on realtime node	2015-09-16 18:39:31 -07:00
Charles Allen	6e1eb3b7fe	Add better concurrency testing to IncrementalIndexTest	2015-09-16 14:04:20 -07:00
Gian Merlino	9705c5139b	Merge pull request #1732 from jon-wei/segmentmeta ... Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups	2015-09-16 12:36:25 -07:00
Fangjin Yang	8b071a7230	Merge pull request #1710 from metamx/incrementalIndexConcurrentTestLatching ... Add some basic latching to concurrency testing in IncrementalIndexTest	2015-09-15 13:55:52 -07:00
jon-wei	193fb4fdfc	Add support for a configurable default segment history period for segmentMetadata queries and GET /datasources/<datasourceName> lookups	2015-09-14 19:41:42 -07:00
Charles Allen	bd605a097e	Merge pull request #1731 from metamx/regex-extraction-npe ... fix NPE with regex extraction function	2015-09-14 15:55:05 -07:00
Xavier Léauté	08a527d01a	fix NPE with regex extraction function	2015-09-14 14:45:30 -07:00
Charles Allen	e569f4b6a7	Add dimension extraction functionality to SearchQuery ... * Add IdentityExtractionFn	2015-09-14 11:36:15 -07:00
Himanshu	5ff92664f8	Merge pull request #1696 from metamx/cpuTimeReporting ... Add CPU time to metrics for segment scanning.	2015-09-14 10:53:55 -05:00
Fangjin Yang	34ef81572d	Merge pull request #1700 from himanshug/update_agg_test_helper ... update indexing in the helper to use multiple persists and merge	2015-09-14 06:56:29 -07:00
Charles Allen	8d3cdd8572	Don't check for sortedness if we already know GenericIndexedWriter isn't sorted	2015-09-11 16:32:09 -07:00
Charles Allen	d6849805ea	Add some basic latching to concurrency testing in IncrementalIndexTest	2015-09-10 10:06:51 -07:00
Himanshu Gupta	5da58e48e0	use Rule based TemporaryFolder for cleanup of temp directory/files	2015-09-09 11:10:33 -05:00
Himanshu Gupta	44911039c5	update indexing in the helper to use multiple persists and final merge to ... catch further issues in aggregator implementations	2015-09-09 11:10:33 -05:00
Charles Allen	fcf5cae81d	Add CPU time to metrics for segment scanning.	2015-09-08 13:34:19 -07:00
cheddar	4f61b42f40	Merge pull request #1578 from b-slim/fix_extraction_filter_2 ... Fix UT and documentation to the extraction filter	2015-09-01 10:46:20 -07:00
Himanshu	04ff6cd355	Merge pull request #1685 from gianm/close-loudly ... Close output streams and channels loudly when creating segments.	2015-08-28 23:32:22 -05:00
Gian Merlino	940e1aa3eb	Replace funky imports with standard ones. ... 1) Lots of Guava imports were not coming from the actual Guava 2) junit.framework.Assert should be org.junit.Assert	2015-08-28 18:02:05 -07:00
Gian Merlino	7d6fa2ba50	Close output streams and channels loudly when creating segments.	2015-08-28 17:14:03 -07:00
Himanshu Gupta	2e0dd1d792	adding UTs and addressing review comments to ... firehoseV2 addition to Realtime[Manager|Plumber], essential segment metadata persist support, kafka-simple-consumer-firehose extension patch	2015-08-27 20:50:46 -05:00
lvjq	2237a8cf0f	kafka 8 simple consumer firehose	2015-08-27 20:50:46 -05:00
Charles Allen	c1388a1685	Merge pull request #1632 from Hailei/fix-subquery-innerquery-demension ... Inner Query should build on sub query	2015-08-27 10:25:38 -07:00
Gian Merlino	2a866f49df	Downgrade Jackson to 2.4.6.	2015-08-26 18:25:55 -07:00
Charles Allen	24aa762c79	Add test for #1632	2015-08-25 20:50:30 -07:00
Xavier Léauté	51f6a9a2c9	update jackson to 2.6.1	2015-08-25 16:07:01 -07:00
Himanshu Gupta	c57c07f28a	add ability for client code to provide InputStream of input data in addition to File ... It would be needed when input data file does not reside in the same jar but you could still use getResourceAsStream() to read the data inside a file	2015-08-20 00:54:58 -05:00
Xavier Léauté	3b2e41e42a	update for next release	2015-08-18 17:16:46 -07:00
Slim Bouguerra	7549f02578	support the case filter value is null	2015-08-17 15:09:37 -05:00
zhanghailei	234a958817	Inner Query should build on sub query	2015-08-17 18:18:26 +08:00
Charles Allen	db19d2d547	Revert "Update to guice 4.0"	2015-08-14 09:26:07 -07:00
Charles Allen	be89105621	Merge pull request #1602 from metamx/more-code-cleanup ... Some perf Improvements in Broker	2015-08-11 13:51:49 -07:00
Xavier Léauté	fbdb841928	Merge pull request #1603 from metamx/optimize-lexicographic-topN ... Optimizations for LexicographicTopNs	2015-08-11 13:35:34 -07:00
Nishant	b8d8a8da9e	Optimisations for LexicographicTopNs ... initial review for perf optimizations for lexicographic TopNs fix compilation create map with proper size review comment review comment review comments	2015-08-12 00:37:48 +05:30
Charles Allen	7e61216287	Update to guice 4.0 ... - Mark a lot of `@Provides` methods as final since guice 4.0 disallows overriding them	2015-08-10 13:57:18 -07:00
Slim Bouguerra	f0bc362981	clean code if is not needed anymore	2015-08-07 12:38:41 -05:00
Slim Bouguerra	64d638a386	optimize makeMatcher	2015-08-06 17:04:36 -05:00
Nishant	1a46c4c71c	avoid creating mergeSeqence when not required	2015-08-06 14:25:13 +05:30
Slim Bouguerra	83de5a4716	addressing reviewers comments	2015-08-03 09:03:28 -05:00
Slim Bouguerra	dda0790a60	Fix extractionFilter by implementing make matcher ... Fix getBitmapIndex to consider the case were dim is null Unit Test for exractionFn with empty result and null_column UT for TopN queries with Extraction filter refactor in Extractiuon fileter makematcher for realtime segment and clean code in b/processing/src/test/java/io/druid/query/groupby/GroupByQueryRunnerTest.java fix to make sure that empty string are converted to null	2015-08-03 09:02:17 -05:00
Himanshu Gupta	d11d9b6c45	dont waste memory in storing all lines from input ... CharSource.readLines() reads all lines from input into a in-memory list Since we need an iterator here, so this wastage can be easily prevented	2015-07-20 21:59:38 -05:00
Fangjin Yang	0481c8ca26	Merge pull request #1406 from zhaown/fix-breaking-while-exceeding-max-intermediate-rows ... Fix breaking while exceeding max intermediate rows.	2015-07-20 13:41:22 -07:00
Himanshu Gupta	f7a92db332	generic byte[] serde for InputRow	2015-07-20 12:01:53 -05:00
Himanshu Gupta	0439e8ec23	adding serde methods for intermediate aggregation object to ComplexMetricSerde ... This provides the alternative to using ComplexMetricSerde.getObjectStrategy() and using the serde methods from ObjectStrategy as that usage pattern is deprecated.	2015-07-20 12:01:53 -05:00
zhaown	524b05f073	Fix breaking while exceeding max intermediate rows.	2015-07-19 10:41:53 +08:00
Fangjin Yang	e21195f987	Merge pull request #1469 from guobingkun/table_config ... Inconsistent property names for "druid.metadata.storage.tables.xxx"	2015-07-17 07:43:19 -07:00
Himanshu	19af3bc9bc	Merge pull request #1535 from metamx/alphanum-docs-tests ... Update alphanumeric sort docs + more tests / examples	2015-07-16 22:09:41 -05:00
Xavier Léauté	2c464ad936	correct reference in docs + more tests / examples	2015-07-16 19:50:05 -07:00
Xavier Léauté	9616c10b1d	remove import static	2015-07-16 17:46:21 -07:00
Xavier Léauté	c1308203b8	Merge pull request #1532 from metamx/fixTopNDimExtractionDoubleApply ... Fix TopN dimension extractions being applied twice	2015-07-16 13:39:02 -07:00
Xavier Léauté	3a0793aaf9	Merge pull request #1533 from metamx/extraCheckGroupByDimExtraction ... Add more unit tests for group by	2015-07-15 21:09:00 -07:00
Charles Allen	7d0b77c261	Add more unit tests for group by	2015-07-15 20:15:21 -07:00
Xavier Léauté	a15a2c4047	fix histogram aggregator cache key	2015-07-15 17:33:36 -07:00
Charles Allen	9092c665b7	Fix TopN dimension extractions being applied twice	2015-07-15 16:58:15 -07:00
Charles Allen	456ad9ffba	Merge pull request #1529 from metamx/update-versions ... inrement version	2015-07-15 13:25:31 -07:00
Xavier Léauté	4cfb00bc8a	inrement version	2015-07-15 13:09:05 -07:00
Charles Allen	5eadd395e2	Move lots of executor service creation to Execs	2015-07-14 15:38:49 -07:00
Nishant	184b12bee8	fix groupBy caching to work with renamed aggregators ... Issue - while storing results in cache we store the event map which contains aggregator names mapped to values. Now when someone fire same query after renaming aggs, the cache key will be same but the event will contain metric values mapped to older names which leads to wrong results. Fix - modify cache to not store raw event but the actual list of values only. review comments + fix dimension renaming review comment	2015-07-09 11:48:26 +05:30
Xavier Léauté	9789417612	ModuleList is already part of Initialization	2015-07-01 11:37:40 -07:00
Xavier Léauté	2c463ae435	Merge pull request #1489 from metamx/moveTestPackages ... Move some test packages	2015-07-01 11:18:09 -07:00
Charles Allen	5e19a615f1	Add coments to DimExtractionTopNAlgorithm	2015-07-01 10:32:45 -07:00
Charles Allen	7a2a8a3d6e	Move extraction tests to more reasonable package	2015-07-01 10:30:50 -07:00
Bingkun Guo	4a0ae7d8d5	Fix inconsistent druid property names for "druid.metadata.storage.tables.xxx" between document and code	2015-06-29 10:12:30 -05:00
Xavier Léauté	28fa1642b9	add node time metrics to DirectDruidClient	2015-06-26 17:57:44 -07:00
Xavier Léauté	36b4453789	Merge pull request #1455 from druid-io/fix-protobuf ... Fix protobuf impl and docs	2015-06-22 23:15:40 -07:00
nishant	f9cdb0ad61	test for #1120 ... Make the changes described in #1120 to add test for the issue described there.	2015-06-21 23:34:21 +05:30
fjy	9c74993559	fix protobuf impl and docs	2015-06-20 21:59:38 -07:00
Xavier Léauté	0a5bb909a2	[maven-release-plugin] prepare for next development iteration	2015-06-18 17:35:19 -07:00
Xavier Léauté	59c6b2b279	[maven-release-plugin] prepare release druid-0.8.0-rc1	2015-06-18 17:35:14 -07:00
Charles Allen	6230ac90ae	Use IndexMerger for conversion	2015-06-10 11:34:58 -07:00
Xavier Léauté	395ba79f8b	Merge pull request #1403 from metamx/mergerMakerTests ... Improvements around resource handling in IndexMerger / IndexIO / QueryableIndex	2015-06-04 15:59:10 -07:00
Charles Allen	ed8eb5c991	Improvements around resource handling in IndexMerger / IndexIO / QueryableIndex ... * Fix resource leak in `io.druid.segment.IndexIO.DefaultIndexIOHandler#validateTwoSegments(java.io.File, java.io.File)` * Un-deprecate `close()` in `QueryableIndex` and make it inherit `Closeable` * Fix resource leaks in various unit tests * Add `CloserRule` for closing out resources	2015-06-04 14:18:27 -07:00
Himanshu	50ad0e6474	Merge pull request #1412 from pjain1/alphaNumericTopN_NPE_fix ... NPE fix for TopN query with alphaNumericTopN metric spec	2015-06-04 09:49:31 -05:00
Parag Jain	a7b09e857c	NPE fix for alphaNumericTopN when pervious stop is not specified	2015-06-04 09:30:31 -05:00
Xavier Léauté	35e2fde18e	Merge pull request #1386 from himanshug/aggregation_testing1 ... General class for testing any Aggregation Implementation	2015-06-03 23:43:36 -07:00
Xavier Léauté	92d7316ed8	Merge pull request #1414 from metamx/timeout2TIMEOUT ... Replace "timeout" with QueryContextKeys.TIMEOUT	2015-06-02 17:11:09 -07:00
Charles Allen	1c4d42bc15	Replace "timeout" with QueryContextKeys.TIMEOUT	2015-06-02 14:49:21 -07:00
Charles Allen	f48db09e35	Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths ... * Also adds LookupExtractionFn and MapLookupExtractor which takes in an explicit mapping of renames * Add injective to javascript extraction fn	2015-06-02 12:22:56 -07:00
Himanshu Gupta	215c1ab01e	UTs for hyperUnique aggregation	2015-06-01 12:52:40 -05:00
Himanshu Gupta	160d5fe6b7	a general class for testing any [complex] aggregation implementation	2015-06-01 12:52:40 -05:00
Charles Allen	55292bba13	Add more IndexMergerTests	2015-05-28 18:18:20 -07:00
Charles Allen	1ebe622c7d	Add checkin GroupByQuery for null DimensionSpec in dimension list	2015-05-28 14:55:34 -07:00
Xavier Léauté	f9c624c7db	Merge pull request #1361 from mrijke/groupby-limithavingorder-unittest ... GroupBy Query with Having/Limit/Orderingspec inconsistencies (UnitTest)	2015-05-27 14:49:18 -07:00
Xavier Léauté	1a3f04f0ed	Merge pull request #1354 from metamx/multi-valued-dimension-compression ... Enabling compression for multiValued dimension	2015-05-26 23:43:53 -07:00
Charles Allen	fd64c24e43	Fix roaring extraction filter on empty values	2015-05-26 13:54:18 -07:00
nishant	81415282aa	Enabling compression for multiValued dimension ... Add test and refactoring Add benchmark tests	2015-05-27 00:09:14 +05:30
Charles Allen	e97d22a10a	Fix Extraction Filter cast problems for empty results	2015-05-22 15:20:11 -07:00
Charles Allen	e1399b7ce4	Add unit test to show breaking Dimension Extraction Filter	2015-05-22 15:02:11 -07:00
Xavier Léauté	75c092ccb1	Merge pull request #1375 from metamx/MetricManipulatorFnInstances ... Modify MetricManipulatorFns to use instanced classes	2015-05-22 15:56:47 -04:00
Charles Allen	042653ebcb	Modify MetricManipulatorFns to use instanced classes	2015-05-22 12:38:38 -07:00
Himanshu Gupta	723df735e9	force eagerness of processing of SegmentMetadata queries on the processing executor by converting the Sequence into List	2015-05-22 13:46:26 -05:00
Himanshu Gupta	5852b64852	adding UT for SegmentMetadata bySegment query which catches following regression caused by commit 55ebf0cfdf ... it fails when we issue the SegmentMetadataQuery by setting {"bySegment" : true} in context with exception - java.lang.ClassCastException: io.druid.query.Result cannot be cast to io.druid.query.metadata.metadata.SegmentAnalysis at io.druid.query.metadata.SegmentMetadataQueryQueryToolChest$4.compare(SegmentMetadataQueryQueryToolChest.java:222) ~[druid-processing-0.7.3-SNAPSHOT.jar:0.7.3-SNAPSHOT] at com.google.common.collect.NullsFirstOrdering.compare(NullsFirstOrdering.java:44) ~[guava-16.0.1.jar:?] at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:46) ~[java-util-0.27.0.jar:?] at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:42) ~[java-util-0.27.0.jar:?] at java.util.PriorityQueue.siftUpUsingComparator(PriorityQueue.java:649) ~[?:1.7.0_80]	2015-05-22 13:45:54 -05:00
Himanshu Gupta	da0cc32bc8	Revert commit 55ebf0cfdf ... which caused following regression it fails when we issue the SegmentMetadataQuery by setting {"bySegment" : true} in context with exception - java.lang.ClassCastException: io.druid.query.Result cannot be cast to io.druid.query.metadata.metadata.SegmentAnalysis at io.druid.query.metadata.SegmentMetadataQueryQueryToolChest$4.compare(SegmentMetadataQueryQueryToolChest.java:222) ~[druid-processing-0.7.3-SNAPSHOT.jar:0.7.3-SNAPSHOT] at com.google.common.collect.NullsFirstOrdering.compare(NullsFirstOrdering.java:44) ~[guava-16.0.1.jar:?] at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:46) ~[java-util-0.27.0.jar:?] at com.metamx.common.guava.MergeIterator$1.compare(MergeIterator.java:42) ~[java-util-0.27.0.jar:?] at java.util.PriorityQueue.siftUpUsingComparator(PriorityQueue.java:649) ~[?:1.7.0_80]	2015-05-22 13:39:34 -05:00
Maarten Rijke	82da479464	Fix for GroupBy with Having+Limit+Orderspec ... * Inverted function arguments to compose postProcFn for GroupBy queries with havingspec + limitspec. * Replaced query.getLimitSpec() with null in GroupByQueryToolChest's mergeGroupByResults * Added unittest to verify functionality	2015-05-19 18:35:48 +02:00
Himanshu Gupta	2fd3e9e8e5	return size = 0 in ColumnAnalysis if its unknown ... that is if complex agg did not implement inputSizeFn() so that segment metadata query shows atleast some information. also instead of COMPLEX, return type of data stored.	2015-05-15 20:11:56 -05:00
Xavier Léauté	3c3db7229c	Merge pull request #1355 from himanshug/long_max_min_aggregators ... Long max/min aggregators	2015-05-13 12:08:11 -07:00
Himanshu Gupta	cebb550796	additional UTs for [DoubleMax/DoubleMin] aggregation	2015-05-13 09:25:41 -05:00
Himanshu Gupta	d0ec945129	adding aliases doubleMax and doubleMin for max and min respectively ... renamed all [Max/Min]*.java to [DoubleMax/DoubleMin]*.java and created [Max/Min]AggregatorFactory.java which can be removed when we dont need the min/max aggregator type backward compatibility	2015-05-13 09:25:41 -05:00
Himanshu Gupta	2de38f7d29	UTs for long[Max/Min] aggregation	2015-05-13 09:25:22 -05:00
Himanshu Gupta	00436f93e2	long max/min aggregators implementation	2015-05-13 09:25:22 -05:00
fjy	7a6acf5c1b	update pom to 0.8	2015-05-11 19:41:58 -06:00
Xavier Léauté	33265d63e1	Merge pull request #1262 from metamx/fix-null-dimension ... fix handling of dimension having only null values	2015-05-06 13:51:26 -07:00
nishant	34be1e96fa	fix NPE ... review comments Add test fix test for java8	2015-05-05 23:11:13 +05:30
Neo	8f8400e24e	fix handling of dimension having only null values ... fixes #1211 fix value matcher more improvements more fixes for partial null column fix handling of dimension having only null values fixes #1211 fix value matcher more improvements more fixes for partial null column review comment IndexMaker speedups * About 15% speedup Conflicts: processing/src/main/java/io/druid/segment/IndexMaker.java fix handling of dimension having only null values fixes #1211 fix value matcher more improvements more fixes for partial null column fix handling of dimension having only null values fixes #1211 fix value matcher more improvements more fixes for partial null column review comment review comments review comment fix failing tests review comment fix compilation	2015-05-04 22:07:45 +05:30
nishant	50158357ff	fixes #1330 ... fixes #1330, Avoid creating Period instance as creating a Period from Long.MAX_VALUE throws arithmetic exception. After this query metric will emit duration in seconds instead of minutes.	2015-05-04 20:34:28 +05:30
Xavier Léauté	721505c017	Merge pull request #1208 from druid-io/rework-metrics ... Schemaless metrics + additional metrics for things we care about	2015-04-27 15:04:54 -07:00
fjy	963e5765bf	Schemaless metrics + additional metrics for things we care about	2015-04-27 13:39:40 -07:00
Charles Allen	27016c0289	Fix IndexIO segment validator to account for timestamp mismatches.	2015-04-27 12:42:16 -07:00
Charles Allen	633fdb029e	Add option to ConvertSegmentTask to skip validation ... * Validation is enabled by default	2015-04-27 08:37:55 -07:00