Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-03-03 15:59:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,825 Commits 116 Branches 508 Tags
Commit Graph

534 Commits

Author SHA1 Message Date
Himanshu Gupta
0722ced413 with GpBy query outer query results need to be further merged 2016-02-29 10:16:25 -06:00
jon-wei
fd3782522c Rename 'replaceMissingValues...' parameters in RegexExtractionFn 2016-02-24 13:12:56 -08:00
Nishant
fb7eae34ed Merge pull request #2249 from metamx/workerExpanded 
Use Worker instead of ZkWorker whenever possible
 2016-02-24 13:23:22 +05:30
Charles Allen
ac13a5942a Use Worker instead of ZkWorker whenver possible 
* Moves last run task state information to Worker
* Makes WorkerTaskRunner a TaskRunner which has interfaces to help with getting information about a Worker
 2016-02-23 15:02:03 -08:00
Gian Merlino
3534483433 Better handling of ParseExceptions. 
Two changes:
- Allow IncrementalIndex to suppress ParseExceptions on "aggregate".
- Add "reportParseExceptions" option to realtime tuning configs. By default this is "false".

Behavior of the counters should now be:

- processed: Number of rows indexed, including rows where some fields could be parsed and some could not.
- thrownAway: Number of rows thrown away due to rejection policy.
- unparseable: Number of rows thrown away due to being completely unparseable (no fields salvageable at all).

If "reportParseExceptions" is true then "unparseable" will always be zero (because a parse error would
cause an exception to be thrown). In addition, "processed" will only include fully parseable rows
(because even partial parse failures will cause exceptions to be thrown).

Fixes #2510.
 2016-02-23 10:11:43 -08:00
Fangjin Yang
3bdd757024 Merge pull request #1773 from b-slim/log_details 
Adding downstream source when throwing QueryInterruptedException
 2016-02-22 10:16:07 -08:00
Slim Bouguerra
77925cc061 adding downstream source of QueryInterruptedException 2016-02-20 13:05:14 -06:00
Gian Merlino
d25c46cb9f Add comparator to HyperUniquesFinalizingPostAggregator. 
This makes it possible to do groupBys with clauses like "HAVING uniques > 10".
Beforehand you couldn't do it with either an aggregator (because it returns
an HLLV1 which the havingSpec can't understand) or a finalized postaggregator
(because it didn't have a comparator).

Now you can at least do it with a finalizing postaggregator. Trying it with
the aggregator alone still doesn't work.

Added some topN and groupBy tests verifying the comparator, and added an
@Ignore test that should pass if havingSpecs are made work on the aggregator
directly.
 2016-02-19 08:36:08 -08:00
Jaehong Choi
32b9d57b23 handle a failing UT in GroupByQueryRunnerTest after merging into the master 2016-02-16 16:56:57 +09:00
Jaehong Choi
b25bca85bc Merge branch 'master' of https://github.com/druid-io/druid into support-alphanumeric-dimensional-sort-in-gropu-by 2016-02-16 16:42:05 +09:00
Jaehong Choi
e89afc901b delete System.out.println() in test code 2016-02-16 15:26:37 +09:00
Navis Ryu
cd315627c9 Merge pull request #2393 from CHOIJAEHONG1/support-alphanumeric-dimensional-sort-in-gropu-by 
support alphanumeric sorting for dimensional columns in groupby (#2393)
 2016-02-16 14:11:30 +09:00
Jonathan Wei
d63eec65a1 Merge pull request #2208 from navis/metadataquery-minmax 
Support min/max values for metadata query
 2016-02-11 17:28:07 -08:00
Jonathan Wei
e1b022eac9 Merge pull request #2349 from navis/dimensionspec-for-selectquery 
Support dimension spec for select query
 2016-02-11 16:38:16 -08:00
navis.ryu
dd2375477a Support min/max values for metadata query (#2208) 2016-02-12 09:35:58 +09:00
navis.ryu
4d63196535 Support dimension spec for select query 2016-02-12 08:54:28 +09:00
turu
f277a54a5c removed unsafe heuristics from hll compareTo and provided unit test for regression 2016-02-11 23:46:24 +01:00
Slim
368988d187 Merge pull request #2291 from druid-io/lookupManager 
Promoting LookupExtractor state and LookupExtractorFactory to be a first class druid state object.
 2016-02-11 16:07:27 -06:00
Slim Bouguerra
4e119b7a24 Adding lookup ref manager and lookup dimension spec impl 2016-02-11 12:11:51 -06:00
Jaehong Choi
2f2e2ff5b9 support alphanumeric sorting for dimensional columns in groupby 2016-02-11 17:31:28 +09:00
Keuntae Park
05a144e39a fix crash with filtered aggregator at ingestion time 
- only for selector filter because extraction filter is not supported as
  cardinality is not fixed at ingestion time
 2016-02-11 11:25:33 +09:00
Fangjin Yang
b1673ee90e Merge pull request #2409 from gianm/smq-merged-thing 
SegmentMetadataQuery: Retain segment id when merging, if possible.
 2016-02-08 15:43:39 -08:00
Fangjin Yang
c9c20bb7f3 Merge pull request #2395 from metamx/fixExtractionDimFilterNullTest 
Actually check cache key null checking in ExtractionDimFilterTest
 2016-02-08 14:10:52 -08:00
Gian Merlino
bd9c04244f SegmentMetadataQuery: Retain segment id when merging, if possible. 
This is helpful on realtime nodes, where two analyses from two different hydrants
are merged together but they are actually from the same segment.
 2016-02-08 13:07:02 -08:00
Himanshu Gupta
b40c342cd1 make Global stupid pool cache size configurable 2016-02-05 14:18:06 -06:00
Himanshu Gupta
72a1e730a2 OffheapIncrementalIndex updates to do the aggregation merging off-heap 2016-02-05 14:17:05 -06:00
Charles Allen
aac5f9b2c9 Actually check cache key null checking in ExtractionDimFilterTest 2016-02-04 09:44:13 -08:00
Fangjin Yang
da77591129 Merge pull request #2392 from metamx/fix2391 
Allow ExtractionDimFilter value to be null
 2016-02-03 17:47:14 -08:00
Charles Allen
d4f00096ff Allow ExtractionDimFilter value to be null 
* Fixes #2391
 2016-02-03 15:51:47 -08:00
Himanshu Gupta
6e7d90cf56 UTs for DefaultLimitSpec 2016-02-03 15:59:12 -06:00
Himanshu Gupta
29e0d7f971 lazily create comparators for row columns when needed 2016-02-03 13:38:20 -06:00
navis.ryu
1d602be0f9 Replace string[] with int[] for dimensions 2016-02-03 15:03:22 +09:00
Himanshu
93c50d8538 Merge pull request #2094 from navis/simplify-index-merge 
Simplifying dimension merging
 2016-01-29 11:23:14 -06:00
navis.ryu
55a888ea2f time-descending result of select queries 2016-01-29 10:06:05 +09:00
navis.ryu
dd774ef4dd one-pass merging of dictionary & index 2016-01-29 10:03:53 +09:00
Himanshu
edd7ce58aa Merge pull request #2348 from AlexanderSaydakov/fix-aggregator-test-helper 
fixed createIndex
 2016-01-28 16:01:36 -06:00
saydakov
e0860661b1 fixed createIndex 2016-01-28 13:20:50 -08:00
Nishant
99017f4518 Merge pull request #2326 from navis/use-reverse-iterator 
use reverse-iterator if possible
 2016-01-28 19:48:38 +05:30
navis.ryu
7324ece8f9 use reverse-iterator if possible 2016-01-28 09:04:55 +09:00
Xavier Léauté
5a3642bb93 Merge pull request #2247 from metamx/pedanticBuild 
Enable strict building in travis
 2016-01-27 10:27:03 -08:00
Charles Allen
508734c8b0 Long constant reformatting in tests l --> L 2016-01-27 08:59:19 -08:00
Gian Merlino
795343f7ef SegmentMetadataQuery: Fix merging of ColumnAnalysis errors. 
Also add tests for:
- ColumnAnalysis folding
- Mixed mmap/incremental merging
 2016-01-26 17:16:26 -08:00
Himanshu
3844658fb5 Merge pull request #2323 from druid-io/update-druidapi 
Update druid-api to 0.3.16
 2016-01-26 13:02:10 -06:00
Himanshu Gupta
09d3678667 adding single threaded indexing and querying test for IncrementalIndex 2016-01-23 00:17:14 -06:00
Charles Allen
0000b9fc62 Remove sorting in ProtoBufInputRowParserTest 
Due to processing/src/test/java/io/druid/data/input/ProtoBufInputRowParserTest.java
 2016-01-22 16:02:25 -08:00
Himanshu Gupta
2f7f5119cf older segments might not have field bitmapSerdeFactory for dimension columns and we must use appropriate default 2016-01-22 13:28:25 -06:00
binlijin
1d1f4d996d Merge pull request #2111 from binlijin/optimize-create-inverted-indexes 
optimize create inverted indexes
 2016-01-22 11:36:27 +08:00
binlijin
55f7dd4629 optimize create inverted indexes 2016-01-22 10:40:09 +08:00
Gian Merlino
d416279c14 SegmentMetadataQuery support for returning aggregators. 2016-01-21 17:27:25 -08:00
Fangjin Yang
5a9cd89059 Merge pull request #2305 from gianm/segment-metadata-query-multivalues 
Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments
 2016-01-21 17:22:34 -08:00