Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-09 03:24:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,849 Commits 116 Branches 507 Tags
Commit Graph

1402 Commits

Author SHA1 Message Date
Bingkun Guo
4a58462fc7 update querySegmentSpec when passing query to getQueryRunner 
After finding the FireChief for a specific partition, Druid will need to find the specific queryRunner for each segment being queried by passing the query to FireChief. Currently Druid is passing the original query that contains all the segments need to be queried, it's possible that fireChief.getQueryRunner(query) returns more than 1 queryRunner because query.getIntervals() is not specific to a single segment.

In this patch, for each segment being queried, Druid will update the query with its corresponding SpecificSegmentSpec.
 2016-03-02 16:44:56 -06:00
Nishant
31b502773a Merge pull request #2480 from navis/pagingfail-over-segments 
Select query cannot span to next segment with paging
 2016-03-01 11:42:41 +05:30
Fangjin Yang
e5c25725c0 Merge pull request #2562 from himanshug/fix_2556 
with nested GpBy query outer query results need to be further merged
 2016-02-29 12:17:33 -08:00
Himanshu Gupta
0722ced413 with GpBy query outer query results need to be further merged 2016-02-29 10:16:25 -06:00
navis.ryu
b1ff920831 Lazily initialize predicate for bound filter 2016-02-29 15:35:52 +09:00
navis.ryu
5f1e60324a Added more complex test case with versioned segments 2016-02-29 14:48:24 +09:00
navis.ryu
2686bfa394 Select query cannot span to next segment with paging 2016-02-29 00:01:46 +09:00
Fangjin Yang
29d29ba98d Merge pull request #2263 from jon-wei/flex_dims3 
Allow IncrementalIndex to store Long/Float dimensions
 2016-02-25 17:23:02 -08:00
jon-wei
c17ce02467 Allow IncrementalIndex to store Long/Float dimensions 2016-02-24 13:51:57 -08:00
jon-wei
fd3782522c Rename 'replaceMissingValues...' parameters in RegexExtractionFn 2016-02-24 13:12:56 -08:00
Nishant
fb7eae34ed Merge pull request #2249 from metamx/workerExpanded 
Use Worker instead of ZkWorker whenever possible
 2016-02-24 13:23:22 +05:30
Charles Allen
ac13a5942a Use Worker instead of ZkWorker whenver possible 
* Moves last run task state information to Worker
* Makes WorkerTaskRunner a TaskRunner which has interfaces to help with getting information about a Worker
 2016-02-23 15:02:03 -08:00
Gian Merlino
3534483433 Better handling of ParseExceptions. 
Two changes:
- Allow IncrementalIndex to suppress ParseExceptions on "aggregate".
- Add "reportParseExceptions" option to realtime tuning configs. By default this is "false".

Behavior of the counters should now be:

- processed: Number of rows indexed, including rows where some fields could be parsed and some could not.
- thrownAway: Number of rows thrown away due to rejection policy.
- unparseable: Number of rows thrown away due to being completely unparseable (no fields salvageable at all).

If "reportParseExceptions" is true then "unparseable" will always be zero (because a parse error would
cause an exception to be thrown). In addition, "processed" will only include fully parseable rows
(because even partial parse failures will cause exceptions to be thrown).

Fixes #2510.
 2016-02-23 10:11:43 -08:00
Fangjin Yang
3bdd757024 Merge pull request #1773 from b-slim/log_details 
Adding downstream source when throwing QueryInterruptedException
 2016-02-22 10:16:07 -08:00
Slim Bouguerra
77925cc061 adding downstream source of QueryInterruptedException 2016-02-20 13:05:14 -06:00
Fangjin Yang
8ee81947cd Merge pull request #2494 from himanshug/fix_timeseries 
do not drop post-aggs in TimeseriesQueryToolChest.makePreComputeManipulatorFn
 2016-02-20 10:37:32 -08:00
Gian Merlino
d25c46cb9f Add comparator to HyperUniquesFinalizingPostAggregator. 
This makes it possible to do groupBys with clauses like "HAVING uniques > 10".
Beforehand you couldn't do it with either an aggregator (because it returns
an HLLV1 which the havingSpec can't understand) or a finalized postaggregator
(because it didn't have a comparator).

Now you can at least do it with a finalizing postaggregator. Trying it with
the aggregator alone still doesn't work.

Added some topN and groupBy tests verifying the comparator, and added an
@Ignore test that should pass if havingSpecs are made work on the aggregator
directly.
 2016-02-19 08:36:08 -08:00
Himanshu Gupta
11b0117422 do not drop post-aggs in timeseries query tool chest makePreComputeManipulatorFn like other query types 2016-02-17 20:51:35 -06:00
Jaehong Choi
32b9d57b23 handle a failing UT in GroupByQueryRunnerTest after merging into the master 2016-02-16 16:56:57 +09:00
Jaehong Choi
b25bca85bc Merge branch 'master' of https://github.com/druid-io/druid into support-alphanumeric-dimensional-sort-in-gropu-by 2016-02-16 16:42:05 +09:00
Jaehong Choi
e89afc901b delete System.out.println() in test code 2016-02-16 15:26:37 +09:00
Navis Ryu
cd315627c9 Merge pull request #2393 from CHOIJAEHONG1/support-alphanumeric-dimensional-sort-in-gropu-by 
support alphanumeric sorting for dimensional columns in groupby (#2393)
 2016-02-16 14:11:30 +09:00
Slim
16092eb5e2 Merge pull request #2464 from gianm/print-properties 
Make startup properties logging optional.
 2016-02-14 15:11:35 -06:00
Gian Merlino
e0c049c0b0 Make startup properties logging optional. 
Off by default, but enabled in the example config files. See also #2452.
 2016-02-12 14:12:16 -08:00
Himanshu Gupta
da5fcd0124 before facts get it , indexAndOffsets should already know about it 2016-02-12 13:32:06 -06:00
Jonathan Wei
d63eec65a1 Merge pull request #2208 from navis/metadataquery-minmax 
Support min/max values for metadata query
 2016-02-11 17:28:07 -08:00
Jonathan Wei
e1b022eac9 Merge pull request #2349 from navis/dimensionspec-for-selectquery 
Support dimension spec for select query
 2016-02-11 16:38:16 -08:00
navis.ryu
dd2375477a Support min/max values for metadata query (#2208) 2016-02-12 09:35:58 +09:00
Gian Merlino
2d037ef05e Merge pull request #2453 from DreamLab/fix/topn_sorting_anomaly 
Fix for unstable behavior of HyperLogLog comparator
 2016-02-11 16:05:34 -08:00
navis.ryu
4d63196535 Support dimension spec for select query 2016-02-12 08:54:28 +09:00
Himanshu
47d48e1e67 Merge pull request #2452 from gianm/print-properties 
PropertiesModule: Print properties, processors, totalMemory on startup.
 2016-02-11 16:49:34 -06:00
turu
f277a54a5c removed unsafe heuristics from hll compareTo and provided unit test for regression 2016-02-11 23:46:24 +01:00
Slim
368988d187 Merge pull request #2291 from druid-io/lookupManager 
Promoting LookupExtractor state and LookupExtractorFactory to be a first class druid state object.
 2016-02-11 16:07:27 -06:00
Gian Merlino
29f7758e74 PropertiesModule: Print properties, processors, totalMemory on startup. 2016-02-11 13:51:08 -08:00
Slim Bouguerra
4e119b7a24 Adding lookup ref manager and lookup dimension spec impl 2016-02-11 12:11:51 -06:00
Jaehong Choi
2f2e2ff5b9 support alphanumeric sorting for dimensional columns in groupby 2016-02-11 17:31:28 +09:00
Keuntae Park
05a144e39a fix crash with filtered aggregator at ingestion time 
- only for selector filter because extraction filter is not supported as
  cardinality is not fixed at ingestion time
 2016-02-11 11:25:33 +09:00
Fangjin Yang
b1673ee90e Merge pull request #2409 from gianm/smq-merged-thing 
SegmentMetadataQuery: Retain segment id when merging, if possible.
 2016-02-08 15:43:39 -08:00
Fangjin Yang
c9c20bb7f3 Merge pull request #2395 from metamx/fixExtractionDimFilterNullTest 
Actually check cache key null checking in ExtractionDimFilterTest
 2016-02-08 14:10:52 -08:00
Gian Merlino
bd9c04244f SegmentMetadataQuery: Retain segment id when merging, if possible. 
This is helpful on realtime nodes, where two analyses from two different hydrants
are merged together but they are actually from the same segment.
 2016-02-08 13:07:02 -08:00
Himanshu Gupta
9fe1b28ee5 provide configuration to enable usage of Off heap merging for groupBy query 2016-02-05 14:18:06 -06:00
Himanshu Gupta
b40c342cd1 make Global stupid pool cache size configurable 2016-02-05 14:18:06 -06:00
Himanshu Gupta
72a1e730a2 OffheapIncrementalIndex updates to do the aggregation merging off-heap 2016-02-05 14:17:05 -06:00
Himanshu Gupta
907dd77483 OffheapIncrementalIndex a copy/paste of OnheapIncrementalIndex 2016-02-05 14:02:31 -06:00
Charles Allen
aac5f9b2c9 Actually check cache key null checking in ExtractionDimFilterTest 2016-02-04 09:44:13 -08:00
fjy
1aa363cea7 new quickstart 2016-02-04 09:37:38 -08:00
Fangjin Yang
da77591129 Merge pull request #2392 from metamx/fix2391 
Allow ExtractionDimFilter value to be null
 2016-02-03 17:47:14 -08:00
Charles Allen
d4f00096ff Allow ExtractionDimFilter value to be null 
* Fixes #2391
 2016-02-03 15:51:47 -08:00
Himanshu Gupta
6e7d90cf56 UTs for DefaultLimitSpec 2016-02-03 15:59:12 -06:00
Himanshu Gupta
29e0d7f971 lazily create comparators for row columns when needed 2016-02-03 13:38:20 -06:00