24860a1391
Two-stage filtering ( #3018 )
...
* Two-stage filtering
* PR comment
2016-06-22 16:08:21 -07:00
f46ad9a4cb
support Union Segment metadata queries ( #3132 )
...
* support Union Segment metadata queries
fix 3128
* remove extraneous sys out
2016-06-21 10:30:50 -07:00
12be1c0a4b
Add bucket extraction function ( #3033 )
...
* add bucket extraction function
* add doc and header
* updated doc and test
2016-06-17 09:24:27 -07:00
ebf890fe79
Update master version to 0.9.2-SNAPSHOT. ( #3133 )
2016-06-13 13:10:38 -07:00
0d427923c0
fix caching for search results ( #3119 )
...
* fix caching for search results
properly read count when reading from cache.
* fix NPE during merging search count and add test
* Update cache key to invalidate prev results
2016-06-09 17:49:47 -07:00
5998de7d5b
Fix lenient merging of conflicting aggregators. ( #3113 )
...
This should have marked the conflicting aggregator as null, but instead it
threw an NPE for the entire query.
2016-06-08 15:56:48 -07:00
37c8a8f186
Speed up filter tests with adapter cache ( #3103 )
2016-06-08 07:41:10 -07:00
54139c6815
Fix NPE in registeredLookup extractionFn when "optimize" is not provided. ( #3064 )
2016-06-03 12:58:17 -05:00
6171e078c8
Improve NPE message in LookupDimensionSpec when lookup does not exist. ( #3065 )
...
The message used to be empty, which made things hard to debug.
2016-06-02 19:59:12 -07:00
e662efa79f
segment interface refactor for proposal 2965 ( #2990 )
2016-05-26 20:36:41 -07:00
b5bd406597
fix #2991 : race condition in OnheapIncrementalIndex#addToFacts ( #3002 )
...
* fix #2991 : race condition in OnheapIncrementalIndex#addToFacts
* add missing header
* handle parseExceptions when first doing first agg
2016-05-25 19:05:46 -07:00
b72c54c4f8
Add benchmark data generator, basic ingestion/persist/merge/query benchmarks ( #2875 )
2016-05-25 16:39:37 -07:00
dcabd4b1ee
Add lookup optimization for InDimFilter ( #2938 )
...
* Add lookup optimization for InDimFilter
* tests for in filter with lookup extraction fn
* refactor
* refactor2 and modified filter test
* make optimizeLookup private
2016-05-19 16:29:16 -07:00
15ccf451f9
Move QueryGranularity static fields to QueryGranularities ( #2980 )
...
* Move QueryGranularity static fields to QueryGranularityUtil
* Fixes #2979
* Add test showing #2979
* change name to QueryGranularities
2016-05-17 16:23:48 -07:00
fb01db4db7
[QTL] Allows RegisteredLookupExtractionFn to find its lookups lazily ( #2971 )
...
* Allows RegisteredLookupExtractionFn to find its lookups lazily
* Use raw variables instead of AtomicReference
* Make sure to use volatile
* Remove extra local variable.
* Move from BAOS to ByteBuffer
2016-05-17 11:29:39 -07:00
d3e9c47a5f
use correct ObjectMapper in Index[IO/Merger] in AggregationTestHelper and minor fix in theta sketch SketchMergeAggregatorFactory.getMergingFactory(..) ( #2943 )
2016-05-13 10:06:31 +05:30
d821144738
at historicals GpBy query mergeResults does not need merging as results are already merged by GroupByQueryRunnerFactory.mergeRunners(..) ( #2962 )
2016-05-12 17:41:24 -07:00
01bebf432a
GroupByQuery: Multi-value dimension tests. ( #2959 )
2016-05-12 11:31:50 -07:00
a31348450f
Add toString for LookupConfig ( #2935 )
...
* Helps with operations and getting where the snapshot dir is
2016-05-09 18:20:00 -07:00
79a54283d4
Optimize filter for timeseries, search, and select queries ( #2931 )
...
* Optimize filter for timeseries, search, and select queries
* exception at failed toolchest type check
* took out query type check
* java7 error fix and test improvement
2016-05-09 11:04:06 -07:00
8b570ab130
make it clear what LookupExtractorFactory start/stop methods return ( #2925 )
2016-05-05 10:38:40 -07:00
b489f63698
Supervisor for KafkaIndexTask ( #2656 )
...
* supervisor for kafka indexing tasks
* cr changes
2016-05-04 23:13:13 -07:00
8e2742b7e8
adding QueryGranularity to segment metadata and optionally expose same from segmentMetadata query ( #2873 )
2016-05-03 11:31:10 -07:00
40e595c7a0
Remove types from TimeAndDims, they aren't needed. ( #2865 )
2016-05-03 13:10:25 -05:00
841be5c61f
periodically emit metric segment/scan/pending ( #2854 )
2016-05-02 22:38:13 -07:00
2729fea84d
Fix parsing fail of segment id with datasource containing underscore ( #2797 )
...
* Fix parsing fail of segment id with underscored datasource (Fix for #2786 )
* addressed comment
* renamed and moved code into api. added log4 dependency for tests
* addressed comments
* fixed test fails
2016-05-02 22:37:28 -07:00
90ce03c66f
Fix integer overflow in SegmentMetadataQuery numRows. ( #2890 )
2016-04-27 14:37:04 -07:00
6dc7688a29
TimeAndDims equals/hashCode implementation. ( #2870 )
...
Adapted from #2692 , thanks @navis for original implementation.
2016-04-22 08:45:20 +08:00
3cfd9c64c9
make singleThreaded groupBy query config overridable at query time ( #2828 )
...
* make isSingleThreaded groupBy query processing overridable at query time
* refactor code in GroupByMergedQueryRunner to make processing of single threaded and parallel merging of runners consistent
2016-04-21 17:12:58 -07:00
984a518c9f
Merge pull request #2734 from b-slim/LookupIntrospection2
...
[QTL][Lookup] adding introspection endpoint
2016-04-21 12:15:57 -05:00
c74391e54c
JavaScript: Ability to disable. ( #2853 )
...
Fixes #2852 .
2016-04-21 09:43:15 -05:00
7d3e55717d
Reduce cost of various toFilter calls. ( #2860 )
...
These happen once per segment and so it's better if they don't do
as much work.
2016-04-21 04:28:46 +08:00
59460b17cc
Add Filters.matchPredicate helper, use it where appropriate. ( #2851 )
...
This approach simplifies code and is generally faster, due to skipping
unnecessary dictionary lookups (see #2850 ).
2016-04-19 15:54:32 -07:00
b2745befb7
remove obsolete comment ( #2858 )
2016-04-19 13:06:58 -07:00
7b65ca7889
refactor ClientQuerySegmentWalker ( #2837 )
...
* refactor ClientQuerySegmentWalker
* add header to FluentQueryRunnerBuilder
* refactor QueryRunnerTestHelper
2016-04-18 14:00:47 -07:00
7c0b1dde3a
DimensionPredicateFilter: Skip unnecessary dictionary lookup. ( #2850 )
2016-04-18 12:38:25 -07:00
b534f7203c
Fix performance regression from #2753 in IndexMerger ( #2841 )
2016-04-14 21:39:41 -07:00
a26134575b
Fix NPE in TopNLexicographicResultBuilder.addEntry() ( #2835 )
2016-04-13 17:27:16 -07:00
abd951df1a
Document how to use roaring bitmaps ( #2824 )
...
* Document how to use roaring bitmaps
This fixes #2408 .
While not all indexSpec properties are explained, it does explain how roaring bitmaps can be turned on.
* fix
* fix
* fix
* fix
2016-04-12 19:28:02 -07:00
db35dd7508
fix issue #2744 . Check for null before combining metrics ( #2774 )
2016-04-12 14:46:31 -07:00
1bf1dd03a0
Merge pull request #2812 from mrijke/fix-missing-equals-hashcode-filters
...
Add missing equals/hashcode to JS, Regex and SearchQuery DimFilters
2016-04-12 12:00:23 +05:30
21e406613c
Merge pull request #2809 from metamx/fix2694
...
Fix test for snapshot taker to better check for lookup perist failure
2016-04-11 14:52:47 -07:00
de68d6b7c4
Add missing equals/hashcode to JS, Regex and SearchQuery DimFilters
...
This commits adds missing equals() and hashcode() methods to
the JavascriptDimFilter, RegexDimFilter and the SearchQueryDimFilter.
2016-04-11 12:16:24 +02:00
bbb326decf
Merge pull request #2799 from b-slim/fix_snapshot
...
MapLookupFactory need to be Ser/Desr ready.
2016-04-07 13:22:34 +05:30
bf1eafc4e1
remove all the mock lookupFactory
2016-04-06 15:37:52 -05:00
59eb2490a0
MapLookupFactory need to be Ser/Desr.
2016-04-06 15:02:18 -05:00
f915a59138
Merge pull request #2691 from metamx/lookupExtrFn
...
Add ExtractionFn to LookupExtractor bridge
2016-04-06 09:13:08 -07:00
051fd6c0eb
Remove extra println from InFilter
2016-04-05 14:55:49 -07:00
289bb6f885
Merge pull request #2690 from jon-wei/filter_support
...
Allow filters to use extraction functions
2016-04-05 15:40:15 -06:00
0e481d6f93
Allow filters to use extraction functions
2016-04-05 13:24:56 -07:00
Jonathan Wei
Nishant
Dave Li
Gian Merlino
John Wang
Kurt Young
Charles Allen
Himanshu
Slim
David Lim
binlijin
Navis Ryu
Xavier Léauté
Jisoo Kim
Fangjin Yang
michaelschiff
Maarten Rijke
Slim Bouguerra
jon-wei