nishant
bb8c0cb50b
Improve filtering of segments for dataSourceMetadataQuery
...
dataSourceMetadataQuery only needs to be executed on latest segments at
present, modify filterSegments and add test.
2015-04-21 09:31:13 +05:30
Xavier Léauté
f73f14ab91
Merge pull request #1297 from metamx/versionConverterTaskUpdates
...
Update VersionConverterTask for IndexSpec and allowing Forced updates
2015-04-20 16:44:35 -07:00
Charles Allen
7479ac9012
Update VersionConverterTask for IndexSepc and allowing Forced updates
2015-04-20 16:17:06 -07:00
fjy
d260515a43
update druid-api version
2015-04-17 14:58:35 -07:00
Bingkun Guo
cf155e4eba
Fix an issue that after broker forwards GroupByQuery to historical, havingSpec is still applied
...
on postAggregations which are removed in the forwarded query.
Add a unit test to replicate the issue.
Add a query that can replicate this issue into integration test.
2015-04-17 13:00:41 -05:00
fjy
f0a19349bf
fix up some comments for contributed test
2015-04-16 15:07:09 -07:00
Fangjin Yang
90b17a5259
Merge pull request #1285 from venkateshk/limitspec-tests
...
Unit test to surface bug with limit-spec order by over specific query intervals
2015-04-16 13:52:58 -07:00
Xavier Léauté
1d153674b6
remove overzealous check for backwards compatibility
2015-04-15 22:11:55 -07:00
Xavier Léauté
ea5572d001
Merge pull request #1271 from metamx/strictErrorChecking
...
Add stricter checking for potential coding errors
2015-04-15 15:21:41 -07:00
Charles Allen
abdeaa0746
Add stricter checking for potential coding errors
...
Can use via `mvn clean compile test-compile -P strict'
2015-04-15 14:52:25 -07:00
vkavuluri
a2ba5b6183
Unit test to surface bug with limit-spec order by over specific query intervals
2015-04-15 06:31:22 -07:00
Xavier Léauté
3a3046ccf3
add support for dimension compression
...
- compression for single-value dimensions using CompressedVSizeIntsIndexedSupplier
- makes dimension compression configurable via IndexSpec
- IndexSpec also enables configuring bitmap and metric compression
2015-04-14 10:44:18 -07:00
Xavier Léauté
bafc5114b4
add toString, equals, and hashCode to BitmapSerdeFactory
2015-04-14 10:44:18 -07:00
Xavier Léauté
d20128b89b
add compressed variable-size ints column type
2015-04-14 10:44:18 -07:00
Xavier Léauté
ce928d9636
add compressed ints column type
2015-04-14 10:44:17 -07:00
Xavier Léauté
5c23679238
add WritableSupplier and IndexedMultivalue
2015-04-14 10:44:17 -07:00
Xavier Léauté
1abb9cce7c
make IndexedInts closeable + add fill method
2015-04-14 10:44:17 -07:00
Xavier Léauté
ed0d49933e
fix memory leak in CompressedXXXIndexedSupplierTest
2015-04-14 10:44:16 -07:00
Xavier Léauté
6790e6cf0f
add fromList to CompressedLongsIndexedSupplier
2015-04-14 10:44:16 -07:00
Eric Tschetter
7517f0d0f0
Add some javadoc to the two Query processing interfaces to help aid in implementations of new Queries.
...
Also, remove some comments that did not have enough context to actually make sense to anyone but the original author (at least, I hope they make sense to the author, I definitely don't know what was being said).
2015-04-09 18:11:42 -07:00
Fangjin Yang
208e307915
Merge pull request #1251 from metamx/uriSegmentLoaders
...
Revert "Revert "Overhaul of SegmentPullers to add consistency and retries""
2015-03-30 17:43:51 -07:00
fjy
aea7f9d192
[maven-release-plugin] prepare for next development iteration
2015-03-30 16:35:24 -07:00
fjy
060d7aef03
[maven-release-plugin] prepare release druid-0.7.1
2015-03-30 16:35:20 -07:00
Charles Allen
1c6cbea89c
Revert "Revert "Overhaul of SegmentPullers to add consistency and retries""
...
This reverts commit f904bc7858
.
2015-03-30 13:40:04 -07:00
Fangjin Yang
f904bc7858
Revert "Overhaul of SegmentPullers to add consistency and retries"
2015-03-30 13:15:50 -07:00
Charles Allen
6d407e8677
Add URI handling to SegmentPullers
...
* Requires https://github.com/druid-io/druid-api/pull/37
* Requires https://github.com/metamx/java-util/pull/22
* Moves the puller logic to use a more standard workflow going through java-util helpers instead of re-writing the handlers for each impl
* General workflow goes like this: 1) LoadSpec makes sure the correct Puller is called with the correct parameters. 2) The Puller sets up general information like how to make an InputStream, how to find a file name (for .gz files for example), and when to retry. 3) CompressionUtils does most of the heavy lifting when it can
2015-03-30 12:33:23 -07:00
Fangjin Yang
e5653f0752
Merge pull request #1190 from vigiglobe/master
...
Fix NPE when partionNumber 0 does not exist.
2015-03-26 13:25:39 -07:00
Xavier Léauté
389ea4c32f
Merge pull request #1245 from b-slim/fix_injector_plus_ut
...
Bug fix @DruidSecondaryModule plus unit test
2015-03-26 10:04:44 -07:00
Fangjin Yang
a9c47de571
Merge pull request #1243 from metamx/fix-union-timeline-lookup
...
fixes TimeboundaryQuery and DataSourceMetadata queries returning wrong values for union queries
2015-03-26 10:02:56 -07:00
Slim Bouguerra
1e6be7796e
bug fix @DruidSecondaryModule plus unit test
2015-03-26 10:44:52 -05:00
nishantmonu51
638bf9d4e9
return sorted List of TimeLineObjectHolder
2015-03-26 11:51:09 +05:30
msprunck
942c17a2aa
Remove timeline chunk count assumptions.
...
* Replace with generic iterables
2015-03-24 22:40:49 +01:00
Prajwal Tuladhar
9983216871
use https maven repo URL to download dependencies
2015-03-20 14:09:07 -04:00
fjy
b389cfe404
[maven-release-plugin] prepare for next development iteration
2015-03-19 12:38:17 -07:00
fjy
60e7d543cc
[maven-release-plugin] prepare release druid-0.7.1-rc1
2015-03-19 12:38:13 -07:00
nishantmonu51
39e60b3405
fix race in groupByParallelQueryRunner
...
add UT and use a queue for better concurrency
2015-03-17 20:57:05 +05:30
Xavier Léauté
127b6fd857
Merge pull request #1172 from himanshug/segment_metadata_eager
...
force eager the processing of segment metadata query on the processing executor
2015-03-12 10:19:48 -07:00
Xavier Léauté
0a5a3fe2dc
fix file missing from rebase
2015-03-11 17:30:11 -07:00
Xavier Léauté
e01ed16030
serde tests + equals/hashCode fixes for extraction functions
2015-03-11 16:48:28 -07:00
Xavier Léauté
d3f5bddc5c
Add ability to apply extraction functions to the time dimension
...
- Moves DimExtractionFn under a more generic ExtractionFn interface to
support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
2015-03-11 16:45:42 -07:00
Himanshu Gupta
55ebf0cfdf
force eager the processing of segment metadata query on the processing threadpool by using ChainedExecutionQueryRunner in SegmentMetadataQueryRunnerFactory.mergeRunners(..)
2015-03-11 12:58:58 -05:00
Xavier Léauté
217e674063
Handling aggregators and post aggregators with duplicate names
...
* add test for same-name groupBy hyperUniques post-agg
* add test for same-name post-agg in groupby with approx histogram
* Fixes https://github.com/druid-io/druid/issues/1045
* Throws an error if post aggs and aggs do not have unique names
* Add more groupBy tests for Having filters
2015-03-10 17:10:43 -07:00
Fangjin Yang
0b467624ec
Merge pull request #694 from druid-io/arithmetic-op-strategies
...
normal division & configurable ordering for ArithmeticPostAggregator
2015-03-10 13:48:27 -07:00
Fangjin Yang
2abdce1dc0
Merge pull request #1180 from metamx/logging-groupBy-NPE
...
add null check early to catch root cause for groupBy NPE while running bySegment query
2015-03-09 09:16:33 -07:00
nishantmonu51
6e935cca0a
add null check early to catch root cause
2015-03-09 21:10:28 +05:30
Xavier Léauté
0d47c0c36d
normal division and configurable ordering for ArithmeticPostAggregator
...
Fixes #510
2015-03-04 12:44:24 -08:00
Fangjin Yang
d685e2ab04
Merge pull request #1165 from friedhardware/fix-NPerror-select
...
Added null check for the pagingSpec on a Select Query.
2015-03-02 14:17:06 -08:00
Fangjin Yang
e8605c63a9
Merge pull request #1150 from himanshug/broker-parallel-chunk-process
...
interval chunk query runner now processes individual chunk in a threadpool
2015-03-02 13:50:23 -08:00
Himanshu Gupta
29039fd541
interval chunk query runner now processes individual chunk in a thread pool and prints metrics query/time per chunk
2015-03-02 15:45:09 -06:00
Joshua Schumacher
e6130e0fdc
Added null check for the pagingSpec on a Select Query.
2015-03-02 12:41:59 -08:00