Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-09 03:24:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,529 Commits 116 Branches 507 Tags
Commit Graph

1121 Commits

Author SHA1 Message Date
Charles Allen
633fdb029e Add option to ConvertSegmentTask to skip validation 
* Validation is enabled by default
 2015-04-27 08:37:55 -07:00
Charles Allen
303727e6a9 IndexMaker speedups 
* About 15% speedup

Conflicts:
	processing/src/main/java/io/druid/segment/IndexMaker.java
 2015-04-23 13:19:21 -07:00
Charles Allen
f2300430d1 Cleanup some code in index creation. 
* Add some unit tests
* Add io.druid.segment.IndexMerger.reprocess for quick re-indexing of data
* Add dim-value validation to validation checker (instead of ONLY index #)
* General code refactoring to make things a little easier to read
 2015-04-23 12:41:42 -07:00
Xavier Léauté
7939f43681 Merge pull request #1296 from druid-io/limit-test 
Add test for order by metric and limit across multiple days
 2015-04-22 11:28:06 -07:00
fjy
97d87a06d0 Add another test for limit across multiple days 2015-04-22 11:27:37 -07:00
Fangjin Yang
28f69d6bd3 Merge pull request #1299 from metamx/improve-filter-datasource-metadata 
Improve filtering of segments for dataSourceMetadataQuery
 2015-04-22 11:07:35 -07:00
Xavier Léauté
a0a28de551 fix serde issue when pulling timestamps from cache 2015-04-22 11:03:26 -07:00
Xavier Léauté
2b4406671e Merge pull request #1301 from druid-io/fix-type 
fix count agg factory type
 2015-04-21 09:24:20 -07:00
fjy
7805357ab1 fix count agg factory type 2015-04-21 09:23:04 -07:00
nishant
bb8c0cb50b Improve filtering of segments for dataSourceMetadataQuery 
dataSourceMetadataQuery only needs to be executed on latest segments at
present, modify filterSegments and add test.
 2015-04-21 09:31:13 +05:30
Xavier Léauté
f73f14ab91 Merge pull request #1297 from metamx/versionConverterTaskUpdates 
Update VersionConverterTask for IndexSpec and allowing Forced updates
 2015-04-20 16:44:35 -07:00
Charles Allen
7479ac9012 Update VersionConverterTask for IndexSepc and allowing Forced updates 2015-04-20 16:17:06 -07:00
fjy
d260515a43 update druid-api version 2015-04-17 14:58:35 -07:00
Bingkun Guo
cf155e4eba Fix an issue that after broker forwards GroupByQuery to historical, havingSpec is still applied 
on postAggregations which are removed in the forwarded query.

Add a unit test to replicate the issue.
Add a query that can replicate this issue into integration test.
 2015-04-17 13:00:41 -05:00
fjy
f0a19349bf fix up some comments for contributed test 2015-04-16 15:07:09 -07:00
Fangjin Yang
90b17a5259 Merge pull request #1285 from venkateshk/limitspec-tests 
Unit test to surface bug with limit-spec order by over specific query intervals
 2015-04-16 13:52:58 -07:00
Xavier Léauté
1d153674b6 remove overzealous check for backwards compatibility 2015-04-15 22:11:55 -07:00
Xavier Léauté
ea5572d001 Merge pull request #1271 from metamx/strictErrorChecking 
Add stricter checking for potential coding errors
 2015-04-15 15:21:41 -07:00
Charles Allen
abdeaa0746 Add stricter checking for potential coding errors 
Can use via `mvn clean compile test-compile -P strict'
 2015-04-15 14:52:25 -07:00
vkavuluri
a2ba5b6183 Unit test to surface bug with limit-spec order by over specific query intervals 2015-04-15 06:31:22 -07:00
Xavier Léauté
3a3046ccf3 add support for dimension compression 
- compression for single-value dimensions using CompressedVSizeIntsIndexedSupplier
- makes dimension compression configurable via IndexSpec
- IndexSpec also enables configuring bitmap and metric compression
 2015-04-14 10:44:18 -07:00
Xavier Léauté
bafc5114b4 add toString, equals, and hashCode to BitmapSerdeFactory 2015-04-14 10:44:18 -07:00
Xavier Léauté
d20128b89b add compressed variable-size ints column type 2015-04-14 10:44:18 -07:00
Xavier Léauté
ce928d9636 add compressed ints column type 2015-04-14 10:44:17 -07:00
Xavier Léauté
5c23679238 add WritableSupplier and IndexedMultivalue 2015-04-14 10:44:17 -07:00
Xavier Léauté
1abb9cce7c make IndexedInts closeable + add fill method 2015-04-14 10:44:17 -07:00
Xavier Léauté
ed0d49933e fix memory leak in CompressedXXXIndexedSupplierTest 2015-04-14 10:44:16 -07:00
Xavier Léauté
6790e6cf0f add fromList to CompressedLongsIndexedSupplier 2015-04-14 10:44:16 -07:00
Eric Tschetter
7517f0d0f0 Add some javadoc to the two Query processing interfaces to help aid in implementations of new Queries. 
Also, remove some comments that did not have enough context to actually make sense to anyone but the original author (at least, I hope they make sense to the author, I definitely don't know what was being said).
 2015-04-09 18:11:42 -07:00
Fangjin Yang
208e307915 Merge pull request #1251 from metamx/uriSegmentLoaders 
Revert "Revert "Overhaul of SegmentPullers to add consistency and retries""
 2015-03-30 17:43:51 -07:00
fjy
aea7f9d192 [maven-release-plugin] prepare for next development iteration 2015-03-30 16:35:24 -07:00
fjy
060d7aef03 [maven-release-plugin] prepare release druid-0.7.1 2015-03-30 16:35:20 -07:00
Charles Allen
1c6cbea89c Revert "Revert "Overhaul of SegmentPullers to add consistency and retries"" 
This reverts commit f904bc785860f97c4b741d69df4c606bf1bfe3ae.
 2015-03-30 13:40:04 -07:00
Fangjin Yang
f904bc7858 Revert "Overhaul of SegmentPullers to add consistency and retries" 2015-03-30 13:15:50 -07:00
Charles Allen
6d407e8677 Add URI handling to SegmentPullers 
* Requires https://github.com/druid-io/druid-api/pull/37
* Requires https://github.com/metamx/java-util/pull/22
* Moves the puller logic to use a more standard workflow going through java-util helpers instead of re-writing the handlers for each impl
  * General workflow goes like this: 1) LoadSpec makes sure the correct Puller is called with the correct parameters. 2) The Puller sets up general information like how to make an InputStream, how to find a file name (for .gz files for example), and when to retry. 3) CompressionUtils does most of the heavy lifting when it can
 2015-03-30 12:33:23 -07:00
Fangjin Yang
e5653f0752 Merge pull request #1190 from vigiglobe/master 
Fix NPE when partionNumber 0 does not exist.
 2015-03-26 13:25:39 -07:00
Xavier Léauté
389ea4c32f Merge pull request #1245 from b-slim/fix_injector_plus_ut 
Bug fix @DruidSecondaryModule plus unit test
 2015-03-26 10:04:44 -07:00
Fangjin Yang
a9c47de571 Merge pull request #1243 from metamx/fix-union-timeline-lookup 
fixes TimeboundaryQuery and DataSourceMetadata queries returning wrong values for union queries
 2015-03-26 10:02:56 -07:00
Slim Bouguerra
1e6be7796e bug fix @DruidSecondaryModule plus unit test 2015-03-26 10:44:52 -05:00
nishantmonu51
638bf9d4e9 return sorted List of TimeLineObjectHolder 2015-03-26 11:51:09 +05:30
msprunck
942c17a2aa Remove timeline chunk count assumptions. 
* Replace with generic iterables
 2015-03-24 22:40:49 +01:00
Prajwal Tuladhar
9983216871 use https maven repo URL to download dependencies 2015-03-20 14:09:07 -04:00
fjy
b389cfe404 [maven-release-plugin] prepare for next development iteration 2015-03-19 12:38:17 -07:00
fjy
60e7d543cc [maven-release-plugin] prepare release druid-0.7.1-rc1 2015-03-19 12:38:13 -07:00
nishantmonu51
39e60b3405 fix race in groupByParallelQueryRunner 
add UT and use a queue for better concurrency
 2015-03-17 20:57:05 +05:30
Xavier Léauté
127b6fd857 Merge pull request #1172 from himanshug/segment_metadata_eager 
force eager the processing of segment metadata query on the processing executor
 2015-03-12 10:19:48 -07:00
Xavier Léauté
0a5a3fe2dc fix file missing from rebase 2015-03-11 17:30:11 -07:00
Xavier Léauté
e01ed16030 serde tests + equals/hashCode fixes for extraction functions 2015-03-11 16:48:28 -07:00
Xavier Léauté
d3f5bddc5c Add ability to apply extraction functions to the time dimension 
- Moves DimExtractionFn under a more generic ExtractionFn interface to
  support extracting dimension values other than strings
- pushes down extractionFn to the storage adapter from query engine
- 'dimExtractionFn' parameter has been deprecated in favor of 'extractionFn'
- adds a TimeFormatExtractionFn, allowing to project the '__time' dimension
- JavascriptDimExtractionFn renamed to JavascriptExtractionFn, adding
  support for any dimension value types that map directly to Javascript
- update documentation for time column extraction and related changes
 2015-03-11 16:45:42 -07:00
Himanshu Gupta
55ebf0cfdf force eager the processing of segment metadata query on the processing threadpool by using ChainedExecutionQueryRunner in SegmentMetadataQueryRunnerFactory.mergeRunners(..) 2015-03-11 12:58:58 -05:00