Commit Graph

6611 Commits

Author SHA1 Message Date
navis.ryu dd774ef4dd one-pass merging of dictionary & index 2016-01-29 10:03:53 +09:00
Himanshu edd7ce58aa Merge pull request #2348 from AlexanderSaydakov/fix-aggregator-test-helper
fixed createIndex
2016-01-28 16:01:36 -06:00
Nishant ef8e78ca98 Merge pull request #2346 from himanshug/fix_bug
Fixes bug in kill task scheduling DruidCoordinatorSegmentKiller.findIntervalForKillTask()
2016-01-29 02:56:26 +05:30
saydakov e0860661b1 fixed createIndex 2016-01-28 13:20:50 -08:00
Himanshu Gupta f6b4dbd697 bug fix and unit tests for DruidCoordinatorSegmentKiller 2016-01-28 14:10:17 -06:00
Himanshu Gupta ab3edfa8fc moving DruidCoordinatorSegmentKiller class out of DruidCoordinator 2016-01-28 14:03:56 -06:00
Nishant 99017f4518 Merge pull request #2326 from navis/use-reverse-iterator
use reverse-iterator if possible
2016-01-28 19:48:38 +05:30
Nishant 3880f54b87 Merge pull request #2332 from himanshug/configurable_partial
make populateUncoveredIntervals a configuration in query context
2016-01-28 10:34:35 +05:30
navis.ryu 7324ece8f9 use reverse-iterator if possible 2016-01-28 09:04:55 +09:00
Xavier Léauté 5a3642bb93 Merge pull request #2247 from metamx/pedanticBuild
Enable strict building in travis
2016-01-27 10:27:03 -08:00
Xavier Léauté e3d1e07b34 Merge pull request #2261 from metamx/improve-segment-ordering
Prioritize loading of segments based on segment interval
2016-01-27 10:05:54 -08:00
Xavier Léauté 2e5004095a Merge pull request #2341 from gianm/smq-test
SegmentMetadataQuery: Fix merging of ColumnAnalysis errors.
2016-01-27 09:37:06 -08:00
Fangjin Yang 25630c7ebb Merge pull request #2344 from metamx/testVersionedTimelineReturnsEmpty
Add missing timeline test for VersionedIntervalTimelineTest
2016-01-27 09:31:59 -08:00
Charles Allen 71dbe5c0f0 Enable pedantic checks during travis build 2016-01-27 08:59:20 -08:00
Charles Allen 508734c8b0 Long constant reformatting in tests `l` --> `L` 2016-01-27 08:59:19 -08:00
Charles Allen 4282eac067 Add missing timeline test for VersionedIntervalTimelineTest 2016-01-27 08:49:08 -08:00
Slim abf2f457b1 Merge pull request #2343 from gianm/fix-lookups
Fix a couple of problems with lookups
2016-01-27 10:34:11 -06:00
Nishant fd6bf3fe22 Use interval comparator instead of bucketMonthComparator
fix when two segments have same interval

review comments
2016-01-27 17:35:43 +05:30
Gian Merlino b1e6c01762 Make LookupExtractor abstract methods public, they have to work across classloaders. 2016-01-26 23:08:03 -08:00
Gian Merlino cac4651da0 Fix spelling of 'dimReverseExtractionNamespace'. 2016-01-26 23:08:02 -08:00
Gian Merlino 795343f7ef SegmentMetadataQuery: Fix merging of ColumnAnalysis errors.
Also add tests for:
- ColumnAnalysis folding
- Mixed mmap/incremental merging
2016-01-26 17:16:26 -08:00
Bingkun Guo cac675351e Merge pull request #2340 from himanshug/data_src_input_no_segments
add ignoreWhenNoSegments flag to optionally ignore no segments error
2016-01-26 18:45:13 -06:00
Himanshu Gupta b3437825f0 add ignoreWhenNoSegments flag to optionally ignore the dataSource inputSpec when no segments were found 2016-01-26 17:23:55 -06:00
Himanshu Gupta 3719b6e3c8 make populateUncoveredIntervals a configuration in query context 2016-01-26 15:13:45 -06:00
Himanshu 3844658fb5 Merge pull request #2323 from druid-io/update-druidapi
Update druid-api to 0.3.16
2016-01-26 13:02:10 -06:00
Charles Allen 8f7d062add Merge pull request #2334 from guobingkun/fix_doc
[fix doc]: Coordinator druid.coordinator.merge.on triggers an Append Task
2016-01-26 09:46:26 -08:00
Bingkun Guo b07db4089c fix doc: Setting druid.coordinator.merge.on will trigger an Append Task instead of Merge Task. 2016-01-26 10:20:32 -06:00
Xavier Léauté 1b2a568285 Merge pull request #2327 from abbondanza/master
Updates number of parts in a topN query
2016-01-25 10:12:47 -08:00
Rafael Abbondanza 145c65c72d Updates number of parts in a topN query
This threw me off a bit, so I'm sure it may throw others off, too.
Updating from 10 to 11 parts.
2016-01-25 10:29:25 -05:00
Fangjin Yang fc32e34e1e Merge pull request #2324 from himanshug/ut
unit test: adding single threaded indexing and querying test for IncrementalIndex
2016-01-23 15:25:41 -08:00
Himanshu Gupta 09d3678667 adding single threaded indexing and querying test for IncrementalIndex 2016-01-23 00:17:14 -06:00
Charles Allen 0000b9fc62 Remove sorting in ProtoBufInputRowParserTest
Due to processing/src/test/java/io/druid/data/input/ProtoBufInputRowParserTest.java
2016-01-22 16:02:25 -08:00
Charles Allen e941303bc6 Remove sorting of dimensions in AvroStreamInputRowParserTest
Due to https://github.com/druid-io/druid-api/pull/68
2016-01-22 16:01:41 -08:00
Charles Allen 937ae6ad20 Update druid-api to 0.3.16
Fixes https://github.com/druid-io/druid/issues/2316
2016-01-22 14:37:16 -08:00
Fangjin Yang 073c101d72 Merge pull request #2322 from himanshug/fix_regression
fixing regressions
2016-01-22 12:52:50 -08:00
Himanshu 7a6109f0ca Merge pull request #2321 from gianm/pending-index
Replace two-column index on pendingSegments table with one-column index.
2016-01-22 13:38:15 -06:00
Himanshu Gupta dccf636676 adding null aggregators and false hasMultipleValues to expected results of segment metadata query 2016-01-22 13:28:25 -06:00
Himanshu Gupta 2f7f5119cf older segments might not have field bitmapSerdeFactory for dimension columns and we must use appropriate default 2016-01-22 13:28:25 -06:00
Xavier Léauté 789b35a108 Merge pull request #2264 from himank/CustomExceptionMapper
Adding custom mapper for json processing exception
2016-01-22 11:09:18 -08:00
Gian Merlino 0bd9bff075 Replace two-column index on pendingSegments table with one-column index.
Fixes #2319.
2016-01-22 10:50:21 -08:00
Himank Chaudhary 1a5d4e714c Adding custom mapper for json processing exception to return bad request instead of 500 2016-01-22 09:48:52 -08:00
Fangjin Yang df814247b9 Merge pull request #2318 from binlijin/rename_persistBackgroundCount
rename persistBackgroundCount to numBackgroundPersistThreads
2016-01-21 23:24:35 -08:00
binlijin cd1c71ceb4 rename persistBackgroundCount to numBackgroundPersistThreads 2016-01-22 14:29:41 +08:00
binlijin 1d1f4d996d Merge pull request #2111 from binlijin/optimize-create-inverted-indexes
optimize create inverted indexes
2016-01-22 11:36:27 +08:00
Fangjin Yang f03b65480f Merge pull request #2295 from gianm/segment-metadata-query-query-metadata
SegmentMetadataQuery support for returning aggregators.
2016-01-21 19:12:46 -08:00
binlijin 55f7dd4629 optimize create inverted indexes 2016-01-22 10:40:09 +08:00
Gian Merlino d416279c14 SegmentMetadataQuery support for returning aggregators. 2016-01-21 17:27:25 -08:00
Fangjin Yang 5a9cd89059 Merge pull request #2305 from gianm/segment-metadata-query-multivalues
Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments
2016-01-21 17:22:34 -08:00
Gian Merlino e5913be90e Merge pull request #2257 from tubemogul/index-merge-bug
Adds support for empty merge metrics. fixes #2256
2016-01-21 16:38:00 -08:00
Gian Merlino 87c8046c6c Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments.
SegmentMetadataQuery stuff:

- Simplify implementation of SegmentAnalyzer.
- Fix type names for realtime complex columns; this used to try to merge a nice type
  name (like "hyperUnique") from mmapped segments with the word "COMPLEX" from incremental
  index segments, leading to a merge failure. Now it always uses the nice name.
- Add hasMultipleValues to ColumnAnalysis.
- Add tests for both mmapped and incremental index segments.
- Update docs to include errorMessage.
2016-01-21 15:50:33 -08:00