Himanshu Gupta
b3437825f0
add ignoreWhenNoSegments flag to optionally ignore the dataSource inputSpec when no segments were found
2016-01-26 17:23:55 -06:00
Himanshu Gupta
3719b6e3c8
make populateUncoveredIntervals a configuration in query context
2016-01-26 15:13:45 -06:00
Himanshu
3844658fb5
Merge pull request #2323 from druid-io/update-druidapi
...
Update druid-api to 0.3.16
2016-01-26 13:02:10 -06:00
Charles Allen
8f7d062add
Merge pull request #2334 from guobingkun/fix_doc
...
[fix doc]: Coordinator druid.coordinator.merge.on triggers an Append Task
2016-01-26 09:46:26 -08:00
Bingkun Guo
b07db4089c
fix doc: Setting druid.coordinator.merge.on will trigger an Append Task instead of Merge Task.
2016-01-26 10:20:32 -06:00
Xavier Léauté
1b2a568285
Merge pull request #2327 from abbondanza/master
...
Updates number of parts in a topN query
2016-01-25 10:12:47 -08:00
Rafael Abbondanza
145c65c72d
Updates number of parts in a topN query
...
This threw me off a bit, so I'm sure it may throw others off, too.
Updating from 10 to 11 parts.
2016-01-25 10:29:25 -05:00
Harsh Jain
41730b96d4
Fix for issue 2021
2016-01-25 02:48:22 +05:30
Fangjin Yang
fc32e34e1e
Merge pull request #2324 from himanshug/ut
...
unit test: adding single threaded indexing and querying test for IncrementalIndex
2016-01-23 15:25:41 -08:00
Himanshu Gupta
09d3678667
adding single threaded indexing and querying test for IncrementalIndex
2016-01-23 00:17:14 -06:00
Charles Allen
0000b9fc62
Remove sorting in ProtoBufInputRowParserTest
...
Due to processing/src/test/java/io/druid/data/input/ProtoBufInputRowParserTest.java
2016-01-22 16:02:25 -08:00
Charles Allen
e941303bc6
Remove sorting of dimensions in AvroStreamInputRowParserTest
...
Due to https://github.com/druid-io/druid-api/pull/68
2016-01-22 16:01:41 -08:00
Charles Allen
937ae6ad20
Update druid-api to 0.3.16
...
Fixes https://github.com/druid-io/druid/issues/2316
2016-01-22 14:37:16 -08:00
Fangjin Yang
073c101d72
Merge pull request #2322 from himanshug/fix_regression
...
fixing regressions
2016-01-22 12:52:50 -08:00
Himanshu
7a6109f0ca
Merge pull request #2321 from gianm/pending-index
...
Replace two-column index on pendingSegments table with one-column index.
2016-01-22 13:38:15 -06:00
Himanshu Gupta
dccf636676
adding null aggregators and false hasMultipleValues to expected results of segment metadata query
2016-01-22 13:28:25 -06:00
Himanshu Gupta
2f7f5119cf
older segments might not have field bitmapSerdeFactory for dimension columns and we must use appropriate default
2016-01-22 13:28:25 -06:00
Xavier Léauté
789b35a108
Merge pull request #2264 from himank/CustomExceptionMapper
...
Adding custom mapper for json processing exception
2016-01-22 11:09:18 -08:00
Gian Merlino
0bd9bff075
Replace two-column index on pendingSegments table with one-column index.
...
Fixes #2319 .
2016-01-22 10:50:21 -08:00
Himank Chaudhary
1a5d4e714c
Adding custom mapper for json processing exception to return bad request instead of 500
2016-01-22 09:48:52 -08:00
Fangjin Yang
df814247b9
Merge pull request #2318 from binlijin/rename_persistBackgroundCount
...
rename persistBackgroundCount to numBackgroundPersistThreads
2016-01-21 23:24:35 -08:00
binlijin
cd1c71ceb4
rename persistBackgroundCount to numBackgroundPersistThreads
2016-01-22 14:29:41 +08:00
binlijin
1d1f4d996d
Merge pull request #2111 from binlijin/optimize-create-inverted-indexes
...
optimize create inverted indexes
2016-01-22 11:36:27 +08:00
Fangjin Yang
f03b65480f
Merge pull request #2295 from gianm/segment-metadata-query-query-metadata
...
SegmentMetadataQuery support for returning aggregators.
2016-01-21 19:12:46 -08:00
binlijin
55f7dd4629
optimize create inverted indexes
2016-01-22 10:40:09 +08:00
Gian Merlino
d416279c14
SegmentMetadataQuery support for returning aggregators.
2016-01-21 17:27:25 -08:00
Fangjin Yang
5a9cd89059
Merge pull request #2305 from gianm/segment-metadata-query-multivalues
...
Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments
2016-01-21 17:22:34 -08:00
Gian Merlino
e5913be90e
Merge pull request #2257 from tubemogul/index-merge-bug
...
Adds support for empty merge metrics. fixes #2256
2016-01-21 16:38:00 -08:00
Gian Merlino
87c8046c6c
Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments.
...
SegmentMetadataQuery stuff:
- Simplify implementation of SegmentAnalyzer.
- Fix type names for realtime complex columns; this used to try to merge a nice type
name (like "hyperUnique") from mmapped segments with the word "COMPLEX" from incremental
index segments, leading to a merge failure. Now it always uses the nice name.
- Add hasMultipleValues to ColumnAnalysis.
- Add tests for both mmapped and incremental index segments.
- Update docs to include errorMessage.
2016-01-21 15:50:33 -08:00
Fangjin Yang
3f998117a6
Merge pull request #2306 from jon-wei/inherit2
...
More specific null/empty str handling in IndexMerger
2016-01-21 14:36:09 -08:00
Michael Schiff
1e44445f06
Adds support for empty merge metrics. fixes #2256
2016-01-21 13:21:37 -08:00
jon-wei
459a236067
More specific null/empty str handling in IndexMerger
2016-01-21 12:24:38 -08:00
Slim
a752bc064e
Merge pull request #1978 from b-slim/graphite_emitter
...
Graphite emitter
2016-01-21 14:22:35 -06:00
Slim Bouguerra
e0d90f875c
Graphite emitter
2016-01-21 13:43:37 -06:00
Fangjin Yang
ab635c5cd3
Merge pull request #2315 from rasahner/docUpdateBuild
...
docs: edits related to loadList
2016-01-21 09:52:27 -08:00
Robin
c9368702fa
do some editing of the instructions for using mysql for metadata
2016-01-21 10:37:30 -06:00
Fangjin Yang
04d3054353
Merge pull request #2303 from CHOIJAEHONG1/localfirehouse-basedir-npe
...
Throw an IAE when baseDir is null in LocalFireHose
2016-01-21 07:58:52 -08:00
Slim
201539260c
Merge pull request #2076 from b-slim/issue_2010_upper_lower_extractionFN
...
adding lower and upper extraction fn
2016-01-21 09:58:07 -06:00
Slim Bouguerra
78feb3a13e
adding lower and upper extraction fn
2016-01-21 08:59:05 -06:00
Nishant
dcb7830330
Merge pull request #984 from drcrallen/thread-priority-rebase
...
Use thread priorities. (aka set `nice` values for background-like tasks)
2016-01-21 15:02:34 +05:30
Fangjin Yang
500c11a35a
Merge pull request #2311 from metamx/commentsIn2309
...
Minor field name change in RemoteTaskRunnerFactory to be more descriptive
2016-01-20 19:27:49 -08:00
Charles Allen
66e74b1a63
Minor field name change in RemoteTaskRunnerFactory to be more descriptive
...
* Addresses https://github.com/druid-io/druid/pull/2309#discussion_r50335081
2016-01-20 17:43:20 -08:00
Gian Merlino
5a932d28c1
Merge pull request #2288 from tubemogul/index-merge-bug2
...
Null check in IncrementalIndexAdapter.getDimValueLookup()
2016-01-20 17:07:15 -08:00
Charles Allen
2a69a58570
Merge pull request #2149 from binlijin/master
...
Do persist IncrementalIndex in another thread in IndexGeneratorReducer
2016-01-20 17:06:42 -08:00
Fangjin Yang
067baf10f2
Merge pull request #2310 from metamx/testFor2308
...
Add basic tests to some CliXXX classes
2016-01-20 17:00:06 -08:00
Fangjin Yang
996c1173c6
Merge pull request #2223 from navis/besteffort-split-locations
...
Best effort to find locations for input splits
2016-01-20 16:53:43 -08:00
Charles Allen
eddc18ecf2
Add basic tests to some CliXXX classes
2016-01-20 16:19:15 -08:00
Charles Allen
551d08da2a
Merge pull request #2309 from metamx/fix2308
...
Fix overlord scheduled executor injection
2016-01-20 16:04:57 -08:00
Charles Allen
3152d08844
Fix overlord scheduled executor injection
...
* Fixes https://github.com/druid-io/druid/issues/2308
2016-01-20 14:16:14 -08:00
Charles Allen
2e1d6aaf3d
Use thread priorities. (aka set `nice` values for background-like tasks)
...
* Defaults the thread priority to java.util.Thread.NORM_PRIORITY in io.druid.indexing.common.task.AbstractTask
* Each exec service has its own Task Factory which is assigned a priority for spawned task. Therefore each priority class has a unique exec service
* Added priority to tasks as taskPriority in the task context. <0 means low, 0 means take default, >0 means high. It is up to any particular implementation to determine how to handle these numbers
* Add options to ForkingTaskRunner
* Add "-XX:+UseThreadPriorities" default option
* Add "-XX:ThreadPriorityPolicy=42" default option
* AbstractTask - Removed unneded @JsonIgnore on priority
* Added priority to RealtimePlumber executors. All sub-executors (non query runners) get Thread.MIN_PRIORITY
* Add persistThreadPriority and mergeThreadPriority to realtime tuning config
2016-01-20 14:00:31 -08:00