Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,788 Commits 111 Branches 503 Tags 721 MiB
Commit Graph

6788 Commits

Author SHA1 Message Date
Bingkun Guo b07db4089c fix doc: Setting druid.coordinator.merge.on will trigger an Append Task instead of Merge Task. 2016-01-26 10:20:32 -06:00
Xavier Léauté 1b2a568285 Merge pull request #2327 from abbondanza/master 
Updates number of parts in a topN query
 2016-01-25 10:12:47 -08:00
Rafael Abbondanza 145c65c72d Updates number of parts in a topN query 
This threw me off a bit, so I'm sure it may throw others off, too.
Updating from 10 to 11 parts.
 2016-01-25 10:29:25 -05:00
Harsh Jain 41730b96d4 Fix for issue 2021 2016-01-25 02:48:22 +05:30
Fangjin Yang fc32e34e1e Merge pull request #2324 from himanshug/ut 
unit test: adding single threaded indexing and querying test for IncrementalIndex
 2016-01-23 15:25:41 -08:00
Himanshu Gupta 09d3678667 adding single threaded indexing and querying test for IncrementalIndex 2016-01-23 00:17:14 -06:00
Charles Allen 0000b9fc62 Remove sorting in ProtoBufInputRowParserTest 
Due to processing/src/test/java/io/druid/data/input/ProtoBufInputRowParserTest.java
 2016-01-22 16:02:25 -08:00
Charles Allen e941303bc6 Remove sorting of dimensions in AvroStreamInputRowParserTest 
Due to https://github.com/druid-io/druid-api/pull/68
 2016-01-22 16:01:41 -08:00
Charles Allen 937ae6ad20 Update druid-api to 0.3.16 
Fixes https://github.com/druid-io/druid/issues/2316
 2016-01-22 14:37:16 -08:00
Fangjin Yang 073c101d72 Merge pull request #2322 from himanshug/fix_regression 
fixing regressions
 2016-01-22 12:52:50 -08:00
Himanshu 7a6109f0ca Merge pull request #2321 from gianm/pending-index 
Replace two-column index on pendingSegments table with one-column index.
 2016-01-22 13:38:15 -06:00
Himanshu Gupta dccf636676 adding null aggregators and false hasMultipleValues to expected results of segment metadata query 2016-01-22 13:28:25 -06:00
Himanshu Gupta 2f7f5119cf older segments might not have field bitmapSerdeFactory for dimension columns and we must use appropriate default 2016-01-22 13:28:25 -06:00
Xavier Léauté 789b35a108 Merge pull request #2264 from himank/CustomExceptionMapper 
Adding custom mapper for json processing exception
 2016-01-22 11:09:18 -08:00
Gian Merlino 0bd9bff075 Replace two-column index on pendingSegments table with one-column index. 
Fixes #2319.
 2016-01-22 10:50:21 -08:00
Himank Chaudhary 1a5d4e714c Adding custom mapper for json processing exception to return bad request instead of 500 2016-01-22 09:48:52 -08:00
Fangjin Yang df814247b9 Merge pull request #2318 from binlijin/rename_persistBackgroundCount 
rename persistBackgroundCount to numBackgroundPersistThreads
 2016-01-21 23:24:35 -08:00
binlijin cd1c71ceb4 rename persistBackgroundCount to numBackgroundPersistThreads 2016-01-22 14:29:41 +08:00
binlijin 1d1f4d996d Merge pull request #2111 from binlijin/optimize-create-inverted-indexes 
optimize create inverted indexes
 2016-01-22 11:36:27 +08:00
Fangjin Yang f03b65480f Merge pull request #2295 from gianm/segment-metadata-query-query-metadata 
SegmentMetadataQuery support for returning aggregators.
 2016-01-21 19:12:46 -08:00
binlijin 55f7dd4629 optimize create inverted indexes 2016-01-22 10:40:09 +08:00
Gian Merlino d416279c14 SegmentMetadataQuery support for returning aggregators. 2016-01-21 17:27:25 -08:00
Fangjin Yang 5a9cd89059 Merge pull request #2305 from gianm/segment-metadata-query-multivalues 
Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments
 2016-01-21 17:22:34 -08:00
Gian Merlino e5913be90e Merge pull request #2257 from tubemogul/index-merge-bug 
Adds support for empty merge metrics. fixes #2256
 2016-01-21 16:38:00 -08:00
Gian Merlino 87c8046c6c Add StorageAdapter#getColumnTypeName, and various SegmentMetadataQuery adjustments. 
SegmentMetadataQuery stuff:

- Simplify implementation of SegmentAnalyzer.
- Fix type names for realtime complex columns; this used to try to merge a nice type
  name (like "hyperUnique") from mmapped segments with the word "COMPLEX" from incremental
  index segments, leading to a merge failure. Now it always uses the nice name.
- Add hasMultipleValues to ColumnAnalysis.
- Add tests for both mmapped and incremental index segments.
- Update docs to include errorMessage.
 2016-01-21 15:50:33 -08:00
Fangjin Yang 3f998117a6 Merge pull request #2306 from jon-wei/inherit2 
More specific null/empty str handling in IndexMerger
 2016-01-21 14:36:09 -08:00
Michael Schiff 1e44445f06 Adds support for empty merge metrics. fixes #2256 2016-01-21 13:21:37 -08:00
jon-wei 459a236067 More specific null/empty str handling in IndexMerger 2016-01-21 12:24:38 -08:00
Slim a752bc064e Merge pull request #1978 from b-slim/graphite_emitter 
Graphite emitter
 2016-01-21 14:22:35 -06:00
Slim Bouguerra e0d90f875c Graphite emitter 2016-01-21 13:43:37 -06:00
Fangjin Yang ab635c5cd3 Merge pull request #2315 from rasahner/docUpdateBuild 
docs: edits related to loadList
 2016-01-21 09:52:27 -08:00
Robin c9368702fa do some editing of the instructions for using mysql for metadata 2016-01-21 10:37:30 -06:00
Fangjin Yang 04d3054353 Merge pull request #2303 from CHOIJAEHONG1/localfirehouse-basedir-npe 
Throw an IAE when baseDir is null in LocalFireHose
 2016-01-21 07:58:52 -08:00
Slim 201539260c Merge pull request #2076 from b-slim/issue_2010_upper_lower_extractionFN 
adding lower and upper extraction fn
 2016-01-21 09:58:07 -06:00
Slim Bouguerra 78feb3a13e adding lower and upper extraction fn 2016-01-21 08:59:05 -06:00
Nishant dcb7830330 Merge pull request #984 from drcrallen/thread-priority-rebase 
Use thread priorities. (aka set `nice` values for background-like tasks)
 2016-01-21 15:02:34 +05:30
Fangjin Yang 500c11a35a Merge pull request #2311 from metamx/commentsIn2309 
Minor field name change in RemoteTaskRunnerFactory to be more descriptive
 2016-01-20 19:27:49 -08:00
Charles Allen 66e74b1a63 Minor field name change in RemoteTaskRunnerFactory to be more descriptive 
* Addresses https://github.com/druid-io/druid/pull/2309#discussion_r50335081
 2016-01-20 17:43:20 -08:00
Gian Merlino 5a932d28c1 Merge pull request #2288 from tubemogul/index-merge-bug2 
Null check in IncrementalIndexAdapter.getDimValueLookup()
 2016-01-20 17:07:15 -08:00
Charles Allen 2a69a58570 Merge pull request #2149 from binlijin/master 
Do persist IncrementalIndex in another thread in IndexGeneratorReducer
 2016-01-20 17:06:42 -08:00
Fangjin Yang 067baf10f2 Merge pull request #2310 from metamx/testFor2308 
Add basic tests to some CliXXX classes
 2016-01-20 17:00:06 -08:00
Fangjin Yang 996c1173c6 Merge pull request #2223 from navis/besteffort-split-locations 
Best effort to find locations for input splits
 2016-01-20 16:53:43 -08:00
Charles Allen eddc18ecf2 Add basic tests to some CliXXX classes 2016-01-20 16:19:15 -08:00
Charles Allen 551d08da2a Merge pull request #2309 from metamx/fix2308 
Fix overlord scheduled executor injection
 2016-01-20 16:04:57 -08:00
Charles Allen 3152d08844 Fix overlord scheduled executor injection 
* Fixes https://github.com/druid-io/druid/issues/2308
 2016-01-20 14:16:14 -08:00
Charles Allen 2e1d6aaf3d Use thread priorities. (aka set `nice` values for background-like tasks) 
* Defaults the thread priority to java.util.Thread.NORM_PRIORITY in io.druid.indexing.common.task.AbstractTask
 * Each exec service has its own Task Factory which is assigned a priority for spawned task. Therefore each priority class has a unique exec service
 * Added priority to tasks as taskPriority in the task context. <0 means low, 0 means take default, >0 means high. It is up to any particular implementation to determine how to handle these numbers
 * Add options to ForkingTaskRunner
    * Add "-XX:+UseThreadPriorities" default option
    * Add "-XX:ThreadPriorityPolicy=42" default option
 * AbstractTask - Removed unneded @JsonIgnore on priority
 * Added priority to RealtimePlumber executors. All sub-executors (non query runners) get Thread.MIN_PRIORITY
 * Add persistThreadPriority and mergeThreadPriority to realtime tuning config
 2016-01-20 14:00:31 -08:00
Fangjin Yang 0c5f4b947c Merge pull request #2301 from metamx/fix-2299_2 
fix reference counting for segments
 2016-01-20 11:21:35 -08:00
Nishant 61aca6f9cc remove wrong checks 
sink never have null hydrants and hydrants never have null adapters
 2016-01-20 23:43:53 +05:30
Fangjin Yang 695f107870 Merge pull request #2302 from metamx/lowerCaseGranPathTest 
Make GranularityPathSpecTest check with lower-case enums
 2016-01-20 09:18:06 -08:00
Fangjin Yang 6f4dfbc8d1 Merge pull request #2296 from loganlinn/loganlinn-dataGranularity-type-doc 
Update batch-ingestion.md
 2016-01-20 08:58:49 -08:00