a355bfb7a9
Fix default TaskResource for RealtimeIndexTasks.
...
It was supposed to be the same as the task id, but it wasn't because
"makeTaskId" has a random component.
2016-03-01 16:54:22 -08:00
c82b680cd4
Merge pull request #2565 from sascha-coenen/feature-pulldeps-local-mvn-repo
...
pointing pull-deps tool to local maven repository
2016-03-01 13:26:18 -08:00
9340cae985
Merge pull request #2457 from bjozet/docs/fixes
...
Default value for maxRowsInMemory
2016-03-01 07:43:26 -08:00
2462c82c0e
New defaults for maxRowsInMemory rowFlushBoundary
...
To bring consistency to docs and source this commit changes the default
values for maxRowsInMemory and rowFlushBoundary to 75000 after
discussion in PR https://github.com/druid-io/druid/pull/2457 .
The previous default was 500000 and it's lower now on the grounds that
it's better for a default to be somewhat less efficient, and work,
than to reach for the stars and possibly result in
"OutOfMemoryError: java heap space" errors.
2016-03-01 13:50:28 +01:00
31b502773a
Merge pull request #2480 from navis/pagingfail-over-segments
...
Select query cannot span to next segment with paging
2016-03-01 11:42:41 +05:30
55c9320671
Merge pull request #2542 from guobingkun/fix_multiple_specs
...
[Fix Bug] Realtime Node may double count query results when multiple spec files are specified.
2016-02-29 15:53:14 -06:00
4edcb1b861
Refactor FireChief + UTs for RealtimeManagerTest
...
Add tests that verify whether RealtimeManager is querying the correct FireChief for a specific partition
make FireChief static and package private, add latches in the UT
2016-02-29 14:41:10 -06:00
e5c25725c0
Merge pull request #2562 from himanshug/fix_2556
...
with nested GpBy query outer query results need to be further merged
2016-02-29 12:17:33 -08:00
5b3d99c412
pointing pull-deps tool to local maven repository
2016-02-29 21:13:00 +01:00
68631d89e9
Allow realtime nodes to have multiple shards of the same datasource
2016-02-29 12:30:25 -06:00
14a306c553
Merge pull request #2553 from guobingkun/versioning_mysql
...
Give mysql tarball a version
2016-02-29 10:59:23 -06:00
0722ced413
with GpBy query outer query results need to be further merged
2016-02-29 10:16:25 -06:00
5aa1164b1a
Merge pull request #2482 from navis/lazy-init-boundfilter
...
Lazily initialize predicate for bound filter
2016-02-29 07:18:35 -06:00
b1ff920831
Lazily initialize predicate for bound filter
2016-02-29 15:35:52 +09:00
5f1e60324a
Added more complex test case with versioned segments
2016-02-29 14:48:24 +09:00
aa871b9353
versioning mysql tarball
2016-02-28 16:21:26 -06:00
2686bfa394
Select query cannot span to next segment with paging
2016-02-29 00:01:46 +09:00
8f97b1e40c
Merge pull request #2554 from guobingkun/improve_include_extensions
...
improve doc on including druid and hadoop extensions
2016-02-26 20:05:57 -08:00
dd060eb826
Merge pull request #2558 from gianm/hdfs-log-overwrite
...
HdfsTaskLogs: Allow overwriting existing logs.
2016-02-26 15:50:51 -08:00
7e70881101
HdfsTaskLogs: Allow overwriting existing logs.
...
Necessary because ForkingTaskRunner pushes logs when gracefully stopping,
but it may need to re-push those logs when the task finishes for real after
restoring.
2016-02-26 15:10:19 -08:00
ca1bf648d1
Merge pull request #2533 from metamx/javaOptsArray
...
Allow specifying peon javaOpts as an array
2016-02-26 14:05:49 -08:00
c6803c4364
Allow specifying peon javaOpts as an array
2016-02-26 13:24:35 -08:00
18f9e05f0f
improve doc on including druid and hadoop extensions
2016-02-26 13:53:08 -06:00
eb13d7afe3
Merge pull request #2521 from himanshug/fix_2497
...
RTR has multiple threads for assignment of pending tasks now
2016-02-26 08:14:15 -08:00
9f8faabddb
Merge pull request #2469 from pdeva/patch-10
...
correct service names
2016-02-26 21:15:58 +05:30
bc156effe7
RTR has multiple threads for assignment of pending tasks now.
2016-02-26 09:27:03 -06:00
1fe277ee29
Merge pull request #2367 from se7entyse7en/feature-rackspace-cloud-files-static-firehose
...
Adds support to use Rackspace's cloudfiles as static firehose
2016-02-25 17:31:06 -08:00
29d29ba98d
Merge pull request #2263 from jon-wei/flex_dims3
...
Allow IncrementalIndex to store Long/Float dimensions
2016-02-25 17:23:02 -08:00
3a9fe2aad0
Merge pull request #2231 from lizhanhui/pull_request
...
Add druid-rocketmq module
2016-02-25 17:19:57 -08:00
3691fbd849
Merge pull request #2548 from metamx/moreLoggingJDBCNamespace
...
More logging for JDBCExtractionNamespaceFunctionFactory
2016-02-25 17:13:20 -08:00
53a5f07c14
Merge pull request #2544 from metamx/fixMaxPort
...
Limit PortFinder to 0xFFFF
2016-02-25 17:12:53 -08:00
143e85eaa5
Merge pull request #2419 from gianm/task-hostports
...
Plumb task peon host/ports back out to the overlord.
2016-02-25 17:11:53 -08:00
e987e2d73d
Merge pull request #2552 from gianm/fix-dumb-bug
...
Fix parsing of druid.indexer.server.maxChatRequests.
2016-02-25 15:49:24 -08:00
b331fb4a83
Fix parsing of druid.indexer.server.maxChatRequests.
2016-02-25 14:47:15 -08:00
a8820d837b
More logging for JDBCExtractionNamespaceFunctionFactory
2016-02-25 09:48:56 -08:00
4c522a8159
Merge pull request #2543 from metamx/fixUnregisterChildPorts
...
UnRegister port in ForkingTaskRunner
2016-02-25 22:32:31 +05:30
3fa7a7ebfe
Limit PortFinder to 0xFFFF
2016-02-25 08:16:40 -08:00
187b788089
UnRegister port in ForkingTaskRunner
2016-02-25 08:04:25 -08:00
cf0bc905fb
Plumb task peon host/ports back out to the overlord.
...
- Add TaskLocation class
- Add registerListener to TaskRunner
- Add getLocation to TaskRunnerWorkItem
- Implement location tracking in existing TaskRunners
- Rework WorkerTaskMonitor to do management out of a single thread so it can
handle status and location updates more simply.
2016-02-24 15:13:10 -08:00
917e7e58f5
Merge pull request #2536 from jon-wei/regex_extraction_rename
...
Rename 'replaceMissingValues...' parameters in RegexExtractionFn
2016-02-24 14:41:06 -08:00
c17ce02467
Allow IncrementalIndex to store Long/Float dimensions
2016-02-24 13:51:57 -08:00
fd3782522c
Rename 'replaceMissingValues...' parameters in RegexExtractionFn
2016-02-24 13:12:56 -08:00
6ac32c5518
Merge pull request #2530 from himanshug/fix_plumber
...
In persistAndMerge, increase the scope of try-catch block so that any…
2016-02-24 22:41:32 +05:30
fb7eae34ed
Merge pull request #2249 from metamx/workerExpanded
...
Use Worker instead of ZkWorker whenever possible
2016-02-24 13:23:22 +05:30
a3b37e9225
In persistAndMerge, increase the scope of try-catch block so that any exception while persisting hydrants is caught and consequently that sink is abandoned or the task will forever wait for handoff to happen.
2016-02-23 22:22:33 -06:00
6c9e1a28ad
Merge pull request #2519 from gianm/unparseable-handling
...
Better handling of ParseExceptions.
2016-02-24 04:46:29 +05:30
ac13a5942a
Use Worker instead of ZkWorker whenver possible
...
* Moves last run task state information to Worker
* Makes WorkerTaskRunner a TaskRunner which has interfaces to help with getting information about a Worker
2016-02-23 15:02:03 -08:00
93540c0631
Merge pull request #2503 from gianm/jetty-qos
...
Add druid.indexer.server.maxChatRequests for QoS; deprecate separate ports.
2016-02-23 10:35:53 -08:00
4f300cfe49
Merge pull request #2526 from druid-io/b-slim-patch-1
...
fix docs about sketches
2016-02-23 10:23:53 -08:00
3534483433
Better handling of ParseExceptions.
...
Two changes:
- Allow IncrementalIndex to suppress ParseExceptions on "aggregate".
- Add "reportParseExceptions" option to realtime tuning configs. By default this is "false".
Behavior of the counters should now be:
- processed: Number of rows indexed, including rows where some fields could be parsed and some could not.
- thrownAway: Number of rows thrown away due to rejection policy.
- unparseable: Number of rows thrown away due to being completely unparseable (no fields salvageable at all).
If "reportParseExceptions" is true then "unparseable" will always be zero (because a parse error would
cause an exception to be thrown). In addition, "processed" will only include fully parseable rows
(because even partial parse failures will cause exceptions to be thrown).
Fixes #2510 .
2016-02-23 10:11:43 -08:00
Gian Merlino
Charles Allen
Fangjin Yang
Björn Zettergren
Nishant
Himanshu
Bingkun Guo
Sascha Coenen
Eric Tschetter
Slim
navis.ryu
jon-wei