b40c342cd1
make Global stupid pool cache size configurable
2016-02-05 14:18:06 -06:00
9002548eeb
increase test time out and general clean up
2016-02-03 13:26:37 -06:00
5111fd52f2
Add check for log4j-core in Log4jShutterDownerModule
2016-02-02 15:56:48 -08:00
dc89cdd0f9
Merge pull request #2336 from himanshug/fix_2331
...
limit size of X-Druid-Response-Context header to 7K
2016-02-02 12:06:59 -06:00
c03918f89a
AsyncQueryForwardingServletTest#testDeleteBroadcast sometimes fails by port conflict
2016-01-29 19:28:58 +09:00
f6b4dbd697
bug fix and unit tests for DruidCoordinatorSegmentKiller
2016-01-28 14:10:17 -06:00
ab3edfa8fc
moving DruidCoordinatorSegmentKiller class out of DruidCoordinator
2016-01-28 14:03:56 -06:00
3880f54b87
Merge pull request #2332 from himanshug/configurable_partial
...
make populateUncoveredIntervals a configuration in query context
2016-01-28 10:34:35 +05:30
a7bde8f4da
limit size of X-Druid-Response-Context header to 7K due to https://github.com/druid-io/druid/issues/2331
2016-01-27 15:18:08 -06:00
5a3642bb93
Merge pull request #2247 from metamx/pedanticBuild
...
Enable strict building in travis
2016-01-27 10:27:03 -08:00
508734c8b0
Long constant reformatting in tests `l` --> `L`
2016-01-27 08:59:19 -08:00
fd6bf3fe22
Use interval comparator instead of bucketMonthComparator
...
fix when two segments have same interval
review comments
2016-01-27 17:35:43 +05:30
3719b6e3c8
make populateUncoveredIntervals a configuration in query context
2016-01-26 15:13:45 -06:00
7a6109f0ca
Merge pull request #2321 from gianm/pending-index
...
Replace two-column index on pendingSegments table with one-column index.
2016-01-22 13:38:15 -06:00
0bd9bff075
Replace two-column index on pendingSegments table with one-column index.
...
Fixes #2319 .
2016-01-22 10:50:21 -08:00
1a5d4e714c
Adding custom mapper for json processing exception to return bad request instead of 500
2016-01-22 09:48:52 -08:00
04d3054353
Merge pull request #2303 from CHOIJAEHONG1/localfirehouse-basedir-npe
...
Throw an IAE when baseDir is null in LocalFireHose
2016-01-21 07:58:52 -08:00
dcb7830330
Merge pull request #984 from drcrallen/thread-priority-rebase
...
Use thread priorities. (aka set `nice` values for background-like tasks)
2016-01-21 15:02:34 +05:30
2e1d6aaf3d
Use thread priorities. (aka set `nice` values for background-like tasks)
...
* Defaults the thread priority to java.util.Thread.NORM_PRIORITY in io.druid.indexing.common.task.AbstractTask
* Each exec service has its own Task Factory which is assigned a priority for spawned task. Therefore each priority class has a unique exec service
* Added priority to tasks as taskPriority in the task context. <0 means low, 0 means take default, >0 means high. It is up to any particular implementation to determine how to handle these numbers
* Add options to ForkingTaskRunner
* Add "-XX:+UseThreadPriorities" default option
* Add "-XX:ThreadPriorityPolicy=42" default option
* AbstractTask - Removed unneded @JsonIgnore on priority
* Added priority to RealtimePlumber executors. All sub-executors (non query runners) get Thread.MIN_PRIORITY
* Add persistThreadPriority and mergeThreadPriority to realtime tuning config
2016-01-20 14:00:31 -08:00
61aca6f9cc
remove wrong checks
...
sink never have null hydrants and hydrants never have null adapters
2016-01-20 23:43:53 +05:30
7132428bba
throw IAE when baseDir is null in LocalFireHose
2016-01-21 01:27:32 +09:00
59ea186af7
fix reference counting for segments
2016-01-20 17:24:21 +05:30
747343e621
Preserve dimension order across indexes during ingestion
2016-01-19 13:34:11 -08:00
df2906a91c
Merge pull request #2290 from gianm/index-merger-v9-stuff
...
Respect buildV9Directly in PlumberSchools, so it works on standalone realtime.
2016-01-19 13:04:00 -08:00
0c31f007fc
Merge pull request #1728 from himanshug/aggregators_in_segment_metadata
...
Store AggregatorFactory[] in segment metadata
2016-01-19 12:55:49 -08:00
fe841fd961
Merge pull request #2118 from guobingkun/fix_segment_loading
...
Fix loading segment for historical
2016-01-19 14:25:48 -06:00
a99aef29a1
adding aggregators to segment metadata
2016-01-19 14:23:39 -06:00
1dcf22edb7
Respect buildV9Directly in PlumberSchools, so it works on standalone realtime nodes.
...
Also parameterize some tests to run with/without buildV9Directly:
- IndexGeneratorJobTest
- RealtimeIndexTaskTest
- RealtimePlumberSchoolTest
2016-01-19 12:15:06 -08:00
c4ad50f92c
Fix loading segment for historical
...
Historical will drop a segment that shouldn't be dropped in the following scenario:
Historical node tried to load segmentA, but failed with SegmentLoadingException,
then ZkCoordinator called removeSegment(segmentA, blah) to schedule a runnable that would drop segmentA by deleting its files. Now, before that runnable executed, another LOAD request was sent to this historical, this time historical actually succeeded on loading segmentA and announced it. But later on, the scheduled drop-of-segment runnable started executing and removed the segment files, while historical is still announcing segmentA.
2016-01-19 10:29:49 -06:00
164b0aad7a
removing Map<String,Object> segmentMetadata from methods in Index[Maker/Merger] and using Metadata class
...
instead of a Map to store segment metadata
2016-01-18 22:03:46 -06:00
637d2605e7
kill unwanted parent directories when a segment is deleted from LocalDataSegmentKiller
2016-01-18 21:51:04 -06:00
f6a1a4ae20
Merge pull request #2138 from KurtYoung/feature-build-v9
...
build v9 directly
2016-01-16 13:35:46 -06:00
82ff98c2bf
add config for build v9 directly and update docs
2016-01-16 11:26:34 +08:00
2e54553a8f
Merge pull request #1990 from himanshug/schedule_kill_task
...
support periodic hard delete of segments
2016-01-15 15:22:33 -06:00
7c65880e55
Merge pull request #2270 from rasahner/warnOfChatHandlerNoop
...
if chathandler is noop, log using warn instead of info
2016-01-15 13:29:27 -07:00
34cd8f8c72
Merge pull request #2258 from fjy/acl-zk
...
acl for zookeeper is added
2016-01-15 10:27:08 -07:00
a54c726726
Merge pull request #2266 from anubhgup/fix-announce
...
Fix loss in segment announcements when segments do not fit in zNode
2016-01-14 17:10:43 -08:00
dc1a62c3d9
Merge pull request #2248 from metamx/druidNodeHashEquals
...
Add hashCode and equals to DruidNode
2016-01-14 16:04:58 -08:00
6d09ab839f
Fix for loss in segment announcements when segments do not fit in the znodes during compress mode.
...
Added unit test (from Navis).
2016-01-14 14:44:23 -08:00
7361cd173f
if chathandler is noop, log using warn instead of info
2016-01-14 10:12:42 -06:00
1908d63162
acl for zookeeper is added
2016-01-13 14:56:05 -08:00
18479bb757
time-descending result of timeseries queries
2016-01-13 12:23:01 +09:00
eb2d251ac8
support periodic hard delete of segments
2016-01-12 16:55:05 -06:00
01a0715ee2
Merge pull request #2161 from metamx/query-metrics-timeout
...
Fix Query metrics for query timeout
2016-01-12 09:50:40 -06:00
ef3cddabe9
adding UTs for DruidCoordinatorConfig
2016-01-11 22:03:25 -06:00
b0e04a9162
Add hashCode and equals to DruidNode
2016-01-11 15:23:45 -08:00
ea623e43d2
Merge pull request #2240 from metamx/fix-load-rule
...
Fix loadRule when one of the tiers had no available servers
2016-01-11 10:05:31 -08:00
32bc2f776e
Fix loadRule when one of the tiers had no servers
...
When one of the tiers have no servers, LoadRule should ignore that tier
and continue to load/drop segments in other available tiers.
the bug also causes whacky behavior with LoadRule with non existent
tier where the segment balancer keeps on moving segments to other nodes
in existing tiers but the extra segment copies are never dropped
eventually leading to all the tiers getting full .
2016-01-11 15:53:14 +05:30
d255f4baac
Merge pull request #2234 from pjain1/emit_realtime_metrics
...
emit handoff count metrics
2016-01-08 14:24:16 -06:00
9dba0f67e7
emit handoff count metrics
2016-01-08 12:36:13 -06:00
Himanshu Gupta
Parag Jain
Charles Allen
navis.ryu
Nishant
Xavier Léauté
Gian Merlino
Himank Chaudhary
Fangjin Yang
Charles Allen
Jaehong Choi
jon-wei
Jonathan Wei
Bingkun Guo
Kurt Young
David Lim
Anubhav Gupta
Robin
Nikita Geer