6303 Commits

Author SHA1 Message Date
Himanshu
9118b010c0 Merge pull request #1976 from noddi/feature/count-parameter-rules-history
Add count parameter to rules history endpoint.
2015-11-17 14:41:50 -06:00
Charles Allen
dbe201aeed Merge pull request #1929 from pjain1/jetty_threads
separate ingestion and query thread pool
2015-11-17 12:14:25 -08:00
Parag Jain
6c498b7d4a separate ingestion and query thread pool 2015-11-17 13:42:41 -06:00
Bartosz Ługowski
b0a444eafc Add count parameter to rules history endpoint. 2015-11-17 20:14:12 +01:00
Xavier Léauté
d7eb2f717e enable query caching on intermediate realtime persists 2015-11-17 10:58:00 -08:00
Xavier Léauté
71376efd57 make cache injection optional
allows enabling the CacheMonitor for all index tasks, even if some don't
bind any cache instance.
2015-11-16 22:40:01 -08:00
Xavier Léauté
0fb7e4e040 Merge pull request #1975 from gianm/query-to-strings
Better toString for groupBy, segmentMetadata queries.
2015-11-16 13:08:50 -08:00
Gian Merlino
57f213d536 Better toString for groupBy, segmentMetadata queries. 2015-11-16 12:54:59 -08:00
Charles Allen
acc1a215c7 Merge pull request #1968 from metamx/fix-integration-tests
Fix ITUnionQueryTest failing on machines with less than 4 cores
2015-11-13 15:19:54 -08:00
Nishant
4486b3fe8b Fix ITUnionQueryTest failing on machines with 1 core
ITUnionQueryTest runs 4 realtime tasks and runs a unionQuery over them,
the worker is not able to run all the tasks concurrently on machines
with less cpu cores as it picks default worker capacity.
Explicitly specify worker capacity to avoid this.
2015-11-13 13:46:36 -08:00
Charles Allen
46527a9610 Merge pull request #1954 from metamx/fix-stupid-aws-limit
EC2 autoscaler: avoid hitting aws filter limits
2015-11-13 10:52:35 -08:00
Fangjin Yang
846bef3d7a Merge pull request #1964 from metamx/update-docker-stuff
update integration-test docker instructions for docker-machine
2015-11-12 16:52:57 -08:00
Xavier Léauté
bd7d2c9b3a update integration-test docker instructions for docker-machine 2015-11-12 16:44:28 -08:00
Xavier Léauté
353e568cbd Merge pull request #1959 from jon-wei/indexadapter_getrows
Fix IncrementalIndexAdapter getRows() Iterable
2015-11-12 14:38:33 -08:00
jon-wei
cdceaf2d26 Fix IncrementalIndexAdapter getRows() Iterable 2015-11-12 13:10:42 -08:00
Charles Allen
af34e9c8cb Add the druid artifact version to metrics when emitted 2015-11-12 12:11:27 -08:00
Xavier Léauté
ef74cd394c Merge pull request #1960 from binlijin/master
optimize index merge
2015-11-12 11:38:20 -08:00
Fangjin Yang
4f46d457f1 Merge pull request #1947 from noddi/feature/count-parameter-history-endpoints
Add count parameter to history endpoints
2015-11-12 10:23:44 -08:00
Fangjin Yang
148153b47c Merge pull request #1897 from himanshug/new_sketch_aggregation
complex aggregator based on http://datasketches.github.io
2015-11-12 09:01:01 -08:00
Himanshu Gupta
7788f7c2a1 update doc with new thetaSketch api 2015-11-12 00:04:34 -06:00
Himanshu Gupta
338f88b86b further simplifying the api, users just need to use thetaSketch as aggregator 2015-11-12 00:04:34 -06:00
Himanshu Gupta
88ae3c43f9 changing names to be explicit about theta sketch algorithm
old names are still valid though so as to be backwards compatible for now
2015-11-12 00:04:34 -06:00
Himanshu Gupta
6c6a38cedb adding datasketches aggregator to documentation 2015-11-12 00:04:33 -06:00
Himanshu Gupta
9c569be11e adding datasketches module to top level pom 2015-11-12 00:04:33 -06:00
Himanshu Gupta
817cf41f5c druid aggregators based on datasketches lib http://datasketches.github.io/ 2015-11-12 00:04:33 -06:00
Xavier Léauté
749ac12f88 EC2 autoscaler: avoid hitting aws filter limits 2015-11-11 20:28:06 -08:00
binlijin
286b8f8c6f optimize index merge 2015-11-12 11:08:54 +08:00
Fangjin Yang
465cbcf9a7 Merge pull request #1956 from metamx/remove-unused-imports
Cleanup + remove unused imports
2015-11-11 17:36:47 -08:00
Gian Merlino
e4e5f0375b SegmentAllocateAction (fixes #1515)
This is a feature meant to allow realtime tasks to work without being told upfront
what shardSpec they should use (so we can potentially publish a variable number
of segments per interval).

The idea is that there is a "pendingSegments" table in the metadata store that
tracks allocated segments. Each one has a segment id (the same segment id we know
and love) and is also part of a sequence.

The sequences are an idea from @cheddar that offers a way of doing replication.
If there are N tasks reading exactly the same data with exactly the same logic
(think Kafka tasks reading a fixed range of offsets) then you can place them
in the same sequence, and they will generate the same sequence of segments.
2015-11-11 16:54:35 -08:00
Charles Allen
dc4ae59aaf Merge pull request #1865 from noddi/bugfix/issue-560
Fix #560 - datasource segments summary shouldn't include replication.
2015-11-11 15:29:08 -08:00
Bartosz Ługowski
6e5d2c6745 Add count parameter to history endpoints. 2015-11-11 23:03:57 +01:00
Fangjin Yang
9f78598672 Merge pull request #1950 from zhxiaogg/feature/ut_remote_task_action_client
add unit test for RemoteTaskActionClientTest
2015-11-11 12:29:54 -08:00
Gian Merlino
8e743b70c6 SegmentIdentifier, like a pre-DataSegment. 2015-11-11 12:25:43 -08:00
Xavier Léauté
e26f7fca36 cleanup cache interface 2015-11-11 12:25:22 -08:00
Xavier Léauté
fa6142e217 cleanup and remove unused imports 2015-11-11 12:25:21 -08:00
zhxiaog
c197a4cf32 fix #1918, add unit tests for RemoteTaskActionClient 2015-11-12 03:15:17 +08:00
Charles Allen
abae47850a Add backwards compatability for PR #1922 2015-11-11 10:27:00 -08:00
Xavier Léauté
b519fcf99b redirect to overlord console by default 2015-11-11 09:55:18 -08:00
Fangjin Yang
9e12a501fe Merge pull request #1946 from gianm/local-storage-better-permission-error
Better error message when LocalDataSegmentPusher cannot create its directory.
2015-11-11 09:02:25 -08:00
Gian Merlino
07157f9e9d Merge pull request #1945 from dclim/hadoop-spatial-dim
fix spatial dimension transformer to work with hadoop
2015-11-10 20:01:20 -08:00
Gian Merlino
f2c271e500 Better error message when LocalDataSegmentPusher cannot create its directory. 2015-11-10 19:49:01 -08:00
dclim
fd0935ecb9 fix spatial dimension transformer to work with hadoop 2015-11-10 19:16:51 -07:00
Gian Merlino
e75c2a407d Merge pull request #1944 from druid-io/fix-doc
fix website rendering for this doc
2015-11-10 16:04:40 -08:00
fjy
e923de3eea fix website rendering for this doc 2015-11-10 15:36:30 -08:00
Xavier Léauté
cf779946ef Merge pull request #1791 from guobingkun/event_receiver_firehose_monitor
EventReceiverFirehoseMonitor
2015-11-10 11:09:42 -08:00
Xavier Léauté
a57cbfd2c3 Merge pull request #1387 from metamx/enableShutdownLogging
Add special handler to allow logger messages during shutdown
2015-11-09 17:20:09 -08:00
fjy
46bf1ba5ef remove unneeded 2015-11-09 17:03:00 -08:00
fjy
8a8bb0369e address more comments 2015-11-09 16:56:43 -08:00
fjy
b99576d854 rework compares again 2015-11-09 16:40:07 -08:00
fjy
0b319093df New comparisons for Druid 2015-11-09 14:31:23 -08:00