Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,180 Commits 111 Branches 503 Tags 721 MiB
Commit Graph

6180 Commits

Author SHA1 Message Date
Himanshu Gupta 338f88b86b further simplifying the api, users just need to use thetaSketch as aggregator 2015-11-12 00:04:34 -06:00
Himanshu Gupta 88ae3c43f9 changing names to be explicit about theta sketch algorithm 
old names are still valid though so as to be backwards compatible for now
 2015-11-12 00:04:34 -06:00
Himanshu Gupta 6c6a38cedb adding datasketches aggregator to documentation 2015-11-12 00:04:33 -06:00
Himanshu Gupta 9c569be11e adding datasketches module to top level pom 2015-11-12 00:04:33 -06:00
Himanshu Gupta 817cf41f5c druid aggregators based on datasketches lib http://datasketches.github.io/ 2015-11-12 00:04:33 -06:00
Xavier Léauté 749ac12f88 EC2 autoscaler: avoid hitting aws filter limits 2015-11-11 20:28:06 -08:00
binlijin 286b8f8c6f optimize index merge 2015-11-12 11:08:54 +08:00
Fangjin Yang 465cbcf9a7 Merge pull request #1956 from metamx/remove-unused-imports 
Cleanup + remove unused imports
 2015-11-11 17:36:47 -08:00
Gian Merlino e4e5f0375b SegmentAllocateAction (fixes #1515) 
This is a feature meant to allow realtime tasks to work without being told upfront
what shardSpec they should use (so we can potentially publish a variable number
of segments per interval).

The idea is that there is a "pendingSegments" table in the metadata store that
tracks allocated segments. Each one has a segment id (the same segment id we know
and love) and is also part of a sequence.

The sequences are an idea from @cheddar that offers a way of doing replication.
If there are N tasks reading exactly the same data with exactly the same logic
(think Kafka tasks reading a fixed range of offsets) then you can place them
in the same sequence, and they will generate the same sequence of segments.
 2015-11-11 16:54:35 -08:00
Charles Allen dc4ae59aaf Merge pull request #1865 from noddi/bugfix/issue-560 
Fix #560 - datasource segments summary shouldn't include replication.
 2015-11-11 15:29:08 -08:00
Bartosz Ługowski 6e5d2c6745 Add count parameter to history endpoints. 2015-11-11 23:03:57 +01:00
Fangjin Yang 9f78598672 Merge pull request #1950 from zhxiaogg/feature/ut_remote_task_action_client 
add unit test for RemoteTaskActionClientTest
 2015-11-11 12:29:54 -08:00
Gian Merlino 8e743b70c6 SegmentIdentifier, like a pre-DataSegment. 2015-11-11 12:25:43 -08:00
Xavier Léauté e26f7fca36 cleanup cache interface 2015-11-11 12:25:22 -08:00
Xavier Léauté fa6142e217 cleanup and remove unused imports 2015-11-11 12:25:21 -08:00
zhxiaog c197a4cf32 fix #1918, add unit tests for RemoteTaskActionClient 2015-11-12 03:15:17 +08:00
Fangjin Yang 9e12a501fe Merge pull request #1946 from gianm/local-storage-better-permission-error 
Better error message when LocalDataSegmentPusher cannot create its directory.
 2015-11-11 09:02:25 -08:00
Gian Merlino 07157f9e9d Merge pull request #1945 from dclim/hadoop-spatial-dim 
fix spatial dimension transformer to work with hadoop
 2015-11-10 20:01:20 -08:00
Gian Merlino f2c271e500 Better error message when LocalDataSegmentPusher cannot create its directory. 2015-11-10 19:49:01 -08:00
dclim fd0935ecb9 fix spatial dimension transformer to work with hadoop 2015-11-10 19:16:51 -07:00
Gian Merlino e75c2a407d Merge pull request #1944 from druid-io/fix-doc 
fix website rendering for this doc
 2015-11-10 16:04:40 -08:00
fjy e923de3eea fix website rendering for this doc 2015-11-10 15:36:30 -08:00
Xavier Léauté cf779946ef Merge pull request #1791 from guobingkun/event_receiver_firehose_monitor 
EventReceiverFirehoseMonitor
 2015-11-10 11:09:42 -08:00
Xavier Léauté a57cbfd2c3 Merge pull request #1387 from metamx/enableShutdownLogging 
Add special handler to allow logger messages during shutdown
 2015-11-09 17:20:09 -08:00
fjy 46bf1ba5ef remove unneeded 2015-11-09 17:03:00 -08:00
fjy 8a8bb0369e address more comments 2015-11-09 16:56:43 -08:00
fjy b99576d854 rework compares again 2015-11-09 16:40:07 -08:00
fjy 0b319093df New comparisons for Druid 2015-11-09 14:31:23 -08:00
Gian Merlino afd67a39a1 Merge pull request #1940 from metamx/repackageGuiceJackson 
Move Jackson Guice adapters into io.druid
 2015-11-09 14:08:38 -08:00
Fangjin Yang 78b42c1087 Merge pull request #1941 from guobingkun/custom_extension 
add doc for bundling custom extensions with other Druid extensions
 2015-11-09 11:32:33 -08:00
Bingkun Guo b24eccfb9e add doc for bundling custom extensions with other Druid extensions 2015-11-09 13:11:22 -06:00
Charles Allen 1df4baf489 Move Jackson Guice adapters into io.druid 
* Removes access to protected methods in com.fasterxml
* Eliminates druid-common's use of foreign package com.fasterxml
 2015-11-09 10:50:45 -08:00
Xavier Léauté 7816d67148 Merge pull request #1935 from gianm/unbuffered-ftr-logging 
ForkingTaskRunner: Log without buffering.
 2015-11-07 17:17:24 -08:00
Fangjin Yang fe6efb6367 Merge pull request #1932 from gianm/data-schema-exclude-metric-names 
DataSchema: Exclude metric names from dimension list.
 2015-11-07 15:22:33 -08:00
Gian Merlino fc55314d1c ForkingTaskRunner: Log without buffering. 
In #933 the ForkingTaskRunner's logging was changed to buffered from
unbuffered. This means that the last few KB of the logs are generally
not visible while a task is running, which makes debugging running
tasks difficult.
 2015-11-07 15:16:53 -08:00
Bartosz Ługowski 8b5de492cc Fix #560 - datasource segments summary shouldn't include replication. 2015-11-07 21:43:47 +01:00
Gian Merlino 6b908a5061 DataSchema: Exclude metric names from dimension list. 
Otherwise we could end up with a metric and a dimension with the same column name.
 2015-11-07 12:25:36 -08:00
Charles Allen 61139b9dfa Merge pull request #1912 from b-slim/in_filter 
Adding in filter
 2015-11-06 14:47:47 -08:00
Slim Bouguerra c511273efd adding in filter 2015-11-06 16:23:24 -06:00
Xavier Léauté e9533db987 Merge pull request #1850 from metamx/friendlyBardCache 
Allow setting upper limit on the number of cache segments a broker will try to fetch.
 2015-11-06 10:25:49 -08:00
Gian Merlino dfbd0e2b60 Merge pull request #1925 from gianm/fix-index-generator 
Fix reference to INDEX_MAKER in IndexGeneratorJob.
 2015-11-06 09:56:30 -08:00
Gian Merlino 0e75642e01 Merge pull request #1923 from himanshug/fix_index_generator_job 
remove LoggingProgressIndicator from IndexGeneratorJob
 2015-11-06 09:26:06 -08:00
Charles Allen cf8b9a8613 Merge pull request #1920 from metamx/upgrade-curator 
Update curator to 2.9.1
 2015-11-06 09:25:27 -08:00
Gian Merlino 75122dc396 Fix reference to INDEX_MAKER in IndexGeneratorJob. 2015-11-06 09:19:58 -08:00
Himanshu Gupta 6bed633121 do not use LoggingProcessIndicator in IndexGeneratorJob because that uses Stopwatch methods from guava not available in older guava versions, this makes the behavior same as LegacyIndexGeneratorJob 2015-11-06 00:40:51 -06:00
Xavier Léauté c896818241 Update curator to 2.9.1 
Lots of bugfixes since 2.8.0
- https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314425&version=12333324
- https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314425&version=12332392
 2015-11-05 15:53:01 -08:00
Fangjin Yang 379ca87e6a Merge pull request #1919 from metamx/old-todo 
fix a very old todo
 2015-11-05 13:33:06 -08:00
Xavier Léauté 223d1ebe9f fix a very old todo 2015-11-05 13:00:30 -08:00
Xavier Léauté 7cbff731e3 Merge pull request #1917 from gianm/math-is-hard 
RemoteTaskActionClient: Fix statusCode check.
 2015-11-05 11:25:41 -08:00
Gian Merlino cb409ee928 RemoteTaskActionClient: Fix statusCode check. 2015-11-05 10:03:49 -08:00