Himanshu Gupta
9c569be11e
adding datasketches module to top level pom
2015-11-12 00:04:33 -06:00
Himanshu Gupta
817cf41f5c
druid aggregators based on datasketches lib http://datasketches.github.io/
2015-11-12 00:04:33 -06:00
Xavier Léauté
749ac12f88
EC2 autoscaler: avoid hitting aws filter limits
2015-11-11 20:28:06 -08:00
binlijin
286b8f8c6f
optimize index merge
2015-11-12 11:08:54 +08:00
Fangjin Yang
465cbcf9a7
Merge pull request #1956 from metamx/remove-unused-imports
...
Cleanup + remove unused imports
2015-11-11 17:36:47 -08:00
Gian Merlino
e4e5f0375b
SegmentAllocateAction ( fixes #1515 )
...
This is a feature meant to allow realtime tasks to work without being told upfront
what shardSpec they should use (so we can potentially publish a variable number
of segments per interval).
The idea is that there is a "pendingSegments" table in the metadata store that
tracks allocated segments. Each one has a segment id (the same segment id we know
and love) and is also part of a sequence.
The sequences are an idea from @cheddar that offers a way of doing replication.
If there are N tasks reading exactly the same data with exactly the same logic
(think Kafka tasks reading a fixed range of offsets) then you can place them
in the same sequence, and they will generate the same sequence of segments.
2015-11-11 16:54:35 -08:00
Charles Allen
dc4ae59aaf
Merge pull request #1865 from noddi/bugfix/issue-560
...
Fix #560 - datasource segments summary shouldn't include replication.
2015-11-11 15:29:08 -08:00
Bartosz Ługowski
6e5d2c6745
Add count parameter to history endpoints.
2015-11-11 23:03:57 +01:00
Fangjin Yang
9f78598672
Merge pull request #1950 from zhxiaogg/feature/ut_remote_task_action_client
...
add unit test for RemoteTaskActionClientTest
2015-11-11 12:29:54 -08:00
Gian Merlino
8e743b70c6
SegmentIdentifier, like a pre-DataSegment.
2015-11-11 12:25:43 -08:00
Xavier Léauté
e26f7fca36
cleanup cache interface
2015-11-11 12:25:22 -08:00
Xavier Léauté
fa6142e217
cleanup and remove unused imports
2015-11-11 12:25:21 -08:00
zhxiaog
c197a4cf32
fix #1918 , add unit tests for RemoteTaskActionClient
2015-11-12 03:15:17 +08:00
Charles Allen
abae47850a
Add backwards compatability for PR #1922
2015-11-11 10:27:00 -08:00
Xavier Léauté
b519fcf99b
redirect to overlord console by default
2015-11-11 09:55:18 -08:00
Fangjin Yang
9e12a501fe
Merge pull request #1946 from gianm/local-storage-better-permission-error
...
Better error message when LocalDataSegmentPusher cannot create its directory.
2015-11-11 09:02:25 -08:00
Gian Merlino
07157f9e9d
Merge pull request #1945 from dclim/hadoop-spatial-dim
...
fix spatial dimension transformer to work with hadoop
2015-11-10 20:01:20 -08:00
Gian Merlino
f2c271e500
Better error message when LocalDataSegmentPusher cannot create its directory.
2015-11-10 19:49:01 -08:00
dclim
fd0935ecb9
fix spatial dimension transformer to work with hadoop
2015-11-10 19:16:51 -07:00
Gian Merlino
e75c2a407d
Merge pull request #1944 from druid-io/fix-doc
...
fix website rendering for this doc
2015-11-10 16:04:40 -08:00
fjy
e923de3eea
fix website rendering for this doc
2015-11-10 15:36:30 -08:00
Xavier Léauté
cf779946ef
Merge pull request #1791 from guobingkun/event_receiver_firehose_monitor
...
EventReceiverFirehoseMonitor
2015-11-10 11:09:42 -08:00
Xavier Léauté
a57cbfd2c3
Merge pull request #1387 from metamx/enableShutdownLogging
...
Add special handler to allow logger messages during shutdown
2015-11-09 17:20:09 -08:00
fjy
46bf1ba5ef
remove unneeded
2015-11-09 17:03:00 -08:00
fjy
8a8bb0369e
address more comments
2015-11-09 16:56:43 -08:00
fjy
b99576d854
rework compares again
2015-11-09 16:40:07 -08:00
fjy
0b319093df
New comparisons for Druid
2015-11-09 14:31:23 -08:00
Gian Merlino
afd67a39a1
Merge pull request #1940 from metamx/repackageGuiceJackson
...
Move Jackson Guice adapters into io.druid
2015-11-09 14:08:38 -08:00
Fangjin Yang
78b42c1087
Merge pull request #1941 from guobingkun/custom_extension
...
add doc for bundling custom extensions with other Druid extensions
2015-11-09 11:32:33 -08:00
Bingkun Guo
b24eccfb9e
add doc for bundling custom extensions with other Druid extensions
2015-11-09 13:11:22 -06:00
Charles Allen
1df4baf489
Move Jackson Guice adapters into io.druid
...
* Removes access to protected methods in com.fasterxml
* Eliminates druid-common's use of foreign package com.fasterxml
2015-11-09 10:50:45 -08:00
Xavier Léauté
7816d67148
Merge pull request #1935 from gianm/unbuffered-ftr-logging
...
ForkingTaskRunner: Log without buffering.
2015-11-07 17:17:24 -08:00
Fangjin Yang
fe6efb6367
Merge pull request #1932 from gianm/data-schema-exclude-metric-names
...
DataSchema: Exclude metric names from dimension list.
2015-11-07 15:22:33 -08:00
Gian Merlino
fc55314d1c
ForkingTaskRunner: Log without buffering.
...
In #933 the ForkingTaskRunner's logging was changed to buffered from
unbuffered. This means that the last few KB of the logs are generally
not visible while a task is running, which makes debugging running
tasks difficult.
2015-11-07 15:16:53 -08:00
Bartosz Ługowski
8b5de492cc
Fix #560 - datasource segments summary shouldn't include replication.
2015-11-07 21:43:47 +01:00
Gian Merlino
6b908a5061
DataSchema: Exclude metric names from dimension list.
...
Otherwise we could end up with a metric and a dimension with the same column name.
2015-11-07 12:25:36 -08:00
Charles Allen
61139b9dfa
Merge pull request #1912 from b-slim/in_filter
...
Adding in filter
2015-11-06 14:47:47 -08:00
Slim Bouguerra
c511273efd
adding in filter
2015-11-06 16:23:24 -06:00
Xavier Léauté
e9533db987
Merge pull request #1850 from metamx/friendlyBardCache
...
Allow setting upper limit on the number of cache segments a broker will try to fetch.
2015-11-06 10:25:49 -08:00
Gian Merlino
dfbd0e2b60
Merge pull request #1925 from gianm/fix-index-generator
...
Fix reference to INDEX_MAKER in IndexGeneratorJob.
2015-11-06 09:56:30 -08:00
Gian Merlino
0e75642e01
Merge pull request #1923 from himanshug/fix_index_generator_job
...
remove LoggingProgressIndicator from IndexGeneratorJob
2015-11-06 09:26:06 -08:00
Charles Allen
cf8b9a8613
Merge pull request #1920 from metamx/upgrade-curator
...
Update curator to 2.9.1
2015-11-06 09:25:27 -08:00
Gian Merlino
75122dc396
Fix reference to INDEX_MAKER in IndexGeneratorJob.
2015-11-06 09:19:58 -08:00
Himanshu Gupta
6bed633121
do not use LoggingProcessIndicator in IndexGeneratorJob because that uses Stopwatch methods from guava not available in older guava versions, this makes the behavior same as LegacyIndexGeneratorJob
2015-11-06 00:40:51 -06:00
Charles Allen
929b981710
Change DefaultObjectMapper to NOT overwrite final fields unless explicitly asked to
2015-11-05 18:10:13 -08:00
Xavier Léauté
c896818241
Update curator to 2.9.1
...
Lots of bugfixes since 2.8.0
- https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314425&version=12333324
- https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12314425&version=12332392
2015-11-05 15:53:01 -08:00
Fangjin Yang
379ca87e6a
Merge pull request #1919 from metamx/old-todo
...
fix a very old todo
2015-11-05 13:33:06 -08:00
Xavier Léauté
223d1ebe9f
fix a very old todo
2015-11-05 13:00:30 -08:00
Xavier Léauté
7cbff731e3
Merge pull request #1917 from gianm/math-is-hard
...
RemoteTaskActionClient: Fix statusCode check.
2015-11-05 11:25:41 -08:00
Gian Merlino
cb409ee928
RemoteTaskActionClient: Fix statusCode check.
2015-11-05 10:03:49 -08:00
