cheddar
f71b941a1a
1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer
...
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
2013-04-26 19:19:54 -05:00
cheddar
dde50a0d87
1) Remove references to zkclient
...
2) Eradicate zkclient from the poms!
2013-04-26 19:19:53 -05:00
cheddar
43d630c098
1) Replace InventoryManagers with Curator-based Inventory Managers
...
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook
Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
Gian Merlino
341ee27419
Changes to allow pushing events directly to realtime tasks, and the creation
...
of single-segment realtime tasks.
Realtime:
- Move firehose stuff to com.metamx.druid.realtime.firehose package
- ClippedFirehoseFactory provides a time-clipped view
- TimedShutoffFirehoseFactory shuts off at a particular time
Indexer:
- Split StringInputRowParser into {String,Map}InputRowParser
Merger:
- Remove minTime in favor of clipped firehoses
- Add task executor servlet that can push events to EventReceivers
- Add EventReceivingFirehose that accepts events as an EventReceiver
2013-04-25 14:06:46 +03:00
Gian Merlino
deefa870ec
[maven-release-plugin] prepare for next development iteration
2013-04-19 17:15:07 -07:00
Gian Merlino
5ea1a77a45
[maven-release-plugin] prepare release druid-0.4.0
2013-04-19 17:15:00 -07:00
xvrl
db2f3aa761
fix pom versions
2013-04-16 09:53:34 -07:00
Gian Merlino
a166344297
[maven-release-plugin] prepare for next development iteration
2013-04-15 18:55:53 -07:00
Gian Merlino
21c2aa5793
[maven-release-plugin] prepare release druid-0.3.38
2013-04-15 18:55:46 -07:00
Gian Merlino
d879c9a41e
[maven-release-plugin] prepare for next development iteration
2013-04-15 18:17:42 -07:00
Gian Merlino
c3d229df7f
[maven-release-plugin] prepare release druid-0.3.37
2013-04-15 18:17:36 -07:00
Gian Merlino
128b873022
[maven-release-plugin] prepare for next development iteration
2013-04-15 16:43:53 -07:00
Gian Merlino
eb80429177
[maven-release-plugin] prepare release druid-0.3.36
2013-04-15 16:43:47 -07:00
Gian Merlino
beff15f8d4
[maven-release-plugin] prepare for next development iteration
2013-04-15 15:03:26 -07:00
Gian Merlino
b71ae8ade3
[maven-release-plugin] prepare release druid-0.3.35
2013-04-15 15:03:20 -07:00
cheddar
a678f08b67
Merge pull request #118 from darxriggs/master
...
cleanup & refactoring
2013-04-09 18:56:59 -07:00
Fangjin Yang
6fe9707f96
[maven-release-plugin] prepare for next development iteration
2013-04-08 11:26:37 -07:00
Fangjin Yang
f0ab28be90
[maven-release-plugin] prepare release druid-0.3.34
2013-04-08 11:26:32 -07:00
René Scheibe
6c27cd2e8e
cleanup - removed unused imports
2013-04-07 23:31:22 +02:00
René Scheibe
a6dc29cf85
cleanup - removed extra empty lines
...
- there should not be any adjacent empty lines
2013-04-07 14:32:09 +02:00
Fangjin Yang
8b100248a8
[maven-release-plugin] prepare for next development iteration
2013-04-01 17:17:50 -07:00
Fangjin Yang
bbb3991bc9
[maven-release-plugin] prepare release druid-0.3.33
2013-04-01 17:17:44 -07:00
Fangjin Yang
e8c6936aca
[maven-release-plugin] prepare for next development iteration
2013-04-01 14:28:43 -07:00
Fangjin Yang
1f342dc0f2
[maven-release-plugin] prepare release druid-0.3.32
2013-04-01 14:28:36 -07:00
Fangjin Yang
30465b5c26
[maven-release-plugin] prepare for next development iteration
2013-03-28 19:48:46 -07:00
Fangjin Yang
1515dddfe0
[maven-release-plugin] prepare release druid-0.3.31
2013-03-28 19:48:39 -07:00
Fangjin Yang
04a46fb74f
[maven-release-plugin] prepare for next development iteration
2013-03-28 19:21:14 -07:00
Fangjin Yang
36601ee3aa
[maven-release-plugin] prepare release druid-0.3.30
2013-03-28 19:21:07 -07:00
Fangjin Yang
9e54e11827
[maven-release-plugin] prepare for next development iteration
2013-03-27 11:55:48 -07:00
Fangjin Yang
8fee044c68
[maven-release-plugin] prepare release druid-0.3.29
2013-03-27 11:55:38 -07:00
Fangjin Yang
e785b87be0
[maven-release-plugin] prepare for next development iteration
2013-03-26 11:10:15 -07:00
Fangjin Yang
a97287fa50
[maven-release-plugin] prepare release druid-0.3.28
2013-03-26 11:10:04 -07:00
Fangjin Yang
efd57dcf38
[maven-release-plugin] prepare for next development iteration
2013-03-25 13:17:50 -07:00
Fangjin Yang
3d7a0ea2d3
[maven-release-plugin] prepare release druid-0.3.27
2013-03-25 13:17:43 -07:00
Eric Tschetter
35cfd1f186
[maven-release-plugin] prepare for next development iteration
2013-03-21 13:14:20 -05:00
Eric Tschetter
3860710f11
[maven-release-plugin] prepare release druid-0.3.26
2013-03-21 13:14:14 -05:00
Eric Tschetter
f47319f118
[maven-release-plugin] prepare for next development iteration
2013-03-18 17:09:01 -05:00
Eric Tschetter
1066144b43
[maven-release-plugin] prepare release druid-0.3.25
2013-03-18 17:08:56 -05:00
Eric Tschetter
cba404a65d
[maven-release-plugin] prepare for next development iteration
2013-03-18 13:02:40 -05:00
Eric Tschetter
29a0a7e6c6
[maven-release-plugin] prepare release druid-0.3.24
2013-03-18 13:02:33 -05:00
Fangjin Yang
b9de751b32
[maven-release-plugin] prepare for next development iteration
2013-03-15 14:32:31 -07:00
Fangjin Yang
57655f19c4
[maven-release-plugin] prepare release druid-0.3.23
2013-03-15 14:32:24 -07:00
Eric Tschetter
7dacf952d6
[maven-release-plugin] prepare for next development iteration
2013-03-15 13:53:39 -05:00
Eric Tschetter
ff017fe72a
[maven-release-plugin] prepare release druid-0.3.22
2013-03-15 13:53:33 -05:00
Gian Merlino
9fe6a37f86
Realtime: Remove MetadataUpdater
2013-03-14 12:35:38 -07:00
Gian Merlino
df8e4d4061
Merge branch 'master' into realtime-index-task
2013-03-13 22:43:01 -07:00
Eric Tschetter
2bd34f1454
[maven-release-plugin] prepare for next development iteration
2013-03-13 18:32:00 -05:00
Eric Tschetter
b7960e202d
[maven-release-plugin] prepare release druid-0.3.21
2013-03-13 18:31:55 -05:00
Eric Tschetter
f1175389c4
[maven-release-plugin] prepare for next development iteration
2013-03-13 16:33:17 -05:00
Eric Tschetter
8aac482618
[maven-release-plugin] prepare release druid-0.3.20
2013-03-13 16:33:10 -05:00
Fangjin Yang
a49d0c5e4c
[maven-release-plugin] prepare for next development iteration
2013-03-11 17:20:16 -07:00
Fangjin Yang
97f828f6b1
[maven-release-plugin] prepare release druid-0.3.19
2013-03-11 17:20:09 -07:00
Gian Merlino
3fa46988f5
Realtime:
...
- MetadataUpdater now built from SegmentAnnouncer, SegmentPublisher instances.
- Sinks can take a version instead of always using interval.start. The realtime
plumber selects a version using a VersioningPolicy.
- Plumbers gained a startJob method.
- Realtime plumbers gained an implementation for finishJob.
2013-03-11 11:14:51 -07:00
Fangjin Yang
552b365194
[maven-release-plugin] prepare for next development iteration
2013-03-04 15:11:37 -08:00
Fangjin Yang
fdb3911794
[maven-release-plugin] prepare release druid-0.3.18
2013-03-04 15:11:28 -08:00
Fangjin Yang
91f54a72ee
fix broken UT
2013-03-04 15:09:55 -08:00
Fangjin Yang
6977fe03bd
[maven-release-plugin] prepare for next development iteration
2013-03-04 13:08:26 -08:00
Fangjin Yang
d4f4e41320
[maven-release-plugin] prepare release druid-0.3.16
2013-03-04 13:08:09 -08:00
Fangjin Yang
ee38d096c7
[maven-release-plugin] prepare for next development iteration
2013-03-02 09:29:04 -08:00
Fangjin Yang
a90d204ba2
[maven-release-plugin] prepare release druid-0.3.15
2013-03-02 09:28:51 -08:00
Fangjin Yang
879b2475d4
[maven-release-plugin] prepare for next development iteration
2013-03-01 19:53:13 -08:00
Fangjin Yang
e3ba6efb80
[maven-release-plugin] prepare release druid-0.3.14
2013-03-01 19:53:07 -08:00
Fangjin Yang
7f6747194d
[maven-release-plugin] prepare for next development iteration
2013-03-01 19:45:59 -08:00
Fangjin Yang
06a2a3a793
[maven-release-plugin] prepare release druid-0.3.13
2013-03-01 19:45:50 -08:00
Fangjin Yang
e0700bb161
[maven-release-plugin] prepare for next development iteration
2013-03-01 19:28:34 -08:00
Fangjin Yang
38c8ffb552
[maven-release-plugin] prepare release druid-0.3.12
2013-03-01 19:28:28 -08:00
Fangjin Yang
49e61d00fd
[maven-release-plugin] prepare for next development iteration
2013-03-01 19:05:46 -08:00
Fangjin Yang
7e316e3508
[maven-release-plugin] prepare release druid-0.3.11
2013-03-01 19:05:39 -08:00
Fangjin Yang
e2b4163e31
[maven-release-plugin] prepare for next development iteration
2013-03-01 18:24:09 -08:00
Fangjin Yang
023199702e
[maven-release-plugin] prepare release druid-0.3.10
2013-03-01 18:24:03 -08:00
Fangjin Yang
a574da55ed
fix broken UT
2013-03-01 18:22:30 -08:00
Gian Merlino
0092ad7efb
[maven-release-plugin] prepare for next development iteration
2013-03-01 16:57:47 -08:00
Gian Merlino
03ff72b7e2
[maven-release-plugin] prepare release druid-0.3.8
2013-03-01 16:57:38 -08:00
Gian Merlino
998ed0a8de
[maven-release-plugin] prepare for next development iteration
2013-03-01 14:43:20 -08:00
Gian Merlino
89d5ddf2f7
[maven-release-plugin] prepare release druid-0.3.7
2013-03-01 14:43:13 -08:00
Fangjin Yang
360c6a1df1
[maven-release-plugin] prepare for next development iteration
2013-03-01 13:55:07 -08:00
Fangjin Yang
a43dc44ebb
[maven-release-plugin] prepare release druid-0.3.6
2013-03-01 13:55:01 -08:00
Fangjin Yang
3264a689f1
[maven-release-plugin] prepare for next development iteration
2013-03-01 11:43:23 -08:00
Fangjin Yang
334fffdef5
[maven-release-plugin] prepare release druid-0.3.5
2013-03-01 11:43:16 -08:00
Fangjin Yang
2e1e1753d5
[maven-release-plugin] prepare for next development iteration
2013-02-26 15:15:54 -08:00
Fangjin Yang
ab456cf3b1
[maven-release-plugin] prepare release druid-0.3.4
2013-02-26 15:15:36 -08:00
Gian Merlino
d32a6284ce
Merge branch 'task-stuff' into indexing_refactor
...
Conflicts:
merger/src/main/java/com/metamx/druid/merger/worker/config/WorkerConfig.java
2013-02-26 13:03:56 -08:00
Gian Merlino
9964e7dfe4
[maven-release-plugin] prepare for next development iteration
2013-02-25 12:24:24 -08:00
Gian Merlino
99c4f9446c
[maven-release-plugin] prepare release druid-0.3.3
2013-02-25 12:24:15 -08:00
Eric Tschetter
e0f6df1a5c
[maven-release-plugin] prepare for next development iteration
2013-02-21 20:39:50 -06:00
Eric Tschetter
846bc0e4f0
[maven-release-plugin] prepare release druid-0.3.2
2013-02-21 20:39:45 -06:00
Eric Tschetter
699aadd2b1
[maven-release-plugin] prepare for next development iteration
2013-02-21 15:50:01 -06:00
Eric Tschetter
606a2e4b01
[maven-release-plugin] prepare release druid-0.3.1
2013-02-21 15:49:55 -06:00
Eric Tschetter
f8c54a72c2
1) Changes to allow for local storage
2013-02-21 15:47:01 -06:00
Eric Tschetter
dc3459d3f9
1) Initial commit of refactorings on top of housejester's to simplify the zipping and simplify the creation of other methods of loading data
2013-02-21 15:47:01 -06:00
Gian Merlino
824e3c0eb2
[maven-release-plugin] prepare for next development iteration
2013-02-15 13:03:39 -08:00
Gian Merlino
6bbc992101
[maven-release-plugin] prepare release druid-0.3.0
2013-02-15 13:03:32 -08:00
xvrl
1b85eaad3e
simplify query toolchest interface
2013-02-13 21:25:16 -08:00
Eric Tschetter
c5b78e75cf
1) Move up to Jackson 2.1
...
2) Some bugs were fixed, but they ended up getting mixed in with the Jackson upgrade :(
2013-02-13 18:51:32 -08:00
Fangjin Yang
82f02a4fe4
Merge branch 'master' into indexing_refactor
...
Conflicts:
merger/src/main/java/com/metamx/druid/merger/common/TaskStatus.java
merger/src/main/java/com/metamx/druid/merger/common/task/DeleteTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/IndexDeterminePartitionsTask.java
merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
merger/src/main/java/com/metamx/druid/merger/common/task/V8toV9UpgradeTask.java
merger/src/main/java/com/metamx/druid/merger/coordinator/MergerDBCoordinator.java
merger/src/main/java/com/metamx/druid/merger/coordinator/RemoteTaskRunner.java
merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
2013-02-13 16:34:14 -08:00
Eric Tschetter
a0b159fed7
1) Move up to Jackson 2.1
...
2) Some bugs were fixed, but they ended up getting mixed in with the Jackson upgrade :(
2013-02-12 20:58:17 -06:00
xvrl
07b0b4611b
bump up to 0.3.0
2013-02-12 09:52:21 -08:00
Fangjin Yang
e519f82e87
[maven-release-plugin] prepare for next development iteration
2013-02-11 10:58:51 -08:00
Fangjin Yang
73f7468a23
[maven-release-plugin] prepare release druid-0.2.7
2013-02-11 10:58:43 -08:00
Fangjin Yang
ec2b906fad
[maven-release-plugin] prepare for next development iteration
2013-02-06 18:43:42 -08:00
Fangjin Yang
22d9607169
[maven-release-plugin] prepare release druid-0.2.6
2013-02-06 18:43:34 -08:00
Fangjin Yang
e09c658352
[maven-release-plugin] prepare for next development iteration
2013-02-06 17:42:39 -08:00
Fangjin Yang
668353e895
[maven-release-plugin] prepare release druid-0.2.5
2013-02-06 17:42:33 -08:00
Fangjin Yang
d023d219ae
[maven-release-plugin] prepare for next development iteration
2013-02-06 16:54:21 -08:00
Fangjin Yang
d0fdf4ccf0
[maven-release-plugin] prepare release druid-0.2.4
2013-02-06 16:54:16 -08:00
xvrl
7ec3563e7b
[maven-release-plugin] prepare for next development iteration
2013-02-01 16:25:42 -08:00
xvrl
a239f62158
[maven-release-plugin] prepare release druid-0.2.3
2013-02-01 16:25:35 -08:00
Fangjin Yang
00e6ac1e10
[maven-release-plugin] prepare for next development iteration
2013-01-30 17:09:23 -08:00
Fangjin Yang
ef19de8270
[maven-release-plugin] prepare release druid-0.2.2
2013-01-30 17:09:18 -08:00
Fangjin Yang
fa733565e8
[maven-release-plugin] prepare for next development iteration
2013-01-30 16:28:28 -08:00
Fangjin Yang
0b116a8fe4
[maven-release-plugin] prepare release druid-0.2.1
2013-01-30 16:28:22 -08:00
Fangjin Yang
2a0de2090b
[maven-release-plugin] prepare for next development iteration
2013-01-30 13:47:15 -08:00
Fangjin Yang
049ca2bad4
[maven-release-plugin] prepare release druid-0.2.0
2013-01-30 13:47:08 -08:00
Eric Tschetter
c8cb96b006
1) Remove vast majority of usages of IndexIO.mapDir() and deprecated it. IndexIO.loadIndex() is the new IndexIO.mapDir()
...
2) Fix bug with IndexMerger and null columns
3) Add QueryableIndexIndexableAdapter so that QueryableIndexes can be merged
4) Adjust twitter example to have multiple values for each hash tag
5) Adjusted GroupByQueryEngine to just drop dimensions that don't exist instead of throwing an NPE
2013-01-16 17:10:33 -06:00
Fangjin Yang
7e074e8158
fix pom breakage
2013-01-15 12:04:12 -08:00
Eric Tschetter
b184c46ae0
1) Introduce idea of value types and generic columns to the serialization format
...
2) Create SegmentLoader interface for the loading of segments!
3) Setup serialization of new format and conversion function inside IndexIO
4) Make some adjustments to the twitter demo to make it make a bit more sense based on some email feedback from someone kicking the tires.
2013-01-04 18:12:49 -06:00
xvrl
9627fdcd1c
[maven-release-plugin] prepare for next development iteration
2013-01-03 10:09:52 -08:00
xvrl
f2c2d3f4cf
[maven-release-plugin] prepare release druid-0.1.25
2013-01-03 10:09:43 -08:00
xvrl
2a188996cd
[maven-release-plugin] prepare for next development iteration
2012-12-31 14:56:10 -08:00
xvrl
6cdcc2becc
[maven-release-plugin] prepare release druid-0.1.24
2012-12-31 14:56:03 -08:00
Fangjin Yang
5137af0750
[maven-release-plugin] prepare for next development iteration
2012-12-18 16:17:44 -08:00
Fangjin Yang
c579ba5a42
[maven-release-plugin] prepare release druid-0.1.23
2012-12-18 16:17:38 -08:00
Fangjin Yang
090a5a105d
[maven-release-plugin] prepare for next development iteration
2012-12-18 14:19:09 -08:00
Fangjin Yang
fb8f4f1f41
[maven-release-plugin] prepare release druid-0.1.22
2012-12-18 14:19:02 -08:00
Fangjin Yang
75d465aed0
[maven-release-plugin] prepare for next development iteration
2012-12-18 10:37:16 -08:00
Fangjin Yang
decc4e4c0e
[maven-release-plugin] prepare release druid-0.1.21
2012-12-18 10:37:08 -08:00
Fangjin Yang
e34944b1c5
[maven-release-plugin] prepare for next development iteration
2012-12-15 00:52:01 -08:00
Fangjin Yang
24f0207fd8
[maven-release-plugin] prepare release druid-0.1.20
2012-12-15 00:51:54 -08:00
Fangjin Yang
f9386c3623
[maven-release-plugin] prepare for next development iteration
2012-12-15 00:44:58 -08:00
Fangjin Yang
4bcc8d27fa
[maven-release-plugin] prepare release druid-0.1.19
2012-12-15 00:44:50 -08:00
Fangjin Yang
5fff07a8b0
[maven-release-plugin] prepare for next development iteration
2012-12-14 22:56:49 -08:00
Fangjin Yang
2b2818dbaf
[maven-release-plugin] prepare release druid-0.1.18
2012-12-14 22:56:43 -08:00
Fangjin Yang
b0e1f90e35
[maven-release-plugin] prepare for next development iteration
2012-12-14 22:07:57 -08:00
Fangjin Yang
ce8e02b5a3
[maven-release-plugin] prepare release druid-0.1.17
2012-12-14 22:07:50 -08:00
Fangjin Yang
0821dce8c1
[maven-release-plugin] prepare for next development iteration
2012-12-14 21:29:20 -08:00
Fangjin Yang
a0d22a6646
[maven-release-plugin] prepare release druid-0.1.16
2012-12-14 21:29:14 -08:00
Fangjin Yang
e37e24cc25
[maven-release-plugin] prepare for next development iteration
2012-12-14 17:19:59 -08:00
Fangjin Yang
4e78d8e734
[maven-release-plugin] prepare release druid-0.1.15
2012-12-14 17:19:53 -08:00
Eric Tschetter
b4a1bb4a00
[maven-release-plugin] prepare for next development iteration
2012-12-14 11:37:17 -06:00
Eric Tschetter
cb9b18c7c2
[maven-release-plugin] prepare release druid-0.1.14
2012-12-14 11:37:12 -06:00
Eric Tschetter
29a64f50e2
[maven-release-plugin] prepare for next development iteration
2012-12-13 17:57:46 -06:00
Eric Tschetter
c82007973e
[maven-release-plugin] prepare release druid-0.1.13
2012-12-13 17:57:42 -06:00
Fangjin Yang
6729f166d9
[maven-release-plugin] prepare for next development iteration
2012-12-12 15:38:58 -08:00
Fangjin Yang
578cf94bc0
[maven-release-plugin] prepare release druid-0.1.12
2012-12-12 15:38:37 -08:00
Fangjin Yang
0105233fc3
[maven-release-plugin] prepare for next development iteration
2012-12-07 17:50:47 -08:00
Fangjin Yang
943fe5e6bf
[maven-release-plugin] prepare release druid-0.1.11
2012-12-07 17:50:41 -08:00
Fangjin Yang
da4b31c28f
[maven-release-plugin] prepare for next development iteration
2012-12-07 15:18:19 -08:00
Fangjin Yang
6df32ac0b0
[maven-release-plugin] prepare release druid-0.1.10
2012-12-07 15:18:11 -08:00
Fangjin Yang
9eb28254f8
[maven-release-plugin] prepare for next development iteration
2012-12-07 14:49:13 -08:00
Fangjin Yang
9ce536e040
[maven-release-plugin] prepare release druid-0.1.9
2012-12-07 14:49:04 -08:00