fjy
19276f6bad
fix spacing issues and other code review comments
2013-09-24 14:34:09 -07:00
fjy
be5bb7f2eb
fix lifecycle startup/stop ordering problem with discovery module and make druid able to load local extensions
2013-09-24 14:20:56 -07:00
fjy
1ff04412a2
clean up realtime module and fix breakage in broker paths
2013-09-23 16:26:05 -07:00
cheddar
1750b702d7
Add missed com.metamx.druid.emitter.period propery to ConvertProperties
2013-09-23 16:46:37 -05:00
cheddar
cc632cdb30
Make Jetty Server lazy
...
JettyServerModule had been eagerly instantiating the Server object, which was causing things that didn't care about an HTTP interface to all of a sudden require host and port parameters. The change makes the JettyServerModule only setup the bindings without eagerly instantiating the Jetty Server. Each cli needs to register the Server class with the Lifecycle in order to make it actually get used.
2013-09-23 16:02:24 -05:00
fjy
dc8a119787
fix broken unit tests are a result of the last merge
2013-09-23 12:56:01 -07:00
cheddar
fefc71e34f
Refix the things that were lost in the merge.
2013-09-20 18:01:08 -05:00
cheddar
b13ae3f405
Merge branch 'master' into fix-extensionization
...
Conflicts:
services/src/main/java/io/druid/cli/CliBroker.java
services/src/main/java/io/druid/cli/CliCoordinator.java
2013-09-20 17:49:13 -05:00
cheddar
5712b29c8c
Fix issues with bindings and handling extensions
...
The way the Guice bindings were setup previously, each process only had bindings
for the things it cared about. This became problematic when adding extension modules
that bound everything that they could possibly need expecting that the processes would
only instantiate what they actually do need. Guice tries to fail-fast and verifies that all
bindings exist before it does anything, which is a problem because the extension bind
some objects that don't necessarily have all of their dependencies bound in all processes.
The fix for this is to build a single Injector with all bindings in it and let each of the
processes only load the things that they care about. This also requires the use of
Module overrides and other such interesting things, which are node done.
In doing the fix, I also swapped out the way that the DataSegmentPusher/Puller stuff is bound, as well as made the Cassandra stuff fail if its settings are not provided. This all of a sudden made all of the things require Cassandra's settings, so I migrated the Cassandra deep storage stuff into its own module.
In doing these changes, I also discovered that some properties weren't properly converting for the ConvertProperties command (specifically, the properties related to data segment loading and pushing), so I fixed that.
2013-09-20 17:45:01 -05:00
fjy
f26e13c61a
fix broken http endpoints
2013-09-19 17:33:58 -07:00
cheddar
dc728b5721
Update versions of poms and make IncrementalIndexStorageAdapterTest compile
2013-09-18 17:01:03 -05:00
cheddar
6bfe2310bb
Merge branch 'master' into guice
...
Conflicts:
client/pom.xml
client/src/main/java/com/metamx/druid/query/segment/LegacySegmentSpec.java
indexing-common/pom.xml
indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolbox.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolboxFactory.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/task/RealtimeIndexTask.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/RemoteTaskRunnerTest.java
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskLifecycleTest.java
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskQueueTest.java
realtime/src/main/java/com/metamx/druid/realtime/RealtimeNode.java
realtime/src/main/java/com/metamx/druid/realtime/firehose/IrcFirehoseFactory.java
realtime/src/main/java/com/metamx/druid/realtime/firehose/WikipediaIrcDecoder.java
realtime/src/main/java/com/metamx/druid/realtime/plumber/RealtimePlumberSchool.java
server/src/main/java/com/metamx/druid/BaseServerNode.java
server/src/main/java/com/metamx/druid/http/ComputeNode.java
server/src/main/java/com/metamx/druid/index/v1/IncrementalIndexStorageAdapter.java
server/src/main/java/com/metamx/druid/query/group/GroupByQueryEngine.java
2013-09-18 16:46:54 -05:00
fjy
f7df951610
broker needs to announce itself in service discovery
2013-09-18 09:23:46 -07:00
fjy
cabae7993d
port over multi threaded realtime and also fix broken realtime nodes that can't start up
2013-09-16 16:03:47 -07:00
Gian Merlino
163fa14e62
[maven-release-plugin] prepare for next development iteration
2013-09-13 19:02:46 -07:00
Gian Merlino
a20f3fc6dd
[maven-release-plugin] prepare release druid-0.5.58
2013-09-13 19:02:40 -07:00
fjy
d0b0adbb68
[maven-release-plugin] prepare for next development iteration
2013-09-13 18:57:25 -07:00
fjy
23c5fdb107
[maven-release-plugin] prepare release druid-0.5.57
2013-09-13 18:57:20 -07:00
fjy
b0a09ba1f1
[maven-release-plugin] prepare for next development iteration
2013-09-13 18:45:20 -07:00
fjy
b17f5c403b
[maven-release-plugin] prepare release druid-0.5.56
2013-09-13 18:45:14 -07:00
fjy
30bde45556
Merge branch 'master' of github.com:metamx/druid
2013-09-13 18:41:36 -07:00
fjy
5a8b71ddec
fix how druid services is assembled
2013-09-13 18:41:33 -07:00
Gian Merlino
22a99c7589
[maven-release-plugin] prepare for next development iteration
2013-09-13 17:59:03 -07:00
Gian Merlino
542d564453
[maven-release-plugin] prepare release druid-0.5.55
2013-09-13 17:58:56 -07:00
cheddar
e0738b3b22
1) Add tool to convert properties from the old settings to the new ones.
2013-09-12 17:59:23 -05:00
cheddar
a2dcc45a8e
1) Remove SingleSegmentLoader and replace with OmniSegmentLoader
2013-09-12 11:47:03 -05:00
cheddar
3e4a4f5566
1) Adjustments to allow for the addition of new Runnables via modules. Modules should implement CliCommandCreator and add their stuff there.
2013-09-11 17:41:20 -05:00
cheddar
6c9a107356
1) remove duplicate package initialization.initialization
2013-09-09 17:02:57 -05:00
fjy
e03c623467
[maven-release-plugin] prepare for next development iteration
2013-09-05 13:48:21 -07:00
fjy
552d0c061a
[maven-release-plugin] prepare release druid-0.5.54
2013-09-05 13:48:11 -07:00
fjy
5a64e2a64a
[maven-release-plugin] prepare for next development iteration
2013-09-04 14:24:04 -07:00
fjy
523355d00b
[maven-release-plugin] prepare release druid-0.5.53
2013-09-04 14:23:56 -07:00
fjy
567168330b
[maven-release-plugin] prepare for next development iteration
2013-09-04 14:06:33 -07:00
fjy
39bda32b81
[maven-release-plugin] prepare release druid-0.5.52
2013-09-04 14:06:25 -07:00
fjy
f08b8287a4
[maven-release-plugin] prepare for next development iteration
2013-09-04 13:22:19 -07:00
fjy
cf9038abb4
[maven-release-plugin] prepare release druid-0.5.51
2013-09-04 13:22:11 -07:00
fjy
301e1896e7
Merge pull request #236 from rjurney/master
...
Edited assembly.xml to exclude the selfcontained jars, and edited path o...
2013-09-04 13:03:15 -07:00
Russell Jurney
a11eae4144
Edited assembly.xml to exclude the selfcontained jars, and edited path of run_example_server to use the lib/ directory instead of selfcontained jars, thus reducing the size of the assembly tarball from 150MB to 50MB.
2013-09-04 12:53:38 -07:00
cheddar
740c70ed06
1) It's good when unit tests actually pass...
2013-08-31 17:27:15 -05:00
cheddar
5ab671050e
No more com.metamx.druid, it is now all io.druid!
2013-08-30 19:42:12 -05:00
cheddar
bd0756e360
More stuff moved, things still compiling and tests still passing. Yay!
2013-08-30 18:58:35 -05:00
cheddar
56e2b956d0
OMG!!! A lot of stuff has been moved. Modules have been created and destroyed, but everything is compiling and unit tests are passing, OMFG this is awesome.!
2013-08-30 18:21:04 -05:00
cheddar
386cc79420
[maven-release-plugin] prepare for next development iteration
2013-08-29 17:20:10 -05:00
cheddar
83e5e5434e
[maven-release-plugin] prepare release druid-0.5.50
2013-08-29 17:20:05 -05:00
cheddar
5ad023cd3f
Merge branch 'master' into guice
2013-08-29 13:59:59 -05:00
cheddar
d9a8340dc7
[maven-release-plugin] prepare for next development iteration
2013-08-29 13:29:54 -05:00
cheddar
5118e1da12
[maven-release-plugin] prepare release druid-0.5.49
2013-08-29 13:29:49 -05:00
cheddar
5fa944dd26
Merge branch 'master' into guice
...
Conflicts:
client/src/main/java/com/metamx/druid/coordination/BatchDataSegmentAnnouncer.java
client/src/main/java/com/metamx/druid/curator/announcement/Announcer.java
client/src/main/java/com/metamx/druid/query/filter/SelectorDimFilter.java
client/src/main/java/com/metamx/druid/query/search/SearchQueryQueryToolChest.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/tasklogs/S3TaskLogs.java
indexing-service/src/main/java/com/metamx/druid/indexing/coordinator/ForkingTaskRunner.java
indexing-service/src/main/java/com/metamx/druid/indexing/coordinator/RemoteTaskRunner.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/WorkerCuratorCoordinator.java
indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/RemoteTaskRunnerTest.java
pom.xml
server/src/main/java/com/metamx/druid/http/MasterMain.java
server/src/main/java/com/metamx/druid/http/MasterServletModule.java
server/src/main/java/com/metamx/druid/master/DruidMasterConfig.java
server/src/test/java/com/metamx/druid/master/DruidMasterTest.java
server/src/test/java/com/metamx/druid/query/group/GroupByQueryRunnerTest.java
2013-08-27 14:27:32 -05:00
cheddar
3617ac17fc
1) Eliminate ExecutorMain and have it run using the new Main!
2013-08-27 14:11:05 -05:00
cheddar
269997dc94
1) ExecutorNode is working, except for the running of the task. Need to adjust it to be able to run a task and then everything will be wonderful
2013-08-26 18:08:41 -05:00