69f7831d82
1) Rename QueryToolChestModule because there was a case sensitivity issue, grrr
2013-08-06 12:04:04 -07:00
c3ca9f5a3b
1) Rename MemcachedCacheConfig back to what it should be
2013-08-06 12:02:19 -07:00
9f71d42314
1) Broker works with Guice
...
2) Extract ServerViewModule to handle various ServerView thingies
3) Extract QueryToolChestModule and QueryRunnerFactoryModule to reuse code for configuration of Query stuff
4) Extract QueryJettyServerInitializer to reuse between Historical and Broker nodes
5) Remove ClientMain, BrokerMain and BrokerNode
2013-08-06 12:01:52 -07:00
293c0e8418
1) Clean up the servlet registration stuff, resource registrations on CliHistorical weren't working, they do now.
2013-08-05 13:58:45 -07:00
d64bc2f762
1) Eliminate Old mains() that aren't needed anymore.
2013-08-05 13:33:43 -07:00
d66af7625c
1) Eliminate the need for SingleSegmentLoader
...
2) Setup the configuration glue for ServerInventoryViews and DataSegmentAnnouncer
3) Make processes run and work again!
2013-08-02 17:05:01 -07:00
f593b23aac
Remove unused boolean parameter
2013-08-02 10:15:57 -07:00
2361e0112a
Make it all compile again...
2013-08-02 10:14:46 -07:00
9e78bb38f5
Merge branch 'master' into guice
...
Conflicts:
client/src/main/java/com/metamx/druid/QueryableNode.java
client/src/main/java/com/metamx/druid/client/ServerInventoryView.java
client/src/main/java/com/metamx/druid/coordination/SingleDataSegmentAnnouncer.java
client/src/main/java/com/metamx/druid/initialization/CuratorDiscoveryConfig.java
client/src/main/java/com/metamx/druid/query/MetricsEmittingExecutorService.java
indexing-hadoop/src/test/java/com/metamx/druid/indexer/HadoopDruidIndexerConfigTest.java
indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolbox.java
indexing-service/src/main/java/com/metamx/druid/indexing/coordinator/http/IndexerCoordinatorNode.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
indexing-service/src/main/java/com/metamx/druid/indexing/worker/http/WorkerNode.java
pom.xml
server/src/main/java/com/metamx/druid/coordination/ServerManager.java
server/src/main/java/com/metamx/druid/coordination/ZkCoordinator.java
server/src/main/java/com/metamx/druid/db/DatabaseRuleManager.java
server/src/main/java/com/metamx/druid/db/DatabaseSegmentManager.java
server/src/main/java/com/metamx/druid/http/ComputeNode.java
server/src/main/java/com/metamx/druid/http/MasterMain.java
server/src/main/java/com/metamx/druid/loading/SegmentLoaderConfig.java
server/src/main/java/com/metamx/druid/loading/SingleSegmentLoader.java
server/src/main/java/com/metamx/druid/master/DruidMaster.java
2013-08-01 16:42:47 -07:00
019bb5d453
1) Another whole bunch of changes to annotate things and create Modules and bind stuff. But OMFG, the compute node actually appears to be working!
...
2) The compute node works with Guice
3) The compute node fires up with Guice and appears to work
4) Did I mention that the compute node, now called historical node, fires up with Guice and appears to work?
2013-08-01 15:28:08 -07:00
fba2bc9623
Merge pull request #204 from metamx/close-handle
...
add the ability to unmap mmapped files
2013-08-01 14:09:46 -07:00
8f39db7804
more data to exception msgs
2013-08-01 14:04:27 -07:00
6d54ae9f81
more unit tests to test for multiple closes in different threads
2013-08-01 13:51:56 -07:00
dc169d9fcd
hide decrement and update close logic to call decrement
2013-08-01 13:24:56 -07:00
e92e0c35a4
put all concurrency test back into server manager test, introduce better concurrency for reference counting
2013-08-01 13:13:03 -07:00
b86258cc14
fix broken master UT based on changes that were discarded as part of a pull req
2013-08-01 10:44:39 -07:00
f4fc8b2f6e
1) A whole boondoggle of changes to Guicify the instantiation of things for the Historical nodes
...
2) Add GuiceInjectableValues that supports @JacksonInject resolution via Guice
3) Refactor RequestLogger stuff and setup polymorphic deserialization method of creating objects
2013-07-31 18:36:47 -07:00
f76540c16c
move reference counting classes out of server manager and more tests for concurrency
2013-07-31 15:14:39 -07:00
9de2e5b096
1) Adjust JsonConfigurator to be able to attach the proper property path if it is renamed via a @JsonProperty annotation
...
2) JsonConfigurator now requires that fields be annotated with @JsonProperty. It will fail fast if they aren't.
2013-07-31 14:55:34 -07:00
5d1fe50703
additional ut for reference counting
2013-07-30 17:55:57 -07:00
404b84823e
reference count to make sure we arent accessing any instances of a closed mmapped segment
2013-07-30 17:36:56 -07:00
843b6650a2
Merge pull request #206 from metamx/peontimeout
...
Add a timeout in LoadQueuePeon to fail an assign if it takes too long
2013-07-30 15:08:46 -07:00
e7c6dd8112
get and reset failed assign count
2013-07-30 14:50:24 -07:00
35d8a82879
move the close method to the segment object
2013-07-30 12:24:01 -07:00
97fb971f84
1) Start the journey of making the historical nodes work with Guice. Doesn't work yet, but at least it builds.
2013-07-30 11:58:05 -07:00
1c5c2e0ef5
Merge pull request #205 from metamx/compress-curator
...
Toggle between compressed and non compressed service discovery
2013-07-30 11:33:43 -07:00
66adef5d64
Merge pull request #179 from zanox/master
...
Fix path used when storing segments to HDFS
2013-07-30 11:13:29 -07:00
f55e12040f
fix according to code review
2013-07-29 18:39:14 -07:00
6a96c1fb76
fix according to code review comments
2013-07-29 17:56:19 -07:00
af6db21264
fix configs based on code review
2013-07-29 17:04:27 -07:00
091dce11c8
Add a timeout in LQP to fail an assign if it takes too long
2013-07-29 15:47:05 -07:00
50836798fa
toggle between compressed and non compressed service discovery
2013-07-29 15:40:45 -07:00
1226190279
add the ability to close mmapped files
2013-07-29 15:22:34 -07:00
2b587cba85
1) Introduce airlift/airline for CLI stuff and add a Coordinator CLI verb to make it all happiness
2013-07-29 15:14:20 -07:00
4c9be81912
1) Pull try/catch check in the JettyServerInitializer out of the initializer.
2013-07-29 14:35:30 -07:00
9cd26c70c0
1) Adjust the JettyServerModule and other things such that Jetty will actually serve the static artifacts and the various resources of the Master
2013-07-29 14:26:51 -07:00
6b9963b472
1) Move the @Json and @Smile annotations to com.metamx.druid.guice.annotations
...
2) Changed ServiceAnnouncer to take a DruidNode object
3) Remove ServiceInstanceFactory interface and implementations
4) Add registrations to DiscoveryModule so that you can register nodes that should be announced on startup
5) Make the set of default Monitors configurable
2013-07-26 14:03:51 -07:00
b0090a1de6
[maven-release-plugin] prepare for next development iteration
2013-07-25 17:26:44 -07:00
6868153905
[maven-release-plugin] prepare release druid-0.5.22
2013-07-25 17:26:36 -07:00
a6bc63732d
Merge pull request #199 from metamx/indexing-service-mods
...
Improve robustness and usability of RealtimeIndexTask and some code cleanup in the Indexing Service
2013-07-25 17:09:15 -07:00
cf0cb3b703
[maven-release-plugin] prepare for next development iteration
2013-07-25 16:55:28 -07:00
8297f068c3
[maven-release-plugin] prepare release druid-0.5.21
2013-07-25 16:55:20 -07:00
05219689e8
added close methods on inputSupplier tests
2013-07-25 16:52:29 -07:00
f68a68112f
[maven-release-plugin] prepare for next development iteration
2013-07-25 16:21:59 -07:00
b6e8d11aec
[maven-release-plugin] prepare release druid-0.5.20
2013-07-25 16:21:49 -07:00
4dd42c7177
RemoteTaskActionClient: Log service uri when submitting action
2013-07-25 14:48:25 -07:00
20acd6f450
RealtimePlumberSchool: Persist and merge immediately upon finishJob
2013-07-25 14:38:07 -07:00
5d44f0f15b
ForkingTaskRunner: Use guava Closer to closer stuff
2013-07-25 14:37:45 -07:00
952b8ce06b
RemoteTaskActionClient: Fix http path
2013-07-25 14:37:20 -07:00
ea201be555
Merge pull request #200 from activitystream/master
...
Minor fixes - maven dependency, unit test that was failing and quirk for third party S3 provider
2013-07-25 13:42:53 -07:00
cheddar
cheddar
fjy
Dhruv Parthasarathy
Gian Merlino