Commit Graph

2250 Commits

Author SHA1 Message Date
cheddar 98c663e75c Enable usage of SysMonitor to verify disk locations via DruidSysMonitor 2013-09-20 18:33:14 -05:00
fjy 289b4c5024 Merge pull request #243 from metamx/fix-extensionization
Fix issues with bindings and handling extensions
2013-09-20 16:19:02 -07:00
cheddar fefc71e34f Refix the things that were lost in the merge. 2013-09-20 18:01:08 -05:00
cheddar b13ae3f405 Merge branch 'master' into fix-extensionization
Conflicts:
	services/src/main/java/io/druid/cli/CliBroker.java
	services/src/main/java/io/druid/cli/CliCoordinator.java
2013-09-20 17:49:13 -05:00
cheddar 5712b29c8c Fix issues with bindings and handling extensions
The way the Guice bindings were setup previously, each process only had bindings
for the things it cared about.  This became problematic when adding extension modules
that bound everything that they could possibly need expecting that the processes would
only instantiate what they actually do need.  Guice tries to fail-fast and verifies that all
 bindings exist before it does anything, which is a problem because the extension bind
 some objects that don't necessarily have all of their dependencies bound in all processes.

The fix for this is to build a single Injector with all bindings in it and let each of the
 processes only load the things that they care about.  This also requires the use of
 Module overrides and other such interesting things, which are node done.

 In doing the fix, I also swapped out the way that the DataSegmentPusher/Puller stuff is bound, as well as made the Cassandra stuff fail if its settings are not provided.  This all of a sudden made all of the things require Cassandra's settings, so I migrated the Cassandra deep storage stuff into its own module.

 In doing these changes, I also discovered that some properties weren't properly converting for the ConvertProperties command (specifically, the properties related to data segment loading and pushing), so I fixed that.
2013-09-20 17:45:01 -05:00
fjy f26e13c61a fix broken http endpoints 2013-09-19 17:33:58 -07:00
cheddar 46631bf409 Port fix for issue where IncrementalIndex doesn't properly filter for "null" values from 0.5.x to master 2013-09-18 18:18:53 -05:00
fjy a74b6de9c5 Merge pull request #242 from metamx/guice
Druid version 0.6.0
2013-09-18 16:00:08 -07:00
fjy 8d7af40313 Merge branch 'guice' of github.com:metamx/druid into guice 2013-09-18 15:59:29 -07:00
fjy b3bfcb7792 workaround for broker to plug in extensions 2013-09-18 15:59:05 -07:00
cheddar e019dddaaa Reapply Fix for NoSuchElementException that happens in IncrementalIndex when some columns are null 2013-09-18 17:54:49 -05:00
cheddar 6150365c12 Reapply "fix regex and assign random user ids" from Xavier 2013-09-18 17:15:15 -05:00
cheddar d61fe9585a Fix RealtimePlumberSchool.setQueryExecutorService() to actually use its argument 2013-09-18 17:05:18 -05:00
cheddar dc728b5721 Update versions of poms and make IncrementalIndexStorageAdapterTest compile 2013-09-18 17:01:03 -05:00
cheddar 6bfe2310bb Merge branch 'master' into guice
Conflicts:
	client/pom.xml
	client/src/main/java/com/metamx/druid/query/segment/LegacySegmentSpec.java
	indexing-common/pom.xml
	indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolbox.java
	indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolboxFactory.java
	indexing-service/src/main/java/com/metamx/druid/indexing/common/task/RealtimeIndexTask.java
	indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
	indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/RemoteTaskRunnerTest.java
	indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskLifecycleTest.java
	indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskQueueTest.java
	realtime/src/main/java/com/metamx/druid/realtime/RealtimeNode.java
	realtime/src/main/java/com/metamx/druid/realtime/firehose/IrcFirehoseFactory.java
	realtime/src/main/java/com/metamx/druid/realtime/firehose/WikipediaIrcDecoder.java
	realtime/src/main/java/com/metamx/druid/realtime/plumber/RealtimePlumberSchool.java
	server/src/main/java/com/metamx/druid/BaseServerNode.java
	server/src/main/java/com/metamx/druid/http/ComputeNode.java
	server/src/main/java/com/metamx/druid/index/v1/IncrementalIndexStorageAdapter.java
	server/src/main/java/com/metamx/druid/query/group/GroupByQueryEngine.java
2013-09-18 16:46:54 -05:00
cheddar 949c52d482 1) Remove snapshots 2013-09-18 15:42:30 -05:00
fjy e551afef5d fix broken master console 2013-09-18 09:41:59 -07:00
fjy 02b86a6fc7 Merge branch 'guice' of github.com:metamx/druid into guice 2013-09-18 09:24:24 -07:00
fjy f7df951610 broker needs to announce itself in service discovery 2013-09-18 09:23:46 -07:00
cheddar 4557838c5d Merge pull request #241 from rjurney/guice
Updated config to create tables.
2013-09-17 17:58:52 -07:00
Russell Jurney 295426df9f Updated config to create tables. 2013-09-17 17:07:55 -07:00
cheddar 48dea82890 Merge pull request #240 from rjurney/guice
Working import, sans tables
2013-09-17 13:14:45 -07:00
fjy 64f3821b4e throw exception for annotated members 2013-09-16 17:36:31 -07:00
Russell Jurney 6df31408d9 made layouts work 2013-09-16 17:09:59 -07:00
Russell Jurney 946a9e502f Replaced spaces with dashes 2013-09-16 16:19:49 -07:00
fjy cabae7993d port over multi threaded realtime and also fix broken realtime nodes that can't start up 2013-09-16 16:03:47 -07:00
Russell Jurney 063a068ab2 Converted links, sans space to slash 2013-09-16 16:01:14 -07:00
Russell Jurney 248fba683a Added prepend tag to make pages display. 2013-09-16 14:49:36 -07:00
Russell Jurney c06b37f36e Won't serve html 2013-09-16 14:08:22 -07:00
fjy 9b4c3756ed fix exception catching logic of moving segments 2013-09-15 10:27:37 -07:00
Gian Merlino 163fa14e62 [maven-release-plugin] prepare for next development iteration 2013-09-13 19:02:46 -07:00
Gian Merlino a20f3fc6dd [maven-release-plugin] prepare release druid-0.5.58 2013-09-13 19:02:40 -07:00
fjy d0b0adbb68 [maven-release-plugin] prepare for next development iteration 2013-09-13 18:57:25 -07:00
fjy 23c5fdb107 [maven-release-plugin] prepare release druid-0.5.57 2013-09-13 18:57:20 -07:00
fjy b0a09ba1f1 [maven-release-plugin] prepare for next development iteration 2013-09-13 18:45:20 -07:00
fjy b17f5c403b [maven-release-plugin] prepare release druid-0.5.56 2013-09-13 18:45:14 -07:00
fjy 30bde45556 Merge branch 'master' of github.com:metamx/druid 2013-09-13 18:41:36 -07:00
fjy 5a8b71ddec fix how druid services is assembled 2013-09-13 18:41:33 -07:00
Gian Merlino 22a99c7589 [maven-release-plugin] prepare for next development iteration 2013-09-13 17:59:03 -07:00
Gian Merlino 542d564453 [maven-release-plugin] prepare release druid-0.5.55 2013-09-13 17:58:56 -07:00
cheddar 8b480e55db Add docs from github wiki 2013-09-13 17:20:39 -05:00
fjy 48db34a4b7 Merge branch 'master' of github.com:metamx/druid 2013-09-13 14:36:49 -07:00
fjy 87dc839fb2 fix example properties for real time node 2013-09-13 14:36:42 -07:00
Gian Merlino 24df6c482d Use shared query executor in indexing-service 2013-09-13 14:33:13 -07:00
cheddar 73a87fe2f6 Merge branch 'guice' of github.com:metamx/druid into guice 2013-09-13 16:28:21 -05:00
cheddar 66c2ea2ce3 1) Move doc/publications to top-level publications directory.
2) Move data_flow and segment propagation stuff to static.druid.io/docs/flow and remove from repository
2013-09-13 16:26:41 -05:00
cheddar 242476a73f Merge pull request #239 from metamx/mt-rt
Correctly use number of processing threads for realtime query execution
2013-09-13 14:00:41 -07:00
fjy 1ec098c010 use num processing threads for realtime query execution 2013-09-13 13:54:41 -07:00
cheddar ef1ac46a7e Merge pull request #237 from metamx/is-ut
Rework tests in indexing service to be more unit testy
2013-09-13 13:21:03 -07:00
fjy f7c10e3594 rework tests in indexing service to be more unit testy 2013-09-12 16:37:58 -07:00