Commit Graph

2062 Commits

Author SHA1 Message Date
fjy 87259321b6 port hadoop druid indexer to new guice framework 2013-09-26 11:04:42 -07:00
fjy 713ba63306 Merge pull request #245 from metamx/s3-retry-fix
Fix S3DataSegmentPuller retry bug
2013-09-25 15:32:18 -07:00
Gian Merlino 45e22d98f1 Fix S3DataSegmentPuller retry bug 2013-09-25 07:56:45 -07:00
cheddar 9b57b4e1f3 Merge pull request #244 from metamx/guice-discovery
Refactor how server service discovery is done
2013-09-24 14:58:34 -07:00
fjy 19276f6bad fix spacing issues and other code review comments 2013-09-24 14:34:09 -07:00
fjy be5bb7f2eb fix lifecycle startup/stop ordering problem with discovery module and make druid able to load local extensions 2013-09-24 14:20:56 -07:00
fjy 15843c3978 refactor how server service discovery is done 2013-09-24 10:36:26 -07:00
fjy 1ff04412a2 clean up realtime module and fix breakage in broker paths 2013-09-23 16:26:05 -07:00
cheddar 1750b702d7 Add missed com.metamx.druid.emitter.period propery to ConvertProperties 2013-09-23 16:46:37 -05:00
cheddar 4f3202f3d9 Move docs into a separate directory to better facilitate the separation that will exist. I think. 2013-09-23 16:26:10 -05:00
cheddar cc632cdb30 Make Jetty Server lazy
JettyServerModule had been eagerly instantiating the Server object, which was causing things that didn't care about an HTTP interface to all of a sudden require host and port parameters.  The change makes the JettyServerModule only setup the bindings without eagerly instantiating the Jetty Server.  Each cli needs to register the Server class with the Lifecycle in order to make it actually get used.
2013-09-23 16:02:24 -05:00
fjy dc8a119787 fix broken unit tests are a result of the last merge 2013-09-23 12:56:01 -07:00
cheddar 98c663e75c Enable usage of SysMonitor to verify disk locations via DruidSysMonitor 2013-09-20 18:33:14 -05:00
fjy 289b4c5024 Merge pull request #243 from metamx/fix-extensionization
Fix issues with bindings and handling extensions
2013-09-20 16:19:02 -07:00
cheddar fefc71e34f Refix the things that were lost in the merge. 2013-09-20 18:01:08 -05:00
cheddar b13ae3f405 Merge branch 'master' into fix-extensionization
Conflicts:
	services/src/main/java/io/druid/cli/CliBroker.java
	services/src/main/java/io/druid/cli/CliCoordinator.java
2013-09-20 17:49:13 -05:00
cheddar 5712b29c8c Fix issues with bindings and handling extensions
The way the Guice bindings were setup previously, each process only had bindings
for the things it cared about.  This became problematic when adding extension modules
that bound everything that they could possibly need expecting that the processes would
only instantiate what they actually do need.  Guice tries to fail-fast and verifies that all
 bindings exist before it does anything, which is a problem because the extension bind
 some objects that don't necessarily have all of their dependencies bound in all processes.

The fix for this is to build a single Injector with all bindings in it and let each of the
 processes only load the things that they care about.  This also requires the use of
 Module overrides and other such interesting things, which are node done.

 In doing the fix, I also swapped out the way that the DataSegmentPusher/Puller stuff is bound, as well as made the Cassandra stuff fail if its settings are not provided.  This all of a sudden made all of the things require Cassandra's settings, so I migrated the Cassandra deep storage stuff into its own module.

 In doing these changes, I also discovered that some properties weren't properly converting for the ConvertProperties command (specifically, the properties related to data segment loading and pushing), so I fixed that.
2013-09-20 17:45:01 -05:00
fjy f26e13c61a fix broken http endpoints 2013-09-19 17:33:58 -07:00
cheddar 46631bf409 Port fix for issue where IncrementalIndex doesn't properly filter for "null" values from 0.5.x to master 2013-09-18 18:18:53 -05:00
fjy a74b6de9c5 Merge pull request #242 from metamx/guice
Druid version 0.6.0
2013-09-18 16:00:08 -07:00
fjy 8d7af40313 Merge branch 'guice' of github.com:metamx/druid into guice 2013-09-18 15:59:29 -07:00
fjy b3bfcb7792 workaround for broker to plug in extensions 2013-09-18 15:59:05 -07:00
cheddar e019dddaaa Reapply Fix for NoSuchElementException that happens in IncrementalIndex when some columns are null 2013-09-18 17:54:49 -05:00
cheddar 6150365c12 Reapply "fix regex and assign random user ids" from Xavier 2013-09-18 17:15:15 -05:00
cheddar d61fe9585a Fix RealtimePlumberSchool.setQueryExecutorService() to actually use its argument 2013-09-18 17:05:18 -05:00
cheddar dc728b5721 Update versions of poms and make IncrementalIndexStorageAdapterTest compile 2013-09-18 17:01:03 -05:00
cheddar 6bfe2310bb Merge branch 'master' into guice
Conflicts:
	client/pom.xml
	client/src/main/java/com/metamx/druid/query/segment/LegacySegmentSpec.java
	indexing-common/pom.xml
	indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolbox.java
	indexing-service/src/main/java/com/metamx/druid/indexing/common/TaskToolboxFactory.java
	indexing-service/src/main/java/com/metamx/druid/indexing/common/task/RealtimeIndexTask.java
	indexing-service/src/main/java/com/metamx/druid/indexing/worker/executor/ExecutorNode.java
	indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/RemoteTaskRunnerTest.java
	indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskLifecycleTest.java
	indexing-service/src/test/java/com/metamx/druid/indexing/coordinator/TaskQueueTest.java
	realtime/src/main/java/com/metamx/druid/realtime/RealtimeNode.java
	realtime/src/main/java/com/metamx/druid/realtime/firehose/IrcFirehoseFactory.java
	realtime/src/main/java/com/metamx/druid/realtime/firehose/WikipediaIrcDecoder.java
	realtime/src/main/java/com/metamx/druid/realtime/plumber/RealtimePlumberSchool.java
	server/src/main/java/com/metamx/druid/BaseServerNode.java
	server/src/main/java/com/metamx/druid/http/ComputeNode.java
	server/src/main/java/com/metamx/druid/index/v1/IncrementalIndexStorageAdapter.java
	server/src/main/java/com/metamx/druid/query/group/GroupByQueryEngine.java
2013-09-18 16:46:54 -05:00
cheddar 949c52d482 1) Remove snapshots 2013-09-18 15:42:30 -05:00
fjy e551afef5d fix broken master console 2013-09-18 09:41:59 -07:00
fjy 02b86a6fc7 Merge branch 'guice' of github.com:metamx/druid into guice 2013-09-18 09:24:24 -07:00
fjy f7df951610 broker needs to announce itself in service discovery 2013-09-18 09:23:46 -07:00
cheddar 4557838c5d Merge pull request #241 from rjurney/guice
Updated config to create tables.
2013-09-17 17:58:52 -07:00
Russell Jurney 295426df9f Updated config to create tables. 2013-09-17 17:07:55 -07:00
cheddar 48dea82890 Merge pull request #240 from rjurney/guice
Working import, sans tables
2013-09-17 13:14:45 -07:00
fjy 64f3821b4e throw exception for annotated members 2013-09-16 17:36:31 -07:00
Russell Jurney 6df31408d9 made layouts work 2013-09-16 17:09:59 -07:00
Russell Jurney 946a9e502f Replaced spaces with dashes 2013-09-16 16:19:49 -07:00
fjy cabae7993d port over multi threaded realtime and also fix broken realtime nodes that can't start up 2013-09-16 16:03:47 -07:00
Russell Jurney 063a068ab2 Converted links, sans space to slash 2013-09-16 16:01:14 -07:00
Russell Jurney 248fba683a Added prepend tag to make pages display. 2013-09-16 14:49:36 -07:00
Russell Jurney c06b37f36e Won't serve html 2013-09-16 14:08:22 -07:00
fjy 9b4c3756ed fix exception catching logic of moving segments 2013-09-15 10:27:37 -07:00
Gian Merlino 163fa14e62 [maven-release-plugin] prepare for next development iteration 2013-09-13 19:02:46 -07:00
Gian Merlino a20f3fc6dd [maven-release-plugin] prepare release druid-0.5.58 2013-09-13 19:02:40 -07:00
fjy d0b0adbb68 [maven-release-plugin] prepare for next development iteration 2013-09-13 18:57:25 -07:00
fjy 23c5fdb107 [maven-release-plugin] prepare release druid-0.5.57 2013-09-13 18:57:20 -07:00
fjy b0a09ba1f1 [maven-release-plugin] prepare for next development iteration 2013-09-13 18:45:20 -07:00
fjy b17f5c403b [maven-release-plugin] prepare release druid-0.5.56 2013-09-13 18:45:14 -07:00
fjy 30bde45556 Merge branch 'master' of github.com:metamx/druid 2013-09-13 18:41:36 -07:00
fjy 5a8b71ddec fix how druid services is assembled 2013-09-13 18:41:33 -07:00