Commit Graph

310 Commits

Author SHA1 Message Date
Gian Merlino dfe91d3bf9 RealtimeIndexTask: Close firehose after finishing plumbing job 2013-03-19 18:02:23 -07:00
Gian Merlino ed56bc52e9 RealtimeIndexTask: Better handle early shutdowns 2013-03-19 17:56:28 -07:00
Gian Merlino 76f4d12059 ForkingTaskRunner: Totally ridiculous graceful shutdown mechanism 2013-03-19 17:56:22 -07:00
Gian Merlino 6324225a4f ExecutorMain: Shut down when our parent disappears 2013-03-19 16:32:01 -07:00
Gian Merlino 243e70a3c0 TaskConsumer: Less complainy when interrupted 2013-03-19 16:31:37 -07:00
Fangjin Yang e5f46f2a66 fix more startup problems 2013-03-19 12:45:35 -07:00
Fangjin Yang 69a0e0e1a7 fix nodes not able to start 2013-03-19 12:35:02 -07:00
Fangjin Yang d53822130b Merge branch 'forking-task-runner' into stop_task
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/task/AbstractTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorResource.java
2013-03-19 12:23:20 -07:00
Fangjin Yang 30fdb2956d intiial commit for stop task 2013-03-19 11:30:33 -07:00
Gian Merlino ec566ee37a Ability to run tasks in separate JVMs, and cancel tasks.
- ForkingTaskRunner spawns new JVMs for each task
- Added ExecutorMain, ExecutorNode to be the spawned JVM
- LocalTaskRunner renamed ExecutorServiceTaskRunner
- Add shutdown method to Task and TaskRunner
2013-03-19 11:01:03 -07:00
Gian Merlino d1eb61d451 TaskAction:
- Add isAudited
- Generally straighten out Jackson annotations
2013-03-19 11:00:39 -07:00
Gian Merlino 922ed66a91 Task: Fix comments in preamble 2013-03-19 11:00:39 -07:00
Gian Merlino b5e7bff927 TaskMasterLifecycle: Less noisy exit when interrupted 2013-03-19 11:00:38 -07:00
Gian Merlino 5f513be363 Merger: Replace TaskCallback with ListenableFuture<TaskStatus> 2013-03-19 11:00:38 -07:00
Gian Merlino 5c3db75a01 IndexGeneratorTask: Fix serialization 2013-03-19 11:00:38 -07:00
Gian Merlino d163f07ae0 Task: preflight takes TaskActionClient instead of TaskToolbox 2013-03-19 11:00:36 -07:00
Eric Tschetter f47319f118 [maven-release-plugin] prepare for next development iteration 2013-03-18 17:09:01 -05:00
Eric Tschetter 1066144b43 [maven-release-plugin] prepare release druid-0.3.25 2013-03-18 17:08:56 -05:00
Eric Tschetter cba404a65d [maven-release-plugin] prepare for next development iteration 2013-03-18 13:02:40 -05:00
Eric Tschetter 29a0a7e6c6 [maven-release-plugin] prepare release druid-0.3.24 2013-03-18 13:02:33 -05:00
Eric Tschetter bbed862b0b Merge branch 'master' of github.com:metamx/druid 2013-03-18 12:59:33 -05:00
Eric Tschetter e3674368ab 1) Fix bug with the MergeTask not setting the binaryVersion field on DataSegments and causing the converter to run a lot. 2013-03-18 12:57:01 -05:00
Fangjin Yang b9de751b32 [maven-release-plugin] prepare for next development iteration 2013-03-15 14:32:31 -07:00
Fangjin Yang 57655f19c4 [maven-release-plugin] prepare release druid-0.3.23 2013-03-15 14:32:24 -07:00
Eric Tschetter 72b82b1b1d 1) Remove logline that really shouldn't be there. 2013-03-15 15:50:37 -05:00
Eric Tschetter 7dacf952d6 [maven-release-plugin] prepare for next development iteration 2013-03-15 13:53:39 -05:00
Eric Tschetter ff017fe72a [maven-release-plugin] prepare release druid-0.3.22 2013-03-15 13:53:33 -05:00
Eric Tschetter a933438e4e 1) Fix bugs with VersionConverterTask
2) Fix bugs with NPEs on indexing
2013-03-15 13:48:55 -05:00
Gian Merlino f6752799bc Merge branch 'master' into realtime-index-task
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/actions/SegmentInsertAction.java
2013-03-14 13:45:59 -07:00
Gian Merlino e45a51714f RealtimeIndexTask: Fix serde 2013-03-14 13:43:40 -07:00
Gian Merlino b8c08f235a Realtime:
- Move VersioningPolicy, RetryPolicy outside of RealtimePlumberSchool
- Move plumber stuff into its own package, since there's a lot of it
2013-03-14 12:56:25 -07:00
Gian Merlino c34108418a RealtimeIndexTask: Reword comments 2013-03-14 12:49:17 -07:00
Gian Merlino 9fe6a37f86 Realtime: Remove MetadataUpdater 2013-03-14 12:35:38 -07:00
Gian Merlino 055a98a89c Merger: Fix VersionConverterTask version selection by making SegmentInsertAction more flexible 2013-03-14 10:37:59 -07:00
Gian Merlino e5d5050c3f RemoteTaskActionClient: Log retry timer on errors 2013-03-13 23:06:55 -07:00
Gian Merlino df8e4d4061 Merge branch 'master' into realtime-index-task 2013-03-13 22:43:01 -07:00
Gian Merlino a1c823402b Merger: Make json exceptions while bootstrapping non-fatal 2013-03-13 22:42:29 -07:00
Gian Merlino cf470b1ed4 Merger: Task serde without relying on jackson private-final-setter magic 2013-03-13 22:42:29 -07:00
Eric Tschetter 4c165b4880 1) Better logging of master doing version checking
2) Exception out when the scv cannot find its indexer
2013-03-13 19:15:29 -05:00
Eric Tschetter 2bd34f1454 [maven-release-plugin] prepare for next development iteration 2013-03-13 18:32:00 -05:00
Eric Tschetter b7960e202d [maven-release-plugin] prepare release druid-0.3.21 2013-03-13 18:31:55 -05:00
Eric Tschetter 32f8b09733 Merge branch 'master' of github.com:metamx/druid 2013-03-13 18:29:54 -05:00
Eric Tschetter 688e5e7417 1) Serialization of Tasks is important 2013-03-13 18:29:47 -05:00
Fangjin Yang 60e75d21ce Merge branch 'master' of github.com:metamx/druid 2013-03-13 15:45:21 -07:00
Fangjin Yang 16de004fdc fix json 2013-03-13 15:45:07 -07:00
Eric Tschetter f1175389c4 [maven-release-plugin] prepare for next development iteration 2013-03-13 16:33:17 -05:00
Eric Tschetter 8aac482618 [maven-release-plugin] prepare release druid-0.3.20 2013-03-13 16:33:10 -05:00
Fangjin Yang 86c7ebe1e2 autoscaling will clear state if a node takes too long to create 2013-03-13 14:28:18 -07:00
Fangjin Yang ac2d4e52da bug fix for indexer coordinator not alerting when worker provisioning taking too long 2013-03-13 14:09:21 -07:00
Fangjin Yang a49d0c5e4c [maven-release-plugin] prepare for next development iteration 2013-03-11 17:20:16 -07:00