Commit Graph

343 Commits

Author SHA1 Message Date
Gian Merlino c21d7f6ee2 ForkingTaskRunner: Slight tweaks to setup and teardown 2013-04-12 14:06:51 -07:00
Fangjin Yang a24274029f change shutdown logic for firehose 2013-04-12 11:49:01 -07:00
Fangjin Yang 465b78b4bc more changes 2013-04-10 20:21:26 -07:00
Gian Merlino eaea8ae163 - Ability to cancel pending tasks in the ForkingTaskRunner.
- Other various changes from code review.
2013-04-10 19:54:22 -07:00
Gian Merlino f90304d07b Merger: Task logging system 2013-04-09 10:34:15 -07:00
Gian Merlino 33434f2c82 Executor: Move most logic out of main 2013-04-09 10:34:14 -07:00
Fangjin Yang e125a58f0e [maven-release-plugin] prepare for next development iteration 2013-04-09 10:34:14 -07:00
Fangjin Yang 27cef03724 [maven-release-plugin] prepare release druid-0.3.33 2013-04-09 10:34:14 -07:00
Fangjin Yang 2fcf7e018b [maven-release-plugin] prepare for next development iteration 2013-04-09 10:34:14 -07:00
Fangjin Yang 4f232fe430 [maven-release-plugin] prepare release druid-0.3.32 2013-04-09 10:34:14 -07:00
Fangjin Yang bf2f2df22c [maven-release-plugin] prepare for next development iteration 2013-04-09 10:34:13 -07:00
Fangjin Yang d4dc593ecc [maven-release-plugin] prepare release druid-0.3.31 2013-04-09 10:34:13 -07:00
Fangjin Yang 185d367153 [maven-release-plugin] prepare for next development iteration 2013-04-09 10:34:12 -07:00
Fangjin Yang ff0fdc15c2 [maven-release-plugin] prepare release druid-0.3.30 2013-04-09 10:34:12 -07:00
Fangjin Yang dbb03deb26 [maven-release-plugin] prepare for next development iteration 2013-04-09 10:34:12 -07:00
Fangjin Yang ef50da3b9b [maven-release-plugin] prepare release druid-0.3.29 2013-04-09 10:34:12 -07:00
Fangjin Yang 537f527960 Merge branch 'master' into stop_task
Conflicts:
	merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
2013-03-26 14:14:23 -07:00
Fangjin Yang e785b87be0 [maven-release-plugin] prepare for next development iteration 2013-03-26 11:10:15 -07:00
Fangjin Yang a97287fa50 [maven-release-plugin] prepare release druid-0.3.28 2013-03-26 11:10:04 -07:00
Fangjin Yang f38566de7a Merge branch 'master' of github.com:metamx/druid 2013-03-26 10:26:12 -07:00
Fangjin Yang a7d836a0dd fix NPE for master balancing; introduce max number of workers for indexing service 2013-03-26 10:25:52 -07:00
Eric Tschetter 42ca6aff4f Merge branch 'master' of github.com:metamx/druid 2013-03-26 09:07:28 -05:00
Eric Tschetter 2306602e93 1) Remove zookeeper 3.4.3 dependency from merger 2013-03-26 09:06:11 -05:00
Fangjin Yang f0f4eee787 Merge branch 'master' into stop_task 2013-03-25 13:31:03 -07:00
Fangjin Yang efd57dcf38 [maven-release-plugin] prepare for next development iteration 2013-03-25 13:17:50 -07:00
Fangjin Yang 3d7a0ea2d3 [maven-release-plugin] prepare release druid-0.3.27 2013-03-25 13:17:43 -07:00
Gian Merlino dcd10e69c7 WorkerTaskMonitor: Fix isTaskRunning check 2013-03-24 18:19:32 -07:00
Fangjin Yang e4c8122f9c Merge branch 'master' of github.com:metamx/druid into stop_task 2013-03-22 12:53:51 -07:00
Eric Tschetter 35cfd1f186 [maven-release-plugin] prepare for next development iteration 2013-03-21 13:14:20 -05:00
Eric Tschetter 3860710f11 [maven-release-plugin] prepare release druid-0.3.26 2013-03-21 13:14:14 -05:00
Fangjin Yang a1dcdab54d clean up shutdown 2013-03-20 10:51:16 -07:00
Gian Merlino dc615ab795 RealtimePlumberSchool: Faster graceful shutdown 2013-03-19 18:29:00 -07:00
Gian Merlino 017278a5d5 IndexerCoordinatorResource: Un-break null returns 2013-03-19 18:18:33 -07:00
Gian Merlino dfe91d3bf9 RealtimeIndexTask: Close firehose after finishing plumbing job 2013-03-19 18:02:23 -07:00
Gian Merlino ed56bc52e9 RealtimeIndexTask: Better handle early shutdowns 2013-03-19 17:56:28 -07:00
Gian Merlino 76f4d12059 ForkingTaskRunner: Totally ridiculous graceful shutdown mechanism 2013-03-19 17:56:22 -07:00
Gian Merlino 6324225a4f ExecutorMain: Shut down when our parent disappears 2013-03-19 16:32:01 -07:00
Gian Merlino 243e70a3c0 TaskConsumer: Less complainy when interrupted 2013-03-19 16:31:37 -07:00
Fangjin Yang e5f46f2a66 fix more startup problems 2013-03-19 12:45:35 -07:00
Fangjin Yang 69a0e0e1a7 fix nodes not able to start 2013-03-19 12:35:02 -07:00
Fangjin Yang d53822130b Merge branch 'forking-task-runner' into stop_task
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/task/AbstractTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorResource.java
2013-03-19 12:23:20 -07:00
Fangjin Yang 30fdb2956d intiial commit for stop task 2013-03-19 11:30:33 -07:00
Gian Merlino ec566ee37a Ability to run tasks in separate JVMs, and cancel tasks.
- ForkingTaskRunner spawns new JVMs for each task
- Added ExecutorMain, ExecutorNode to be the spawned JVM
- LocalTaskRunner renamed ExecutorServiceTaskRunner
- Add shutdown method to Task and TaskRunner
2013-03-19 11:01:03 -07:00
Gian Merlino d1eb61d451 TaskAction:
- Add isAudited
- Generally straighten out Jackson annotations
2013-03-19 11:00:39 -07:00
Gian Merlino 922ed66a91 Task: Fix comments in preamble 2013-03-19 11:00:39 -07:00
Gian Merlino b5e7bff927 TaskMasterLifecycle: Less noisy exit when interrupted 2013-03-19 11:00:38 -07:00
Gian Merlino 5f513be363 Merger: Replace TaskCallback with ListenableFuture<TaskStatus> 2013-03-19 11:00:38 -07:00
Gian Merlino 5c3db75a01 IndexGeneratorTask: Fix serialization 2013-03-19 11:00:38 -07:00
Gian Merlino d163f07ae0 Task: preflight takes TaskActionClient instead of TaskToolbox 2013-03-19 11:00:36 -07:00
Eric Tschetter f47319f118 [maven-release-plugin] prepare for next development iteration 2013-03-18 17:09:01 -05:00