Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
936 Commits 111 Branches 503 Tags 721 MiB
Commit Graph

393 Commits

Author SHA1 Message Date
Fangjin Yang f0ab28be90 [maven-release-plugin] prepare release druid-0.3.34 2013-04-08 11:26:32 -07:00
Fangjin Yang 120b822c18 Merge branch 'master' of github.com:metamx/druid 
Conflicts:
	client/src/main/java/com/metamx/druid/QueryableNode.java
	server/src/main/java/com/metamx/druid/http/ComputeNode.java
 2013-04-08 11:24:17 -07:00
Fangjin Yang 925c104dd2 update emitter version and fix some NPEs 2013-04-08 11:23:08 -07:00
René Scheibe 6c27cd2e8e cleanup - removed unused imports 2013-04-07 23:31:22 +02:00
René Scheibe a6dc29cf85 cleanup - removed extra empty lines 
- there should not be any adjacent empty lines
 2013-04-07 14:32:09 +02:00
Eric Tschetter 0b621c7bde 1) Expand logging of unregistering real-time segments to help diagnose strange zookeeper behavior 2013-04-06 11:10:36 -05:00
Fangjin Yang 8b100248a8 [maven-release-plugin] prepare for next development iteration 2013-04-01 17:17:50 -07:00
Fangjin Yang bbb3991bc9 [maven-release-plugin] prepare release druid-0.3.33 2013-04-01 17:17:44 -07:00
Fangjin Yang e8c6936aca [maven-release-plugin] prepare for next development iteration 2013-04-01 14:28:43 -07:00
Fangjin Yang 1f342dc0f2 [maven-release-plugin] prepare release druid-0.3.32 2013-04-01 14:28:36 -07:00
Fangjin Yang 30465b5c26 [maven-release-plugin] prepare for next development iteration 2013-03-28 19:48:46 -07:00
Fangjin Yang 1515dddfe0 [maven-release-plugin] prepare release druid-0.3.31 2013-03-28 19:48:39 -07:00
Fangjin Yang 04a46fb74f [maven-release-plugin] prepare for next development iteration 2013-03-28 19:21:14 -07:00
Fangjin Yang 36601ee3aa [maven-release-plugin] prepare release druid-0.3.30 2013-03-28 19:21:07 -07:00
Fangjin Yang 9e54e11827 [maven-release-plugin] prepare for next development iteration 2013-03-27 11:55:48 -07:00
Fangjin Yang 8fee044c68 [maven-release-plugin] prepare release druid-0.3.29 2013-03-27 11:55:38 -07:00
Fangjin Yang 537f527960 Merge branch 'master' into stop_task 
Conflicts:
	merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
 2013-03-26 14:14:23 -07:00
Fangjin Yang e785b87be0 [maven-release-plugin] prepare for next development iteration 2013-03-26 11:10:15 -07:00
Fangjin Yang a97287fa50 [maven-release-plugin] prepare release druid-0.3.28 2013-03-26 11:10:04 -07:00
Fangjin Yang f38566de7a Merge branch 'master' of github.com:metamx/druid 2013-03-26 10:26:12 -07:00
Fangjin Yang a7d836a0dd fix NPE for master balancing; introduce max number of workers for indexing service 2013-03-26 10:25:52 -07:00
Eric Tschetter 42ca6aff4f Merge branch 'master' of github.com:metamx/druid 2013-03-26 09:07:28 -05:00
Eric Tschetter 2306602e93 1) Remove zookeeper 3.4.3 dependency from merger 2013-03-26 09:06:11 -05:00
Fangjin Yang f0f4eee787 Merge branch 'master' into stop_task 2013-03-25 13:31:03 -07:00
Fangjin Yang efd57dcf38 [maven-release-plugin] prepare for next development iteration 2013-03-25 13:17:50 -07:00
Fangjin Yang 3d7a0ea2d3 [maven-release-plugin] prepare release druid-0.3.27 2013-03-25 13:17:43 -07:00
Gian Merlino dcd10e69c7 WorkerTaskMonitor: Fix isTaskRunning check 2013-03-24 18:19:32 -07:00
Fangjin Yang e4c8122f9c Merge branch 'master' of github.com:metamx/druid into stop_task 2013-03-22 12:53:51 -07:00
Eric Tschetter 35cfd1f186 [maven-release-plugin] prepare for next development iteration 2013-03-21 13:14:20 -05:00
Eric Tschetter 3860710f11 [maven-release-plugin] prepare release druid-0.3.26 2013-03-21 13:14:14 -05:00
Fangjin Yang a1dcdab54d clean up shutdown 2013-03-20 10:51:16 -07:00
Gian Merlino dc615ab795 RealtimePlumberSchool: Faster graceful shutdown 2013-03-19 18:29:00 -07:00
Gian Merlino 017278a5d5 IndexerCoordinatorResource: Un-break null returns 2013-03-19 18:18:33 -07:00
Gian Merlino dfe91d3bf9 RealtimeIndexTask: Close firehose after finishing plumbing job 2013-03-19 18:02:23 -07:00
Gian Merlino ed56bc52e9 RealtimeIndexTask: Better handle early shutdowns 2013-03-19 17:56:28 -07:00
Gian Merlino 76f4d12059 ForkingTaskRunner: Totally ridiculous graceful shutdown mechanism 2013-03-19 17:56:22 -07:00
Gian Merlino 6324225a4f ExecutorMain: Shut down when our parent disappears 2013-03-19 16:32:01 -07:00
Gian Merlino 243e70a3c0 TaskConsumer: Less complainy when interrupted 2013-03-19 16:31:37 -07:00
Fangjin Yang e5f46f2a66 fix more startup problems 2013-03-19 12:45:35 -07:00
Fangjin Yang 69a0e0e1a7 fix nodes not able to start 2013-03-19 12:35:02 -07:00
Fangjin Yang d53822130b Merge branch 'forking-task-runner' into stop_task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/task/AbstractTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorResource.java
 2013-03-19 12:23:20 -07:00
Fangjin Yang 30fdb2956d intiial commit for stop task 2013-03-19 11:30:33 -07:00
Gian Merlino ec566ee37a Ability to run tasks in separate JVMs, and cancel tasks. 
- ForkingTaskRunner spawns new JVMs for each task
- Added ExecutorMain, ExecutorNode to be the spawned JVM
- LocalTaskRunner renamed ExecutorServiceTaskRunner
- Add shutdown method to Task and TaskRunner
 2013-03-19 11:01:03 -07:00
Gian Merlino d1eb61d451 TaskAction: 
- Add isAudited
- Generally straighten out Jackson annotations
 2013-03-19 11:00:39 -07:00
Gian Merlino 922ed66a91 Task: Fix comments in preamble 2013-03-19 11:00:39 -07:00
Gian Merlino b5e7bff927 TaskMasterLifecycle: Less noisy exit when interrupted 2013-03-19 11:00:38 -07:00
Gian Merlino 5f513be363 Merger: Replace TaskCallback with ListenableFuture<TaskStatus> 2013-03-19 11:00:38 -07:00
Gian Merlino 5c3db75a01 IndexGeneratorTask: Fix serialization 2013-03-19 11:00:38 -07:00
Gian Merlino d163f07ae0 Task: preflight takes TaskActionClient instead of TaskToolbox 2013-03-19 11:00:36 -07:00
Eric Tschetter f47319f118 [maven-release-plugin] prepare for next development iteration 2013-03-18 17:09:01 -05:00
Eric Tschetter 1066144b43 [maven-release-plugin] prepare release druid-0.3.25 2013-03-18 17:08:56 -05:00
Eric Tschetter cba404a65d [maven-release-plugin] prepare for next development iteration 2013-03-18 13:02:40 -05:00
Eric Tschetter 29a0a7e6c6 [maven-release-plugin] prepare release druid-0.3.24 2013-03-18 13:02:33 -05:00
Eric Tschetter bbed862b0b Merge branch 'master' of github.com:metamx/druid 2013-03-18 12:59:33 -05:00
Eric Tschetter e3674368ab 1) Fix bug with the MergeTask not setting the binaryVersion field on DataSegments and causing the converter to run a lot. 2013-03-18 12:57:01 -05:00
Fangjin Yang b9de751b32 [maven-release-plugin] prepare for next development iteration 2013-03-15 14:32:31 -07:00
Fangjin Yang 57655f19c4 [maven-release-plugin] prepare release druid-0.3.23 2013-03-15 14:32:24 -07:00
Eric Tschetter 72b82b1b1d 1) Remove logline that really shouldn't be there. 2013-03-15 15:50:37 -05:00
Eric Tschetter 7dacf952d6 [maven-release-plugin] prepare for next development iteration 2013-03-15 13:53:39 -05:00
Eric Tschetter ff017fe72a [maven-release-plugin] prepare release druid-0.3.22 2013-03-15 13:53:33 -05:00
Eric Tschetter a933438e4e 1) Fix bugs with VersionConverterTask 
2) Fix bugs with NPEs on indexing
 2013-03-15 13:48:55 -05:00
Gian Merlino f6752799bc Merge branch 'master' into realtime-index-task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/actions/SegmentInsertAction.java
 2013-03-14 13:45:59 -07:00
Gian Merlino e45a51714f RealtimeIndexTask: Fix serde 2013-03-14 13:43:40 -07:00
Gian Merlino b8c08f235a Realtime: 
- Move VersioningPolicy, RetryPolicy outside of RealtimePlumberSchool
- Move plumber stuff into its own package, since there's a lot of it
 2013-03-14 12:56:25 -07:00
Gian Merlino c34108418a RealtimeIndexTask: Reword comments 2013-03-14 12:49:17 -07:00
Gian Merlino 9fe6a37f86 Realtime: Remove MetadataUpdater 2013-03-14 12:35:38 -07:00
Gian Merlino 055a98a89c Merger: Fix VersionConverterTask version selection by making SegmentInsertAction more flexible 2013-03-14 10:37:59 -07:00
Gian Merlino e5d5050c3f RemoteTaskActionClient: Log retry timer on errors 2013-03-13 23:06:55 -07:00
Gian Merlino df8e4d4061 Merge branch 'master' into realtime-index-task 2013-03-13 22:43:01 -07:00
Gian Merlino a1c823402b Merger: Make json exceptions while bootstrapping non-fatal 2013-03-13 22:42:29 -07:00
Gian Merlino cf470b1ed4 Merger: Task serde without relying on jackson private-final-setter magic 2013-03-13 22:42:29 -07:00
Eric Tschetter 4c165b4880 1) Better logging of master doing version checking 
2) Exception out when the scv cannot find its indexer
 2013-03-13 19:15:29 -05:00
Eric Tschetter 2bd34f1454 [maven-release-plugin] prepare for next development iteration 2013-03-13 18:32:00 -05:00
Eric Tschetter b7960e202d [maven-release-plugin] prepare release druid-0.3.21 2013-03-13 18:31:55 -05:00
Eric Tschetter 32f8b09733 Merge branch 'master' of github.com:metamx/druid 2013-03-13 18:29:54 -05:00
Eric Tschetter 688e5e7417 1) Serialization of Tasks is important 2013-03-13 18:29:47 -05:00
Fangjin Yang 60e75d21ce Merge branch 'master' of github.com:metamx/druid 2013-03-13 15:45:21 -07:00
Fangjin Yang 16de004fdc fix json 2013-03-13 15:45:07 -07:00
Eric Tschetter f1175389c4 [maven-release-plugin] prepare for next development iteration 2013-03-13 16:33:17 -05:00
Eric Tschetter 8aac482618 [maven-release-plugin] prepare release druid-0.3.20 2013-03-13 16:33:10 -05:00
Fangjin Yang 86c7ebe1e2 autoscaling will clear state if a node takes too long to create 2013-03-13 14:28:18 -07:00
Fangjin Yang ac2d4e52da bug fix for indexer coordinator not alerting when worker provisioning taking too long 2013-03-13 14:09:21 -07:00
Fangjin Yang a49d0c5e4c [maven-release-plugin] prepare for next development iteration 2013-03-11 17:20:16 -07:00
Fangjin Yang 97f828f6b1 [maven-release-plugin] prepare release druid-0.3.19 2013-03-11 17:20:09 -07:00
Gian Merlino 765e70bc8e RemoteTaskActionClient: Better logging 2013-03-11 15:23:45 -07:00
Gian Merlino 34d6b3a7f0 Merger: 
- RealtimeIndexTask: Drop locks on startup
- RealtimeIndexTask: Acquire lock before announcing a new segment
- Retry failed RemoteTaskActionClient submissions using a RetryPolicy
- Add comments to RealtimeIndexTask
 2013-03-11 14:08:05 -07:00
Gian Merlino 6245e38981 RealtimeIndexTask-related stuff. 
- New task: RealtimeIndexTask
- Add SegmentAnnouncer, ServerView, QueryRunnerFactoryConglomerate to TaskToolbox
- Tasks can advertise ability to answer queries (through returning non-null from
  getQueryRunner)
- WorkerTaskMonitor (the thing on a worker that tracks running tasks) is now a
  QuerySegmentWalker
- LockAcquireAction is now blocking

Assorted other changes.
- TaskAction.perform throws IOException
- TaskActions generally have better stringification
- Renamed TaskMonitor -> WorkerTaskMonitor
 2013-03-11 11:22:36 -07:00
Gian Merlino 0e4db00d54 TaskQueue: Fix task ordering when bootstrapping 2013-03-11 11:15:19 -07:00
Gian Merlino 4643030716 TaskToolbox: Rename getTaskActionClientFactory -> getTaskActionClient 2013-03-07 22:38:28 -08:00
Gian Merlino 08bff3f472 Merger: Fix JacksonConfigManager initialization 2013-03-07 22:06:42 -08:00
Eric Tschetter b979096d74 1) Building is good 2013-03-07 18:46:51 -06:00
Eric Tschetter d1ffe93c5a Merge remote branch 'origin/convert_task' into convert_task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/TaskMasterLifecycle.java
 2013-03-07 18:12:31 -06:00
Eric Tschetter f70f71243d 1) Stop polling in ConfigManager when stop is called 
2) Remove WorkSetupManager in favor of just using ConfigManager
 2013-03-07 17:45:57 -06:00
Eric Tschetter 1c3ef48f34 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable 
2) Use new ConfigManager to pull out a whitelist for the Master
 2013-03-07 17:45:57 -06:00
Eric Tschetter 6864007c05 1) Remove Task parameter from other methods off of TaskToolbox that required it 
2) Move getTaskDir() off of TaskConfig and onto TaskToolbox
3) Rename SegmentKiller interface to DataSegmentKiller
4) Change signature of "DataSegmentKiller.kill(Collection<DataSegment>) throws ServiceException" to just kill(DataSegment) throws SegmentLoadingException
5) Add various log messages
6) Update the version of the segment that has been converted
 2013-03-07 17:44:06 -06:00
Eric Tschetter c9b411c0ca 1) Remove the need for TaskActions to require a Task as a constructor parameter 2013-03-07 17:44:05 -06:00
Eric Tschetter a11a34f87e 1) Initial commit: Converter Task 2013-03-07 17:44:05 -06:00
Eric Tschetter ef4ccce30c 1) Stop polling in ConfigManager when stop is called 
2) Remove WorkSetupManager in favor of just using ConfigManager
 2013-03-07 17:43:37 -06:00
Eric Tschetter 9ffccb6803 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable 
2) Use new ConfigManager to pull out a whitelist for the Master
 2013-03-07 12:59:59 -06:00
Fangjin Yang 1b9bbb2f2a remove test code 2013-03-06 11:20:27 -08:00