Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
936 Commits 111 Branches 503 Tags 725 MiB
Commit Graph

213 Commits

Author SHA1 Message Date
cheddar e21e85b9fa 1) Make RealtimeIndexTask merge results like it should 2013-05-01 13:08:13 -05:00
cheddar 8922adb1f2 1) Make the demos work again. 
2) First step in restructuring the demos into a single repository
 2013-04-30 18:13:55 -05:00
cheddar cee15bb88a Adjust passing of nodeType to ExecutorMain to be via a system property instead of via a command line argument. 2013-04-29 12:05:59 -05:00
cheddar 405eed7c60 Better name for ServerInventoryThingie 2013-04-29 11:48:42 -05:00
cheddar 52ba60963e Screwed up the conflicts on rebasing. Fixorz orz orz 2013-04-26 19:25:23 -05:00
cheddar 3e94204c44 1) Switch from com.netflix.curator to org.apache.curator 2013-04-26 19:19:55 -05:00
cheddar f71b941a1a 1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer 
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
 2013-04-26 19:19:54 -05:00
cheddar 7370b0f2fc 1) Cleanup TODO comments 2013-04-26 19:19:54 -05:00
cheddar 43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers 
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
 2013-04-26 19:19:23 -05:00
Gian Merlino 4f4ebd5a77 Merger: Switch payloads from strings to bytes 2013-04-19 16:59:09 -07:00
Gian Merlino 7da1466340 RealtimeIndexTask: Fix minTime serialization 2013-04-19 15:50:09 -07:00
Gian Merlino 376df4032d IndexerCoordinatorNode: Only create tables when in "db" storage mode 2013-04-19 15:26:00 -07:00
Gian Merlino 17205ebea4 RealtimeIndexTask: Add minTime to assist in graceful switchover 2013-04-19 14:07:28 -07:00
Gian Merlino 1a6594524f Merger: Tweaks to DB tables. Create tables automatically. 2013-04-19 14:07:27 -07:00
Gian Merlino cdbdf843c0 Merger: Tweaks to task shutdown 2013-04-15 18:51:01 -07:00
Gian Merlino cafbcdb899 Merger: Tweaks to task tracking 2013-04-15 18:15:33 -07:00
Gian Merlino 3884ebbc3e ForkingTaskRunner: Fix properties loading 2013-04-15 16:41:54 -07:00
Fangjin Yang 8a4ec1cd17 Merge branch 'stop_task' of github.com:metamx/druid into stop_task 2013-04-12 22:13:22 -07:00
Fangjin Yang bacb1e5520 update fix 2013-04-12 22:12:22 -07:00
Gian Merlino a0b2a34845 Merge branch 'master' into stop_task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/actions/LockListAction.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/ExecutorServiceTaskRunner.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
	merger/src/main/java/com/metamx/druid/merger/worker/http/WorkerNode.java
 2013-04-12 14:10:27 -07:00
Gian Merlino c21d7f6ee2 ForkingTaskRunner: Slight tweaks to setup and teardown 2013-04-12 14:06:51 -07:00
Fangjin Yang a24274029f change shutdown logic for firehose 2013-04-12 11:49:01 -07:00
Fangjin Yang 465b78b4bc more changes 2013-04-10 20:21:26 -07:00
Gian Merlino eaea8ae163 - Ability to cancel pending tasks in the ForkingTaskRunner. 
- Other various changes from code review.
 2013-04-10 19:54:22 -07:00
cheddar a678f08b67 Merge pull request #118 from darxriggs/master 
cleanup & refactoring
 2013-04-09 18:56:59 -07:00
Gian Merlino f90304d07b Merger: Task logging system 2013-04-09 10:34:15 -07:00
Gian Merlino 33434f2c82 Executor: Move most logic out of main 2013-04-09 10:34:14 -07:00
Fangjin Yang 120b822c18 Merge branch 'master' of github.com:metamx/druid 
Conflicts:
	client/src/main/java/com/metamx/druid/QueryableNode.java
	server/src/main/java/com/metamx/druid/http/ComputeNode.java
 2013-04-08 11:24:17 -07:00
Fangjin Yang 925c104dd2 update emitter version and fix some NPEs 2013-04-08 11:23:08 -07:00
René Scheibe 6c27cd2e8e cleanup - removed unused imports 2013-04-07 23:31:22 +02:00
René Scheibe a6dc29cf85 cleanup - removed extra empty lines 
- there should not be any adjacent empty lines
 2013-04-07 14:32:09 +02:00
Eric Tschetter 0b621c7bde 1) Expand logging of unregistering real-time segments to help diagnose strange zookeeper behavior 2013-04-06 11:10:36 -05:00
Fangjin Yang 537f527960 Merge branch 'master' into stop_task 
Conflicts:
	merger/src/test/java/com/metamx/druid/merger/coordinator/RemoteTaskRunnerTest.java
 2013-03-26 14:14:23 -07:00
Fangjin Yang a7d836a0dd fix NPE for master balancing; introduce max number of workers for indexing service 2013-03-26 10:25:52 -07:00
Fangjin Yang f0f4eee787 Merge branch 'master' into stop_task 2013-03-25 13:31:03 -07:00
Gian Merlino dcd10e69c7 WorkerTaskMonitor: Fix isTaskRunning check 2013-03-24 18:19:32 -07:00
Fangjin Yang a1dcdab54d clean up shutdown 2013-03-20 10:51:16 -07:00
Gian Merlino dc615ab795 RealtimePlumberSchool: Faster graceful shutdown 2013-03-19 18:29:00 -07:00
Gian Merlino 017278a5d5 IndexerCoordinatorResource: Un-break null returns 2013-03-19 18:18:33 -07:00
Gian Merlino dfe91d3bf9 RealtimeIndexTask: Close firehose after finishing plumbing job 2013-03-19 18:02:23 -07:00
Gian Merlino ed56bc52e9 RealtimeIndexTask: Better handle early shutdowns 2013-03-19 17:56:28 -07:00
Gian Merlino 76f4d12059 ForkingTaskRunner: Totally ridiculous graceful shutdown mechanism 2013-03-19 17:56:22 -07:00
Gian Merlino 6324225a4f ExecutorMain: Shut down when our parent disappears 2013-03-19 16:32:01 -07:00
Gian Merlino 243e70a3c0 TaskConsumer: Less complainy when interrupted 2013-03-19 16:31:37 -07:00
Fangjin Yang e5f46f2a66 fix more startup problems 2013-03-19 12:45:35 -07:00
Fangjin Yang 69a0e0e1a7 fix nodes not able to start 2013-03-19 12:35:02 -07:00
Fangjin Yang d53822130b Merge branch 'forking-task-runner' into stop_task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/task/AbstractTask.java
	merger/src/main/java/com/metamx/druid/merger/common/task/Task.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorResource.java
 2013-03-19 12:23:20 -07:00
Fangjin Yang 30fdb2956d intiial commit for stop task 2013-03-19 11:30:33 -07:00
Gian Merlino ec566ee37a Ability to run tasks in separate JVMs, and cancel tasks. 
- ForkingTaskRunner spawns new JVMs for each task
- Added ExecutorMain, ExecutorNode to be the spawned JVM
- LocalTaskRunner renamed ExecutorServiceTaskRunner
- Add shutdown method to Task and TaskRunner
 2013-03-19 11:01:03 -07:00
Gian Merlino d1eb61d451 TaskAction: 
- Add isAudited
- Generally straighten out Jackson annotations
 2013-03-19 11:00:39 -07:00