Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,106 Commits 113 Branches 504 Tags 718 MiB
Commit Graph

232 Commits

Author SHA1 Message Date
fjy efc92e7ca6 bug fixes for segment metadata queries and spatial indexing 2013-05-20 20:19:18 -07:00
fjy 803e8ff69e add configurable spatial dimensions to hadoop indexer 2013-05-14 17:38:05 -07:00
fjy e8ab0893ff fix column size reporting 2013-05-14 14:52:38 -07:00
fjy 5c9df85883 better path validation 2013-05-13 15:21:45 -07:00
fjy 53c3af6633 actually fix the bug mentioned in the last commit 2013-05-13 12:37:21 -07:00
fjy 9ab22f238e fix bug in RTR for not correctly exiting after timeout 2013-05-13 11:06:46 -07:00
fjy 89eb2aff5a fix logging 2013-05-12 15:17:09 -07:00
Gian Merlino 7930a76b0b EventReceiverFirehoseFactory: Remove useless getHandlerId method 2013-05-06 15:00:59 -07:00
Gian Merlino 202953c57b ChatHandler: Remove useless method, add docs 2013-05-06 14:58:47 -07:00
Gian Merlino d9b72e314e Merger: Replace EventReceivers with ChatHandlers 
This allows task-related objects to create any http endpoint their little
hearts desire.
 2013-05-06 14:46:59 -07:00
Gian Merlino b32a728863 Move indexer zk paths to ZkPathsConfig 2013-05-03 16:38:23 +03:00
Gian Merlino af08ea7617 ServiceAnnouncer: 
- Interface with two impls, Noop and Curator
- Used wherever fine services are advertised

Initialization:
- Don't automatically register with service discovery
- Add makeServiceAnnouncer, announceDefaultService methods
- Replace serviceInstance with makeServiceInstanceFactory
 2013-05-03 14:29:17 +03:00
Gian Merlino 8ce55ac632 ExecutorMain: Fix args count 2013-05-03 14:26:54 +03:00
Gian Merlino 8948c8d4ca Merge branch 'master' into event-push 
Conflicts:
	client/src/main/java/com/metamx/druid/initialization/Initialization.java
	examples/src/main/java/druid/examples/twitter/TwitterSpritzerFirehoseFactory.java
	index-common/src/main/java/com/metamx/druid/indexer/data/StringInputRowParser.java
	merger/src/main/java/com/metamx/druid/merger/common/task/RealtimeIndexTask.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
	merger/src/main/java/com/metamx/druid/merger/worker/executor/ExecutorNode.java
 2013-05-02 16:34:14 +03:00
cheddar e21e85b9fa 1) Make RealtimeIndexTask merge results like it should 2013-05-01 13:08:13 -05:00
Gian Merlino 407e413a90 IndexerCoordinatorResource: Return 404 with proper json for status not found 2013-05-01 17:13:02 +03:00
Gian Merlino 1a2135a0ea TaskStorageQueryAdapter: Fix getSameGroupMergedStatus for nonexistent tasks 2013-05-01 12:26:36 +03:00
cheddar 8922adb1f2 1) Make the demos work again. 
2) First step in restructuring the demos into a single repository
 2013-04-30 18:13:55 -05:00
Gian Merlino 862365e1fa EventReceiverFirehoseFactory: Move parse exceptions from hasMore to addAll 2013-04-30 15:05:26 +03:00
cheddar cee15bb88a Adjust passing of nodeType to ExecutorMain to be via a system property instead of via a command line argument. 2013-04-29 12:05:59 -05:00
cheddar 405eed7c60 Better name for ServerInventoryThingie 2013-04-29 11:48:42 -05:00
cheddar 52ba60963e Screwed up the conflicts on rebasing. Fixorz orz orz 2013-04-26 19:25:23 -05:00
cheddar 3e94204c44 1) Switch from com.netflix.curator to org.apache.curator 2013-04-26 19:19:55 -05:00
cheddar f71b941a1a 1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer 
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
 2013-04-26 19:19:54 -05:00
cheddar 7370b0f2fc 1) Cleanup TODO comments 2013-04-26 19:19:54 -05:00
cheddar 43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers 
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
 2013-04-26 19:19:23 -05:00
Gian Merlino f463b95256 Merger: Advertise event receivers through service discovery 2013-04-25 14:06:46 +03:00
Gian Merlino 341ee27419 Changes to allow pushing events directly to realtime tasks, and the creation 
of single-segment realtime tasks.

Realtime:
- Move firehose stuff to com.metamx.druid.realtime.firehose package
- ClippedFirehoseFactory provides a time-clipped view
- TimedShutoffFirehoseFactory shuts off at a particular time

Indexer:
- Split StringInputRowParser into {String,Map}InputRowParser

Merger:
- Remove minTime in favor of clipped firehoses
- Add task executor servlet that can push events to EventReceivers
- Add EventReceivingFirehose that accepts events as an EventReceiver
 2013-04-25 14:06:46 +03:00
Gian Merlino 4f4ebd5a77 Merger: Switch payloads from strings to bytes 2013-04-19 16:59:09 -07:00
Gian Merlino 7da1466340 RealtimeIndexTask: Fix minTime serialization 2013-04-19 15:50:09 -07:00
Gian Merlino 376df4032d IndexerCoordinatorNode: Only create tables when in "db" storage mode 2013-04-19 15:26:00 -07:00
Gian Merlino 17205ebea4 RealtimeIndexTask: Add minTime to assist in graceful switchover 2013-04-19 14:07:28 -07:00
Gian Merlino 1a6594524f Merger: Tweaks to DB tables. Create tables automatically. 2013-04-19 14:07:27 -07:00
Gian Merlino cdbdf843c0 Merger: Tweaks to task shutdown 2013-04-15 18:51:01 -07:00
Gian Merlino cafbcdb899 Merger: Tweaks to task tracking 2013-04-15 18:15:33 -07:00
Gian Merlino 3884ebbc3e ForkingTaskRunner: Fix properties loading 2013-04-15 16:41:54 -07:00
Fangjin Yang 8a4ec1cd17 Merge branch 'stop_task' of github.com:metamx/druid into stop_task 2013-04-12 22:13:22 -07:00
Fangjin Yang bacb1e5520 update fix 2013-04-12 22:12:22 -07:00
Gian Merlino a0b2a34845 Merge branch 'master' into stop_task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/actions/LockListAction.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/ExecutorServiceTaskRunner.java
	merger/src/main/java/com/metamx/druid/merger/coordinator/http/IndexerCoordinatorNode.java
	merger/src/main/java/com/metamx/druid/merger/worker/http/WorkerNode.java
 2013-04-12 14:10:27 -07:00
Gian Merlino c21d7f6ee2 ForkingTaskRunner: Slight tweaks to setup and teardown 2013-04-12 14:06:51 -07:00
Fangjin Yang a24274029f change shutdown logic for firehose 2013-04-12 11:49:01 -07:00
Fangjin Yang 465b78b4bc more changes 2013-04-10 20:21:26 -07:00
Gian Merlino eaea8ae163 - Ability to cancel pending tasks in the ForkingTaskRunner. 
- Other various changes from code review.
 2013-04-10 19:54:22 -07:00
cheddar a678f08b67 Merge pull request #118 from darxriggs/master 
cleanup & refactoring
 2013-04-09 18:56:59 -07:00
Gian Merlino f90304d07b Merger: Task logging system 2013-04-09 10:34:15 -07:00
Gian Merlino 33434f2c82 Executor: Move most logic out of main 2013-04-09 10:34:14 -07:00
Fangjin Yang 120b822c18 Merge branch 'master' of github.com:metamx/druid 
Conflicts:
	client/src/main/java/com/metamx/druid/QueryableNode.java
	server/src/main/java/com/metamx/druid/http/ComputeNode.java
 2013-04-08 11:24:17 -07:00
Fangjin Yang 925c104dd2 update emitter version and fix some NPEs 2013-04-08 11:23:08 -07:00
René Scheibe 6c27cd2e8e cleanup - removed unused imports 2013-04-07 23:31:22 +02:00
René Scheibe a6dc29cf85 cleanup - removed extra empty lines 
- there should not be any adjacent empty lines
 2013-04-07 14:32:09 +02:00