Commit Graph

5854 Commits

Author SHA1 Message Date
cheddar f71b941a1a 1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
2013-04-26 19:19:54 -05:00
cheddar 7370b0f2fc 1) Cleanup TODO comments 2013-04-26 19:19:54 -05:00
cheddar 545b489093 1) Use PathChildrenCacheFactory to simplify creation of PathChildrenCache objects. 2013-04-26 19:19:53 -05:00
cheddar 57c31656d1 1) Eliminate PhoneBook 2013-04-26 19:19:53 -05:00
cheddar dde50a0d87 1) Remove references to zkclient
2) Eradicate zkclient from the poms!
2013-04-26 19:19:53 -05:00
cheddar 43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
fjy e01a78515e many more fixes and unit tests 2013-04-25 19:01:45 -07:00
Gian Merlino f463b95256 Merger: Advertise event receivers through service discovery 2013-04-25 14:06:46 +03:00
Gian Merlino 341ee27419 Changes to allow pushing events directly to realtime tasks, and the creation
of single-segment realtime tasks.

Realtime:
- Move firehose stuff to com.metamx.druid.realtime.firehose package
- ClippedFirehoseFactory provides a time-clipped view
- TimedShutoffFirehoseFactory shuts off at a particular time

Indexer:
- Split StringInputRowParser into {String,Map}InputRowParser

Merger:
- Remove minTime in favor of clipped firehoses
- Add task executor servlet that can push events to EventReceivers
- Add EventReceivingFirehose that accepts events as an EventReceiver
2013-04-25 14:06:46 +03:00
fjy d29b3e0960 fix lowercase bug 2013-04-24 16:00:47 -07:00
cheddar 77ef525a65 Merge pull request #130 from metamx/requestlogemitter
emitting request logger
2013-04-24 15:59:19 -07:00
xvrl e3c6bad117 add emitting request logger 2013-04-24 15:38:16 -07:00
fjy 7f43f37441 bug fixes 2013-04-23 18:06:41 -07:00
fjy 13b617cfa9 fix some interval bugs 2013-04-23 16:53:57 -07:00
fjy 7184e528fd fix some config bugs 2013-04-23 13:16:50 -07:00
fjy 70937af7bd Merge branch 'master' of github.com:metamx/druid into spatial
Conflicts:
	server/src/main/java/com/metamx/druid/index/v1/IndexStorageAdapter.java
	server/src/main/java/com/metamx/druid/index/v1/QueryableIndexStorageAdapter.java
2013-04-23 11:40:44 -07:00
fjy 9b9c516e30 more tests 2013-04-22 18:39:41 -07:00
fjy f28abd4256 fix cache 2013-04-22 15:01:07 -07:00
Gian Merlino deefa870ec [maven-release-plugin] prepare for next development iteration 2013-04-19 17:15:07 -07:00
Gian Merlino 5ea1a77a45 [maven-release-plugin] prepare release druid-0.4.0 2013-04-19 17:15:00 -07:00
cheddar 42c3f278ed Merge pull request #125 from metamx/indexing-service-stuff
Indexing service stuff
2013-04-19 17:03:56 -07:00
Gian Merlino 4f4ebd5a77 Merger: Switch payloads from strings to bytes 2013-04-19 16:59:09 -07:00
fjy 4c1cbdc5dc Merge branch 'master' of github.com:metamx/druid 2013-04-19 16:57:52 -07:00
fjy 1c3ceddbab fix typo and also testing commit 2013-04-19 16:57:42 -07:00
Gian Merlino 78850a0706 MinTimeFirehose: Care less about making nextRow work without hasMore 2013-04-19 16:57:20 -07:00
fjy 6c4e844f97 semi working spatial 2013-04-19 16:56:56 -07:00
Gian Merlino 7da1466340 RealtimeIndexTask: Fix minTime serialization 2013-04-19 15:50:09 -07:00
Gian Merlino 4c4d30cf66 Initialization: Set service discovery address equal to druid.host (without port if any) 2013-04-19 15:45:00 -07:00
Gian Merlino 376df4032d IndexerCoordinatorNode: Only create tables when in "db" storage mode 2013-04-19 15:26:00 -07:00
Gian Merlino 5edbf2b4b9 MinTimeFirehose: Correcter logic 2013-04-19 14:51:41 -07:00
Gian Merlino dbfa045df0 DbConnector: SQL and validation query tweaks 2013-04-19 14:51:22 -07:00
Gian Merlino 17205ebea4 RealtimeIndexTask: Add minTime to assist in graceful switchover 2013-04-19 14:07:28 -07:00
Gian Merlino 1a6594524f Merger: Tweaks to DB tables. Create tables automatically. 2013-04-19 14:07:27 -07:00
Gian Merlino 1dfe133554 DbConnector: Optional validation query (default off for now) 2013-04-19 14:07:27 -07:00
cheddar cc30dfad2f Test commit to test contributions 2013-04-19 10:14:17 -05:00
Fangjin Yang 71269d7e88 somehow tests are passing 2013-04-17 17:13:24 -07:00
xvrl db2f3aa761 fix pom versions 2013-04-16 09:53:34 -07:00
cheddar 31a38f6c84 Merge pull request #121 from metamx/column-selectors
Column Selectors
2013-04-16 09:39:49 -07:00
xvrl 50998671ae formatting 2013-04-16 09:33:50 -07:00
xvrl 4597d7f44e remove IndexStorageAdapter 2013-04-16 09:33:50 -07:00
xvrl 2afe2bdeae formatting 2013-04-16 09:33:50 -07:00
xvrl 66a52ed282 javascript aggregator now uses column selector 2013-04-16 09:33:50 -07:00
xvrl b66f69def6 specify javascript aggregator functions individually to support getCombiningFactory() 2013-04-16 09:33:50 -07:00
xvrl c83631928c object column selectors 2013-04-16 09:33:50 -07:00
xvrl 0c68bd1b1d rename MetricSelectorFactory to ColumnSelectorFactory 2013-04-16 09:33:49 -07:00
xvrl de5622d792 bump up druid version to 0.4.0 2013-04-16 09:33:47 -07:00
Gian Merlino a166344297 [maven-release-plugin] prepare for next development iteration 2013-04-15 18:55:53 -07:00
Gian Merlino 21c2aa5793 [maven-release-plugin] prepare release druid-0.3.38 2013-04-15 18:55:46 -07:00
Gian Merlino cdbdf843c0 Merger: Tweaks to task shutdown 2013-04-15 18:51:01 -07:00
Gian Merlino d879c9a41e [maven-release-plugin] prepare for next development iteration 2013-04-15 18:17:42 -07:00