Commit Graph

914 Commits

Author SHA1 Message Date
cheddar 60b279b0d3 1) Add support for storing segments in HDFS 2013-04-30 12:47:43 -05:00
cheddar cd535fcd79 Merge pull request #131 from metamx/curator
Remove references to i0tec.zkClient and replace with Curator
2013-04-30 09:02:47 -07:00
cheddar 25d7ecacb1 No more snapshots 2013-04-30 11:01:04 -05:00
cheddar a665e8b3b7 whitespace! 2013-04-29 14:02:30 -05:00
cheddar 2630d75cd3 More explicit comments around Zookeeper race condition 2013-04-29 13:58:57 -05:00
cheddar cee15bb88a Adjust passing of nodeType to ExecutorMain to be via a system property instead of via a command line argument. 2013-04-29 12:05:59 -05:00
cheddar 405eed7c60 Better name for ServerInventoryThingie 2013-04-29 11:48:42 -05:00
cheddar 52ba60963e Screwed up the conflicts on rebasing. Fixorz orz orz 2013-04-26 19:25:23 -05:00
cheddar 99305b29c8 Fixorz unit tests! 2013-04-26 19:19:57 -05:00
cheddar 74ff07ba3e Moar unit tests 2013-04-26 19:19:57 -05:00
cheddar 8768406069 1) Unit tests! 2013-04-26 19:19:57 -05:00
cheddar 046647c203 1) Make druid.zk.paths.base required
2) Unit tests for announcer and fix race condition with session death
2013-04-26 19:19:57 -05:00
cheddar 163a73bed1 More logging stuff 2013-04-26 19:19:57 -05:00
cheddar 19d80ccd9d Remove extraneous logs 2013-04-26 19:19:57 -05:00
cheddar de5c8c9d64 It's better when things compile 2013-04-26 19:19:56 -05:00
cheddar 1eb2dfe17e 1) Don't need a ServiceEmitter in ZkCoordinator anymore. 2013-04-26 19:19:56 -05:00
cheddar 38b5d94ffc 1) Imports... 2013-04-26 19:19:56 -05:00
cheddar 67ce1b6f26 1) Adjust all of the uses of zookeeper paths to be based on ZkPathsConfig 2013-04-26 19:19:56 -05:00
cheddar b6d72c0da4 1) Log when servers show up and when they load segments
2) Adjust nodes to publish to ZK as the last part of their initialization
2013-04-26 19:19:56 -05:00
cheddar 3e94204c44 1) Switch from com.netflix.curator to org.apache.curator 2013-04-26 19:19:55 -05:00
cheddar 9153cc94ac 1) Nicer logging
2) Announcer should actually delete its zk entries when it is told to unannounce something
3) Skip over complex columns that we don't have a proper deserializer for
2013-04-26 19:19:55 -05:00
cheddar b8ba9138ff 1) Fix bug with Master not starting up without an indexer specified
2) Fix bug with PotentiallyGzippedCompressionProvider only catching ZipExceptions and not IOException (java 6 throws IO, java 7 throws Zip)
3) Create DruidServerMetadata and use that instead of DruidServer to represent the current server
2013-04-26 19:19:55 -05:00
cheddar f71b941a1a 1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
2013-04-26 19:19:54 -05:00
cheddar 7370b0f2fc 1) Cleanup TODO comments 2013-04-26 19:19:54 -05:00
cheddar 545b489093 1) Use PathChildrenCacheFactory to simplify creation of PathChildrenCache objects. 2013-04-26 19:19:53 -05:00
cheddar 57c31656d1 1) Eliminate PhoneBook 2013-04-26 19:19:53 -05:00
cheddar dde50a0d87 1) Remove references to zkclient
2) Eradicate zkclient from the poms!
2013-04-26 19:19:53 -05:00
cheddar 43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
cheddar 77ef525a65 Merge pull request #130 from metamx/requestlogemitter
emitting request logger
2013-04-24 15:59:19 -07:00
xvrl e3c6bad117 add emitting request logger 2013-04-24 15:38:16 -07:00
Gian Merlino deefa870ec [maven-release-plugin] prepare for next development iteration 2013-04-19 17:15:07 -07:00
Gian Merlino 5ea1a77a45 [maven-release-plugin] prepare release druid-0.4.0 2013-04-19 17:15:00 -07:00
cheddar 42c3f278ed Merge pull request #125 from metamx/indexing-service-stuff
Indexing service stuff
2013-04-19 17:03:56 -07:00
Gian Merlino 4f4ebd5a77 Merger: Switch payloads from strings to bytes 2013-04-19 16:59:09 -07:00
fjy 4c1cbdc5dc Merge branch 'master' of github.com:metamx/druid 2013-04-19 16:57:52 -07:00
fjy 1c3ceddbab fix typo and also testing commit 2013-04-19 16:57:42 -07:00
Gian Merlino 78850a0706 MinTimeFirehose: Care less about making nextRow work without hasMore 2013-04-19 16:57:20 -07:00
Gian Merlino 7da1466340 RealtimeIndexTask: Fix minTime serialization 2013-04-19 15:50:09 -07:00
Gian Merlino 4c4d30cf66 Initialization: Set service discovery address equal to druid.host (without port if any) 2013-04-19 15:45:00 -07:00
Gian Merlino 376df4032d IndexerCoordinatorNode: Only create tables when in "db" storage mode 2013-04-19 15:26:00 -07:00
Gian Merlino 5edbf2b4b9 MinTimeFirehose: Correcter logic 2013-04-19 14:51:41 -07:00
Gian Merlino dbfa045df0 DbConnector: SQL and validation query tweaks 2013-04-19 14:51:22 -07:00
Gian Merlino 17205ebea4 RealtimeIndexTask: Add minTime to assist in graceful switchover 2013-04-19 14:07:28 -07:00
Gian Merlino 1a6594524f Merger: Tweaks to DB tables. Create tables automatically. 2013-04-19 14:07:27 -07:00
Gian Merlino 1dfe133554 DbConnector: Optional validation query (default off for now) 2013-04-19 14:07:27 -07:00
cheddar cc30dfad2f Test commit to test contributions 2013-04-19 10:14:17 -05:00
xvrl db2f3aa761 fix pom versions 2013-04-16 09:53:34 -07:00
cheddar 31a38f6c84 Merge pull request #121 from metamx/column-selectors
Column Selectors
2013-04-16 09:39:49 -07:00
xvrl 50998671ae formatting 2013-04-16 09:33:50 -07:00
xvrl 4597d7f44e remove IndexStorageAdapter 2013-04-16 09:33:50 -07:00