Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
972 Commits 111 Branches 503 Tags 728 MiB
Commit Graph

972 Commits

Author SHA1 Message Date
Gian Merlino 1a2135a0ea TaskStorageQueryAdapter: Fix getSameGroupMergedStatus for nonexistent tasks 2013-05-01 12:26:36 +03:00
cheddar 0a3492c9f5 Move all the code for examples under the examples directory. Also add initial take on flights demo. 2013-04-30 18:27:38 -05:00
cheddar 72982f5980 Remove the rand demo directory 2013-04-30 18:18:15 -05:00
cheddar 8922adb1f2 1) Make the demos work again. 
2) First step in restructuring the demos into a single repository
 2013-04-30 18:13:55 -05:00
cheddar e1367f256b Fixes #112, paths specified as "s3://" when given to HadoopDruidIndexerMain will be converted to "s3n://" and loaded via Hadoop's default file system for s3n. 2013-04-30 12:58:36 -05:00
cheddar 60b279b0d3 1) Add support for storing segments in HDFS 2013-04-30 12:47:43 -05:00
cheddar cd535fcd79 Merge pull request #131 from metamx/curator 
Remove references to i0tec.zkClient and replace with Curator
 2013-04-30 09:02:47 -07:00
cheddar 25d7ecacb1 No more snapshots 2013-04-30 11:01:04 -05:00
Gian Merlino 862365e1fa EventReceiverFirehoseFactory: Move parse exceptions from hasMore to addAll 2013-04-30 15:05:26 +03:00
cheddar a665e8b3b7 whitespace! 2013-04-29 14:02:30 -05:00
cheddar 2630d75cd3 More explicit comments around Zookeeper race condition 2013-04-29 13:58:57 -05:00
cheddar cee15bb88a Adjust passing of nodeType to ExecutorMain to be via a system property instead of via a command line argument. 2013-04-29 12:05:59 -05:00
cheddar 405eed7c60 Better name for ServerInventoryThingie 2013-04-29 11:48:42 -05:00
cheddar 52ba60963e Screwed up the conflicts on rebasing. Fixorz orz orz 2013-04-26 19:25:23 -05:00
cheddar 99305b29c8 Fixorz unit tests! 2013-04-26 19:19:57 -05:00
cheddar 74ff07ba3e Moar unit tests 2013-04-26 19:19:57 -05:00
cheddar 8768406069 1) Unit tests! 2013-04-26 19:19:57 -05:00
cheddar 046647c203 1) Make druid.zk.paths.base required 
2) Unit tests for announcer and fix race condition with session death
 2013-04-26 19:19:57 -05:00
cheddar 163a73bed1 More logging stuff 2013-04-26 19:19:57 -05:00
cheddar 19d80ccd9d Remove extraneous logs 2013-04-26 19:19:57 -05:00
cheddar de5c8c9d64 It's better when things compile 2013-04-26 19:19:56 -05:00
cheddar 1eb2dfe17e 1) Don't need a ServiceEmitter in ZkCoordinator anymore. 2013-04-26 19:19:56 -05:00
cheddar 38b5d94ffc 1) Imports... 2013-04-26 19:19:56 -05:00
cheddar 67ce1b6f26 1) Adjust all of the uses of zookeeper paths to be based on ZkPathsConfig 2013-04-26 19:19:56 -05:00
cheddar b6d72c0da4 1) Log when servers show up and when they load segments 
2) Adjust nodes to publish to ZK as the last part of their initialization
 2013-04-26 19:19:56 -05:00
cheddar 3e94204c44 1) Switch from com.netflix.curator to org.apache.curator 2013-04-26 19:19:55 -05:00
cheddar 9153cc94ac 1) Nicer logging 
2) Announcer should actually delete its zk entries when it is told to unannounce something
3) Skip over complex columns that we don't have a proper deserializer for
 2013-04-26 19:19:55 -05:00
cheddar b8ba9138ff 1) Fix bug with Master not starting up without an indexer specified 
2) Fix bug with PotentiallyGzippedCompressionProvider only catching ZipExceptions and not IOException (java 6 throws IO, java 7 throws Zip)
3) Create DruidServerMetadata and use that instead of DruidServer to represent the current server
 2013-04-26 19:19:55 -05:00
cheddar f71b941a1a 1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer 
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
 2013-04-26 19:19:54 -05:00
cheddar 7370b0f2fc 1) Cleanup TODO comments 2013-04-26 19:19:54 -05:00
cheddar 545b489093 1) Use PathChildrenCacheFactory to simplify creation of PathChildrenCache objects. 2013-04-26 19:19:53 -05:00
cheddar 57c31656d1 1) Eliminate PhoneBook 2013-04-26 19:19:53 -05:00
cheddar dde50a0d87 1) Remove references to zkclient 
2) Eradicate zkclient from the poms!
 2013-04-26 19:19:53 -05:00
cheddar 43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers 
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
 2013-04-26 19:19:23 -05:00
Gian Merlino f463b95256 Merger: Advertise event receivers through service discovery 2013-04-25 14:06:46 +03:00
Gian Merlino 341ee27419 Changes to allow pushing events directly to realtime tasks, and the creation 
of single-segment realtime tasks.

Realtime:
- Move firehose stuff to com.metamx.druid.realtime.firehose package
- ClippedFirehoseFactory provides a time-clipped view
- TimedShutoffFirehoseFactory shuts off at a particular time

Indexer:
- Split StringInputRowParser into {String,Map}InputRowParser

Merger:
- Remove minTime in favor of clipped firehoses
- Add task executor servlet that can push events to EventReceivers
- Add EventReceivingFirehose that accepts events as an EventReceiver
 2013-04-25 14:06:46 +03:00
cheddar 77ef525a65 Merge pull request #130 from metamx/requestlogemitter 
emitting request logger
 2013-04-24 15:59:19 -07:00
xvrl e3c6bad117 add emitting request logger 2013-04-24 15:38:16 -07:00
Gian Merlino deefa870ec [maven-release-plugin] prepare for next development iteration 2013-04-19 17:15:07 -07:00
Gian Merlino 5ea1a77a45 [maven-release-plugin] prepare release druid-0.4.0 2013-04-19 17:15:00 -07:00
cheddar 42c3f278ed Merge pull request #125 from metamx/indexing-service-stuff 
Indexing service stuff
 2013-04-19 17:03:56 -07:00
Gian Merlino 4f4ebd5a77 Merger: Switch payloads from strings to bytes 2013-04-19 16:59:09 -07:00
fjy 4c1cbdc5dc Merge branch 'master' of github.com:metamx/druid 2013-04-19 16:57:52 -07:00
fjy 1c3ceddbab fix typo and also testing commit 2013-04-19 16:57:42 -07:00
Gian Merlino 78850a0706 MinTimeFirehose: Care less about making nextRow work without hasMore 2013-04-19 16:57:20 -07:00
Gian Merlino 7da1466340 RealtimeIndexTask: Fix minTime serialization 2013-04-19 15:50:09 -07:00
Gian Merlino 4c4d30cf66 Initialization: Set service discovery address equal to druid.host (without port if any) 2013-04-19 15:45:00 -07:00
Gian Merlino 376df4032d IndexerCoordinatorNode: Only create tables when in "db" storage mode 2013-04-19 15:26:00 -07:00
Gian Merlino 5edbf2b4b9 MinTimeFirehose: Correcter logic 2013-04-19 14:51:41 -07:00
Gian Merlino dbfa045df0 DbConnector: SQL and validation query tweaks 2013-04-19 14:51:22 -07:00