936 Commits

Author SHA1 Message Date
fjy
d57141f46e checking stuff in but stuff not really working yet 2013-05-03 10:35:26 -07:00
fjy
6d4c0850ca Merge branch 'master' into spatial
Conflicts:
	client/src/main/java/com/metamx/druid/QueryableNode.java
2013-05-01 11:49:00 -07:00
cheddar
e21e85b9fa 1) Make RealtimeIndexTask merge results like it should 2013-05-01 13:08:13 -05:00
cheddar
e1a2c43baf 1) Adjust the example code to all be in one repository.
2) Adjust the run scripts to be able to switch between different examples.
2013-05-01 12:51:26 -05:00
fjy
63ccb24ef6 Merge branch 'master' into spatial
Conflicts:
	pom.xml
	server/src/main/java/com/metamx/druid/http/InfoResource.java
2013-05-01 10:12:04 -07:00
cheddar
0a3492c9f5 Move all the code for examples under the examples directory. Also add initial take on flights demo. 2013-04-30 18:27:38 -05:00
cheddar
72982f5980 Remove the rand demo directory 2013-04-30 18:18:15 -05:00
cheddar
8922adb1f2 1) Make the demos work again.
2) First step in restructuring the demos into a single repository
2013-04-30 18:13:55 -05:00
cheddar
e1367f256b Fixes #112, paths specified as "s3://" when given to HadoopDruidIndexerMain will be converted to "s3n://" and loaded via Hadoop's default file system for s3n. 2013-04-30 12:58:36 -05:00
cheddar
60b279b0d3 1) Add support for storing segments in HDFS 2013-04-30 12:47:43 -05:00
cheddar
cd535fcd79 Merge pull request #131 from metamx/curator
Remove references to i0tec.zkClient and replace with Curator
2013-04-30 09:02:47 -07:00
cheddar
25d7ecacb1 No more snapshots 2013-04-30 11:01:04 -05:00
cheddar
a665e8b3b7 whitespace! 2013-04-29 14:02:30 -05:00
cheddar
2630d75cd3 More explicit comments around Zookeeper race condition 2013-04-29 13:58:57 -05:00
cheddar
cee15bb88a Adjust passing of nodeType to ExecutorMain to be via a system property instead of via a command line argument. 2013-04-29 12:05:59 -05:00
cheddar
405eed7c60 Better name for ServerInventoryThingie 2013-04-29 11:48:42 -05:00
fjy
2849486251 simpler sequence limiting 2013-04-28 15:34:43 -07:00
fjy
67cafaa0b1 Merge branch 'master' into spatial 2013-04-26 17:56:18 -07:00
fjy
82a62e3ba0 bug fixes for spatial and groupby; threshold for groupby 2013-04-26 17:46:25 -07:00
cheddar
52ba60963e Screwed up the conflicts on rebasing. Fixorz orz orz 2013-04-26 19:25:23 -05:00
cheddar
99305b29c8 Fixorz unit tests! 2013-04-26 19:19:57 -05:00
cheddar
74ff07ba3e Moar unit tests 2013-04-26 19:19:57 -05:00
cheddar
8768406069 1) Unit tests! 2013-04-26 19:19:57 -05:00
cheddar
046647c203 1) Make druid.zk.paths.base required
2) Unit tests for announcer and fix race condition with session death
2013-04-26 19:19:57 -05:00
cheddar
163a73bed1 More logging stuff 2013-04-26 19:19:57 -05:00
cheddar
19d80ccd9d Remove extraneous logs 2013-04-26 19:19:57 -05:00
cheddar
de5c8c9d64 It's better when things compile 2013-04-26 19:19:56 -05:00
cheddar
1eb2dfe17e 1) Don't need a ServiceEmitter in ZkCoordinator anymore. 2013-04-26 19:19:56 -05:00
cheddar
38b5d94ffc 1) Imports... 2013-04-26 19:19:56 -05:00
cheddar
67ce1b6f26 1) Adjust all of the uses of zookeeper paths to be based on ZkPathsConfig 2013-04-26 19:19:56 -05:00
cheddar
b6d72c0da4 1) Log when servers show up and when they load segments
2) Adjust nodes to publish to ZK as the last part of their initialization
2013-04-26 19:19:56 -05:00
cheddar
3e94204c44 1) Switch from com.netflix.curator to org.apache.curator 2013-04-26 19:19:55 -05:00
cheddar
9153cc94ac 1) Nicer logging
2) Announcer should actually delete its zk entries when it is told to unannounce something
3) Skip over complex columns that we don't have a proper deserializer for
2013-04-26 19:19:55 -05:00
cheddar
b8ba9138ff 1) Fix bug with Master not starting up without an indexer specified
2) Fix bug with PotentiallyGzippedCompressionProvider only catching ZipExceptions and not IOException (java 6 throws IO, java 7 throws Zip)
3) Create DruidServerMetadata and use that instead of DruidServer to represent the current server
2013-04-26 19:19:55 -05:00
cheddar
f71b941a1a 1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
2013-04-26 19:19:54 -05:00
cheddar
7370b0f2fc 1) Cleanup TODO comments 2013-04-26 19:19:54 -05:00
cheddar
545b489093 1) Use PathChildrenCacheFactory to simplify creation of PathChildrenCache objects. 2013-04-26 19:19:53 -05:00
cheddar
57c31656d1 1) Eliminate PhoneBook 2013-04-26 19:19:53 -05:00
cheddar
dde50a0d87 1) Remove references to zkclient
2) Eradicate zkclient from the poms!
2013-04-26 19:19:53 -05:00
cheddar
43d630c098 1) Replace InventoryManagers with Curator-based Inventory Managers
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook

Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
fjy
e01a78515e many more fixes and unit tests 2013-04-25 19:01:45 -07:00
fjy
d29b3e0960 fix lowercase bug 2013-04-24 16:00:47 -07:00
cheddar
77ef525a65 Merge pull request #130 from metamx/requestlogemitter
emitting request logger
2013-04-24 15:59:19 -07:00
xvrl
e3c6bad117 add emitting request logger 2013-04-24 15:38:16 -07:00
fjy
7f43f37441 bug fixes 2013-04-23 18:06:41 -07:00
fjy
13b617cfa9 fix some interval bugs 2013-04-23 16:53:57 -07:00
fjy
7184e528fd fix some config bugs 2013-04-23 13:16:50 -07:00
fjy
70937af7bd Merge branch 'master' of github.com:metamx/druid into spatial
Conflicts:
	server/src/main/java/com/metamx/druid/index/v1/IndexStorageAdapter.java
	server/src/main/java/com/metamx/druid/index/v1/QueryableIndexStorageAdapter.java
2013-04-23 11:40:44 -07:00
fjy
9b9c516e30 more tests 2013-04-22 18:39:41 -07:00
fjy
f28abd4256 fix cache 2013-04-22 15:01:07 -07:00