fjy
63ccb24ef6
Merge branch 'master' into spatial
...
Conflicts:
pom.xml
server/src/main/java/com/metamx/druid/http/InfoResource.java
2013-05-01 10:12:04 -07:00
Gian Merlino
407e413a90
IndexerCoordinatorResource: Return 404 with proper json for status not found
2013-05-01 17:13:02 +03:00
Gian Merlino
1a2135a0ea
TaskStorageQueryAdapter: Fix getSameGroupMergedStatus for nonexistent tasks
2013-05-01 12:26:36 +03:00
cheddar
0a3492c9f5
Move all the code for examples under the examples directory. Also add initial take on flights demo.
2013-04-30 18:27:38 -05:00
cheddar
72982f5980
Remove the rand demo directory
2013-04-30 18:18:15 -05:00
cheddar
8922adb1f2
1) Make the demos work again.
...
2) First step in restructuring the demos into a single repository
2013-04-30 18:13:55 -05:00
cheddar
e1367f256b
Fixes #112 , paths specified as "s3://" when given to HadoopDruidIndexerMain will be converted to "s3n://" and loaded via Hadoop's default file system for s3n.
2013-04-30 12:58:36 -05:00
cheddar
60b279b0d3
1) Add support for storing segments in HDFS
2013-04-30 12:47:43 -05:00
cheddar
cd535fcd79
Merge pull request #131 from metamx/curator
...
Remove references to i0tec.zkClient and replace with Curator
2013-04-30 09:02:47 -07:00
cheddar
25d7ecacb1
No more snapshots
2013-04-30 11:01:04 -05:00
Gian Merlino
862365e1fa
EventReceiverFirehoseFactory: Move parse exceptions from hasMore to addAll
2013-04-30 15:05:26 +03:00
cheddar
a665e8b3b7
whitespace!
2013-04-29 14:02:30 -05:00
cheddar
2630d75cd3
More explicit comments around Zookeeper race condition
2013-04-29 13:58:57 -05:00
cheddar
cee15bb88a
Adjust passing of nodeType to ExecutorMain to be via a system property instead of via a command line argument.
2013-04-29 12:05:59 -05:00
cheddar
405eed7c60
Better name for ServerInventoryThingie
2013-04-29 11:48:42 -05:00
fjy
2849486251
simpler sequence limiting
2013-04-28 15:34:43 -07:00
fjy
67cafaa0b1
Merge branch 'master' into spatial
2013-04-26 17:56:18 -07:00
fjy
82a62e3ba0
bug fixes for spatial and groupby; threshold for groupby
2013-04-26 17:46:25 -07:00
cheddar
52ba60963e
Screwed up the conflicts on rebasing. Fixorz orz orz
2013-04-26 19:25:23 -05:00
cheddar
99305b29c8
Fixorz unit tests!
2013-04-26 19:19:57 -05:00
cheddar
74ff07ba3e
Moar unit tests
2013-04-26 19:19:57 -05:00
cheddar
8768406069
1) Unit tests!
2013-04-26 19:19:57 -05:00
cheddar
046647c203
1) Make druid.zk.paths.base required
...
2) Unit tests for announcer and fix race condition with session death
2013-04-26 19:19:57 -05:00
cheddar
163a73bed1
More logging stuff
2013-04-26 19:19:57 -05:00
cheddar
19d80ccd9d
Remove extraneous logs
2013-04-26 19:19:57 -05:00
cheddar
de5c8c9d64
It's better when things compile
2013-04-26 19:19:56 -05:00
cheddar
1eb2dfe17e
1) Don't need a ServiceEmitter in ZkCoordinator anymore.
2013-04-26 19:19:56 -05:00
cheddar
38b5d94ffc
1) Imports...
2013-04-26 19:19:56 -05:00
cheddar
67ce1b6f26
1) Adjust all of the uses of zookeeper paths to be based on ZkPathsConfig
2013-04-26 19:19:56 -05:00
cheddar
b6d72c0da4
1) Log when servers show up and when they load segments
...
2) Adjust nodes to publish to ZK as the last part of their initialization
2013-04-26 19:19:56 -05:00
cheddar
3e94204c44
1) Switch from com.netflix.curator to org.apache.curator
2013-04-26 19:19:55 -05:00
cheddar
9153cc94ac
1) Nicer logging
...
2) Announcer should actually delete its zk entries when it is told to unannounce something
3) Skip over complex columns that we don't have a proper deserializer for
2013-04-26 19:19:55 -05:00
cheddar
b8ba9138ff
1) Fix bug with Master not starting up without an indexer specified
...
2) Fix bug with PotentiallyGzippedCompressionProvider only catching ZipExceptions and not IOException (java 6 throws IO, java 7 throws Zip)
3) Create DruidServerMetadata and use that instead of DruidServer to represent the current server
2013-04-26 19:19:55 -05:00
cheddar
f71b941a1a
1) Refactor the announcement of segments to all exist inside the DataSegmentAnnouncer
...
2) Adjust the ExecutorNodes to expose the correct nodeType given the refactorings
2013-04-26 19:19:54 -05:00
cheddar
7370b0f2fc
1) Cleanup TODO comments
2013-04-26 19:19:54 -05:00
cheddar
545b489093
1) Use PathChildrenCacheFactory to simplify creation of PathChildrenCache objects.
2013-04-26 19:19:53 -05:00
cheddar
57c31656d1
1) Eliminate PhoneBook
2013-04-26 19:19:53 -05:00
cheddar
dde50a0d87
1) Remove references to zkclient
...
2) Eradicate zkclient from the poms!
2013-04-26 19:19:53 -05:00
cheddar
43d630c098
1) Replace InventoryManagers with Curator-based Inventory Managers
...
2) Replace ZkSegmentAnnouncer with CuratorSegmentAnnouncer
3) Adjust LoadQueuePeons to operate using Curator
4) Remove ZkPhoneBook
Things left to do:
1) Unit tests
2) Remove references to zkclient library
3) Remove references to PhoneBook interface
2013-04-26 19:19:23 -05:00
fjy
e01a78515e
many more fixes and unit tests
2013-04-25 19:01:45 -07:00
Gian Merlino
f463b95256
Merger: Advertise event receivers through service discovery
2013-04-25 14:06:46 +03:00
Gian Merlino
341ee27419
Changes to allow pushing events directly to realtime tasks, and the creation
...
of single-segment realtime tasks.
Realtime:
- Move firehose stuff to com.metamx.druid.realtime.firehose package
- ClippedFirehoseFactory provides a time-clipped view
- TimedShutoffFirehoseFactory shuts off at a particular time
Indexer:
- Split StringInputRowParser into {String,Map}InputRowParser
Merger:
- Remove minTime in favor of clipped firehoses
- Add task executor servlet that can push events to EventReceivers
- Add EventReceivingFirehose that accepts events as an EventReceiver
2013-04-25 14:06:46 +03:00
fjy
d29b3e0960
fix lowercase bug
2013-04-24 16:00:47 -07:00
cheddar
77ef525a65
Merge pull request #130 from metamx/requestlogemitter
...
emitting request logger
2013-04-24 15:59:19 -07:00
xvrl
e3c6bad117
add emitting request logger
2013-04-24 15:38:16 -07:00
fjy
7f43f37441
bug fixes
2013-04-23 18:06:41 -07:00
fjy
13b617cfa9
fix some interval bugs
2013-04-23 16:53:57 -07:00
fjy
7184e528fd
fix some config bugs
2013-04-23 13:16:50 -07:00
fjy
70937af7bd
Merge branch 'master' of github.com:metamx/druid into spatial
...
Conflicts:
server/src/main/java/com/metamx/druid/index/v1/IndexStorageAdapter.java
server/src/main/java/com/metamx/druid/index/v1/QueryableIndexStorageAdapter.java
2013-04-23 11:40:44 -07:00
fjy
9b9c516e30
more tests
2013-04-22 18:39:41 -07:00