Dhruv Parthasarathy
31ffed466c
first set of changes
2013-07-29 11:39:24 -07:00
fjy
4ae8395538
1) on bootstrap, load all initial data and do a compare with bootstrapped tasks, delete any that are extra out there
...
2) change autoscaling logic such that it only works with remote task runnrs
3) zk workers use their own status caches to determine what they are running
2013-07-26 14:32:08 -07:00
fjy
a1262760b2
Merge branch 'master' into worker-resource
2013-07-26 10:02:15 -07:00
fjy
b0090a1de6
[maven-release-plugin] prepare for next development iteration
2013-07-25 17:26:44 -07:00
fjy
6868153905
[maven-release-plugin] prepare release druid-0.5.22
2013-07-25 17:26:36 -07:00
cheddar
a6bc63732d
Merge pull request #199 from metamx/indexing-service-mods
...
Improve robustness and usability of RealtimeIndexTask and some code cleanup in the Indexing Service
2013-07-25 17:09:15 -07:00
fjy
cf0cb3b703
[maven-release-plugin] prepare for next development iteration
2013-07-25 16:55:28 -07:00
fjy
8297f068c3
[maven-release-plugin] prepare release druid-0.5.21
2013-07-25 16:55:20 -07:00
Dhruv Parthasarathy
05219689e8
added close methods on inputSupplier tests
2013-07-25 16:52:29 -07:00
fjy
f68a68112f
[maven-release-plugin] prepare for next development iteration
2013-07-25 16:21:59 -07:00
fjy
b6e8d11aec
[maven-release-plugin] prepare release druid-0.5.20
2013-07-25 16:21:49 -07:00
fjy
217894d44a
Merge branch 'master' into worker-resource
...
Conflicts:
pom.xml
2013-07-25 16:18:42 -07:00
Gian Merlino
4dd42c7177
RemoteTaskActionClient: Log service uri when submitting action
2013-07-25 14:48:25 -07:00
Gian Merlino
20acd6f450
RealtimePlumberSchool: Persist and merge immediately upon finishJob
2013-07-25 14:38:07 -07:00
Gian Merlino
5d44f0f15b
ForkingTaskRunner: Use guava Closer to closer stuff
2013-07-25 14:37:45 -07:00
Gian Merlino
952b8ce06b
RemoteTaskActionClient: Fix http path
2013-07-25 14:37:20 -07:00
cheddar
ea201be555
Merge pull request #200 from activitystream/master
...
Minor fixes - maven dependency, unit test that was failing and quirk for third party S3 provider
2013-07-25 13:42:53 -07:00
cheddar
73cc47d79c
Merge pull request #201 from metamx/fix-rt
...
Fix issue with realtime nodes selecting intervals that are too large in the results
2013-07-25 12:46:09 -07:00
fjy
a909a31bcc
better select sinks
2013-07-24 19:25:32 -07:00
Stefán Freyr Stefánsson
2842a40894
Fixed test that was failing on JDK 1.7
2013-07-24 23:41:47 +00:00
Stefán Freyr Stefánsson
b3530fb15d
Adding a configuration property to disable setting an ACL on the segment pushed to S3.
2013-07-24 23:37:21 +00:00
Gian Merlino
f38d7cf964
Fix busted condition
2013-07-24 16:33:01 -07:00
Gian Merlino
6d1cb1bfc1
IndexerCoordinatorResource: Log when remote task action fails
2013-07-24 16:13:12 -07:00
Gian Merlino
30d98f56c1
RealtimeIndexTask: Allow configurable rejection policies
2013-07-24 16:12:54 -07:00
Stefán Freyr Stefánsson
e3879f0c77
Adding a dependency on Apache commons httpclient in the Druid client pom.xml. It currently gets pulled in through some dependencies but it should be explicitly set.
2013-07-24 23:05:30 +00:00
Gian Merlino
5c96d500d8
More controllable realtime shutdown
...
- Realtime plumber will start persisting segments shortly after finishJob is called, regardless
of rejection policy
- Add "none" rejection policy
2013-07-24 15:32:10 -07:00
Gian Merlino
0eebb0a149
Add RealtimeMetricsMonitor to RealtimeIndexTask
2013-07-24 14:39:59 -07:00
Gian Merlino
867dedfe1b
Remove unused class
2013-07-24 10:27:21 -07:00
Gian Merlino
71704f7ee8
Replace graceful/hard shutdown combo with simple exit
2013-07-24 10:27:21 -07:00
fjy
cfc635de53
[maven-release-plugin] prepare for next development iteration
2013-07-24 09:41:30 -07:00
fjy
09576ccd09
[maven-release-plugin] prepare release druid-0.5.19
2013-07-24 09:41:20 -07:00
cheddar
86dd1a499c
Merge pull request #194 from metamx/batch-zk
...
Changed method of publishing segment ownership to ZK to use batching, includes changes to allow for migration
2013-07-23 16:36:48 -07:00
fjy
fa5f46057c
fix spacing issue
2013-07-23 16:25:07 -07:00
fjy
e4c2a2c705
fix according to comments in code review
2013-07-23 16:23:32 -07:00
fjy
fc65648809
fix a bug introduced in postgres support that breaks inserts for mysql
2013-07-23 13:21:14 -07:00
fjy
94afe72133
add unit test
2013-07-23 12:49:07 -07:00
fjy
980b09d903
fix broken test
2013-07-23 10:19:26 -07:00
fjy
ea7c7d1d66
Merge branch 'master' into batch-zk
...
Conflicts:
client/src/main/java/com/metamx/druid/QueryableNode.java
2013-07-23 10:14:26 -07:00
fjy
ef27810458
rename to fix case issue
2013-07-22 18:02:10 -07:00
fjy
3f97ac9253
add read to batch zk
2013-07-22 18:01:13 -07:00
fjy
f09a43a8d9
Merge pull request #195 from metamx/announcer-cleanup
...
Cleanup znodes left behind by announcer
2013-07-22 17:07:58 -07:00
cheddar
7504f3ab65
1) Adjust the Announcer to cleanup parent nodes that it creates. This stops it from leaving little turdlings lying around on zookeeper as nodes exit
...
2) Rename *CuratorDataSegmentAnnouncer because neither of them depend directly on Curator.
2013-07-22 16:31:01 -07:00
fjy
b6aeb5b376
code review fixes
2013-07-22 14:14:21 -07:00
fjy
f5536ed010
compression for batch-zk
2013-07-22 14:05:48 -07:00
fjy
5d96f6dc99
Merge branch 'master' of github.com:metamx/druid
2013-07-22 10:47:20 -07:00
fjy
2d0fae2fde
add to string to spatial wrapper
2013-07-22 10:47:11 -07:00
cheddar
15f756c3a4
Fix upload script to actually upload into the directory
2013-07-19 16:57:55 -07:00
cheddar
1c34e3f364
1) Fix class-level javadoc on RabbitMQFirehoseFactory to reflect changes in config
2013-07-19 16:47:00 -07:00
cheddar
5f01c633bd
Merge pull request #192 from activitystream/rabbitmq
...
Adding a RabbitMQFirehoseFactory implementation
2013-07-19 16:44:44 -07:00
Stefán Freyr Stefánsson
ade00e441f
Adding minor class-level JavaDoc.
2013-07-19 11:24:13 +00:00
