294 Commits

Author SHA1 Message Date
Eric Tschetter
f47319f118 [maven-release-plugin] prepare for next development iteration 2013-03-18 17:09:01 -05:00
Eric Tschetter
1066144b43 [maven-release-plugin] prepare release druid-0.3.25 2013-03-18 17:08:56 -05:00
Eric Tschetter
cba404a65d [maven-release-plugin] prepare for next development iteration 2013-03-18 13:02:40 -05:00
Eric Tschetter
29a0a7e6c6 [maven-release-plugin] prepare release druid-0.3.24 2013-03-18 13:02:33 -05:00
Eric Tschetter
bbed862b0b Merge branch 'master' of github.com:metamx/druid 2013-03-18 12:59:33 -05:00
Eric Tschetter
e3674368ab 1) Fix bug with the MergeTask not setting the binaryVersion field on DataSegments and causing the converter to run a lot. 2013-03-18 12:57:01 -05:00
Fangjin Yang
b9de751b32 [maven-release-plugin] prepare for next development iteration 2013-03-15 14:32:31 -07:00
Fangjin Yang
57655f19c4 [maven-release-plugin] prepare release druid-0.3.23 2013-03-15 14:32:24 -07:00
Eric Tschetter
72b82b1b1d 1) Remove logline that really shouldn't be there. 2013-03-15 15:50:37 -05:00
Eric Tschetter
7dacf952d6 [maven-release-plugin] prepare for next development iteration 2013-03-15 13:53:39 -05:00
Eric Tschetter
ff017fe72a [maven-release-plugin] prepare release druid-0.3.22 2013-03-15 13:53:33 -05:00
Eric Tschetter
a933438e4e 1) Fix bugs with VersionConverterTask
2) Fix bugs with NPEs on indexing
2013-03-15 13:48:55 -05:00
Gian Merlino
f6752799bc Merge branch 'master' into realtime-index-task
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/common/actions/SegmentInsertAction.java
2013-03-14 13:45:59 -07:00
Gian Merlino
e45a51714f RealtimeIndexTask: Fix serde 2013-03-14 13:43:40 -07:00
Gian Merlino
b8c08f235a Realtime:
- Move VersioningPolicy, RetryPolicy outside of RealtimePlumberSchool
- Move plumber stuff into its own package, since there's a lot of it
2013-03-14 12:56:25 -07:00
Gian Merlino
c34108418a RealtimeIndexTask: Reword comments 2013-03-14 12:49:17 -07:00
Gian Merlino
9fe6a37f86 Realtime: Remove MetadataUpdater 2013-03-14 12:35:38 -07:00
Gian Merlino
055a98a89c Merger: Fix VersionConverterTask version selection by making SegmentInsertAction more flexible 2013-03-14 10:37:59 -07:00
Gian Merlino
e5d5050c3f RemoteTaskActionClient: Log retry timer on errors 2013-03-13 23:06:55 -07:00
Gian Merlino
df8e4d4061 Merge branch 'master' into realtime-index-task 2013-03-13 22:43:01 -07:00
Gian Merlino
a1c823402b Merger: Make json exceptions while bootstrapping non-fatal 2013-03-13 22:42:29 -07:00
Gian Merlino
cf470b1ed4 Merger: Task serde without relying on jackson private-final-setter magic 2013-03-13 22:42:29 -07:00
Eric Tschetter
4c165b4880 1) Better logging of master doing version checking
2) Exception out when the scv cannot find its indexer
2013-03-13 19:15:29 -05:00
Eric Tschetter
2bd34f1454 [maven-release-plugin] prepare for next development iteration 2013-03-13 18:32:00 -05:00
Eric Tschetter
b7960e202d [maven-release-plugin] prepare release druid-0.3.21 2013-03-13 18:31:55 -05:00
Eric Tschetter
32f8b09733 Merge branch 'master' of github.com:metamx/druid 2013-03-13 18:29:54 -05:00
Eric Tschetter
688e5e7417 1) Serialization of Tasks is important 2013-03-13 18:29:47 -05:00
Fangjin Yang
60e75d21ce Merge branch 'master' of github.com:metamx/druid 2013-03-13 15:45:21 -07:00
Fangjin Yang
16de004fdc fix json 2013-03-13 15:45:07 -07:00
Eric Tschetter
f1175389c4 [maven-release-plugin] prepare for next development iteration 2013-03-13 16:33:17 -05:00
Eric Tschetter
8aac482618 [maven-release-plugin] prepare release druid-0.3.20 2013-03-13 16:33:10 -05:00
Fangjin Yang
86c7ebe1e2 autoscaling will clear state if a node takes too long to create 2013-03-13 14:28:18 -07:00
Fangjin Yang
ac2d4e52da bug fix for indexer coordinator not alerting when worker provisioning taking too long 2013-03-13 14:09:21 -07:00
Fangjin Yang
a49d0c5e4c [maven-release-plugin] prepare for next development iteration 2013-03-11 17:20:16 -07:00
Fangjin Yang
97f828f6b1 [maven-release-plugin] prepare release druid-0.3.19 2013-03-11 17:20:09 -07:00
Gian Merlino
765e70bc8e RemoteTaskActionClient: Better logging 2013-03-11 15:23:45 -07:00
Gian Merlino
34d6b3a7f0 Merger:
- RealtimeIndexTask: Drop locks on startup
- RealtimeIndexTask: Acquire lock before announcing a new segment
- Retry failed RemoteTaskActionClient submissions using a RetryPolicy
- Add comments to RealtimeIndexTask
2013-03-11 14:08:05 -07:00
Gian Merlino
6245e38981 RealtimeIndexTask-related stuff.
- New task: RealtimeIndexTask
- Add SegmentAnnouncer, ServerView, QueryRunnerFactoryConglomerate to TaskToolbox
- Tasks can advertise ability to answer queries (through returning non-null from
  getQueryRunner)
- WorkerTaskMonitor (the thing on a worker that tracks running tasks) is now a
  QuerySegmentWalker
- LockAcquireAction is now blocking

Assorted other changes.
- TaskAction.perform throws IOException
- TaskActions generally have better stringification
- Renamed TaskMonitor -> WorkerTaskMonitor
2013-03-11 11:22:36 -07:00
Gian Merlino
0e4db00d54 TaskQueue: Fix task ordering when bootstrapping 2013-03-11 11:15:19 -07:00
Gian Merlino
4643030716 TaskToolbox: Rename getTaskActionClientFactory -> getTaskActionClient 2013-03-07 22:38:28 -08:00
Gian Merlino
08bff3f472 Merger: Fix JacksonConfigManager initialization 2013-03-07 22:06:42 -08:00
Eric Tschetter
b979096d74 1) Building is good 2013-03-07 18:46:51 -06:00
Eric Tschetter
d1ffe93c5a Merge remote branch 'origin/convert_task' into convert_task
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/TaskMasterLifecycle.java
2013-03-07 18:12:31 -06:00
Eric Tschetter
f70f71243d 1) Stop polling in ConfigManager when stop is called
2) Remove WorkSetupManager in favor of just using ConfigManager
2013-03-07 17:45:57 -06:00
Eric Tschetter
1c3ef48f34 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable
2) Use new ConfigManager to pull out a whitelist for the Master
2013-03-07 17:45:57 -06:00
Eric Tschetter
6864007c05 1) Remove Task parameter from other methods off of TaskToolbox that required it
2) Move getTaskDir() off of TaskConfig and onto TaskToolbox
3) Rename SegmentKiller interface to DataSegmentKiller
4) Change signature of "DataSegmentKiller.kill(Collection<DataSegment>) throws ServiceException" to just kill(DataSegment) throws SegmentLoadingException
5) Add various log messages
6) Update the version of the segment that has been converted
2013-03-07 17:44:06 -06:00
Eric Tschetter
c9b411c0ca 1) Remove the need for TaskActions to require a Task as a constructor parameter 2013-03-07 17:44:05 -06:00
Eric Tschetter
a11a34f87e 1) Initial commit: Converter Task 2013-03-07 17:44:05 -06:00
Eric Tschetter
ef4ccce30c 1) Stop polling in ConfigManager when stop is called
2) Remove WorkSetupManager in favor of just using ConfigManager
2013-03-07 17:43:37 -06:00
Eric Tschetter
9ffccb6803 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable
2) Use new ConfigManager to pull out a whitelist for the Master
2013-03-07 12:59:59 -06:00