Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,814 Commits 111 Branches 503 Tags 728 MiB
Commit Graph

3814 Commits

Author SHA1 Message Date
Gian Merlino 6245e38981 RealtimeIndexTask-related stuff. 
- New task: RealtimeIndexTask
- Add SegmentAnnouncer, ServerView, QueryRunnerFactoryConglomerate to TaskToolbox
- Tasks can advertise ability to answer queries (through returning non-null from
  getQueryRunner)
- WorkerTaskMonitor (the thing on a worker that tracks running tasks) is now a
  QuerySegmentWalker
- LockAcquireAction is now blocking

Assorted other changes.
- TaskAction.perform throws IOException
- TaskActions generally have better stringification
- Renamed TaskMonitor -> WorkerTaskMonitor
 2013-03-11 11:22:36 -07:00
Gian Merlino 0e4db00d54 TaskQueue: Fix task ordering when bootstrapping 2013-03-11 11:15:19 -07:00
Gian Merlino 3fa46988f5 Realtime: 
- MetadataUpdater now built from SegmentAnnouncer, SegmentPublisher instances.
- Sinks can take a version instead of always using interval.start. The realtime
  plumber selects a version using a VersioningPolicy.
- Plumbers gained a startJob method.
- Realtime plumbers gained an implementation for finishJob.
 2013-03-11 11:14:51 -07:00
Gian Merlino 4126893ba3 KafkaFirehoseFactory: Fix serialization 2013-03-11 11:13:19 -07:00
Gian Merlino f8d9a3b19b IndexGranularity: Fix increment for day, week 2013-03-11 11:08:44 -07:00
Eric Tschetter d9b9f73494 Merge branch 'master' of github.com:metamx/druid 2013-03-08 12:41:58 -06:00
Eric Tschetter d1161ae0ec 1) Master should create the config table if it's not there. 2013-03-08 12:41:46 -06:00
Nelson Ray a470f3fa6a change name of druid.indexer.configTable to druid.database.configTable to be consistent 2013-03-08 10:35:13 -08:00
Gian Merlino 4643030716 TaskToolbox: Rename getTaskActionClientFactory -> getTaskActionClient 2013-03-07 22:38:28 -08:00
Gian Merlino 08bff3f472 Merger: Fix JacksonConfigManager initialization 2013-03-07 22:06:42 -08:00
Eric Tschetter 53c8ba6e75 Merge branch 'master' of github.com:metamx/druid 2013-03-07 18:47:05 -06:00
Eric Tschetter b979096d74 1) Building is good 2013-03-07 18:46:51 -06:00
Nelson Ray 7a57609c5b emit metrics corresponding to cost-based balancing 2013-03-07 16:31:57 -08:00
Nelson Ray 9f405c0b1e fix constant segment balancing and separate out the differences between segment assignment and balancing 2013-03-07 16:31:57 -08:00
cheddar c3a871b942 Merge pull request #97 from metamx/convert_task 
Index Conversion Task and adjustment to TaskAction API
 2013-03-07 16:13:00 -08:00
Eric Tschetter d1ffe93c5a Merge remote branch 'origin/convert_task' into convert_task 
Conflicts:
	merger/src/main/java/com/metamx/druid/merger/coordinator/TaskMasterLifecycle.java
 2013-03-07 18:12:31 -06:00
Eric Tschetter f70f71243d 1) Stop polling in ConfigManager when stop is called 
2) Remove WorkSetupManager in favor of just using ConfigManager
 2013-03-07 17:45:57 -06:00
Eric Tschetter 1c3ef48f34 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable 
2) Use new ConfigManager to pull out a whitelist for the Master
 2013-03-07 17:45:57 -06:00
Eric Tschetter 6864007c05 1) Remove Task parameter from other methods off of TaskToolbox that required it 
2) Move getTaskDir() off of TaskConfig and onto TaskToolbox
3) Rename SegmentKiller interface to DataSegmentKiller
4) Change signature of "DataSegmentKiller.kill(Collection<DataSegment>) throws ServiceException" to just kill(DataSegment) throws SegmentLoadingException
5) Add various log messages
6) Update the version of the segment that has been converted
 2013-03-07 17:44:06 -06:00
Eric Tschetter c9b411c0ca 1) Remove the need for TaskActions to require a Task as a constructor parameter 2013-03-07 17:44:05 -06:00
Eric Tschetter a11a34f87e 1) Initial commit: Converter Task 2013-03-07 17:44:05 -06:00
Eric Tschetter ef4ccce30c 1) Stop polling in ConfigManager when stop is called 
2) Remove WorkSetupManager in favor of just using ConfigManager
 2013-03-07 17:43:37 -06:00
Eric Tschetter fe4ca2a1a2 Merge branch 'master' of github.com:metamx/druid 2013-03-07 16:19:02 -06:00
Eric Tschetter fd0fcc7319 Whitespace! 2013-03-07 16:18:31 -06:00
xvrl a79c9ec183 fix some issues with negative numbers 2013-03-07 14:10:58 -08:00
Eric Tschetter e4de6f3deb Merge branch 'master' of github.com:metamx/druid 2013-03-07 15:55:38 -06:00
Eric Tschetter 82aa6ed7dd 1) Adjust the SingleSegmentLoader to be able to use cache locations from previous versions as well without re-downloading 2013-03-07 15:55:23 -06:00
cheddar a3279541c6 Merge pull request #102 from metamx/cache-fixes 
log but do not fail if memcached operations do not get queued in time
 2013-03-07 13:36:51 -08:00
cheddar a1cd3c3905 Merge pull request #103 from metamx/request-logs 
make request logs machine-readable
 2013-03-07 13:35:48 -08:00
xvrl b0349a6518 move objectMapper into requestLogger 2013-03-07 11:31:36 -08:00
cheddar bb1b3cd2f9 Merge pull request #98 from metamx/druid-sql 
Basic SQL grammar for Druid
 2013-03-07 11:14:54 -08:00
cheddar e2552cc033 Merge pull request #100 from metamx/indexing_console 
A console to view tasks in the indexing service
 2013-03-07 11:13:47 -08:00
Eric Tschetter 9ffccb6803 1) Adjust the Config stuff that WorkerSetupManager was using to be reusable 
2) Use new ConfigManager to pull out a whitelist for the Master
 2013-03-07 12:59:59 -06:00
xvrl 1b51848a89 add cache errorCount 2013-03-07 10:38:41 -08:00
xvrl 21d648cc39 make request logs machine-readable 2013-03-06 22:33:39 -08:00
xvrl 2837309075 do not fail on exceptions when pulling from cache 2013-03-06 19:22:15 -08:00
xvrl 8f6c313561 log but do not fail if memcached operations do not get queued in time 2013-03-06 17:28:09 -08:00
Fangjin Yang 1b9bbb2f2a remove test code 2013-03-06 11:20:27 -08:00
Fangjin Yang 9d9efadf72 working indexer console 2013-03-06 10:38:40 -08:00
xvrl 4cb3ca00bc support for javascript dimfilters 2013-03-06 09:59:53 -08:00
xvrl 614d7801a4 very simplistic error handling 2013-03-05 12:41:44 -08:00
xvrl 28fe206404 output tsv format + better command line 2013-03-05 11:48:47 -08:00
xvrl 035986b3bc keep track of queried fields 2013-03-05 11:45:51 -08:00
Eric Tschetter 6e95dd49b3 1) Remove Task parameter from other methods off of TaskToolbox that required it 
2) Move getTaskDir() off of TaskConfig and onto TaskToolbox
3) Rename SegmentKiller interface to DataSegmentKiller
4) Change signature of "DataSegmentKiller.kill(Collection<DataSegment>) throws ServiceException" to just kill(DataSegment) throws SegmentLoadingException
5) Add various log messages
6) Update the version of the segment that has been converted
 2013-03-05 13:30:50 -06:00
Fangjin Yang b410f5e805 [maven-release-plugin] prepare for next development iteration 2013-03-05 13:30:49 -06:00
Fangjin Yang c0ab1a503d [maven-release-plugin] prepare release druid-0.3.18 2013-03-05 13:30:49 -06:00
Fangjin Yang e51a01f85f fix broken UT 2013-03-05 13:30:49 -06:00
Fangjin Yang 665f1909c6 fixing a bug with indexing service not correctly killing worker nodes 2013-03-05 13:30:49 -06:00
Fangjin Yang 75cefa05b5 [maven-release-plugin] prepare for next development iteration 2013-03-05 13:30:49 -06:00
Fangjin Yang 90637ab7b7 [maven-release-plugin] prepare release druid-0.3.16 2013-03-05 13:30:49 -06:00