Commit Graph

2668 Commits

Author SHA1 Message Date
Igal Levy 39012c6dbe Separated realitme ingestion from realtime node info; under Data Ingestion the Realtime link now points to the new realtime-ingestion page 2013-12-20 13:43:55 -08:00
Igal Levy 9b53912209 Added titles 2013-12-20 13:42:22 -08:00
Igal Levy 3d66f0fb8b added Realtime-ingestion under Data Ingestion (this is the content split from Realtime, which is now just about the node); moved Firehose and Plumber under Realtime-ingestion 2013-12-20 13:08:25 -08:00
Igal Levy d283693d78 updated links and references since these two files contain the lists of firehoses and plumbers they refer to, and pointed to Realtime-ingestion for the example of the kafka firehose 2013-12-20 13:04:40 -08:00
Gian Merlino 668cf009a0 [maven-release-plugin] prepare for next development iteration 2013-12-20 12:28:54 -08:00
Gian Merlino bd58def933 [maven-release-plugin] prepare release druid-0.6.46 2013-12-20 12:28:49 -08:00
Gian Merlino bbe1b82347 Update versions 2013-12-20 12:26:27 -08:00
Gian Merlino 26991b5a2a Indexing service: Fix termination related log message 2013-12-20 12:05:42 -08:00
Gian Merlino 837dee1934 RealtimePlumberSchool: Alert and continue on any exception when abandoning segments 2013-12-20 11:38:42 -08:00
Gian Merlino 4d83837e88 RealtimeIndexTask: Clean up imports and comments 2013-12-20 11:37:16 -08:00
Gian Merlino 9043c211b2 [maven-release-plugin] prepare for next development iteration 2013-12-20 11:25:36 -08:00
Gian Merlino 29c0fa1df9 [maven-release-plugin] prepare release druid-0.6.45 2013-12-20 11:25:31 -08:00
Gian Merlino 17ad4ee2f0 Fix RemoteTaskRunnerTest 2013-12-20 11:23:28 -08:00
Gian Merlino 4bc8ff4d6a Update versions 2013-12-20 11:19:36 -08:00
Gian Merlino 5711ac4aff [maven-release-plugin] prepare for next development iteration 2013-12-20 11:17:01 -08:00
Gian Merlino 3b15f6a834 [maven-release-plugin] prepare release druid-0.6.44 2013-12-20 11:17:01 -08:00
Gian Merlino e5b8546d19 Autoscaling fixes.
- Initial targetWorkerCount must be subject to pool size limits
- Use consistent workerSetupData for the entire autoscaling run
- Don't call terminate() when we have nothing to terminate
- Terminate obsolete workers even faster
2013-12-20 11:17:01 -08:00
Gian Merlino c503f5e9c5 [maven-release-plugin] prepare for next development iteration 2013-12-20 11:17:01 -08:00
Gian Merlino 97095ee3db [maven-release-plugin] prepare release druid-0.6.43 2013-12-20 11:17:00 -08:00
fjy 3ec2766cd3 Merge pull request #339 from metamx/autoscaling
Autoscaling: Move target count independent of actual count.
2013-12-20 10:04:26 -08:00
Gian Merlino 6224577ed1 Autoscaling: Terminate obsolete workers faster 2013-12-20 10:01:32 -08:00
Gian Merlino 4a722c0a6d Autoscaling changes from code review.
- Log and return immediately when workerSetupData is null
- Allow provisioning more nodes while other nodes are still provisioning
- Add tests for bumping up the minimum version
2013-12-20 08:59:35 -08:00
Gian Merlino 0ee6136ea3 NoopTask: Fix things that should be static. Add simple factory method. 2013-12-20 08:56:17 -08:00
fjy 23edba9e81 Merge pull request #338 from metamx/indexing-service-bugs
Indexing service bugs
2013-12-19 17:54:46 -08:00
Igal Levy 721195ac12 added anchor for linking to section 2013-12-19 17:26:51 -08:00
Gian Merlino 3dd9a25546 Fix import 2013-12-19 16:18:16 -08:00
Gian Merlino 0ff7f0e8e0 TaskActionToolbox: Combine adjacent ifs 2013-12-19 16:16:34 -08:00
Gian Merlino f86342f7dc DbTaskStorage: Protect against invalid lock_payload 2013-12-19 16:16:20 -08:00
Gian Merlino 1f4b99634f Autoscaling: Move target count independent of actual count.
This should let us grow and shrink the worker pool in chunks when necessary
(like when a bunch of them go offline, or when there is a worker version
change).
2013-12-19 16:11:30 -08:00
Igal Levy 18d8b0840e fixed formatting on numbered list and code blocks 2013-12-19 16:07:57 -08:00
Igal Levy 0aa04dd787 added title 2013-12-19 16:04:56 -08:00
Gian Merlino 846c3da4ab Empty task intervals, and empty lock intervals, aren't useful.
So prevent them from being created, through checks in AbstractFixedIntervalTask
and TaskLockbox.tryLock.
2013-12-19 13:21:41 -08:00
Gian Merlino 566a3a6112 Indexing service: Break up segment actions
Each one now one operates on at most a collection of segments that comprise
a single partition. The main purpose of this change is to prevent audit log
payload sizes from getting out of control.
2013-12-19 13:10:40 -08:00
Gian Merlino 2d2fa319bd pom.xml: Update emitter 2013-12-19 13:10:40 -08:00
Gian Merlino 6fbe67eeea IndexerDBCoordinator: Work around SELECT -> INSERT races when adding segments 2013-12-19 13:10:40 -08:00
fjy b6b9bb4cd8 Merge branch 'master' of github.com:metamx/druid into az 2013-12-19 10:52:22 -08:00
fjy fba6caf7fd Merge pull request #326 from metamx/versions
StatusResource
2013-12-18 22:44:50 -08:00
Himadri Singh 818aba458f Moved TestDruidModule 2013-12-19 12:14:06 +05:30
Himadri Singh cd1e7cc65d Updated test 2013-12-19 12:01:18 +05:30
Himadri Singh b1a9ecc1cf StatusResourceTest
misses testing reloading of modules currently
2013-12-19 11:42:22 +05:30
fjy 4ba8a44239 Merge pull request #337 from liquidm/fix_hadoop_intake_too
fix hadoop intake's parser exception catching (was too specific)
2013-12-18 22:08:07 -08:00
Hagen Rother 52746b8ea6 fix hadoop intake's parser exception catching (was too specific) 2013-12-19 07:04:47 +01:00
Himadri Singh c58fbfe40c minor fixes 2013-12-19 10:49:38 +05:30
fjy 6b9bccd796 Merge branch 'master' into az 2013-12-18 18:47:35 -08:00
Gian Merlino 25c3f28907 [maven-release-plugin] prepare for next development iteration 2013-12-18 18:38:27 -08:00
Gian Merlino 6a740768d6 [maven-release-plugin] prepare release druid-0.6.42 2013-12-18 18:38:22 -08:00
Gian Merlino 6478c9a162 S3DataSegmentMover: No need to move files onto themselves 2013-12-18 18:36:10 -08:00
Igal Levy 479b953a79 added definitions for master and compute nodes; tweaked spacing between term and definition 2013-12-18 17:35:30 -08:00
Igal Levy be50cfad6a Merge branch 'master' into igalDruid 2013-12-18 17:20:41 -08:00
Gian Merlino 8d8ec51c9c [maven-release-plugin] prepare for next development iteration 2013-12-18 16:05:33 -08:00