Tugdual Saunier
ae38c92491
Fixed segments SQL queries for PostgreSQL compatibility
2014-03-06 19:14:32 +00:00
Gian Merlino
70db460f97
Blocking Executors and maxPendingPersists, oh my!
...
- Execs.newBlockingSingleThreaded can now accept capacity = 0.
- Changed default maxPendingPersists from 2 to 0.
- Fixed serde of maxPendingPersists in RealtimeIndexTasks.
2014-03-05 10:55:12 -08:00
fjy
37a79dd4cb
[maven-release-plugin] prepare for next development iteration
2014-02-27 11:52:40 -08:00
fjy
8cdd0e3d53
[maven-release-plugin] prepare release druid-0.6.62
2014-02-27 11:52:35 -08:00
Yuval Oren
314e38a2c6
Fixed realtime index query serving failure due to incorrect treatment of DataSource
2014-02-26 22:36:27 -08:00
fjy
d57974d58b
Merge pull request #407 from metamx/restore-task
...
Restore task
2014-02-26 19:18:58 -07:00
Tugdual Saunier
e40725d5f3
Added support for PostgreSQL on overlord nodes
2014-02-26 01:24:37 +01:00
Xavier Léauté
7dbafa5453
fix task id
2014-02-25 13:49:39 -08:00
Xavier Léauté
e2defe8bf1
update copyright date
2014-02-25 13:44:15 -08:00
Xavier Léauté
2f61035585
add restore task
2014-02-25 13:41:40 -08:00
fjy
c57cf6ab4d
[maven-release-plugin] prepare for next development iteration
2014-02-14 15:24:15 -08:00
fjy
44755cc91c
[maven-release-plugin] prepare release druid-0.6.61
2014-02-14 15:24:11 -08:00
fjy
f5affb6b5a
[maven-release-plugin] prepare for next development iteration
2014-02-14 15:09:30 -08:00
fjy
189376f495
[maven-release-plugin] prepare release druid-0.6.60
2014-02-14 15:09:26 -08:00
fjy
3979eb270c
Revert "Revert "Merge branch 'determine-partitions-improvements'""
...
This reverts commit 189b3e2b9b
.
2014-02-14 12:58:56 -08:00
fjy
189b3e2b9b
Revert "Merge branch 'determine-partitions-improvements'"
...
This reverts commit 7ad228ceb5
, reversing
changes made to 9c55e2b779
.
2014-02-14 12:47:34 -08:00
fjy
82fd35726f
[maven-release-plugin] prepare for next development iteration
2014-02-12 20:03:00 -08:00
fjy
cc1b91636f
[maven-release-plugin] prepare release druid-0.6.59
2014-02-12 20:02:55 -08:00
nishantmonu51
7ad228ceb5
Merge branch 'determine-partitions-improvements'
...
Conflicts:
pom.xml
2014-02-12 10:51:26 +05:30
fjy
b7a78680b2
[maven-release-plugin] prepare for next development iteration
2014-02-07 13:06:23 -08:00
fjy
cc6886646e
[maven-release-plugin] prepare release druid-0.6.58
2014-02-07 13:06:18 -08:00
fjy
555f434fa6
[maven-release-plugin] prepare for next development iteration
2014-02-07 11:56:41 -08:00
fjy
371f2bb941
[maven-release-plugin] prepare release druid-0.6.57
2014-02-07 11:56:34 -08:00
Gian Merlino
b9556e2e2e
SimpleResourceManagementStrategy: Fix log/return
2014-02-07 10:02:45 -08:00
Gian Merlino
5ec634e498
SimpleResourceManagementStrategy: Scale up to minWorkerCount when increased
2014-02-06 13:20:09 -08:00
fjy
af48273369
fix bug with dynamic configs in coordinator not working
2014-02-06 11:19:05 -08:00
fjy
056e82a516
[maven-release-plugin] prepare for next development iteration
2014-02-04 15:23:34 -08:00
fjy
0ea45b590f
[maven-release-plugin] prepare release druid-0.6.56
2014-02-04 15:23:30 -08:00
nishantmonu51
bacc72415f
correct locking and partitionsSpec
2014-02-05 03:17:47 +05:30
fjy
fc4cd79125
[maven-release-plugin] prepare for next development iteration
2014-02-03 16:47:50 -08:00
fjy
4d52e20fe1
[maven-release-plugin] prepare release druid-0.6.55
2014-02-03 16:47:46 -08:00
fjy
46571ddf69
[maven-release-plugin] prepare for next development iteration
2014-02-03 16:35:02 -08:00
fjy
cebb46a259
[maven-release-plugin] prepare release druid-0.6.54
2014-02-03 16:34:57 -08:00
Gian Merlino
994c7e3fa8
RemoteTaskActionClient: Retry on ChannelExceptions too
2014-02-03 08:16:51 -08:00
fjy
21d518e15c
[maven-release-plugin] prepare for next development iteration
2014-01-31 16:32:25 -08:00
fjy
84f434d9f4
[maven-release-plugin] prepare release druid-0.6.53
2014-01-31 16:32:21 -08:00
fjy
019be5c3b0
update jquery
2014-01-31 12:37:37 -08:00
nishantmonu51
97e5d68635
determine intervals working with determine partitions
2014-01-31 19:04:52 +05:30
fjy
0c789412bb
add a workaround for jackson bug where jacksoninject fails when a null value is passed through json creator annotated constructor
2014-01-25 07:07:27 +08:00
fjy
2ff86984da
fix broken ut
2014-01-21 10:47:45 -08:00
fjy
ebc66df27d
use terminateWithIds in terminate
2014-01-20 16:58:53 -08:00
fjy
1d81ad2946
remove unused class
2014-01-20 16:45:54 -08:00
fjy
1ecc9d0f98
fix the edge case where autoscaling tries to terminate node without ip
2014-01-20 16:44:19 -08:00
fjy
c1f0027a36
Merge pull request #361 from metamx/worker-oome-fix
...
Worker oome fix
2014-01-20 11:34:45 -08:00
fjy
57e022f446
[maven-release-plugin] prepare for next development iteration
2014-01-17 15:53:54 -08:00
fjy
6540b2a58e
[maven-release-plugin] prepare release druid-0.6.52
2014-01-17 15:53:50 -08:00
nishantmonu51
3fb72aff93
rename maxPendingPersistBatches to maxPendingPersists
2014-01-17 12:59:21 +05:30
nishantmonu51
fb819abd6f
make maxPendingPersistPeriod configurable
2014-01-17 11:01:55 +05:30
fjy
26a0f862fb
[maven-release-plugin] prepare for next development iteration
2014-01-14 17:35:45 -08:00
fjy
3737ac4966
[maven-release-plugin] prepare release druid-0.6.51
2014-01-14 17:35:40 -08:00
fjy
528efedf52
[maven-release-plugin] prepare for next development iteration
2014-01-14 16:08:47 -08:00
fjy
b4e4a5df96
[maven-release-plugin] prepare release druid-0.6.50
2014-01-14 16:08:43 -08:00
fjy
4a9c255cde
[maven-release-plugin] prepare for next development iteration
2014-01-14 09:56:34 -08:00
fjy
d8ac5575bc
[maven-release-plugin] prepare release druid-0.6.49
2014-01-14 09:56:30 -08:00
fjy
396311a547
[maven-release-plugin] prepare for next development iteration
2014-01-13 18:04:29 -08:00
fjy
9c9d6287a2
[maven-release-plugin] prepare release druid-0.6.48
2014-01-13 18:04:24 -08:00
Gian Merlino
1331f2ce56
TaskStorage.add() now throws TaskExistsException, and the servlet respects it
...
The servlet will throw 400 rather than 500 when a task already exists, to
signify that the request has no hope of ever working.
2014-01-13 15:42:05 -08:00
Gian Merlino
a72c4429f7
RemoteTaskRunner: Fix NPE on cleanup due to missing withWorker
2014-01-13 15:41:04 -08:00
fjy
f3476f40e1
fix typo
2014-01-10 18:08:33 -08:00
fjy
f4e3f02c3b
more exceptions
2014-01-10 18:06:42 -08:00
fjy
1ecc94cfb6
another attempt at index task
2014-01-10 17:56:22 -08:00
fjy
f0b4d0c1e4
fix small bug with unusable dims
2014-01-10 14:59:09 -08:00
fjy
fe50104053
fix the index task and more docs
2014-01-10 14:47:18 -08:00
nishantmonu51
da01c4a78a
Add registration for backward compatibility
2014-01-10 02:02:06 +05:30
nishantmonu51
d28f9daccb
Remove duplicate registration of service
...
If the serviceName does not contain ":" this leads to duplicate
registration of firehose with same name
2014-01-10 01:17:41 +05:30
Gian Merlino
9037141c00
IndexTask: Better logging at the end of each segment
2014-01-08 15:22:12 -08:00
Gian Merlino
2c53af4d66
ForkingTaskRunner: Upload task logs even when job fails
2014-01-08 14:46:18 -08:00
Gian Merlino
7f430d9fde
RealtimeIndexTask: If a Throwable was thrown it is not a normalExit
2014-01-08 14:45:35 -08:00
Gian Merlino
83b4641e31
ForkingTaskRunnerConfig: Add java.io.tmpdir to allowedPrefixes
2014-01-07 16:12:24 -08:00
Gian Merlino
bf158102c4
IndexTask: Print metrics even if finishJob fails
2014-01-07 07:17:19 -08:00
fjy
2b46c1d292
[maven-release-plugin] prepare for next development iteration
2014-01-02 19:53:41 -08:00
fjy
7a0f634b02
[maven-release-plugin] prepare release druid-0.6.47
2014-01-02 19:53:35 -08:00
Xavier Léauté
ef05312c97
cleanup dependencies
2013-12-30 16:31:12 -08:00
Gian Merlino
668cf009a0
[maven-release-plugin] prepare for next development iteration
2013-12-20 12:28:54 -08:00
Gian Merlino
bd58def933
[maven-release-plugin] prepare release druid-0.6.46
2013-12-20 12:28:49 -08:00
Gian Merlino
26991b5a2a
Indexing service: Fix termination related log message
2013-12-20 12:05:42 -08:00
Gian Merlino
4d83837e88
RealtimeIndexTask: Clean up imports and comments
2013-12-20 11:37:16 -08:00
Gian Merlino
9043c211b2
[maven-release-plugin] prepare for next development iteration
2013-12-20 11:25:36 -08:00
Gian Merlino
29c0fa1df9
[maven-release-plugin] prepare release druid-0.6.45
2013-12-20 11:25:31 -08:00
Gian Merlino
17ad4ee2f0
Fix RemoteTaskRunnerTest
2013-12-20 11:23:28 -08:00
Gian Merlino
5711ac4aff
[maven-release-plugin] prepare for next development iteration
2013-12-20 11:17:01 -08:00
Gian Merlino
3b15f6a834
[maven-release-plugin] prepare release druid-0.6.44
2013-12-20 11:17:01 -08:00
Gian Merlino
e5b8546d19
Autoscaling fixes.
...
- Initial targetWorkerCount must be subject to pool size limits
- Use consistent workerSetupData for the entire autoscaling run
- Don't call terminate() when we have nothing to terminate
- Terminate obsolete workers even faster
2013-12-20 11:17:01 -08:00
Gian Merlino
c503f5e9c5
[maven-release-plugin] prepare for next development iteration
2013-12-20 11:17:01 -08:00
Gian Merlino
97095ee3db
[maven-release-plugin] prepare release druid-0.6.43
2013-12-20 11:17:00 -08:00
fjy
3ec2766cd3
Merge pull request #339 from metamx/autoscaling
...
Autoscaling: Move target count independent of actual count.
2013-12-20 10:04:26 -08:00
Gian Merlino
6224577ed1
Autoscaling: Terminate obsolete workers faster
2013-12-20 10:01:32 -08:00
Gian Merlino
4a722c0a6d
Autoscaling changes from code review.
...
- Log and return immediately when workerSetupData is null
- Allow provisioning more nodes while other nodes are still provisioning
- Add tests for bumping up the minimum version
2013-12-20 08:59:35 -08:00
Gian Merlino
0ee6136ea3
NoopTask: Fix things that should be static. Add simple factory method.
2013-12-20 08:56:17 -08:00
Gian Merlino
3dd9a25546
Fix import
2013-12-19 16:18:16 -08:00
Gian Merlino
0ff7f0e8e0
TaskActionToolbox: Combine adjacent ifs
2013-12-19 16:16:34 -08:00
Gian Merlino
f86342f7dc
DbTaskStorage: Protect against invalid lock_payload
2013-12-19 16:16:20 -08:00
Gian Merlino
1f4b99634f
Autoscaling: Move target count independent of actual count.
...
This should let us grow and shrink the worker pool in chunks when necessary
(like when a bunch of them go offline, or when there is a worker version
change).
2013-12-19 16:11:30 -08:00
Gian Merlino
846c3da4ab
Empty task intervals, and empty lock intervals, aren't useful.
...
So prevent them from being created, through checks in AbstractFixedIntervalTask
and TaskLockbox.tryLock.
2013-12-19 13:21:41 -08:00
Gian Merlino
566a3a6112
Indexing service: Break up segment actions
...
Each one now one operates on at most a collection of segments that comprise
a single partition. The main purpose of this change is to prevent audit log
payload sizes from getting out of control.
2013-12-19 13:10:40 -08:00
Gian Merlino
6fbe67eeea
IndexerDBCoordinator: Work around SELECT -> INSERT races when adding segments
2013-12-19 13:10:40 -08:00
Gian Merlino
25c3f28907
[maven-release-plugin] prepare for next development iteration
2013-12-18 18:38:27 -08:00
Gian Merlino
6a740768d6
[maven-release-plugin] prepare release druid-0.6.42
2013-12-18 18:38:22 -08:00
Gian Merlino
8d8ec51c9c
[maven-release-plugin] prepare for next development iteration
2013-12-18 16:05:33 -08:00
Gian Merlino
00d651bf6f
[maven-release-plugin] prepare release druid-0.6.41
2013-12-18 16:05:27 -08:00