fjy
25ebba2c38
fix default start delay of indexing service and prepare for next release
2013-12-12 18:51:25 -08:00
fjy
19eafe0e96
prepare for next release
2013-12-12 17:26:50 -08:00
fjy
a58f90a689
prepare for next release
2013-12-12 14:51:14 -08:00
Gian Merlino
70c153592f
CliPeon: Fix local mode
2013-12-12 14:22:57 -08:00
Gian Merlino
c4b8c8bc6f
Rework indexing service internals to hopefully be more reliable.
...
The TaskQueue directly manages the TaskRunner. The main management loop runs
periodically and checks that the runner is doing reasonable things. If not, it
attempts to adjust the runner. The management loop also runs on-demand when a
task is added to keep task assignment relatively low latency. The TaskConsumer
is no longer necessary and so it no longer exists.
Task interval locks are handled differently. Instead of some tasks acquiring
locks at runtime and some tasks having implicit fixed lock intervals, all tasks
ask for locks explicitly. This occurs either in "isReady" (which runs on the
overlord) or in "run" (which runs on the peon).
Other changes:
- The TaskQueue is attached to the leader lifecycle, instead of global
- The TaskLockbox is able to sync itself from storage and is no longer
bootstrapped by the TaskQueue.
- RemoteTaskRunner does not clean up zk paths until asked to. This will
prevent deletion of statuses that have not yet been committed.
- Added retries on DbTaskStorage operations.
- Removed SpawnTasksAction (no more subtasks)
- Removed obsolete EventReceiverFirehose configs
- Removed obsolete OldOverlordResource
- Removed TaskStorageQueryAdapter methods related to subtasks
2013-12-11 15:05:16 -08:00
Gian Merlino
f3cfd1d781
Introduce FileTaskLogs, and move TaskLogs module from server to indexing-service
2013-12-10 17:39:43 -08:00
fjy
6cc0860657
fix s3 module problems and prepare for next release
2013-12-09 20:05:55 -08:00
fjy
ab1f02b2bc
fix version brokenness and prepare for next release
2013-12-09 18:38:22 -08:00
fjy
976affb3af
prepare for next release
2013-12-09 18:28:31 -08:00
fjy
303f6ff334
fix worker config setup problems
2013-12-09 18:25:29 -08:00
fjy
8aba4ad3d2
Merge pull request #311 from metamx/versions
...
Add versions to static page
2013-12-09 17:18:16 -08:00
Himadri Singh
b5f6dbc32f
Code refactoring, one place!
2013-12-10 02:09:41 +05:30
Himadri Singh
8117fff4e2
Some minor fixes
2013-12-10 00:39:10 +05:30
fjy
fbad1e2d7a
fix convert properties with infoPath and prepare for next release
2013-12-04 18:55:35 -08:00
Himadri Singh
32200b9b41
removing debug line.
2013-12-04 11:00:47 +05:30
Himadri Singh
47278ad109
Merge relevant changes from 'druid-version-info'
2013-12-04 10:21:19 +05:30
fjy
05f72601c4
fix request time metric and prepare for next release
2013-12-02 14:20:59 -08:00
fjy
ddb6e83f17
fix realtime default and prepare for next deploy
2013-11-25 17:53:17 -08:00
fjy
fbb65988bd
make query resource eagerly instantiate and prepare for next release
2013-11-20 11:58:25 -08:00
fjy
c234dafee1
prepare for next release
2013-11-20 10:43:37 -08:00
fjy
84a6262e04
prepare for next release
2013-11-20 10:27:09 -08:00
fjy
e7167ae00a
add new query resource
2013-11-20 10:02:43 -08:00
fjy
984e24c1bb
fix broken links in docs, prepare for next release
2013-11-19 09:57:56 -08:00
fjy
67a93ccd4d
fix broken validation query config port
2013-11-18 15:53:49 -08:00
fjy
1820110818
clean up docs and fix server monitor double emitting metrics
2013-11-18 15:37:30 -08:00
fjy
a86d3af17e
fix docs
2013-11-14 18:29:27 -08:00
fjy
346cf0e04c
fix out of order in urls for hadoop classpath
2013-11-14 18:18:39 -08:00
fjy
5d00e4075e
prepare for next release
2013-11-14 15:06:26 -08:00
fjy
6b41681424
fix ordering of urls, ugh, need to write more tests
2013-11-14 15:06:07 -08:00
fjy
23ebca6d32
more hadoop dependency hell, getting the right urls to hadoop is hard
2013-11-14 14:29:42 -08:00
fjy
61367c6b13
prepare for next release
2013-11-14 13:16:38 -08:00
fjy
c51eed060f
actually use a class loader pull out dependencies from extension modules
2013-11-14 11:52:21 -08:00
fjy
fcf0c6ce06
change the classpath ordering for batch processing and prepare for next release
2013-11-14 10:52:51 -08:00
fjy
60300bdad0
fix doc version
2013-11-13 13:34:57 -08:00
fjy
c1009f0872
prepare for next release
2013-11-13 11:36:50 -08:00
fjy
d0f990129a
fix docs
2013-11-13 10:59:03 -08:00
fjy
9fe9ca3163
the emitter library is broken and also prepare for next release
2013-11-08 15:54:16 -08:00
fjy
822a30658d
fix broken http post emitter and prepare for next release
2013-11-08 14:01:16 -08:00
fjy
64b93bf448
fix broken autoscaling and prepare for next release
2013-11-08 11:29:42 -08:00
fjy
d70bcc5657
repair broken pom
2013-11-07 23:27:06 -08:00
fjy
a0eedf7342
fix broken docs
2013-11-07 23:11:30 -08:00
fjy
d1c3176bf5
update docs ver
2013-11-07 19:47:36 -08:00
fjy
a049b42674
fix an issue with task tables not getting created automatically and prepare for next release
2013-11-07 18:01:35 -08:00
fjy
d49554185a
fix broken default table names
2013-11-07 17:38:00 -08:00
fjy
6b573c76f1
more fixes
2013-11-07 14:40:45 -08:00
fjy
33561031a2
update docs version to match next release
2013-11-05 15:30:41 -08:00
Xavier Léauté
dce6e7e0eb
hack to support remote repository authentication
2013-11-01 09:33:07 -07:00
Xavier Léauté
ef88f37bbe
add tools pull-deps to cli
2013-10-30 18:16:27 -07:00
fjy
21235ae533
fix configuration conversion bugs and docs and hdfs configs
2013-10-29 17:34:24 -04:00
Gian Merlino
2e9c46867f
Fixes for indexing service.
...
- Create IndexingServiceFirehoseModule so firehoses can be loaded by all mains
- Fix implicit lock acquisition in AbstractTask
2013-10-18 11:14:33 -07:00
