636 Commits

Author SHA1 Message Date
Gian Merlino
4bc8ff4d6a Update versions 2013-12-20 11:19:36 -08:00
fjy
fba6caf7fd Merge pull request #326 from metamx/versions
StatusResource
2013-12-18 22:44:50 -08:00
Gian Merlino
fc4dd51194 Update versions 2013-12-18 15:33:25 -08:00
fjy
d112b2d211 prepare for next release 2013-12-17 17:47:04 -08:00
fjy
0051877f84 fix status endpoint 2013-12-17 17:46:16 -08:00
fjy
07875dd30b prepare for next release 2013-12-17 16:28:11 -08:00
fjy
69f33b0acd remove commented line 2013-12-17 16:24:15 -08:00
fjy
bbb2754a7c fix redirects in druid 2013-12-17 16:22:36 -08:00
fjy
f2241c8885 prepare for next release 2013-12-16 16:16:00 -08:00
Xavier Léauté
ac2ca0e46c separate move and archive tasks 2013-12-16 14:00:55 -08:00
Xavier Léauté
a417cd5df2 add archive task 2013-12-16 13:59:15 -08:00
fjy
84233238b1 Merge branch 'master' of github.com:metamx/druid 2013-12-16 12:01:55 -08:00
fjy
0998d835b0 fix redirection issues with master and overlord 2013-12-16 12:01:52 -08:00
Gian Merlino
7759ed4517 Coordinator: Link service announcement to leadership 2013-12-16 11:28:28 -08:00
Himadri Singh
3752122a7b implementing comments from review 2013-12-16 15:16:28 +05:30
fjy
87b83bceb1 fix task storage config serde and prepare for next release 2013-12-13 16:55:22 -08:00
fjy
01f9c1df31 fix broken task storage config and prepare for next release 2013-12-13 16:45:32 -08:00
fjy
9a5fd6b0e9 prepare for next release 2013-12-13 16:18:34 -08:00
Gian Merlino
600dc7546f Configurability of recency threshold 2013-12-13 16:02:54 -08:00
fjy
407f8caf94 remove server monitor from list of default monitors 2013-12-13 09:04:32 -08:00
fjy
25ebba2c38 fix default start delay of indexing service and prepare for next release 2013-12-12 18:51:25 -08:00
fjy
19eafe0e96 prepare for next release 2013-12-12 17:26:50 -08:00
fjy
a58f90a689 prepare for next release 2013-12-12 14:51:14 -08:00
Gian Merlino
70c153592f CliPeon: Fix local mode 2013-12-12 14:22:57 -08:00
Gian Merlino
c4b8c8bc6f Rework indexing service internals to hopefully be more reliable.
The TaskQueue directly manages the TaskRunner. The main management loop runs
periodically and checks that the runner is doing reasonable things. If not, it
attempts to adjust the runner. The management loop also runs on-demand when a
task is added to keep task assignment relatively low latency. The TaskConsumer
is no longer necessary and so it no longer exists.

Task interval locks are handled differently. Instead of some tasks acquiring
locks at runtime and some tasks having implicit fixed lock intervals, all tasks
ask for locks explicitly. This occurs either in "isReady" (which runs on the
overlord) or in "run" (which runs on the peon).

Other changes:
- The TaskQueue is attached to the leader lifecycle, instead of global
- The TaskLockbox is able to sync itself from storage and is no longer
  bootstrapped by the TaskQueue.
- RemoteTaskRunner does not clean up zk paths until asked to. This will
  prevent deletion of statuses that have not yet been committed.
- Added retries on DbTaskStorage operations.
- Removed SpawnTasksAction (no more subtasks)
- Removed obsolete EventReceiverFirehose configs
- Removed obsolete OldOverlordResource
- Removed TaskStorageQueryAdapter methods related to subtasks
2013-12-11 15:05:16 -08:00
Gian Merlino
f3cfd1d781 Introduce FileTaskLogs, and move TaskLogs module from server to indexing-service 2013-12-10 17:39:43 -08:00
fjy
6cc0860657 fix s3 module problems and prepare for next release 2013-12-09 20:05:55 -08:00
fjy
ab1f02b2bc fix version brokenness and prepare for next release 2013-12-09 18:38:22 -08:00
fjy
976affb3af prepare for next release 2013-12-09 18:28:31 -08:00
fjy
303f6ff334 fix worker config setup problems 2013-12-09 18:25:29 -08:00
fjy
8aba4ad3d2 Merge pull request #311 from metamx/versions
Add versions to static page
2013-12-09 17:18:16 -08:00
Himadri Singh
b5f6dbc32f Code refactoring, one place! 2013-12-10 02:09:41 +05:30
Himadri Singh
8117fff4e2 Some minor fixes 2013-12-10 00:39:10 +05:30
fjy
fbad1e2d7a fix convert properties with infoPath and prepare for next release 2013-12-04 18:55:35 -08:00
Himadri Singh
32200b9b41 removing debug line. 2013-12-04 11:00:47 +05:30
Himadri Singh
47278ad109 Merge relevant changes from 'druid-version-info' 2013-12-04 10:21:19 +05:30
fjy
05f72601c4 fix request time metric and prepare for next release 2013-12-02 14:20:59 -08:00
fjy
ddb6e83f17 fix realtime default and prepare for next deploy 2013-11-25 17:53:17 -08:00
fjy
fbb65988bd make query resource eagerly instantiate and prepare for next release 2013-11-20 11:58:25 -08:00
fjy
c234dafee1 prepare for next release 2013-11-20 10:43:37 -08:00
fjy
84a6262e04 prepare for next release 2013-11-20 10:27:09 -08:00
fjy
e7167ae00a add new query resource 2013-11-20 10:02:43 -08:00
fjy
984e24c1bb fix broken links in docs, prepare for next release 2013-11-19 09:57:56 -08:00
fjy
67a93ccd4d fix broken validation query config port 2013-11-18 15:53:49 -08:00
fjy
1820110818 clean up docs and fix server monitor double emitting metrics 2013-11-18 15:37:30 -08:00
fjy
a86d3af17e fix docs 2013-11-14 18:29:27 -08:00
fjy
346cf0e04c fix out of order in urls for hadoop classpath 2013-11-14 18:18:39 -08:00
fjy
5d00e4075e prepare for next release 2013-11-14 15:06:26 -08:00
fjy
6b41681424 fix ordering of urls, ugh, need to write more tests 2013-11-14 15:06:07 -08:00
fjy
23ebca6d32 more hadoop dependency hell, getting the right urls to hadoop is hard 2013-11-14 14:29:42 -08:00