326 Commits

Author SHA1 Message Date
nishantmonu51
f006de8639 fix #732
fix metric list discovery
2014-09-16 22:12:36 +05:30
Xavier Léauté
c8b8e3f6e9 negating compare is bad 2014-09-15 13:00:06 -07:00
Xavier Léauté
137ad50bf1 classes that should be static 2014-09-15 13:00:06 -07:00
Xavier Léauté
e57e2d97ba make constants final 2014-09-15 12:53:40 -07:00
Xavier Léauté
cfa92e8217 fix incorrect nullable annotations 2014-09-15 12:13:52 -07:00
Xavier Léauté
58ab759fc6 remove unused imports 2014-08-29 14:03:47 -07:00
Xavier Léauté
ac05836833 make Java 8 javadoc happy 2014-08-29 13:58:50 -07:00
Gian Merlino
8bcb73a0eb Java programs are best run with a java command. 2014-08-28 18:10:01 -07:00
Gian Merlino
5564a67bfc File.pathSeparator is better than ":". 2014-08-28 18:09:33 -07:00
Gian Merlino
68aeafaacd Allow indexing tasks to specify extra classpaths.
This could be used by Hadoop tasks to reference configs for different clusters, assuming
that the possible configs have been pre-distributed to middle managers.
2014-08-28 18:00:26 -07:00
fjy
91ebe45b4e support both rejectionPolicy and rejectionPolicyFactory in serde 2014-08-07 10:06:27 -07:00
Gian Merlino
09fcfc3b6d Fix race in RemoteTaskRunner that could lead to zombie tasks. 2014-07-18 11:41:50 -07:00
nishantmonu51
4ce12470a1 Add way to skip determine partitions for index task
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
2014-07-18 18:52:15 +05:30
fjy
d8b8826c2e Merge branch 'cleanup-ingest' of github.com:metamx/druid into cleanup-ingest
Conflicts:
	server/src/test/java/io/druid/realtime/firehose/CombiningFirehoseFactoryTest.java
2014-07-17 20:26:11 -07:00
fjy
291f4c00ae Merge branch 'master' of github.com:metamx/druid into cleanup-ingest 2014-07-17 20:24:59 -07:00
nishantmonu51
0e0454a34c switch reingest task to noop & fix compilation
switch back to noop task, its confusing to have a reinvest task that
does nothing.
fix compilation
2014-07-18 06:50:58 +05:30
fjy
ded83557dd Merge pull request #640 from metamx/disable-worker
An alternative way to disable middlemanagers based on worker version
2014-07-17 19:07:27 -06:00
fjy
beac0be45b fix enabled endpoint 2014-07-17 18:04:36 -07:00
fjy
c6078ca841 address code review 2014-07-17 13:34:05 -07:00
fjy
ba978d8b79 some minor cleanups to ingest firehose 2014-07-17 13:05:59 -07:00
fjy
bc650a1c80 Merge pull request #627 from metamx/druid-firehose
Functionality to ingest a Druid segment and change the schema
2014-07-17 13:41:16 -06:00
fjy
5197ea527a disable middlemanagers based on worker version 2014-07-17 12:35:45 -07:00
nishantmonu51
e59c9ebdbc minor fixes
fix IndexOutOfBoundsException
fix ingestFirehose
2014-07-17 17:24:57 +05:30
nishantmonu51
972c5dac31 improve memory usage and rename firehose 2014-07-14 21:17:53 +05:30
nishantmonu51
7168adcca7 Use Ingest task instead of Noop Task 2014-07-08 21:20:17 +05:30
fjy
ce478be899 Remove redundant forking task runner config 2014-07-07 18:08:37 -06:00
nishantmonu51
97b58eb193 review comments
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
2014-07-04 12:31:33 +05:30
nishantmonu51
518ab473f3 improve port finding strategy for task runner
1) Recycle free ports
2) Choose only ports that are free & not used by any other application
2014-07-03 09:58:12 +05:30
nishantmonu51
1de390801f Druid Fireshose
Add druidFirehose, can be used to reIndex filtered data from a
datasource
2014-07-02 20:34:18 +05:30
fjy
4c40e71e54 address cr 2014-06-19 14:48:46 -07:00
fjy
a870fe5cbe inject column config 2014-06-19 14:47:57 -07:00
Xavier Léauté
09346b0a3c make column cache configurable 2014-06-19 14:43:03 -07:00
fjy
0bc1915067 Merge pull request #578 from metamx/new-guava
Update guava, java-util, and druid-api
2014-06-18 14:23:32 -06:00
fjy
b0517dc55d Merge pull request #610 from metamx/ec2-user-data
More flexible EC2 user data classes.
2014-06-18 11:36:13 -06:00
Gian Merlino
5c4b9a7d5b Indexing: Allow null userData. 2014-06-18 10:08:50 -07:00
Gian Merlino
65c1553a76 Fix busted TaskConfig. 2014-06-17 17:27:41 -07:00
Gian Merlino
9f16f0a955 More flexible EC2 user data classes. 2014-06-17 17:10:17 -07:00
fjy
5227b43050 fix more test breakage 2014-06-17 10:35:01 -07:00
fjy
8a13e34c50 fix broken ut 2014-06-17 10:31:50 -07:00
Gian Merlino
54833fa43d Indexing: Make default hadoop coordinates configurable. 2014-06-17 08:53:39 -07:00
fjy
5bd4ad3f0f address code review 2014-06-13 11:29:49 -07:00
fjy
a63cda3281 Merge branch 'master' into new-guava
Conflicts:
	server/src/main/java/io/druid/server/QueryResource.java
2014-06-13 10:08:10 -07:00
fjy
ad7db018d5 add default tuning config for index task 2014-06-09 16:28:47 -07:00
fjy
5e48f3907b fix index task new schema defaults 2014-06-09 16:24:12 -07:00
fjy
9f4cc5ca1f fix test 2014-06-04 16:29:20 -07:00
fjy
77ec4df797 update guava, java-util, and druid-api 2014-06-03 13:43:38 -07:00
Gian Merlino
8a6384862f Better task log errors. 2014-06-02 12:55:17 -07:00
Gian Merlino
48511e15cf Autoscaling: Fix case where target < current, but target is too low.
This can happen when workers are provisioned manually.
2014-06-02 12:36:48 -07:00
fjy
7ffe60ca60 clean up a bit of the logic in RTR failure with exceptions in announceTask 2014-06-02 10:49:28 -07:00
nishantmonu51
6f176cee85 fail task on exception
If the task announcement throw exception, set status to fail instead of
retrying it again and again.
2014-06-02 22:52:50 +05:30