Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-03-03 07:49:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,053 Commits 116 Branches 508 Tags
Commit Graph

1173 Commits

Author SHA1 Message Date
Gian Merlino
09fcfc3b6d Fix race in RemoteTaskRunner that could lead to zombie tasks. 2014-07-18 11:41:50 -07:00
nishantmonu51
4ce12470a1 Add way to skip determine partitions for index task 
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
 2014-07-18 18:52:15 +05:30
fjy
d8b8826c2e Merge branch 'cleanup-ingest' of github.com:metamx/druid into cleanup-ingest 
Conflicts:
	server/src/test/java/io/druid/realtime/firehose/CombiningFirehoseFactoryTest.java
 2014-07-17 20:26:11 -07:00
fjy
291f4c00ae Merge branch 'master' of github.com:metamx/druid into cleanup-ingest 2014-07-17 20:24:59 -07:00
nishantmonu51
0e0454a34c switch reingest task to noop & fix compilation 
switch back to noop task, its confusing to have a reinvest task that
does nothing.
fix compilation
 2014-07-18 06:50:58 +05:30
fjy
ded83557dd Merge pull request #640 from metamx/disable-worker 
An alternative way to disable middlemanagers based on worker version
 2014-07-17 19:07:27 -06:00
fjy
beac0be45b fix enabled endpoint 2014-07-17 18:04:36 -07:00
fjy
c6078ca841 address code review 2014-07-17 13:34:05 -07:00
fjy
ba978d8b79 some minor cleanups to ingest firehose 2014-07-17 13:05:59 -07:00
fjy
bc650a1c80 Merge pull request #627 from metamx/druid-firehose 
Functionality to ingest a Druid segment and change the schema
 2014-07-17 13:41:16 -06:00
fjy
5197ea527a disable middlemanagers based on worker version 2014-07-17 12:35:45 -07:00
nishantmonu51
e59c9ebdbc minor fixes 
fix IndexOutOfBoundsException
fix ingestFirehose
 2014-07-17 17:24:57 +05:30
nishantmonu51
972c5dac31 improve memory usage and rename firehose 2014-07-14 21:17:53 +05:30
nishantmonu51
f5f05e3a9b Sync changes from branch new-ingestion PR #599 
Sync and Resolve Conflicts
 2014-07-11 16:15:10 +05:30
nishantmonu51
7168adcca7 Use Ingest task instead of Noop Task 2014-07-08 21:20:17 +05:30
fjy
ce478be899 Remove redundant forking task runner config 2014-07-07 18:08:37 -06:00
nishantmonu51
97b58eb193 review comments 
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
 2014-07-04 12:31:33 +05:30
nishantmonu51
518ab473f3 improve port finding strategy for task runner 
1) Recycle free ports
2) Choose only ports that are free & not used by any other application
 2014-07-03 09:58:12 +05:30
nishantmonu51
1de390801f Druid Fireshose 
Add druidFirehose, can be used to reIndex filtered data from a
datasource
 2014-07-02 20:34:18 +05:30
fjy
4c40e71e54 address cr 2014-06-19 14:48:46 -07:00
fjy
a870fe5cbe inject column config 2014-06-19 14:47:57 -07:00
Xavier Léauté
09346b0a3c make column cache configurable 2014-06-19 14:43:03 -07:00
fjy
0bc1915067 Merge pull request #578 from metamx/new-guava 
Update guava, java-util, and druid-api
 2014-06-18 14:23:32 -06:00
fjy
b0517dc55d Merge pull request #610 from metamx/ec2-user-data 
More flexible EC2 user data classes.
 2014-06-18 11:36:13 -06:00
Gian Merlino
5c4b9a7d5b Indexing: Allow null userData. 2014-06-18 10:08:50 -07:00
Gian Merlino
65c1553a76 Fix busted TaskConfig. 2014-06-17 17:27:41 -07:00
Gian Merlino
9f16f0a955 More flexible EC2 user data classes. 2014-06-17 17:10:17 -07:00
fjy
5227b43050 fix more test breakage 2014-06-17 10:35:01 -07:00
fjy
8a13e34c50 fix broken ut 2014-06-17 10:31:50 -07:00
Gian Merlino
54833fa43d Indexing: Make default hadoop coordinates configurable. 2014-06-17 08:53:39 -07:00
nishantmonu51
0629be622c remove unnecessary changes & fix index closing subquery 2014-06-16 18:50:49 +05:30
fjy
5bd4ad3f0f address code review 2014-06-13 11:29:49 -07:00
fjy
a63cda3281 Merge branch 'master' into new-guava 
Conflicts:
	server/src/main/java/io/druid/server/QueryResource.java
 2014-06-13 10:08:10 -07:00
nishantmonu51
0ddaf4c307 fix race while index closing and querying 2014-06-13 15:36:57 +05:30
nishantmonu51
025814cfff Merge branch 'master' into offheap-incremental-index 
Conflicts:
	processing/src/main/java/io/druid/query/GroupByParallelQueryRunner.java

processing/src/main/java/io/druid/query/groupby/GroupByQueryRunnerFactor
y.java

processing/src/main/java/io/druid/segment/incremental/IncrementalIndexSt
orageAdapter.java
 2014-06-12 20:02:27 +05:30
nishantmonu51
a7e19ad892 configure buffer sizes 2014-06-12 19:32:37 +05:30
fjy
ad7db018d5 add default tuning config for index task 2014-06-09 16:28:47 -07:00
fjy
5e48f3907b fix index task new schema defaults 2014-06-09 16:24:12 -07:00
nishantmonu51
5bdc4a761a close IncrementalIndex properly and free up buffer 2014-06-05 19:41:43 +05:30
nishantmonu51
6265613bb9 Merge branch 'master' into offheap-incremental-index 2014-06-05 17:42:57 +05:30
nishantmonu51
01e8a713b6 unit tests passing with offheap-indexing 2014-06-05 17:42:53 +05:30
fjy
9f4cc5ca1f fix test 2014-06-04 16:29:20 -07:00
fjy
77ec4df797 update guava, java-util, and druid-api 2014-06-03 13:43:38 -07:00
Gian Merlino
8a6384862f Better task log errors. 2014-06-02 12:55:17 -07:00
Gian Merlino
48511e15cf Autoscaling: Fix case where target < current, but target is too low. 
This can happen when workers are provisioned manually.
 2014-06-02 12:36:48 -07:00
fjy
7ffe60ca60 clean up a bit of the logic in RTR failure with exceptions in announceTask 2014-06-02 10:49:28 -07:00
nishantmonu51
6f176cee85 fail task on exception 
If the task announcement throw exception, set status to fail instead of
retrying it again and again.
 2014-06-02 22:52:50 +05:30
fjy
4c13327297 more logging for determine hashed 2014-05-30 16:19:20 -07:00
Xavier Léauté
1a8eb25852 update realtime tasks to use FilteredServerView 2014-05-29 16:41:26 -07:00
fjy
7be93a770a make all firehoses work with tasks, add a lot more documentation about configuration 2014-05-28 16:33:59 -07:00