Commit Graph

3740 Commits

Author SHA1 Message Date
fjy 2be4c04b1a Merge pull request #629 from metacret/ISSUE-628
AWSCredentialsProvider for s3-extentions
2014-07-18 12:01:19 -06:00
Jae Hyeon Bae 9cec7107a9 Properties.load instead of manual population 2014-07-18 09:50:15 -07:00
nishantmonu51 4ce12470a1 Add way to skip determine partitions for index task
Add a way to skip determinePartitions for IndexTask by manually
specifying numShards.
2014-07-18 18:52:15 +05:30
fjy 6430776607 Merge pull request #641 from metamx/cleanup-ingest
some minor cleanups to ingest firehose
2014-07-17 21:28:12 -06:00
fjy d8b8826c2e Merge branch 'cleanup-ingest' of github.com:metamx/druid into cleanup-ingest
Conflicts:
	server/src/test/java/io/druid/realtime/firehose/CombiningFirehoseFactoryTest.java
2014-07-17 20:26:11 -07:00
fjy 291f4c00ae Merge branch 'master' of github.com:metamx/druid into cleanup-ingest 2014-07-17 20:24:59 -07:00
nishantmonu51 0e0454a34c switch reingest task to noop & fix compilation
switch back to noop task, its confusing to have a reinvest task that
does nothing.
fix compilation
2014-07-18 06:50:58 +05:30
fjy ded83557dd Merge pull request #640 from metamx/disable-worker
An alternative way to disable middlemanagers based on worker version
2014-07-17 19:07:27 -06:00
fjy beac0be45b fix enabled endpoint 2014-07-17 18:04:36 -07:00
Xavier Léauté 95a09c04bf log errors in asyncForwardingServlet 2014-07-17 16:22:30 -07:00
fjy 83cb7931ac add more stuff to docs 2014-07-17 14:59:56 -07:00
fjy d765ff5e75 docs for updating 2014-07-17 14:53:26 -07:00
fjy 465ac77b82 fix broken UT 2014-07-17 14:39:52 -07:00
fjy 76f096e667 Merge branch 'master' of github.com:metamx/druid into cleanup-ingest 2014-07-17 14:38:54 -07:00
fjy 8ef380b3f9 Merge pull request #638 from metamx/rejigger-cache
Rejiggering the cache
2014-07-17 15:19:23 -06:00
fjy bb5598df54 fix doc 2014-07-17 14:07:12 -07:00
fjy ef325f15ff update pom and fix broken UT 2014-07-17 13:47:59 -07:00
fjy c6078ca841 address code review 2014-07-17 13:34:05 -07:00
fjy ba978d8b79 some minor cleanups to ingest firehose 2014-07-17 13:05:59 -07:00
fjy bc650a1c80 Merge pull request #627 from metamx/druid-firehose
Functionality to ingest a Druid segment and change the schema
2014-07-17 13:41:16 -06:00
fjy 5197ea527a disable middlemanagers based on worker version 2014-07-17 12:35:45 -07:00
nishantmonu51 e59c9ebdbc minor fixes
fix IndexOutOfBoundsException
fix ingestFirehose
2014-07-17 17:24:57 +05:30
fjy 831d4e9515 update README 2014-07-16 15:38:30 -07:00
fjy bf71d079f3 fix #636 2014-07-16 15:20:20 -07:00
fjy b70a6b1061 address code review comments 2014-07-16 13:52:06 -07:00
fjy de8cb55260 Merge branch 'master' into rejigger-cache
Conflicts:
	pom.xml
2014-07-16 13:37:20 -07:00
fjy 0f3c474dee Merge branch 'master' of github.com:metamx/druid 2014-07-15 22:50:46 -07:00
fjy 534acc9eab fix mm 2014-07-15 22:50:38 -07:00
nishantmonu51 b74845e942 fix test
committed it by mistake.
2014-07-16 09:39:51 +05:30
fjy 935b642b2c fix overlord binding problems 2014-07-15 16:13:11 -07:00
fjy 27c4750780 fix infinite loop in test 2014-07-15 16:00:56 -07:00
fjy bdfeccd092 doc and timeout fix 2014-07-15 15:57:58 -07:00
fjy 6961abaa61 Merge pull request #634 from metamx/shardspec-optimization
Add ShardSpec Lookup
2014-07-15 15:10:24 -06:00
fjy 2f90bfcf9a rejiggering the cache for groupBy and select 2014-07-15 12:12:33 -07:00
Xavier Léauté 12bc3ac27b fix broken S3 moving test 2014-07-15 10:58:53 -07:00
fjy f2e0dc9327 Merge pull request #637 from metamx/fix-s3-storageclass-check
fix storage class npe
2014-07-14 20:23:56 -06:00
Xavier Léauté f56d60b451 fix storage class npe 2014-07-14 16:24:01 -07:00
nishantmonu51 972c5dac31 improve memory usage and rename firehose 2014-07-14 21:17:53 +05:30
nishantmonu51 a31376ee83 point to correct version 2014-07-10 12:23:20 +05:30
nishantmonu51 a12688bc8b fix partitionNum calculation & remove extra sorting 2014-07-10 12:21:27 +05:30
nishantmonu51 fa43049240 review comments & pom changes 2014-07-10 11:48:46 +05:30
Jae Hyeon Bae 193c7259f6 refresh thread should be daemon 2014-07-09 15:52:17 -07:00
Gian Merlino 7a7386be74 Merge pull request #633 from metamx/remove-config
Remove redundant forking task runner config
2014-07-08 11:30:40 -07:00
nishantmonu51 7168adcca7 Use Ingest task instead of Noop Task 2014-07-08 21:20:17 +05:30
nishantmonu51 a1a5e4254f CombiningFirehoseFactory
can be used to ingest data from multiple sources.
2014-07-08 21:14:48 +05:30
nishantmonu51 36fc85736c Add ShardSpec Lookup
Optimize choosing shardSpec for Hash Partitions
2014-07-08 18:01:31 +05:30
Jae Hyeon Bae 3a849b0341 update refresh manually every hour 2014-07-07 23:11:08 -07:00
fjy ce478be899 Remove redundant forking task runner config 2014-07-07 18:08:37 -06:00
fjy b8347cf4af Merge pull request #618 from realfun/master
Add HdfsTaskLogs
2014-07-04 14:17:51 -06:00
nishantmonu51 97b58eb193 review comments
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
2014-07-04 12:31:33 +05:30