Commit Graph

3861 Commits

Author SHA1 Message Date
fjy b8347cf4af Merge pull request #618 from realfun/master
Add HdfsTaskLogs
2014-07-04 14:17:51 -06:00
nishantmonu51 97b58eb193 review comments
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
2014-07-04 12:31:33 +05:30
Jae Hyeon Bae 4ab9af36b0 License header and utf-8 2014-07-03 16:52:47 -07:00
fjy 12afaae2df Merge branch 'master' of github.com:metamx/druid 2014-07-02 23:41:47 -06:00
fjy c1cd9ff2ce fix broken rename of rejection policies 2014-07-02 23:41:37 -06:00
fjy 19494eeb8c Merge pull request #630 from metamx/port-finder
improve port finding strategy for task runner
2014-07-02 23:41:19 -06:00
nishantmonu51 518ab473f3 improve port finding strategy for task runner
1) Recycle free ports
2) Choose only ports that are free & not used by any other application
2014-07-03 09:58:12 +05:30
Jae Hyeon Bae 5e5fa1f357 A few fixes
- EasyMock instead of Mockito
- FileSessionCredentialsProvider fields should be volatile
- getRestS3Service should create AWSCredentials not a AWSSessionCredentials with fixed credentials
2014-07-02 15:53:39 -07:00
Jae Hyeon Bae 31f7bd8bcb AWSCredentialsProvider for s3-extentions
- fileSessionCredentials property is added
- AWSSessionCredentialsAdapter is adapter class between aws sdk AWSCredentialsProvider to jets3t Credentials
- FileSessionCredentialsProvider will refresh its session credentials from the file
- S3StorageDruidModule should return different AWSCredentialsProvider on the config settings
2014-07-02 14:44:02 -07:00
fjy c646648319 fix examples start port 2014-07-02 10:07:04 -07:00
nishantmonu51 1de390801f Druid Fireshose
Add druidFirehose, can be used to reIndex filtered data from a
datasource
2014-07-02 20:34:18 +05:30
fjy d37527ca79 make histos work with groupby maybe 2014-07-01 16:46:58 -07:00
fjy dba7e972d8 refactor docs for histograms 2014-07-01 16:39:24 -07:00
fjy a16bdf9759 Merge pull request #625 from metamx/approx-histo
Approximate Histograms and Quantiles
2014-07-01 17:16:07 -06:00
Xavier Léauté d0b8494735 fix approximate histogram serde to not change buffer limit 2014-07-01 16:13:00 -07:00
Xavier Léauté 70ae6e1fcd Approximate Histogram Module 2014-07-01 15:10:23 -07:00
fjy 484b91db5a Merge pull request #617 from metamx/igalDruid
Igal druid
2014-06-30 19:58:38 -06:00
fjy 1c1f65ab5f Merge pull request #604 from metamx/more-tests
All manners of "new" tests
2014-06-30 19:41:59 -06:00
fjy 92bc340099 Merge branch 'master' into more-tests 2014-06-30 18:40:00 -07:00
fjy afa73a2d3a fix one of the TODOs and add test case 2014-06-30 17:29:19 -07:00
fjy 94ac9645ed Merge pull request #624 from metamx/better-jobProperties-example
Better example of jobProperties.
2014-06-25 21:32:53 -06:00
Gian Merlino 991ff34f38 More explicit example of jobProperties. 2014-06-25 20:24:51 -07:00
fjy ff00b545bc Merge pull request #623 from metamx/document-hadoop-jobProperties
Document how to set hadoop properties
2014-06-25 21:15:21 -06:00
Gian Merlino a7ef019b22 Document batch ingestion jobProperties. 2014-06-25 20:14:11 -07:00
xvrl e3ee06b80f Merge pull request #620 from metamx/more-tostring
add toString method for JavascriptDimExtractionFn
2014-06-25 11:01:07 -06:00
Xavier Léauté 1499ee6458 add toString method for JavascriptDimExtractionFn 2014-06-25 10:47:57 -06:00
realfun 261d6a16b2 Add HdfsTaskLogs 2014-06-20 23:55:05 -07:00
Igal Levy 805e80c24d Merge branch 'master' into igalDruid 2014-06-20 17:16:41 -07:00
Igal Levy 262d43ae2e removed build section that didn't work (direct from whirr repo); added info on resource files needed to run test; tweaked whirr config section to match current requirements; changed cluster-start section to reflect fact that we're starting multiple instances; other minor edits 2014-06-20 17:03:21 -07:00
jisookim0513 cc8a4d0847 revert changes to RetryQueryRunnerConfig 2014-06-20 13:49:33 -07:00
jisookim0513 5e7dfaf298 change retry tests 2014-06-20 13:45:04 -07:00
jisookim0513 3418291333 add a test for retrying multiple times 2014-06-20 13:15:46 -07:00
fjy 255504727a Merge pull request #615 from metamx/push-bootstrapped-sinks
push sinks after bootstrap. fix #570
2014-06-20 11:45:19 -06:00
fjy b978eb33f1 minor fix for cleanup of historical cache file 2014-06-20 10:42:03 -07:00
nishantmonu51 a4003966b2 push sinks after bootstrap. fix #570 2014-06-20 21:45:30 +05:30
xvrl 12ee17c4d2 Merge pull request #614 from metamx/delay-drop
add an optional delay for how long it takes to drop a segment, fixes all...
2014-06-19 22:38:26 -07:00
jisookim0513 1cb3fc250e change missigSegments to a static variable 2014-06-19 18:29:00 -07:00
jisookim0513 0244172ccb change missigSegments to a static variable 2014-06-19 18:22:36 -07:00
jisookim0513 4e2b5b743f add more unit tests 2014-06-19 18:18:58 -07:00
jisookim0513 bdb35e2d7e fix retry logic and change the default value of retry to 0 2014-06-19 17:50:50 -07:00
fjy 10e925aa67 Merge pull request #564 from metamx/cacheable-objectstrategy
Cacheable ObjectStrategy
2014-06-19 18:33:25 -06:00
fjy 5afcb9cbd3 add docs 2014-06-19 16:55:02 -07:00
fjy fc36bfbc6d remove pointless exception 2014-06-19 16:49:50 -07:00
fjy 2aab2a0cd9 address cr 2014-06-19 16:48:43 -07:00
fjy b313601a3b add an optional delay for how long it takes to drop a segment, fixes all manners of inconsistent issues 2014-06-19 16:32:38 -07:00
Xavier Léauté 0602a45200 add column config test (disabled by default) 2014-06-19 14:48:51 -07:00
fjy 4c40e71e54 address cr 2014-06-19 14:48:46 -07:00
fjy a870fe5cbe inject column config 2014-06-19 14:47:57 -07:00
jisookim0513 ff980091c5 delete an unused flag in IncrementalIndexSegment 2014-06-19 14:43:58 -07:00
Xavier Léauté c2e2391e3a fix thread local initial value 2014-06-19 14:43:03 -07:00