Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,803 Commits 113 Branches 505 Tags 731 MiB
Commit Graph

3803 Commits

Author SHA1 Message Date
nishantmonu51 972c5dac31 improve memory usage and rename firehose 2014-07-14 21:17:53 +05:30
nishantmonu51 a31376ee83 point to correct version 2014-07-10 12:23:20 +05:30
nishantmonu51 a12688bc8b fix partitionNum calculation & remove extra sorting 2014-07-10 12:21:27 +05:30
nishantmonu51 fa43049240 review comments & pom changes 2014-07-10 11:48:46 +05:30
Jae Hyeon Bae 193c7259f6 refresh thread should be daemon 2014-07-09 15:52:17 -07:00
Gian Merlino 7a7386be74 Merge pull request #633 from metamx/remove-config 
Remove redundant forking task runner config
 2014-07-08 11:30:40 -07:00
nishantmonu51 7168adcca7 Use Ingest task instead of Noop Task 2014-07-08 21:20:17 +05:30
nishantmonu51 a1a5e4254f CombiningFirehoseFactory 
can be used to ingest data from multiple sources.
 2014-07-08 21:14:48 +05:30
nishantmonu51 36fc85736c Add ShardSpec Lookup 
Optimize choosing shardSpec for Hash Partitions
 2014-07-08 18:01:31 +05:30
Jae Hyeon Bae 3a849b0341 update refresh manually every hour 2014-07-07 23:11:08 -07:00
fjy ce478be899 Remove redundant forking task runner config 2014-07-07 18:08:37 -06:00
fjy b8347cf4af Merge pull request #618 from realfun/master 
Add HdfsTaskLogs
 2014-07-04 14:17:51 -06:00
nishantmonu51 97b58eb193 review comments 
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
 2014-07-04 12:31:33 +05:30
Jae Hyeon Bae 4ab9af36b0 License header and utf-8 2014-07-03 16:52:47 -07:00
fjy 12afaae2df Merge branch 'master' of github.com:metamx/druid 2014-07-02 23:41:47 -06:00
fjy c1cd9ff2ce fix broken rename of rejection policies 2014-07-02 23:41:37 -06:00
fjy 19494eeb8c Merge pull request #630 from metamx/port-finder 
improve port finding strategy for task runner
 2014-07-02 23:41:19 -06:00
nishantmonu51 518ab473f3 improve port finding strategy for task runner 
1) Recycle free ports
2) Choose only ports that are free & not used by any other application
 2014-07-03 09:58:12 +05:30
Jae Hyeon Bae 5e5fa1f357 A few fixes 
- EasyMock instead of Mockito
- FileSessionCredentialsProvider fields should be volatile
- getRestS3Service should create AWSCredentials not a AWSSessionCredentials with fixed credentials
 2014-07-02 15:53:39 -07:00
Jae Hyeon Bae 31f7bd8bcb AWSCredentialsProvider for s3-extentions 
- fileSessionCredentials property is added
- AWSSessionCredentialsAdapter is adapter class between aws sdk AWSCredentialsProvider to jets3t Credentials
- FileSessionCredentialsProvider will refresh its session credentials from the file
- S3StorageDruidModule should return different AWSCredentialsProvider on the config settings
 2014-07-02 14:44:02 -07:00
fjy c646648319 fix examples start port 2014-07-02 10:07:04 -07:00
nishantmonu51 1de390801f Druid Fireshose 
Add druidFirehose, can be used to reIndex filtered data from a
datasource
 2014-07-02 20:34:18 +05:30
fjy d37527ca79 make histos work with groupby maybe 2014-07-01 16:46:58 -07:00
fjy dba7e972d8 refactor docs for histograms 2014-07-01 16:39:24 -07:00
fjy a16bdf9759 Merge pull request #625 from metamx/approx-histo 
Approximate Histograms and Quantiles
 2014-07-01 17:16:07 -06:00
Xavier Léauté d0b8494735 fix approximate histogram serde to not change buffer limit 2014-07-01 16:13:00 -07:00
Xavier Léauté 70ae6e1fcd Approximate Histogram Module 2014-07-01 15:10:23 -07:00
fjy 484b91db5a Merge pull request #617 from metamx/igalDruid 
Igal druid
 2014-06-30 19:58:38 -06:00
fjy 1c1f65ab5f Merge pull request #604 from metamx/more-tests 
All manners of "new" tests
 2014-06-30 19:41:59 -06:00
fjy 92bc340099 Merge branch 'master' into more-tests 2014-06-30 18:40:00 -07:00
fjy afa73a2d3a fix one of the TODOs and add test case 2014-06-30 17:29:19 -07:00
fjy 94ac9645ed Merge pull request #624 from metamx/better-jobProperties-example 
Better example of jobProperties.
 2014-06-25 21:32:53 -06:00
Gian Merlino 991ff34f38 More explicit example of jobProperties. 2014-06-25 20:24:51 -07:00
fjy ff00b545bc Merge pull request #623 from metamx/document-hadoop-jobProperties 
Document how to set hadoop properties
 2014-06-25 21:15:21 -06:00
Gian Merlino a7ef019b22 Document batch ingestion jobProperties. 2014-06-25 20:14:11 -07:00
xvrl e3ee06b80f Merge pull request #620 from metamx/more-tostring 
add toString method for JavascriptDimExtractionFn
 2014-06-25 11:01:07 -06:00
Xavier Léauté 1499ee6458 add toString method for JavascriptDimExtractionFn 2014-06-25 10:47:57 -06:00
realfun 261d6a16b2 Add HdfsTaskLogs 2014-06-20 23:55:05 -07:00
Igal Levy 805e80c24d Merge branch 'master' into igalDruid 2014-06-20 17:16:41 -07:00
Igal Levy 262d43ae2e removed build section that didn't work (direct from whirr repo); added info on resource files needed to run test; tweaked whirr config section to match current requirements; changed cluster-start section to reflect fact that we're starting multiple instances; other minor edits 2014-06-20 17:03:21 -07:00
fjy 255504727a Merge pull request #615 from metamx/push-bootstrapped-sinks 
push sinks after bootstrap. fix #570
 2014-06-20 11:45:19 -06:00
fjy b978eb33f1 minor fix for cleanup of historical cache file 2014-06-20 10:42:03 -07:00
nishantmonu51 a4003966b2 push sinks after bootstrap. fix #570 2014-06-20 21:45:30 +05:30
xvrl 12ee17c4d2 Merge pull request #614 from metamx/delay-drop 
add an optional delay for how long it takes to drop a segment, fixes all...
 2014-06-19 22:38:26 -07:00
fjy 10e925aa67 Merge pull request #564 from metamx/cacheable-objectstrategy 
Cacheable ObjectStrategy
 2014-06-19 18:33:25 -06:00
fjy 5afcb9cbd3 add docs 2014-06-19 16:55:02 -07:00
fjy fc36bfbc6d remove pointless exception 2014-06-19 16:49:50 -07:00
fjy 2aab2a0cd9 address cr 2014-06-19 16:48:43 -07:00
fjy b313601a3b add an optional delay for how long it takes to drop a segment, fixes all manners of inconsistent issues 2014-06-19 16:32:38 -07:00
Xavier Léauté 0602a45200 add column config test (disabled by default) 2014-06-19 14:48:51 -07:00