fjy
b8347cf4af
Merge pull request #618 from realfun/master
...
Add HdfsTaskLogs
2014-07-04 14:17:51 -06:00
nishantmonu51
97b58eb193
review comments
...
1) Rename firehose to IngestSegment
2) fix segment overlapping, intervals
3) fix overshadow
2014-07-04 12:31:33 +05:30
Jae Hyeon Bae
4ab9af36b0
License header and utf-8
2014-07-03 16:52:47 -07:00
fjy
12afaae2df
Merge branch 'master' of github.com:metamx/druid
2014-07-02 23:41:47 -06:00
fjy
c1cd9ff2ce
fix broken rename of rejection policies
2014-07-02 23:41:37 -06:00
fjy
19494eeb8c
Merge pull request #630 from metamx/port-finder
...
improve port finding strategy for task runner
2014-07-02 23:41:19 -06:00
nishantmonu51
518ab473f3
improve port finding strategy for task runner
...
1) Recycle free ports
2) Choose only ports that are free & not used by any other application
2014-07-03 09:58:12 +05:30
Jae Hyeon Bae
5e5fa1f357
A few fixes
...
- EasyMock instead of Mockito
- FileSessionCredentialsProvider fields should be volatile
- getRestS3Service should create AWSCredentials not a AWSSessionCredentials with fixed credentials
2014-07-02 15:53:39 -07:00
Jae Hyeon Bae
31f7bd8bcb
AWSCredentialsProvider for s3-extentions
...
- fileSessionCredentials property is added
- AWSSessionCredentialsAdapter is adapter class between aws sdk AWSCredentialsProvider to jets3t Credentials
- FileSessionCredentialsProvider will refresh its session credentials from the file
- S3StorageDruidModule should return different AWSCredentialsProvider on the config settings
2014-07-02 14:44:02 -07:00
fjy
c646648319
fix examples start port
2014-07-02 10:07:04 -07:00
nishantmonu51
1de390801f
Druid Fireshose
...
Add druidFirehose, can be used to reIndex filtered data from a
datasource
2014-07-02 20:34:18 +05:30
fjy
d37527ca79
make histos work with groupby maybe
2014-07-01 16:46:58 -07:00
fjy
dba7e972d8
refactor docs for histograms
2014-07-01 16:39:24 -07:00
fjy
a16bdf9759
Merge pull request #625 from metamx/approx-histo
...
Approximate Histograms and Quantiles
2014-07-01 17:16:07 -06:00
Xavier Léauté
d0b8494735
fix approximate histogram serde to not change buffer limit
2014-07-01 16:13:00 -07:00
Xavier Léauté
70ae6e1fcd
Approximate Histogram Module
2014-07-01 15:10:23 -07:00
fjy
484b91db5a
Merge pull request #617 from metamx/igalDruid
...
Igal druid
2014-06-30 19:58:38 -06:00
fjy
1c1f65ab5f
Merge pull request #604 from metamx/more-tests
...
All manners of "new" tests
2014-06-30 19:41:59 -06:00
fjy
92bc340099
Merge branch 'master' into more-tests
2014-06-30 18:40:00 -07:00
fjy
afa73a2d3a
fix one of the TODOs and add test case
2014-06-30 17:29:19 -07:00
fjy
94ac9645ed
Merge pull request #624 from metamx/better-jobProperties-example
...
Better example of jobProperties.
2014-06-25 21:32:53 -06:00
Gian Merlino
991ff34f38
More explicit example of jobProperties.
2014-06-25 20:24:51 -07:00
fjy
ff00b545bc
Merge pull request #623 from metamx/document-hadoop-jobProperties
...
Document how to set hadoop properties
2014-06-25 21:15:21 -06:00
Gian Merlino
a7ef019b22
Document batch ingestion jobProperties.
2014-06-25 20:14:11 -07:00
xvrl
e3ee06b80f
Merge pull request #620 from metamx/more-tostring
...
add toString method for JavascriptDimExtractionFn
2014-06-25 11:01:07 -06:00
Xavier Léauté
1499ee6458
add toString method for JavascriptDimExtractionFn
2014-06-25 10:47:57 -06:00
realfun
261d6a16b2
Add HdfsTaskLogs
2014-06-20 23:55:05 -07:00
Igal Levy
805e80c24d
Merge branch 'master' into igalDruid
2014-06-20 17:16:41 -07:00
Igal Levy
262d43ae2e
removed build section that didn't work (direct from whirr repo); added info on resource files needed to run test; tweaked whirr config section to match current requirements; changed cluster-start section to reflect fact that we're starting multiple instances; other minor edits
2014-06-20 17:03:21 -07:00
fjy
255504727a
Merge pull request #615 from metamx/push-bootstrapped-sinks
...
push sinks after bootstrap. fix #570
2014-06-20 11:45:19 -06:00
fjy
b978eb33f1
minor fix for cleanup of historical cache file
2014-06-20 10:42:03 -07:00
nishantmonu51
a4003966b2
push sinks after bootstrap. fix #570
2014-06-20 21:45:30 +05:30
xvrl
12ee17c4d2
Merge pull request #614 from metamx/delay-drop
...
add an optional delay for how long it takes to drop a segment, fixes all...
2014-06-19 22:38:26 -07:00
fjy
10e925aa67
Merge pull request #564 from metamx/cacheable-objectstrategy
...
Cacheable ObjectStrategy
2014-06-19 18:33:25 -06:00
fjy
5afcb9cbd3
add docs
2014-06-19 16:55:02 -07:00
fjy
fc36bfbc6d
remove pointless exception
2014-06-19 16:49:50 -07:00
fjy
2aab2a0cd9
address cr
2014-06-19 16:48:43 -07:00
fjy
b313601a3b
add an optional delay for how long it takes to drop a segment, fixes all manners of inconsistent issues
2014-06-19 16:32:38 -07:00
Xavier Léauté
0602a45200
add column config test (disabled by default)
2014-06-19 14:48:51 -07:00
fjy
4c40e71e54
address cr
2014-06-19 14:48:46 -07:00
fjy
a870fe5cbe
inject column config
2014-06-19 14:47:57 -07:00
Xavier Léauté
c2e2391e3a
fix thread local initial value
2014-06-19 14:43:03 -07:00
Xavier Léauté
09346b0a3c
make column cache configurable
2014-06-19 14:43:03 -07:00
Xavier Léauté
8840af5977
make GenericIndexed release cache resources on close
2014-06-19 14:42:08 -07:00
Xavier Léauté
be25d67894
add comments
2014-06-19 14:12:40 -07:00
Xavier Léauté
618afd9976
optimize single value lookup
2014-06-19 14:12:39 -07:00
Xavier Léauté
7a351dfde3
optimize lookups by caching bytebuffer copy
2014-06-19 14:12:39 -07:00
Xavier Léauté
be92c322e3
make ObjectStrategy cacheable
2014-06-19 14:12:39 -07:00
fjy
276e48e564
another doc fix
2014-06-19 13:33:16 -07:00
fjy
fdb39d57a3
fix another doc problem
2014-06-19 13:10:08 -07:00