Xavier Léauté
629f6bc759
moved methods to java-util
2014-12-05 15:53:23 -08:00
Xavier Léauté
ad23e49777
use fixed-size mapdb cache to avoid heap growing uncontrollably
2014-12-05 15:34:50 -08:00
nishantmonu51
40f223215a
fix buffer pool usage
2014-12-05 16:09:26 +05:30
Weinan Zhao
3119770ce9
Reformatting using intellij_formatting.jar
2014-12-05 14:21:24 +08:00
nishantmonu51
6e03a6245f
Merge branch 'master' into onheap-incremental-index
2014-12-05 10:40:28 +05:30
Xavier Léauté
d4a1752c5d
add code to release ByteBuffers
2014-12-04 16:18:55 -08:00
Xavier Léauté
7cd45a6e1f
IncrementalIndex throws exception if limit exceeded
...
- For now uses a hardcoded ratio of aggregator to timeanddim buffer sizes
- canAppendRow is a workaround for realtime index since the
Firehose currently does not have a way of rolling back the last event in
case of error
- canAppendRow needs a fudge factor; there is a race between checking
if we can add a row and actually adding a row, because of the way MapDB
reports its size.
2014-12-04 14:38:16 -08:00
Charles Allen
18234a2f00
Fix confusing error message in HadoopIndexTask
2014-12-04 10:57:57 -08:00
Gian Merlino
20a7239ffd
Replace google-http-client imports with real guava imports.
2014-12-04 10:57:57 -08:00
Gian Merlino
b48fc51ed1
SSL-capable ServiceEmitter.
2014-12-04 10:57:56 -08:00
Xavier Léauté
1905302c16
use property for jackson version
2014-12-04 10:57:56 -08:00
Xavier Léauté
c7dbe6116c
write byte data as is in smile
2014-12-04 10:57:56 -08:00
Xavier Léauté
c21a82a697
upgrade LZ4 to operate directly on ByteBuffers
2014-12-04 10:57:56 -08:00
Xavier Léauté
1566999a6a
update jackson to 2.4.4
2014-12-04 10:57:56 -08:00
Xavier Léauté
0c521e0a77
update joda-time and fix min/max instant
2014-12-04 10:57:56 -08:00
Charles Allen
c2add5730b
Fix Hadoop CLI jobs
...
* Change "schema" --> "spec" for cli hadoop to keep up with internal hadoop
* Added check for HadoopDruidIndexerConfig deserialization from Map to see if it is trying to get a HadoopDruidIndexerConfig or a HadoopIngestionSpec
2014-12-04 10:57:56 -08:00
fjy
187126dd4b
fix broken unit tests
2014-12-04 10:49:36 -08:00
Fangjin Yang
332e4a4d1c
Merge pull request #902 from metamx/cache-config
...
Commonalize the cache config and change default to disable cache
2014-12-04 11:30:24 -07:00
Fangjin Yang
27d4b2bdea
Merge pull request #934 from metamx/fix-hadoop-metadata-injection
...
metadata update handler injection not needed for indexing service
2014-12-04 10:45:20 -07:00
nishantmonu51
269a51964e
fix size calculation
2014-12-04 17:22:24 +05:30
Fangjin Yang
6533de3563
Merge pull request #933 from metamx/removeDeprecatedFiles
...
Update ForkingTaskRunner to remove @Deprecated Files method usage
2014-12-03 17:27:30 -07:00
xvrl
c867d59ee0
fix error message
2014-12-03 15:30:32 -08:00
Xavier Léauté
2e6c254937
metadata injection not needed for indexing service
2014-12-03 15:09:31 -08:00
Charles Allen
325a5c4abc
Update ForkingTaskRunner to remove @Deprecated Files method usage
2014-12-03 13:18:33 -08:00
xvrl
2681da4420
Merge pull request #929 from metamx/google-cleanup
...
Replace google-http-client imports with real guava imports.
2014-12-03 11:50:19 -08:00
Fangjin Yang
22cc30ff62
Merge pull request #930 from metamx/errorMsgFixHadoopIndexTask
...
Fix confusing error message in HadoopIndexTask
2014-12-03 12:29:14 -07:00
Fangjin Yang
6e9e8862fe
Merge pull request #928 from metamx/ssl-emitter
...
SSL-capable ServiceEmitter.
2014-12-03 12:29:02 -07:00
Charles Allen
b6f71d3fd6
Fix confusing error message in HadoopIndexTask
2014-12-03 11:11:53 -08:00
Gian Merlino
d388a8fe89
Replace google-http-client imports with real guava imports.
2014-12-03 10:52:57 -08:00
Gian Merlino
03ae70ae54
SSL-capable ServiceEmitter.
2014-12-03 10:43:24 -08:00
Charles Allen
4ca8ea19fd
Merge pull request #925 from metamx/update-jackson
...
update jackson to 2.4.4
2014-12-03 10:27:50 -08:00
nishantmonu51
4dc0fdba8a
consider mapped size in limit calculation & review comments
2014-12-03 23:47:30 +05:30
Charles Allen
529e7e0272
Merge pull request #927 from metamx/speedup-smile-bytes
...
Improve Smile serde performance by writing binary data as is
2014-12-03 10:02:08 -08:00
Xavier Léauté
61f9289447
use property for jackson version
2014-12-03 09:44:19 -08:00
Charles Allen
0f5d5840da
Merge pull request #924 from metamx/update-joda-time
...
Update Joda-Time and fix min/max instant overflow
2014-12-03 09:15:39 -08:00
Charles Allen
856d2ffac4
Merge pull request #926 from metamx/lz4-bytebuffer-support
...
upgrade LZ4 to operate directly on ByteBuffers
2014-12-03 09:05:43 -08:00
nishantmonu51
da8bd7836b
Introduce buffer size
2014-12-03 16:28:22 +05:30
Xavier Léauté
5fece517fa
write byte data as is in smile
2014-12-03 00:01:01 -08:00
Xavier Léauté
18f50097a9
upgrade LZ4 to operate directly on ByteBuffers
2014-12-02 23:53:56 -08:00
Xavier Léauté
b59bfaa210
update jackson to 2.4.4
2014-12-02 17:51:55 -08:00
fjy
bc173d14fc
a whole bunch of cleanup and fixes
2014-12-02 17:32:05 -08:00
Xavier Léauté
a79389a9e5
update joda-time and fix min/max instant
2014-12-02 17:27:22 -08:00
Fangjin Yang
c3bcf34c64
Merge pull request #923 from metamx/fixHadoopCli
...
Fix Hadoop CLI jobs
2014-12-02 12:26:29 -07:00
Charles Allen
7cd689be75
Fix Hadoop CLI jobs
...
* Change "schema" --> "spec" for cli hadoop to keep up with internal hadoop
* Added check for HadoopDruidIndexerConfig deserialization from Map to see if it is trying to get a HadoopDruidIndexerConfig or a HadoopIngestionSpec
2014-12-02 11:23:04 -08:00
nishantmonu51
b65933ffb8
make tests parameterised
2014-12-02 23:55:29 +05:30
nishantmonu51
6dc69c2f30
code cleanups & formatting
2014-12-02 22:44:33 +05:30
nishantmonu51
eac776f1a7
tests passing with on heap incremental index
2014-12-02 22:29:28 +05:30
Glenn Nethercutt
79571f78d5
Merge remote-tracking branch 'upstream/master'
2014-12-01 21:24:23 -05:00
Xavier Léauté
59542c41f8
fix port not set in DruidNode
2014-12-01 14:37:28 -08:00
Charles Allen
8b3652a67a
Modify HadoopDruidIndexerConfig to give a port of 0 instead of -1 when binding DruidNode @Self annotation
2014-12-01 14:08:41 -08:00