4756 Commits

Author SHA1 Message Date
Xavier Léauté
59542c41f8 fix port not set in DruidNode 2014-12-01 14:37:28 -08:00
Charles Allen
8b3652a67a Modify HadoopDruidIndexerConfig to give a port of 0 instead of -1 when binding DruidNode @Self annotation 2014-12-01 14:08:41 -08:00
Charles Allen
7ed5f995cb Modify InitializationTest to use a port of 0 instead of -1 2014-12-01 13:48:49 -08:00
Fangjin Yang
a0d5f23ad1 Merge pull request #919 from metamx/fix-payload-casting
request proper type from DBI instead of casting
2014-12-01 14:35:47 -07:00
Xavier Léauté
36c9211791 remove unused imports 2014-12-01 13:34:58 -08:00
Xavier Léauté
839e288ed5 request proper type from DBI instead of casting 2014-12-01 13:27:52 -08:00
Fangjin Yang
646e184ca6 Merge pull request #918 from metamx/fix-broker-timeouts
fix query timeouts not being raised by broker
2014-12-01 13:58:04 -07:00
Fangjin Yang
07b6e6cbe9 Merge pull request #917 from metamx/explicit-host-port
make host+port more explicit + ipv6 support
2014-12-01 13:57:00 -07:00
Xavier Léauté
445af2dc5f use guava methods instead 2014-12-01 12:53:20 -08:00
Xavier Léauté
eb5525f9b4 add support for ipv6 hostnames 2014-12-01 12:27:42 -08:00
Xavier Léauté
d23fd1e1ab make host+port more explicit
- document the behavior for node host/port initialization
- throw exception if settings make no sense
- fixes announcement for nodes without host/port defaults
- makes code clearer as to when host vs. host+port are used
2014-11-26 22:03:25 -08:00
Xavier Léauté
4dccfda61d fix query timeouts not being raised by broker 2014-11-26 21:42:07 -08:00
xvrl
3699a41a54 Merge pull request #912 from metamx/update-curator-jetty
Update curator + jetty
2014-11-26 17:01:27 -08:00
xvrl
34fb2f10b6 Merge pull request #914 from metamx/fix-cardinality-caching
fix cardinality aggregator caching
2014-11-26 16:56:17 -08:00
Xavier Léauté
4eee7e69b9 fix cardinality aggregator caching 2014-11-26 15:00:37 -08:00
Xavier Léauté
35a3452250 update jetty 2014-11-26 14:41:08 -08:00
Xavier Léauté
523f9c53cd update curator and fix test
curator is more strict now
2014-11-26 14:41:08 -08:00
Xavier Léauté
d4bda82916 remove unused imports 2014-11-26 14:41:08 -08:00
xvrl
366ae9e5e4 Merge pull request #911 from metamx/update-spymemcache
update spymemcached library
2014-11-26 12:23:02 -08:00
nishantmonu51
76891d450e update spymemcached library
update spymemcached library
for fixes mainly related to -
1) memory leaks on reconnects
2) better handling of network issues
2014-11-26 19:33:52 +05:30
xvrl
5bc1be5ba0 Merge pull request #850 from metamx/druid-0.7.x-compressionstrategy
Compression strategy changes
2014-11-25 12:58:39 -08:00
Charles Allen
c6043afa32 Removed empty function from CompressionStrategyTest 2014-11-25 12:57:06 -08:00
Charles Allen
6943db5251 Changed branching logic for LZFCompressor to return null only on error, and avoid checking in most circumstances 2014-11-25 12:53:11 -08:00
Charles Allen
46dfce6905 Merge pull request #908 from metamx/fix-smile-0.7
(port from 0.6.x) fix smile exception on error + content-type
2014-11-25 11:46:38 -08:00
Xavier Léauté
9fb93a3a79 fix smile exception on error + content-type 2014-11-25 11:30:17 -08:00
xvrl
763967c62c Merge pull request #903 from metamx/hllSpeedupRebase2
Multiple speed improvements revolving around topN with HLL (Rebased Version)
2014-11-25 09:55:35 -08:00
Weinan Zhao
bcc5f86723 Modify according to fjy's review, add reformatting according to eaclipse_formatting.xml 2014-11-26 00:14:40 +08:00
Fangjin Yang
42a43800ee Merge pull request #905 from metamx/pom_fix
explicitly pass in parent pom
2014-11-24 20:24:58 -07:00
Gautam Jayaprakash
f4dd9cdc31 explicitly pass in parent pom 2014-11-24 18:52:17 -08:00
Fangjin Yang
3ff569ef2d Merge pull request #879 from metamx/rtr-with-pref
Rewrite autoscaling and enable easier configuration of worker selection and autoscaling behaviour
2014-11-24 17:54:28 -07:00
fjy
3808411340 address some cr 2014-11-24 16:54:47 -08:00
Charles Allen
9f945c2216 Removed lz4Fast from CompressedObjectStrategy for compression since it is not currently used 2014-11-24 16:11:03 -08:00
Charles Allen
70e3108282 Multiple speed improvements revolving around topN with HLL
Change serializer / deserializer for HyperLogLog
* Changed DirectDruidClient's InputStream handling. Is now ~10% faster for data heavy queries, and has lower variance in execution speed.
* Changed HLL Collector's toByteStream() method to be better optimized for small values. Is notably faster for small result quantities which fall into the sparse HLL bucket codepath.
  * No change for dense HLL which just uses a direct bytestream of the underlying byte data.

TopNNumericResultBuilder semi-aggressive loop unrolling for metricVals

Benchmark for HLL for sparse packing (small HLL bucket population):
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[0]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 216, GC.time: 0.42, time.total: 15.96, time.warmup: 0.22, time.bench: 15.74
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[1]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 217, GC.time: 0.45, time.total: 13.87, time.warmup: 0.02, time.bench: 13.85
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[2]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 55, GC.time: 0.16, time.total: 4.13, time.warmup: 0.00, time.bench: 4.12
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[3]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 55, GC.time: 0.16, time.total: 4.30, time.warmup: 0.00, time.bench: 4.30
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[4]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 8, GC.time: 0.03, time.total: 1.10, time.warmup: 0.00, time.bench: 1.09
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[5]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 8, GC.time: 0.03, time.total: 0.72, time.warmup: 0.00, time.bench: 0.72
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[6]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 1, GC.time: 0.00, time.total: 0.60, time.warmup: 0.00, time.bench: 0.60
HyperLogLogSerdeBenchmarkTest.benchmarkToByteBuffer[7]: [measured 100000 out of 100100 rounds, threads: 1 (sequential)]
 round: 0.00 [+- 0.00], round.block: 0.00 [+- 0.00], round.gc: 0.00 [+- 0.00], GC.calls: 2, GC.time: 0.01, time.total: 0.26, time.warmup: 0.00, time.bench: 0.25

Updates to HyperLogLogCollector toByteBuffer() based on code review

Removed changes from DirectDruidClient from this branch and put it in another branch.

Changed HyperLogLogCollector to have protected getters and setters

Remove unused ByteOrder from HyperLogLogCollector

Copyright header on HyperLogLogSerdeBenchmarkTest

Now with less ass!

Reformat in TopNNumericResultsBuilder. No code change

Removed unused import in HyperLogLogCollector

Replace AppendableByteArrayInputStream in DirectDruidClient
* Replace with SequenceInputStream fueled by an enumeration of ChannelBufferInputStream which directly wrap the response context ChannelBuffer

Modify TopNQueryQueryToolChest to use Arrays instead of Lists

Modify TopNQueryQueryToolChest to use Arrays instead of Lists

Revert accidental changes to DirectDruidClient

They should be in another merge request:
https://github.com/metamx/druid/pull/893

Fixes from code review
* Extracting names from AggregatorFactory classes now done with TopNQueryQueryToolChest.extractFactoryName
* Renamed variable in TopNNumericResultBuilder
2014-11-24 16:02:00 -08:00
fjy
083a012aa2 Commonalize the cache config and change default to disable cache 2014-11-24 14:54:11 -08:00
fjy
fe0a56cad6 fix newline 2014-11-24 14:10:07 -08:00
xvrl
829c254bac Merge pull request #898 from metamx/refactor-examples
Refactor structure for examples and extensions
2014-11-24 14:02:34 -08:00
fjy
28c609b187 fix some brokenness 2014-11-24 13:31:56 -08:00
fjy
f42b1a4181 fix broken ut 2014-11-24 11:42:24 -08:00
Fangjin Yang
8c5b6e6ef8 Merge pull request #900 from metamx/build-fixes
Build fixes
2014-11-24 12:24:12 -07:00
Xavier Léauté
ebbceb219f simpler build script 2014-11-24 11:16:27 -08:00
Xavier Léauté
a6f9a57f7c fix selfcontained druid-services dependency issues 2014-11-24 11:03:44 -08:00
xvrl
37e5678870 Merge pull request #899 from metamx/fix-log
fix crazy amounts of logging when coordinator loses leadership
2014-11-24 11:01:44 -08:00
fjy
13cae41f6c Merge branch 'master' into refactor-examples 2014-11-24 11:00:26 -08:00
fjy
9b701bbc76 a few more code review fixes 2014-11-24 10:54:29 -08:00
fjy
1aaea9a0d7 address code review 2014-11-24 10:52:30 -08:00
xvrl
9ced097abd Merge pull request #895 from metamx/fix-interval-retry
A set of fixes to retry the query for missing segments in the timeline
2014-11-24 10:23:02 -08:00
fjy
c88aff6205 remove unneeded constant 2014-11-24 10:20:02 -08:00
fjy
f518c53008 address cr 2014-11-24 10:12:29 -08:00
fjy
10d45ab9cf address code review 2014-11-21 16:48:45 -08:00
fjy
f9db3a1fc6 fix crazy amounts of logging when coordinator loses leadership 2014-11-21 15:46:14 -08:00