1290 Commits

Author SHA1 Message Date
Xavier Léauté
8b294d4d98 update mapdb to 1.0.8 2015-08-25 16:07:00 -07:00
Xavier Léauté
edaaf528ab update jets3t to 0.9.4 2015-08-25 16:07:00 -07:00
Xavier Léauté
9a0c15c52c update airline to 0.7 2015-08-25 16:07:00 -07:00
Xavier Léauté
d601038271 update druid-api to 0.3.11 2015-08-25 16:07:00 -07:00
Fangjin Yang
e21954a70f Merge pull request #1619 from metamx/update-server-metrics
update server metrics
2015-08-25 13:58:28 -07:00
Xavier Léauté
2093187c91 rework tarball distribution:
- move assembly out of druid-services into a 'distribution' module
- create separate 'extensions-distribution' module and assembly to
  package extensions and their dependencies into a local maven
  repository
- include this extensions maven repository in the binaries tarball
2015-08-18 18:32:33 -07:00
Xavier Léauté
3b2e41e42a update for next release 2015-08-18 17:16:46 -07:00
Charles Allen
db19d2d547 Revert "Update to guice 4.0" 2015-08-14 09:26:07 -07:00
Nishant
a6a9886339 update server metrics
changes include -
1) https://github.com/metamx/server-metrics/pull/8 - Add custom
dimensions for Jvm and Sys monitors
2) https://github.com/metamx/server-metrics/pull/9 - Add net, tcp,
uptime and cpu metrics
2015-08-12 22:52:17 +05:30
Charles Allen
c8c8169c69 Bump druid-api to 0.3.10 to include guice 4.0 update 2015-08-10 13:57:55 -07:00
Charles Allen
7e61216287 Update to guice 4.0
- Mark a lot of `@Provides` methods as final since guice 4.0 disallows overriding them
2015-08-10 13:57:18 -07:00
Charles Allen
7d5a77b882 Bumb Jersey to 1.19 2015-08-07 17:32:27 -07:00
Himanshu Gupta
a9ee2a383f update druid-api to 0.3.9 2015-07-30 16:35:37 -05:00
Charles Allen
86ede702b1 Add namespaced lookups as extensions
* Adds kafka, URI, and JDBC namespace defintions
* Add ability to explicitly rename using a "namespace" which is a particular data collection that is loaded on all realtime, historic nodes, and brokers. If any of these nodes has the namespace extension, ALL nodes have the namespace extension.
* Add namespace caching and populating (can be on heap or off heap)
* Add NamespaceExtractionCacheManager for handling caches
* Added ExtractionNamespace for handling metadata on the extraction namespaces
* Added ExtractionNamespaceUpdate for handling metadata related to updates
* Add extension which caches renames from a kafka stream (requires kafka8)
* Added README.md for the namespace kafka extension
* Added docs
* Added namespace/size, namespace/count, namespace/deltaTasksStarted metrics

Add static config for namespaces via `druid.query.extraction.namespace`
* This is a rebase of https://github.com/b-slim/druid/tree/static_config_only
2015-07-28 11:14:14 -07:00
Himanshu Gupta
efef20e754 update curator version to 2.8.0
to get fix for https://issues.apache.org/jira/browse/CURATOR-168
2015-07-23 13:49:55 -05:00
Xavier Léauté
4cfb00bc8a inrement version 2015-07-15 13:09:05 -07:00
Nishant
6fa49b771c Merge pull request #1453 from metamx/concicebenchmarkComplement
Update bytebuffer-collections and add basic ConciseComplementBenchmark for testing concise complements
2015-06-23 08:41:42 +05:30
Charles Allen
88b2ef5d6b Update bytebuffer-collections 2015-06-22 18:07:24 -07:00
Xavier Léauté
f1951b253c Fix bad distribution of cache keys across nodes
With the existing hash function some nodes could end up with 3 times the
number of keys as others. The following changes improve that to roughly
less than 5% differences across nodes.

- switch from fnv-1a to murmur3_128 hash
- increase repetitions for ketama algorithm
- test to analyze distribution

Also updates spymemcached for recent bugfixes
2015-06-19 15:30:35 -07:00
Xavier Léauté
0a5bb909a2 [maven-release-plugin] prepare for next development iteration 2015-06-18 17:35:19 -07:00
Xavier Léauté
59c6b2b279 [maven-release-plugin] prepare release druid-0.8.0-rc1 2015-06-18 17:35:14 -07:00
Charles Allen
056cab93ed Add Hadoop Converter Job and task
* Fixes https://github.com/druid-io/druid/issues/1363
* Add extra utils in JobHelper based on PR feedback
2015-06-09 14:47:38 -07:00
nishant
81415282aa Enabling compression for multiValued dimension
Add test and refactoring

Add benchmark tests
2015-05-27 00:09:14 +05:30
fjy
7a6acf5c1b update pom to 0.8 2015-05-11 19:41:58 -06:00
fjy
d6ef2c20df Update server metrics to use schemaless design 2015-04-27 15:06:25 -07:00
fjy
0c734c691a update druid-api version to fix bug 2015-04-18 15:52:39 -07:00
fjy
d260515a43 update druid-api version 2015-04-17 14:58:35 -07:00
David Pinheiro
baeef08c4c Add Microsoft Azure as a Deep Storage option. 2015-04-16 15:39:36 -07:00
Fangjin Yang
1cfc13cc41 Merge pull request #1286 from metamx/fix-java-util-conflict
updated dependencies to java-util 0.27
2015-04-15 17:36:30 -07:00
Xavier Léauté
b535d30912 updated dependencies to java-util 0.27
java-util 0.27 is not binary compatible with 0.26
2015-04-15 16:23:01 -07:00
Charles Allen
abdeaa0746 Add stricter checking for potential coding errors
Can use via `mvn clean compile test-compile -P strict'
2015-04-15 14:52:25 -07:00
Xavier Léauté
2c773dee60 work around Travis CI not setting appropriate heap limits https://github.com/travis-ci/travis-ci/issues/3396 2015-04-08 13:19:40 -07:00
Fangjin Yang
208e307915 Merge pull request #1251 from metamx/uriSegmentLoaders
Revert "Revert "Overhaul of SegmentPullers to add consistency and retries""
2015-03-30 17:43:51 -07:00
fjy
aea7f9d192 [maven-release-plugin] prepare for next development iteration 2015-03-30 16:35:24 -07:00
fjy
060d7aef03 [maven-release-plugin] prepare release druid-0.7.1 2015-03-30 16:35:20 -07:00
Charles Allen
1c6cbea89c Revert "Revert "Overhaul of SegmentPullers to add consistency and retries""
This reverts commit f904bc785860f97c4b741d69df4c606bf1bfe3ae.
2015-03-30 13:40:04 -07:00
Fangjin Yang
f904bc7858 Revert "Overhaul of SegmentPullers to add consistency and retries" 2015-03-30 13:15:50 -07:00
Charles Allen
6d407e8677 Add URI handling to SegmentPullers
* Requires https://github.com/druid-io/druid-api/pull/37
* Requires https://github.com/metamx/java-util/pull/22
* Moves the puller logic to use a more standard workflow going through java-util helpers instead of re-writing the handlers for each impl
  * General workflow goes like this: 1) LoadSpec makes sure the correct Puller is called with the correct parameters. 2) The Puller sets up general information like how to make an InputStream, how to find a file name (for .gz files for example), and when to retry. 3) CompressionUtils does most of the heavy lifting when it can
2015-03-30 12:33:23 -07:00
Charles Allen
9cd6c08e96 Exclude log4j from curator dependencies in favor of log4j-1.2-api 2015-03-26 13:05:12 -07:00
Xavier Léauté
95602de34e Merge pull request #1230 from metamx/updateMapDbVersion107
Update MapDB to version 1.0.7
2015-03-23 14:04:25 -07:00
Charles Allen
5250d89adf Update MapDB to version 1.0.7
The update fixes a bunch of HTree issues which we have not encountered yet, but we use HTRee in many of our MapDB usages
http://www.mapdb.org/changelog.html#Version_107_2015-02-19
2015-03-20 08:31:23 -07:00
fjy
b389cfe404 [maven-release-plugin] prepare for next development iteration 2015-03-19 12:38:17 -07:00
fjy
60e7d543cc [maven-release-plugin] prepare release druid-0.7.1-rc1 2015-03-19 12:38:13 -07:00
fjy
6a47c1530c update versions to prepare for rc release 2015-03-19 11:39:38 -07:00
Slim Bouguerra
03547b4088 Using new release of the http-client.
This new version 1.0.1 it has a bug fix that was  causing can not add a handler exceptions.
Bug description can be found [here](https://github.com/metamx/http-client/pull/16)
2015-03-18 09:33:45 -05:00
fjy
2c834b878e Update jets3t version to support aws v4 auth 2015-03-16 10:50:04 -07:00
cheddar
526a386f50 Merge pull request #1193 from metamx/reduce-test-verbosity
move test output to file for cleaner build logs
2015-03-12 15:42:34 -07:00
Xavier Léauté
7fb4b1d2bb Merge pull request #1144 from metamx/javaLoggingManager
Add log4j2 hooks to other loggings
2015-03-12 14:38:51 -07:00
Charles Allen
edfcea18d8 Add log4j2 hooks to standard java logging 2015-03-12 14:29:41 -07:00
Xavier Léauté
fc613771d2 move test output to file for cleaner build logs
- removes the need for special test log4j2.xml
2015-03-11 17:56:19 -07:00