Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,617 Commits 113 Branches 506 Tags 731 MiB
Commit Graph

5617 Commits

Author SHA1 Message Date
Davide Anastasia 4a3a7dd1ad read hadoop-indexer configuration file from HDFS 2015-06-24 14:08:53 -07:00
Xavier Léauté 0c85c8c60a Merge pull request #1462 from pjain1/validate_rules 
tieredReplicants can be null
 2015-06-24 13:29:27 -07:00
Parag Jain ff738ace05 converting null tieredeplicants to default and not allowing empty ones 2015-06-24 14:55:12 -05:00
Fangjin Yang 9859555346 Merge pull request #1446 from conradlee/docs-segment-details 
Improve segment file documentation
 2015-06-24 12:14:59 -07:00
Conrad Lee f214b412ca Improve segment file documentation 2015-06-24 11:45:23 -07:00
Fangjin Yang 9104d08a6a Merge pull request #1461 from rasahner/doc_queryFixes 
minor fixes to TimeseriesQuery and Aggregations
 2015-06-24 08:12:09 -07:00
sahner a938e65315 minor fixes to TimeseriesQuery and Aggregations 2015-06-24 08:24:07 -05:00
Charles Allen 8795792dba Merge pull request #1454 from optimizely/hao/hadoop-fixes 
A couple of hdfs related fixes
 2015-06-23 13:40:25 -07:00
Fangjin Yang 726ed432a1 Merge pull request #1451 from rasahner/doc_minorFixes 
minor documentation fixes in Tasks.md, index.md, indexing-service.md
 2015-06-23 10:15:47 -07:00
Fangjin Yang 2544f3655e Merge pull request #1457 from ravishrathod/rabbitmq-doc 
updating doc for rabbitmq firehose
 2015-06-23 08:24:49 -07:00
Xavier Léauté 36b4453789 Merge pull request #1455 from druid-io/fix-protobuf 
Fix protobuf impl and docs
 2015-06-22 23:15:40 -07:00
Fangjin Yang 37cafbdebb Merge pull request #1459 from metamx/fix-redirects 
fix broken redirects
 2015-06-22 23:09:50 -07:00
Xavier Léauté d9dfff0689 fix broken redirects 2015-06-22 23:04:31 -07:00
Nishant 6fa49b771c Merge pull request #1453 from metamx/concicebenchmarkComplement 
Update bytebuffer-collections and add basic ConciseComplementBenchmark for testing concise complements
 2015-06-23 08:41:42 +05:30
Charles Allen 88b2ef5d6b Update bytebuffer-collections 2015-06-22 18:07:24 -07:00
Fangjin Yang 0c13fd8018 Merge pull request #1450 from metamx/cache-key-distribution 
Fix bad distribution of cache keys across cache nodes
 2015-06-22 17:58:15 -07:00
fjy 0d8a526ef3 Merge branch 'master' of https://github.com/druid-io/druid 2015-06-22 17:47:26 -07:00
Himanshu 4a83a22f8c Merge pull request #1445 from metamx/JSWorkerSelectStrategy 
JavaScript Worker Select Strategy
 2015-06-22 17:19:13 -05:00
Himanshu 34c8f4c3da Merge pull request #1437 from metamx/limitUsedSegmentInterval 
Add start and end bounds to getUsedSegmentsForInterval
 2015-06-22 14:11:38 -05:00
Charles Allen 8d91c8d399 Add start and end bounds to getUsedSegmentsForInterval 
* Add unit tests
* Add javadoc for methods in IndexerMetadataStorageCoordinator
 2015-06-22 11:46:53 -07:00
Charles Allen f0f453940f Merge pull request #1456 from metamx/test-1120 
test for #1120
 2015-06-22 10:54:24 -07:00
ravishrathod 9213fd3801 updating doc for rabbitmq firehose 2015-06-22 02:40:11 -04:00
nishant f9cdb0ad61 test for #1120 
Make the changes described in #1120 to add test for the issue described
there.
 2015-06-21 23:34:21 +05:30
fjy 9c74993559 fix protobuf impl and docs 2015-06-20 21:59:38 -07:00
Hao Xia 1931491c9f A couple of hdfs related fixes 
* Class loading issue with hdfs-storage extension
* Exception when using hdfs with non-fully qualified segment path
 2015-06-19 17:22:20 -07:00
Charles Allen b72a70522b Add basic ConciseComplementBenchmark for testing concise complements 2015-06-19 16:47:41 -07:00
Xavier Léauté f1951b253c Fix bad distribution of cache keys across nodes 
With the existing hash function some nodes could end up with 3 times the
number of keys as others. The following changes improve that to roughly
less than 5% differences across nodes.

- switch from fnv-1a to murmur3_128 hash
- increase repetitions for ketama algorithm
- test to analyze distribution

Also updates spymemcached for recent bugfixes
 2015-06-19 15:30:35 -07:00
sahner 4ba34fe43d minor documentation fixes in Tasks.md, index.md, indexing-service.md 2015-06-19 17:09:53 -05:00
nishant fb4052d577 JavaScript Worker Select Strategy 
this PR adds a JavaScriptWorkerSelectStrategy which allows defining
arbitrary logic for selecting workers to run task using a JavaScript
function.

This gives users full control to implement complex worker selection
strategies based on task attributes.

more tests and a complex javascript config

fix for java8 modify for nashorn compatibility
 2015-06-20 02:01:34 +05:30
Xavier Léauté 0a5bb909a2 [maven-release-plugin] prepare for next development iteration 2015-06-18 17:35:19 -07:00
Xavier Léauté 59c6b2b279 [maven-release-plugin] prepare release druid-0.8.0-rc1 2015-06-18 17:35:14 -07:00
Xavier Léauté d276d2c90b Merge pull request #1444 from druid-io/logging-improvement 
Separate bootstrap threads from loading threads on historical startup
 2015-06-17 15:24:07 -07:00
Eric Tschetter 06c97b6d7d Separate out the "bootstrapping" threads from the "loading" threads. 
It is highly recommended to keep loading threads single threaded.  There can be benefits to having multiple bootstrapping threads, though.  Those bootstrapping threads shouldn't be kept alive for the whole life of the process, however.

Also, adjust some logging and do some code cleanup.
 2015-06-17 14:58:28 -07:00
Xavier Léauté f7a7daeff9 Merge pull request #1434 from metamx/fix1433 
Wipe FileContext off the face of the earth
 2015-06-16 21:42:40 -07:00
Fangjin Yang 0539e0073d Merge pull request #1442 from guobingkun/broker_server_view_test 
Unit test for BrokerServerView
 2015-06-16 19:45:20 -07:00
Eric Tschetter 1aad7ce521 Add a bit more information to the mapping logging logic. 2015-06-16 19:33:38 -07:00
Bingkun Guo 446d01cc53 Unit test for BrokerServerView 2015-06-16 15:20:32 -05:00
Charles Allen 69bbe21512 Add flush prior to close on output stream in QueryResource 2015-06-16 11:40:56 -07:00
Charles Allen 94a567732a Wipe FileContext off the face of the earth 
* Fixes https://github.com/druid-io/druid/issues/1433
* Works arround https://issues.apache.org/jira/browse/HADOOP-10643
* Reverts to the prior method of renaming
 2015-06-16 09:48:09 -07:00
Xavier Léauté 0de914823d Merge pull request #1435 from metamx/jitterWaitTimes 
Add jitter to the retries for RemoteTaskActionClient
 2015-06-15 22:24:19 -07:00
Charles Allen acc0a3fbf7 Add jitter to the retries for RemoteTaskActionClient 2015-06-12 17:43:25 -07:00
Xavier Léauté 6763e3780a Merge pull request #1417 from metamx/rtr-fixes 
fix behaviour of middlemanagers around ZK disconnects , fixes #709
 2015-06-10 14:42:49 -07:00
Xavier Léauté 9cf8662aeb Merge pull request #1427 from guobingkun/fix_issue_1016 
Fix duplicate extension loading issue described in #1016
 2015-06-10 14:42:24 -07:00
Bingkun Guo bdf4d541e3 Fix issue #1016 that if user specifies extension coordinates, the local extensions will be loaded twice, 
which could cause Guice duplicate binding errors.
Add unit test to replicate duplicate extension issue. Update documents. Add an package accessible getter for loadersMap for testing only.
Notice that extensions explicitly specified in druid.extensions.coordinates have a higher priority than ones included in the classpath.
Extension modules that don't have a canonical class name will be ignored.
 2015-06-10 15:48:03 -05:00
nishant e9afec4a2b fix task status issues on zk outages 
docs

review comments

fix test

review comments

Review comments

fix compilation

fix typo
 2015-06-11 00:49:52 +05:30
Xavier Léauté 78d468700b Merge pull request #1388 from metamx/fix-1360 
fix race described in 1360
 2015-06-10 11:59:36 -07:00
Xavier Léauté 7fd9dcff48 Merge pull request #1409 from metamx/convertTaskMerger 
Converter to use TaskMerger not TaskMaker
 2015-06-10 11:58:52 -07:00
Xavier Léauté f6b336ac3e Merge pull request #1432 from metamx/config-fix 
fix passing of config from IndexTuningConfig to RealtimeTuningConfig
 2015-06-10 11:42:58 -07:00
Charles Allen 6230ac90ae Use IndexMerger for conversion 2015-06-10 11:34:58 -07:00
cheddar 0004ba249f Merge pull request #1351 from metamx/hadoopConvert 
Add Hadoop Converter Job and task
 2015-06-10 11:07:06 -07:00