Commit Graph

5687 Commits

Author SHA1 Message Date
Charles Allen 7a2a8a3d6e Move extraction tests to more reasonable package 2015-07-01 10:30:50 -07:00
Charles Allen a37d631cea Add log4j2 for debugging which can be specified with `-Dlog4j.configurationFile=/some/path/druid/common/src/main/resources/log4j2.debug.xml` during testing and development 2015-07-01 10:29:22 -07:00
Charles Allen f2919b98b1 Merge pull request #1471 from metamx/direct-client-metrics
add query/node/time metrics to DirectDruidClient
2015-06-30 22:06:44 -07:00
Himanshu Gupta 473bc101d7 for example/tutorial, use derby instead of mysql 2015-06-30 20:47:32 -05:00
Fangjin Yang b4eec5b47d Merge pull request #1483 from himanshug/fix_doc_links
fix toc links per the shortened names from commit d2346b6834
2015-06-30 12:18:40 -07:00
Himanshu Gupta 12f5d1743e fix toc links per the shortened names from commit d2346b6834 2015-06-30 14:16:40 -05:00
Bingkun Guo 282a0f9760 Unit tests for KillTask and MetadataTaskStorage 2015-06-29 17:55:41 -05:00
Himanshu b5b9ca1446 Merge pull request #1470 from pjain1/rtindex_test
Realtime Index Task test
2015-06-29 16:51:35 -05:00
fjy 8c551ed889 very minor fix to the TOC 2015-06-29 10:49:45 -07:00
fjy e42d5ac785 Merge branch 'master' of https://github.com/druid-io/druid 2015-06-29 10:49:30 -07:00
Fangjin Yang 2f522f8c8d Merge pull request #1479 from himanshug/fix_doc_imgs
fixing the links to doc images
2015-06-29 10:23:06 -07:00
Himanshu Gupta 4114b4902e fixing the links to doc images 2015-06-29 12:17:42 -05:00
Bingkun Guo 4a0ae7d8d5 Fix inconsistent druid property names for "druid.metadata.storage.tables.xxx" between document and code 2015-06-29 10:12:30 -05:00
Himanshu 8172bdff1c Merge pull request #1468 from guobingkun/fix_npe_for_storage_action_handler
Fix npe thrown from SQLMetadataStorageActionHandler
2015-06-29 09:57:51 -05:00
Parag Jain 284b80b09e Realtime Index Task test 2015-06-29 09:52:41 -05:00
Xavier Léauté 2da12de598 add back query/node/(time|ttfb) docs 2015-06-26 17:58:47 -07:00
Xavier Léauté 28fa1642b9 add node time metrics to DirectDruidClient 2015-06-26 17:57:44 -07:00
Xavier Léauté f883ff2dab Merge pull request #1467 from metamx/cachingclientNoEmit
Remove metrics emitting from caching clustered client
2015-06-26 16:21:23 -07:00
Charles Allen fbcac10e00 Remove metrics emitting from caching clustered client 2015-06-26 10:49:13 -07:00
Bingkun Guo e4e18b17b5 fix npe thrown from getEntry() and getStatus() SQLMetadataStorageActionHandler due to a non-exist entryId 2015-06-26 10:40:56 -05:00
Davide Anastasia 4a3a7dd1ad read hadoop-indexer configuration file from HDFS 2015-06-24 14:08:53 -07:00
Xavier Léauté 0c85c8c60a Merge pull request #1462 from pjain1/validate_rules
tieredReplicants can be null
2015-06-24 13:29:27 -07:00
Parag Jain ff738ace05 converting null tieredeplicants to default and not allowing empty ones 2015-06-24 14:55:12 -05:00
Fangjin Yang 9859555346 Merge pull request #1446 from conradlee/docs-segment-details
Improve segment file documentation
2015-06-24 12:14:59 -07:00
Conrad Lee f214b412ca Improve segment file documentation 2015-06-24 11:45:23 -07:00
Fangjin Yang 9104d08a6a Merge pull request #1461 from rasahner/doc_queryFixes
minor fixes to TimeseriesQuery and Aggregations
2015-06-24 08:12:09 -07:00
sahner a938e65315 minor fixes to TimeseriesQuery and Aggregations 2015-06-24 08:24:07 -05:00
Charles Allen 8795792dba Merge pull request #1454 from optimizely/hao/hadoop-fixes
A couple of hdfs related fixes
2015-06-23 13:40:25 -07:00
Fangjin Yang 726ed432a1 Merge pull request #1451 from rasahner/doc_minorFixes
minor documentation fixes in Tasks.md, index.md, indexing-service.md
2015-06-23 10:15:47 -07:00
Fangjin Yang 2544f3655e Merge pull request #1457 from ravishrathod/rabbitmq-doc
updating doc for rabbitmq firehose
2015-06-23 08:24:49 -07:00
Xavier Léauté 36b4453789 Merge pull request #1455 from druid-io/fix-protobuf
Fix protobuf impl and docs
2015-06-22 23:15:40 -07:00
Fangjin Yang 37cafbdebb Merge pull request #1459 from metamx/fix-redirects
fix broken redirects
2015-06-22 23:09:50 -07:00
Xavier Léauté d9dfff0689 fix broken redirects 2015-06-22 23:04:31 -07:00
Nishant 6fa49b771c Merge pull request #1453 from metamx/concicebenchmarkComplement
Update bytebuffer-collections and add basic ConciseComplementBenchmark for testing concise complements
2015-06-23 08:41:42 +05:30
Charles Allen 88b2ef5d6b Update bytebuffer-collections 2015-06-22 18:07:24 -07:00
Fangjin Yang 0c13fd8018 Merge pull request #1450 from metamx/cache-key-distribution
Fix bad distribution of cache keys across cache nodes
2015-06-22 17:58:15 -07:00
fjy 0d8a526ef3 Merge branch 'master' of https://github.com/druid-io/druid 2015-06-22 17:47:26 -07:00
Himanshu 4a83a22f8c Merge pull request #1445 from metamx/JSWorkerSelectStrategy
JavaScript Worker Select Strategy
2015-06-22 17:19:13 -05:00
Himanshu 34c8f4c3da Merge pull request #1437 from metamx/limitUsedSegmentInterval
Add start and end bounds to getUsedSegmentsForInterval
2015-06-22 14:11:38 -05:00
Charles Allen 8d91c8d399 Add start and end bounds to getUsedSegmentsForInterval
* Add unit tests
* Add javadoc for methods in IndexerMetadataStorageCoordinator
2015-06-22 11:46:53 -07:00
Charles Allen f0f453940f Merge pull request #1456 from metamx/test-1120
test for #1120
2015-06-22 10:54:24 -07:00
ravishrathod 9213fd3801 updating doc for rabbitmq firehose 2015-06-22 02:40:11 -04:00
nishant f9cdb0ad61 test for #1120
Make the changes described in #1120 to add test for the issue described
there.
2015-06-21 23:34:21 +05:30
fjy 9c74993559 fix protobuf impl and docs 2015-06-20 21:59:38 -07:00
Hao Xia 1931491c9f A couple of hdfs related fixes
* Class loading issue with hdfs-storage extension
* Exception when using hdfs with non-fully qualified segment path
2015-06-19 17:22:20 -07:00
Charles Allen b72a70522b Add basic ConciseComplementBenchmark for testing concise complements 2015-06-19 16:47:41 -07:00
Xavier Léauté f1951b253c Fix bad distribution of cache keys across nodes
With the existing hash function some nodes could end up with 3 times the
number of keys as others. The following changes improve that to roughly
less than 5% differences across nodes.

- switch from fnv-1a to murmur3_128 hash
- increase repetitions for ketama algorithm
- test to analyze distribution

Also updates spymemcached for recent bugfixes
2015-06-19 15:30:35 -07:00
sahner 4ba34fe43d minor documentation fixes in Tasks.md, index.md, indexing-service.md 2015-06-19 17:09:53 -05:00
nishant fb4052d577 JavaScript Worker Select Strategy
this PR adds a JavaScriptWorkerSelectStrategy which allows defining
arbitrary logic for selecting workers to run task using a JavaScript
function.

This gives users full control to implement complex worker selection
strategies based on task attributes.

more tests and a complex javascript config

fix for java8 modify for nashorn compatibility
2015-06-20 02:01:34 +05:30
Xavier Léauté 0a5bb909a2 [maven-release-plugin] prepare for next development iteration 2015-06-18 17:35:19 -07:00