Michael Schiff
6ad451a44a
JobHelper.ensurePaths will set job properties from config (tuningConfig.jobProperties) before adding input paths to the config.
...
Adding input paths will create Path and FileSystem instances which may depend on the values in the job config.
This allows all properties to be set from the spec file, avoiding having to directly edit cluster xml files.
IndexGeneratorJob.run adds job properties before adding input paths (adding input paths may depend on having job properies set)
JobHelperTest confirms that JobHelper.ensurePaths adds job properties
javadoc for addInputPaths to explain relationship with
addJobProperties
2015-07-01 12:45:32 -07:00
Xavier Léauté
2c463ae435
Merge pull request #1489 from metamx/moveTestPackages
...
Move some test packages
2015-07-01 11:18:09 -07:00
Fangjin Yang
eec972afa3
Merge pull request #1490 from metamx/smallCommentInDimExtrTopN
...
Add coments to DimExtractionTopNAlgorithm
2015-07-01 10:47:49 -07:00
Charles Allen
5e19a615f1
Add coments to DimExtractionTopNAlgorithm
2015-07-01 10:32:45 -07:00
Charles Allen
7a2a8a3d6e
Move extraction tests to more reasonable package
2015-07-01 10:30:50 -07:00
Charles Allen
f2919b98b1
Merge pull request #1471 from metamx/direct-client-metrics
...
add query/node/time metrics to DirectDruidClient
2015-06-30 22:06:44 -07:00
Fangjin Yang
b4eec5b47d
Merge pull request #1483 from himanshug/fix_doc_links
...
fix toc links per the shortened names from commit d2346b68344
2015-06-30 12:18:40 -07:00
Himanshu Gupta
12f5d1743e
fix toc links per the shortened names from commit d2346b68344
2015-06-30 14:16:40 -05:00
Himanshu
b5b9ca1446
Merge pull request #1470 from pjain1/rtindex_test
...
Realtime Index Task test
2015-06-29 16:51:35 -05:00
fjy
8c551ed889
very minor fix to the TOC
2015-06-29 10:49:45 -07:00
fjy
e42d5ac785
Merge branch 'master' of https://github.com/druid-io/druid
2015-06-29 10:49:30 -07:00
Fangjin Yang
2f522f8c8d
Merge pull request #1479 from himanshug/fix_doc_imgs
...
fixing the links to doc images
2015-06-29 10:23:06 -07:00
Himanshu Gupta
4114b4902e
fixing the links to doc images
2015-06-29 12:17:42 -05:00
Himanshu
8172bdff1c
Merge pull request #1468 from guobingkun/fix_npe_for_storage_action_handler
...
Fix npe thrown from SQLMetadataStorageActionHandler
2015-06-29 09:57:51 -05:00
Parag Jain
284b80b09e
Realtime Index Task test
2015-06-29 09:52:41 -05:00
Xavier Léauté
2da12de598
add back query/node/(time|ttfb) docs
2015-06-26 17:58:47 -07:00
Xavier Léauté
28fa1642b9
add node time metrics to DirectDruidClient
2015-06-26 17:57:44 -07:00
Xavier Léauté
f883ff2dab
Merge pull request #1467 from metamx/cachingclientNoEmit
...
Remove metrics emitting from caching clustered client
2015-06-26 16:21:23 -07:00
Charles Allen
fbcac10e00
Remove metrics emitting from caching clustered client
2015-06-26 10:49:13 -07:00
Bingkun Guo
e4e18b17b5
fix npe thrown from getEntry() and getStatus() SQLMetadataStorageActionHandler due to a non-exist entryId
2015-06-26 10:40:56 -05:00
Xavier Léauté
0c85c8c60a
Merge pull request #1462 from pjain1/validate_rules
...
tieredReplicants can be null
2015-06-24 13:29:27 -07:00
Parag Jain
ff738ace05
converting null tieredeplicants to default and not allowing empty ones
2015-06-24 14:55:12 -05:00
Fangjin Yang
9859555346
Merge pull request #1446 from conradlee/docs-segment-details
...
Improve segment file documentation
2015-06-24 12:14:59 -07:00
Conrad Lee
f214b412ca
Improve segment file documentation
2015-06-24 11:45:23 -07:00
Fangjin Yang
9104d08a6a
Merge pull request #1461 from rasahner/doc_queryFixes
...
minor fixes to TimeseriesQuery and Aggregations
2015-06-24 08:12:09 -07:00
sahner
a938e65315
minor fixes to TimeseriesQuery and Aggregations
2015-06-24 08:24:07 -05:00
Charles Allen
8795792dba
Merge pull request #1454 from optimizely/hao/hadoop-fixes
...
A couple of hdfs related fixes
2015-06-23 13:40:25 -07:00
Fangjin Yang
726ed432a1
Merge pull request #1451 from rasahner/doc_minorFixes
...
minor documentation fixes in Tasks.md, index.md, indexing-service.md
2015-06-23 10:15:47 -07:00
Fangjin Yang
2544f3655e
Merge pull request #1457 from ravishrathod/rabbitmq-doc
...
updating doc for rabbitmq firehose
2015-06-23 08:24:49 -07:00
Xavier Léauté
36b4453789
Merge pull request #1455 from druid-io/fix-protobuf
...
Fix protobuf impl and docs
2015-06-22 23:15:40 -07:00
Fangjin Yang
37cafbdebb
Merge pull request #1459 from metamx/fix-redirects
...
fix broken redirects
2015-06-22 23:09:50 -07:00
Xavier Léauté
d9dfff0689
fix broken redirects
2015-06-22 23:04:31 -07:00
Nishant
6fa49b771c
Merge pull request #1453 from metamx/concicebenchmarkComplement
...
Update bytebuffer-collections and add basic ConciseComplementBenchmark for testing concise complements
2015-06-23 08:41:42 +05:30
Charles Allen
88b2ef5d6b
Update bytebuffer-collections
2015-06-22 18:07:24 -07:00
Fangjin Yang
0c13fd8018
Merge pull request #1450 from metamx/cache-key-distribution
...
Fix bad distribution of cache keys across cache nodes
2015-06-22 17:58:15 -07:00
fjy
0d8a526ef3
Merge branch 'master' of https://github.com/druid-io/druid
2015-06-22 17:47:26 -07:00
Himanshu
4a83a22f8c
Merge pull request #1445 from metamx/JSWorkerSelectStrategy
...
JavaScript Worker Select Strategy
2015-06-22 17:19:13 -05:00
Himanshu
34c8f4c3da
Merge pull request #1437 from metamx/limitUsedSegmentInterval
...
Add start and end bounds to getUsedSegmentsForInterval
2015-06-22 14:11:38 -05:00
Charles Allen
8d91c8d399
Add start and end bounds to getUsedSegmentsForInterval
...
* Add unit tests
* Add javadoc for methods in IndexerMetadataStorageCoordinator
2015-06-22 11:46:53 -07:00
Charles Allen
f0f453940f
Merge pull request #1456 from metamx/test-1120
...
test for #1120
2015-06-22 10:54:24 -07:00
ravishrathod
9213fd3801
updating doc for rabbitmq firehose
2015-06-22 02:40:11 -04:00
nishant
f9cdb0ad61
test for #1120
...
Make the changes described in #1120 to add test for the issue described
there.
2015-06-21 23:34:21 +05:30
fjy
9c74993559
fix protobuf impl and docs
2015-06-20 21:59:38 -07:00
Hao Xia
1931491c9f
A couple of hdfs related fixes
...
* Class loading issue with hdfs-storage extension
* Exception when using hdfs with non-fully qualified segment path
2015-06-19 17:22:20 -07:00
Charles Allen
b72a70522b
Add basic ConciseComplementBenchmark for testing concise complements
2015-06-19 16:47:41 -07:00
Xavier Léauté
f1951b253c
Fix bad distribution of cache keys across nodes
...
With the existing hash function some nodes could end up with 3 times the
number of keys as others. The following changes improve that to roughly
less than 5% differences across nodes.
- switch from fnv-1a to murmur3_128 hash
- increase repetitions for ketama algorithm
- test to analyze distribution
Also updates spymemcached for recent bugfixes
2015-06-19 15:30:35 -07:00
sahner
4ba34fe43d
minor documentation fixes in Tasks.md, index.md, indexing-service.md
2015-06-19 17:09:53 -05:00
nishant
fb4052d577
JavaScript Worker Select Strategy
...
this PR adds a JavaScriptWorkerSelectStrategy which allows defining
arbitrary logic for selecting workers to run task using a JavaScript
function.
This gives users full control to implement complex worker selection
strategies based on task attributes.
more tests and a complex javascript config
fix for java8 modify for nashorn compatibility
2015-06-20 02:01:34 +05:30
Xavier Léauté
0a5bb909a2
[maven-release-plugin] prepare for next development iteration
2015-06-18 17:35:19 -07:00
Xavier Léauté
59c6b2b279
[maven-release-plugin] prepare release druid-0.8.0-rc1
2015-06-18 17:35:14 -07:00
