Commit Graph

5564 Commits

Author SHA1 Message Date
nishant af9ea08041 fix race described in 1360
review comments

review comments

review comments

no need to remove

fix test

review comments
2015-06-10 12:19:12 +05:30
Charles Allen 056cab93ed Add Hadoop Converter Job and task
* Fixes https://github.com/druid-io/druid/issues/1363
* Add extra utils in JobHelper based on PR feedback
2015-06-09 14:47:38 -07:00
Parag Jain b72e6fd51a Druid Coordinator Unit test 2015-06-09 13:51:01 -05:00
Fangjin Yang 6ae4ecc7d4 Merge pull request #1428 from metamx/abstractifyHadoopConfigStuff
Abstractify hadoopy indexer configuration.
2015-06-08 11:26:34 -07:00
Charles Allen 2a76bdc60a Abstractify hadoopy indexer configuration.
* Moves many items to JobHelper
* Remove dependencies of these functions on HadoopDruidIndexerConfig in favor of more general items
* Changes functionalities of some of the path methods to always return a path with scheme
* Adds retry to uploads
* Change output loadSpec determining from using outputFS.getClass().getName() to using outputFS.getScheme()
2015-06-08 10:53:27 -07:00
cheddar 04e4aac03b Merge pull request #1430 from guobingkun/lazy_init_abstract_http_client_provider
Make AbstractHttpClientProvider contents lazily instantiated
2015-06-08 09:33:35 -07:00
Bingkun Guo 22607d19be Make AbstractHttpClientProvider contents lazily instantiated 2015-06-08 09:53:26 -05:00
Xavier Léauté 52f261eea7 Merge pull request #1429 from druid-io/fix-doc
rename servermonitor to historicalmetricsmonitor in docs
2015-06-05 17:33:06 -07:00
fjy afdd9304cf rename servermonitor to historicalmetricsmonitor in docs 2015-06-05 17:32:04 -07:00
Charles Allen b0085c8a8b Merge pull request #1426 from druid-io/more-links
Add more links for talks
2015-06-05 14:37:19 -07:00
fjy 6744eb2889 Add more links for talks 2015-06-05 14:35:56 -07:00
Fangjin Yang c6f36dcccb Merge pull request #1411 from metamx/more-benchmarks
More benchmarks for data compression
2015-06-04 22:01:39 -07:00
Xavier Léauté 395ba79f8b Merge pull request #1403 from metamx/mergerMakerTests
Improvements around resource handling in IndexMerger / IndexIO / QueryableIndex
2015-06-04 15:59:10 -07:00
Himanshu f1721fa912 Merge pull request #1410 from guobingkun/unit_test
Unit tests for LoadQueuePeon and SegmentLoaderLocalCacheManager
2015-06-04 17:58:13 -05:00
Bingkun Guo 1646f650b6 Unit tests for LoadQueuePeon and SegmentLoaderLocalCacheManager, JavaDoc for LoadPeonCallback 2015-06-04 17:28:22 -05:00
Charles Allen ed8eb5c991 Improvements around resource handling in IndexMerger / IndexIO / QueryableIndex
* Fix resource leak in `io.druid.segment.IndexIO.DefaultIndexIOHandler#validateTwoSegments(java.io.File, java.io.File)`
* Un-deprecate `close()` in `QueryableIndex` and make it inherit `Closeable`
* Fix resource leaks in various unit tests
* Add `CloserRule` for closing out resources
2015-06-04 14:18:27 -07:00
Himanshu f81a0d9210 Merge pull request #1425 from guobingkun/guice_fix
Anyways, @guobingkun , if possible,  can you please test proposed change and send another PR to fix #1016 .  but that doesn't necessarily hold this PR, so I'm merging this.
2015-06-04 14:43:26 -05:00
Himanshu f44f7f07de Merge pull request #1424 from pjain1/validate_rules
Check lower bound of replicant values for rules
2015-06-04 14:16:50 -05:00
Parag Jain 1030899cdf Check lower bound of replicant values for rules 2015-06-04 13:47:43 -05:00
nishant 37873eb4f0 more benchmarks + filter
fix test

Modify test to access random filtered rows

formatting

fix test

remove main method

Add newline

Add newline
2015-06-04 22:12:29 +05:30
Bingkun Guo dc26350480 Separate overwrite of Guice modules into 2 steps so that extension modules can overwrite cli modules 2015-06-04 09:57:56 -05:00
Himanshu 50ad0e6474 Merge pull request #1412 from pjain1/alphaNumericTopN_NPE_fix
NPE fix for TopN query with alphaNumericTopN metric spec
2015-06-04 09:49:31 -05:00
Parag Jain a7b09e857c NPE fix for alphaNumericTopN when pervious stop is not specified 2015-06-04 09:30:31 -05:00
Xavier Léauté 35e2fde18e Merge pull request #1386 from himanshug/aggregation_testing1
General class for testing any Aggregation Implementation
2015-06-03 23:43:36 -07:00
Fangjin Yang 7f5164db14 Merge pull request #1418 from metamx/reduce-test-runtime
reduce test runtime
2015-06-03 21:40:36 -07:00
nishant 21864a9407 reduce test runtime
fix check

fix test
2015-06-04 08:35:12 +05:30
Charles Allen ef9b67cce3 Merge pull request #1422 from metamx/fix-ec2-public-ip
fix public IP not working in EC2 autoscaling
2015-06-03 16:30:51 -07:00
Xavier Léauté 4ebdfea76f fix public IP not working in EC2 autoscaling 2015-06-03 16:05:59 -07:00
Himanshu c096c21b6a Merge pull request #1413 from metamx/TaskUtilIdCommonizer
Move TaskUtils.makeId to AbstractTask
2015-06-03 15:54:22 -05:00
Charles Allen 8289914f76 Make AbstractTask.makeId use AbstractTask.joinId
* Also remove TaskUtil
2015-06-03 13:24:20 -07:00
Xavier Léauté 92d7316ed8 Merge pull request #1414 from metamx/timeout2TIMEOUT
Replace "timeout" with QueryContextKeys.TIMEOUT
2015-06-02 17:11:09 -07:00
Charles Allen 1c4d42bc15 Replace "timeout" with QueryContextKeys.TIMEOUT 2015-06-02 14:49:21 -07:00
Xavier Léauté 224886ab52 Merge pull request #1370 from metamx/dimExtractionOptimizations
Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths
2015-06-02 13:25:19 -07:00
Charles Allen f48db09e35 Add optimizations for ExtractionFn by enabling MANY_TO_ONE vs ONE_TO_ONE codepaths
* Also adds LookupExtractionFn and MapLookupExtractor which takes in an explicit mapping of renames
* Add injective to javascript extraction fn
2015-06-02 12:22:56 -07:00
Himanshu Gupta 215c1ab01e UTs for hyperUnique aggregation 2015-06-01 12:52:40 -05:00
Himanshu Gupta 160d5fe6b7 a general class for testing any [complex] aggregation implementation 2015-06-01 12:52:40 -05:00
Xavier Léauté ab34862353 Merge pull request #1408 from druid-io/rename-links
Update links to point to druid-io
2015-05-31 13:38:32 -07:00
fjy 74d8840414 Change tranquility links 2015-05-31 10:59:38 -07:00
Fangjin Yang 39c55b417e Merge pull request #1405 from himanshug/fix_doc
in batch ingestion metadataUpdateSpec->type is derby, mysql etc
2015-05-29 20:42:21 -07:00
Himanshu Gupta be4ecc4b91 in batch ingestion metadataUpdateSpec->type is derby, mysql etc and not metadata 2015-05-29 22:16:18 -05:00
Fangjin Yang 24306d20b6 Merge pull request #1344 from himanshug/change_tutorial_file_names
change all docs/content/*.md filenames to only have lowercase and dashes
2015-05-29 19:37:04 -07:00
Xavier Léauté 96103e1227 remove whirr from documentation 2015-05-29 20:55:42 -05:00
Xavier Léauté d2346b6834 shorten links and file names
* remove redundant parts in file names
* delete unsupported "Druid-Personal-Demo-Cluster"
2015-05-29 20:55:42 -05:00
Himanshu Gupta 8edc2aaca3 renaming all *.md filenames to only have lowercase and dashes
so that they are editable on case-insensitive os as well
2015-05-29 20:55:42 -05:00
Xavier Léauté 20fdb627d9 Merge pull request #1399 from druid-io/overlap-check
Add schema check for overlap between dimension and metric names
2015-05-29 09:39:22 -07:00
fjy 185c99deec Add schema check for overlap between dimension and metric names 2015-05-28 22:18:08 -07:00
Fangjin Yang 069fc25528 Merge pull request #1402 from metamx/IndexMergerTests
Add more IndexMergerTests
2015-05-28 21:15:18 -07:00
Fangjin Yang ac9057c00e Merge pull request #1401 from metamx/ec2-public-ip
flag to enable public IP in EC2 autoscaling
2015-05-28 20:21:32 -07:00
Charles Allen 55292bba13 Add more IndexMergerTests 2015-05-28 18:18:20 -07:00
Xavier Léauté d834a974ba flag to enable public IP in EC2-VPC autoscaling 2015-05-28 18:14:12 -07:00