144 Commits

Author SHA1 Message Date
Himanshu
17c6512ad8 integration-test update - use KafkaProducer in ITKafkaTest and add retries to task submission (#3888)
* use KafkaProducer instead of old Producer in ITKafkaTest

* add retries to OverlordResourceTestClient.submitTask(..)
2017-01-27 07:38:17 -08:00
Parag Jain
515caa8a85 ITKafkaIndexingServiceTest fixes (#3872)
* remove wait between sends, wait for ingestion to complete before querying

send fixed number of events

more fixes

* handle interrupted exception

* remove while

* review comments
2017-01-22 14:37:35 -08:00
Himanshu
7004f5d499 make ITKafkaTest less non-deterministic (#3856) 2017-01-17 16:52:51 -06:00
Jihoon Son
d80bec83cc Enable auto license checking (#3836)
* Enable license checking

* Clean duplicated license headers
2017-01-10 18:13:47 -08:00
Jonathan Wei
2bfcc8a592 First and Last Aggregator (#3566)
* add first and last aggregator

* add test and fix

* moving around

* separate aggregator valueType

* address PR comment

* add finalize inner query and adjust v1 inner indexing

* better test and fixes

* java-util import fixes

* PR comments

* Add first/last aggs to ITWikipediaQueryTest
2016-12-16 15:26:40 -08:00
Jihoon Son
5e39578eee Enable parallel test (#3774)
* Enable parallel test

* Remove unnecessary NotThreadSafe annocation

* Randomize the start port when finding available ports

* Fix test failure

* Change to handle all negatives
2016-12-14 21:05:56 -08:00
Himanshu
ed322a4beb remove size from default analysisTypes list for segmentMetadata query (#3773) 2016-12-13 18:01:21 -08:00
Nishant
361af4c94f Wait for any pending realtime task to complete before disabling datasource (#3757)
Noticed this in our internal testing, sometimes realtime index tasks in
kafkaIndexing service can get stuck waiting for handoff if datasource
is disabled before there task completion.
This is a workaround to ensure integration tests do not hit this case
until https://github.com/druid-io/druid/issues/1729 is fixed.
2016-12-07 10:17:16 -08:00
Parag Jain
877992fe63 use sync kafka producer for deterministic test (#3721) 2016-11-29 10:04:51 -08:00
Gian Merlino
657e4512d2 Checkstyle checks for AvoidStaticImport, UnusedImports. (#3660)
Excludes tests from AvoidStaticImport, since those are used often there and
I didn't want to make this changeset too large. Production code use was minimal
and I switched those to non-static imports.
2016-11-05 11:34:36 -07:00
Nishant
b961b6a69f Add configs to enable running integration tests for cluster running behind proxy (#3646)
* Add configs to enable running integration tests for cluster running behind proxy

As part of https://issues.apache.org/jira/browse/KNOX-758
I am working on adding support for proxying druid queries & UIs using
Apache KNOX gateway.
This PR adds support for integration-tests to be run using the proxy
gateway.
Changes Include -
1) Instead of hostName and port, ability to specify url in the config
file.
2) tests now use HTTPClient defined in DruidTestModule that can pass in
the request.

Note - the config changes are backwards compatible and existing configs
should work fine.

* review comments

* review comments
2016-11-04 08:19:38 -07:00
Akash Dwivedi
4b3bd8bd63 Migrating java-util from Metamarkets. (#3585)
* Migrating java-util from Metamarkets.

* checkstyle and updated license on java-util files.

* Removed unused imports from whole project.

* cherry pick metamx/java-util@826021f.

* Copyright changes on java-util pom, address review comments.
2016-10-21 14:57:07 -07:00
Nishant
8ea5f9324d Integration Tests - fix middlemanager property name in doc (#3586) 2016-10-18 08:23:34 -05:00
Gian Merlino
40f2fe7893 Bump versions to 0.9.3-SNAPSHOT (#3524) 2016-09-29 13:53:32 -07:00
David Lim
96fcca18ea update KafkaSupervisor to make HTTP requests to tasks in parallel where possible (#3452) 2016-09-20 22:51:15 +05:30
Himanshu
2235988069 update wikipedia search query in the integration tests as per the fix in commit 0076b5f (#3420) 2016-09-01 10:13:17 -07:00
Himanshu
be79b095ba fixing expected result for segmentMetadata query in integration tests (#3318) 2016-08-03 12:13:27 -07:00
Himanshu
b0fa274481 fix segmentMetadata query results in integration tests (#3288) 2016-07-26 14:05:14 -07:00
Charles Allen
8b21036833 Make integration test dependency copy run in batch mode (#3152) 2016-06-16 18:44:15 -07:00
Gian Merlino
ebf890fe79 Update master version to 0.9.2-SNAPSHOT. (#3133) 2016-06-13 13:10:38 -07:00
Himanshu
8e2742b7e8 adding QueryGranularity to segment metadata and optionally expose same from segmentMetadata query (#2873) 2016-05-03 11:31:10 -07:00
Nishant
9440598685 fix integration-test (#2814) 2016-04-11 15:46:32 -05:00
Robin
10ec53dc1c fix calculation of expected timestamp for query in ITRealtimeIndexTaskTest 2016-04-01 10:47:17 -05:00
Himanshu
8a473111c5 Merge pull request #2650 from rasahner/IT_index_hadoop
add test for batch indexing from hadoop
2016-03-23 13:04:55 -05:00
Gian Merlino
738dcd8cd9 Update version to 0.9.1-SNAPSHOT.
Fixes #2462
2016-03-17 10:34:20 -07:00
Robin
1205c572bb add count field to expected returns for search queries 2016-03-16 09:45:38 -05:00
Robin
e7a7ecd65d add test for batch indexing from hadoop 2016-03-14 20:02:30 -05:00
rasahner
2861e854f0 Merge pull request #2540 from pjain1/remove_kill
Remove extra parameter from deleteDataSourceSpecificInterval endpoint and correct exception message for invalid interval
2016-03-14 11:16:23 -05:00
Nishant
9f8faabddb Merge pull request #2469 from pdeva/patch-10
correct service names
2016-02-26 21:15:58 +05:30
Parag Jain
b82b487f20 remove extra kill parameter 2016-02-24 17:16:18 -06:00
pdeva
4725522759 update middlemanager.conf 2016-02-18 21:47:50 -08:00
Bingkun Guo
72ab621c2a Integration tests: print expected results in json format 2016-02-18 00:14:49 -06:00
Robin
19774b5e9a integration-tests/README: fix link to docker-install 2016-02-17 11:21:14 -06:00
Robin
a785f0e6ce query tests: add max and min to segment metadata query results 2016-02-16 13:23:46 -06:00
Robin
34b143ae10 integration-tests: stop using kill=false to disable segments 2016-02-14 12:54:43 -06:00
Fangjin Yang
1430bc2c88 Merge pull request #2276 from harshjain2/feature-2021
Fix for issue 2021.
2016-02-10 17:04:45 -08:00
Harsh Jain
41730b96d4 Fix for issue 2021 2016-01-25 02:48:22 +05:30
Himanshu Gupta
dccf636676 adding null aggregators and false hasMultipleValues to expected results of segment metadata query 2016-01-22 13:28:25 -06:00
Gian Merlino
42ee473052 ZooKeeper 3.4.7 was unreleased, revert to 3.4.6. 2016-01-17 21:31:29 -08:00
Bingkun Guo
36ca5b1703 change log level to info for ITKafkaTest 2016-01-11 16:03:57 -06:00
Robin
33504d0190 log start/end of each integration test, make test method names unique 2016-01-07 13:15:17 -06:00
Robin
e280ab5f07 update zookeeper version to 3.4.7 2016-01-04 11:47:02 -06:00
Himanshu Gupta
47910a8333 adding numRows attribute to segment metadata query expected results 2015-12-17 19:31:29 -06:00
Fangjin Yang
3667f283ce Merge pull request #2030 from rasahner/intTestRmAllSegments
int tests: in unloadAndKill, remove all segments if no date range given
2015-12-09 11:12:14 -08:00
sahner
ae4357dfab integration tests: in unloadAndKill, remove all segments if no date range given 2015-12-08 09:16:29 -06:00
Himanshu Gupta
62ba9ade37 unifying license header in all java files 2015-12-05 22:16:23 -06:00
Xavier Léauté
350fdbeec1 switch to Java 8 + cleanup 2015-11-17 13:35:06 -08:00
Nishant
4486b3fe8b Fix ITUnionQueryTest failing on machines with 1 core
ITUnionQueryTest runs 4 realtime tasks and runs a unionQuery over them,
the worker is not able to run all the tasks concurrently on machines
with less cpu cores as it picks default worker capacity.
Explicitly specify worker capacity to avoid this.
2015-11-13 13:46:36 -08:00
Fangjin Yang
846bef3d7a Merge pull request #1964 from metamx/update-docker-stuff
update integration-test docker instructions for docker-machine
2015-11-12 16:52:57 -08:00
Xavier Léauté
bd7d2c9b3a update integration-test docker instructions for docker-machine 2015-11-12 16:44:28 -08:00