Commit Graph

43 Commits

Author SHA1 Message Date
Gav d980770941 HBASE-22913 Use Hadoop label for nightly builds (#532)
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:54:37 +08:00
Josh Elser c3e49fc128 HBASE-22563 Reduce old builds by half
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-10 19:17:24 -04:00
Guanghao Zhang 9c74e612fe HBASE-22490 Nightly client integration test fails with hadoop-3 2019-05-31 22:27:25 +08:00
zhangduo 17b5904d37 HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test 2019-05-29 11:39:04 +08:00
Duo Zhang fe7a73c9e9 HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality
Signed-off-by: stack <stack@apache.org>
2019-05-18 14:03:33 -07:00
Sean Busbey 26c2ff6863 HBASE-22020 update nightly to yetus 0.9.0
Signed-off-by: stack <stack@apache.org>
(cherry picked from commit b5a6fd14fa)
2019-04-24 07:35:24 -05:00
Michael Stack 62d73d2068
HBASE-21424 Change flakies and nightlies so scheduled less often
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
2018-11-01 10:01:52 -07:00
Sean Busbey c9c7436482 HBASE-21103 nightly job should make sure cached yetus will run.
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 42d7ddc678)
2018-10-11 10:30:33 -05:00
Sean Busbey c1c12605ad HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-16 23:17:41 -05:00
Sean Busbey 0a4ae9fa94 HBASE-20334 add a test that verifies basic client and MR integration
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-18 14:03:51 -07:00
Sean Busbey 8a3b44a7e4 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:13:35 -05:00
Sean Busbey 29f492b344 HBASE-20591 nightly job needs to enable maven build system.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:43:21 -05:00
Sean Busbey 53eb0f60c5 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:31:36 -05:00
Sean Busbey dcd20e9cef HBASE-20335 ensure each stage of the nightly job gathers machine information.
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 22:45:19 -05:00
Sean Busbey d5d5c78849 HBASE-20112 register nightly junit over hadoop3 results with jenkins.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:48:05 -05:00
Sean Busbey 9bf087d28b HBASE-20335 nightly job bash cleanup.
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:30:49 -05:00
Sean Busbey b87165cbf7 HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:23:13 -06:00
Sean Busbey c99e6f7439 HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
Sean Busbey d4c4af09a1 HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
Sean Busbey 27642614b4 HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
Sean Busbey 44f1129234 HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-08 11:44:31 -06:00
Michael Stack bc735474a9 HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and
master
2018-03-03 07:33:25 -08:00
Michael Stack 8a1fca09cb HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:35:47 -08:00
Michael Stack 03a418ed39 HBASE-19891 Up nightly test run timeout from 6 hours to 8 2018-01-29 22:15:37 -08:00
Apekshit Sharma 130da9d18b HBASE-19860 Run branch-2 nightly job more frequently to help with flaky tests debugging 2018-01-24 20:00:30 -08:00
Apekshit Sharma e60d302b90 HBASE-19789 Not exclude flaky tests from nightly builds. 2018-01-16 10:09:50 -08:00
Apekshit Sharma f91589d305 HBASE-19789 Exclude flaky tests from nightly branch-2 runs 2018-01-12 16:24:45 -08:00
Apekshit Sharma b263eb5648 HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:44:33 -08:00
Apekshit Sharma a28156be94 HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE. 2017-12-21 10:55:12 -08:00
Apekshit Sharma 90ac3c93c9 HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master. 2017-12-20 17:59:27 -08:00
Sean Busbey d757e651c9 HBASE-19227 Nightly job should archive JVM dumpstream files.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 23:21:23 -06:00
Sean Busbey 4970b0ad06 HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 16:17:26 -06:00
Sean Busbey 1e4267f84d HBASE-19228 nightly job should gather machine stats.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:01 -06:00
Sean Busbey b9b0f15cdb HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:33:11 -05:00
Sean Busbey 20cc11e167 HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:32:35 -05:00
Sean Busbey 5a941d8f80 HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:57:33 -05:00
Sean Busbey aed0d6ce24 HBASE-19030 nightly runs should attempt to log test results after archiving.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:33:53 -05:00
Sean Busbey fe82a302be HBASE-19070 temporarily make the mvnsite nightly test non-voting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:20:51 -05:00
Chia-Ping Tsai bd98620c4f HBASE-19066 Correct the directory of openjdk-8 for jenkins
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:21:25 -05:00
Sean Busbey 7029c23b00 HBASE-18527 Update nightly job to account for changes in jenkins plugins.
- Stop presuming job will be configured with checkout into a 'component' dir
 - Disable autocheckout
 - Specify checkout within 'component' dir
 - leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:25:08 -05:00
Sean Busbey 69fddb58bd HBASE-14220 nightly check that we can build a source tarball.
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:08:51 -05:00
Sean Busbey db18a00b76 HBASE-18426 nightly job should use independent stages to check supported jdks
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 12:08:48 -05:00
Sean Busbey 3c8b364379 HBASE-18147 POC jenkinsfile for nightly checks.
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile

Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-08-06 12:08:34 -05:00