Commit Graph

41 Commits

Author SHA1 Message Date
stack 6aa4a1cecc HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:46:03 -07:00
Duo Zhang cf02e6f59a HBASE-23236 Upgrade to yetus 0.11.1
Signed-off-by: stack <stack@apache.org>
2019-11-08 13:48:26 +08:00
Peter Somogyi 558d835654 HBASE-23053 Disable concurrent nightly builds (#654)
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-10-10 20:15:20 +02:00
Peter Somogyi 6c5df7a564 HBASE-23114 Use archiveArtifacts in Jenkinsfiles (#681)
Signed-off-by: Michael Stack <stack@apache.org>
2019-10-10 19:50:20 +02:00
Peter Somogyi 7239ccb433
HBASE-22653 Do not run errorProne on JDK7 (#651)
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-09-22 20:35:50 +02:00
Sean Busbey 41990ba20a HBASE-22955 Properly set jdk7 as JAVA_HOME for branches-1 precommit and nightly. (#621)
* leave Zulu JDKs at their normal location
* set JAVA_HOME in the dockerfile
* work around yetus setting a different JAVA_HOME

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2019-09-16 22:22:36 -05:00
Duo Zhang 157ffae07d HBASE-22724 Add a emoji on the vote table for pre commit result on github (#568)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Stack <stack@apache.org>
2019-09-04 09:06:30 +08:00
Gav 9ae12f5d4b HBASE-22913 Use Hadoop label for nightly builds (#532)
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:55:03 +08:00
Josh Elser 3e779fcec3 HBASE-22563 Reduce old builds by half
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-10 19:18:04 -04:00
Sean Busbey 76858cf367 HBASE-22020 update nightly to yetus 0.9.0
Signed-off-by: stack <stack@apache.org>
2019-04-24 07:43:02 -05:00
Sean Busbey 9050402ff2 HBASE-21103 nightly job should make sure cached yetus will run.
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 5b6b85aed6)
2018-10-11 10:33:03 -05:00
Sean Busbey 18840e9510 HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Dockerfile
	dev-support/Jenkinsfile
	dev-support/flaky-tests/flaky-dashboard-template.html
	dev-support/flaky-tests/report-flakies.py

For branches 1, includes a backport of the current version of report-flakies.py
and supporting files.
2018-08-16 23:24:11 -05:00
Sean Busbey 416f28356c HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:13:53 -05:00
Sean Busbey 9d35a70b15 HBASE-20591 nightly job needs to enable maven build system.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:43:34 -05:00
Sean Busbey f37916253e HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:34:16 -05:00
Sean Busbey f70f47a032 HBASE-20335 ensure each stage of the nightly job gathers machine information.
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 23:18:50 -05:00
Sean Busbey cad65df87e HBASE-20112 register nightly junit over hadoop3 results with jenkins.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:49:30 -05:00
Sean Busbey ff3e562939 HBASE-20335 nightly job bash cleanup.
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:31:05 -05:00
Sean Busbey 55b3c0c21b HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
2018-03-09 17:24:23 -06:00
Sean Busbey 13519b8d6e HBASE-18467 addendum parallel steps must account for SCM and marshalling results
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:24:57 -06:00
Sean Busbey 2735f35b97 HBASE-20075 remove logic for branch-1.1 nightly testing
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:30:14 -06:00
Sean Busbey 01746c72ab HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:30:10 -06:00
Sean Busbey 5102f5316c HBASE-18467 report nightly results to devs via jira
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
2018-03-01 13:15:35 -06:00
Michael Stack 80f8a8d885 HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:37:09 -08:00
Apekshit Sharma 2e6bec6f2f HBASE-19789 Not exclude flaky tests from nightly builds. 2018-01-16 10:10:48 -08:00
Apekshit Sharma f547f6e7de HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:45:18 -08:00
Apekshit Sharma 304b205246 HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE. 2017-12-21 10:55:50 -08:00
Apekshit Sharma 0a31209f91 HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master. 2017-12-20 18:00:23 -08:00
Michael Stack 4fe4d755ce
HBASE-19368 [nightly] Make xml test non-voting in branch-1.2 2017-11-28 16:38:40 -08:00
Sean Busbey da8e6153d5 HBASE-19227 Nightly job should archive JVM dumpstream files.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-11 18:30:46 -06:00
Sean Busbey a7447e015d HBASE-19228 nightly job should gather machine stats.
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:18 -06:00
Sean Busbey e61f6ff0ec HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:33:22 -05:00
Sean Busbey 27d8a6d126 HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:32:48 -05:00
Sean Busbey 54497a88eb HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:57:44 -05:00
Sean Busbey 19f74284c1 HBASE-19030 nightly runs should attempt to log test results after archiving.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:34:06 -05:00
Sean Busbey 490444c70d HBASE-19070 temporarily make the mvnsite nightly test non-voting.
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:21:04 -05:00
Chia-Ping Tsai 39a791311a HBASE-19066 Correct the directory of openjdk-8 for jenkins
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:21:37 -05:00
Sean Busbey 4279f0d2f0 HBASE-18527 Update nightly job to account for changes in jenkins plugins.
- Stop presuming job will be configured with checkout into a 'component' dir
 - Disable autocheckout
 - Specify checkout within 'component' dir
 - leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:25:19 -05:00
Sean Busbey 695b30318e HBASE-14220 nightly check that we can build a source tarball.
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:17:58 -05:00
Sean Busbey 8c720ac688 HBASE-18426 nightly job should use independent stages to check supported jdks
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step

Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 12:12:58 -05:00
Sean Busbey 6f1cc2c89f HBASE-18147 POC jenkinsfile for nightly checks.
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile

Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-07-20 17:23:33 -05:00