Peter Somogyi
7239ccb433
HBASE-22653 Do not run errorProne on JDK7 ( #651 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-09-22 20:35:50 +02:00
Sean Busbey
41990ba20a
HBASE-22955 Properly set jdk7 as JAVA_HOME for branches-1 precommit and nightly. ( #621 )
...
* leave Zulu JDKs at their normal location
* set JAVA_HOME in the dockerfile
* work around yetus setting a different JAVA_HOME
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2019-09-16 22:22:36 -05:00
Sean Busbey
20d7da50e9
HBASE-23023 upgrade shellcheck used in dockerfile ( #625 )
...
Signed-off-by: stack <stack@apache.org>
2019-09-14 14:03:32 -05:00
Peter Somogyi
99e7f60c7d
HBASE-23019 Handle --skip-errorprone on branch-1 ( #620 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Xu Cang <xcang@salesforce.com>
2019-09-13 20:26:26 +02:00
Peter Somogyi
1c0ee31809
HBASE-22981 Remove unused flags for Yetus ( #591 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-09-06 15:00:50 +02:00
Duo Zhang
157ffae07d
HBASE-22724 Add a emoji on the vote table for pre commit result on github ( #568 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Stack <stack@apache.org>
2019-09-04 09:06:30 +08:00
Gav
9ae12f5d4b
HBASE-22913 Use Hadoop label for nightly builds ( #532 )
...
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:55:03 +08:00
Sean Busbey
81ee53efc0
HBASE-22911 reduce concurrent PR builds.
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:31:14 +08:00
Artem Ervits
3b07221708
HBASE-22464 Improvements to hbase-vote script
...
* wget should use timestamps to avoid re-downloading RC artifacts we already have.
* allow changing to maven profiles other than runAllTests for test step
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 74fb2040ea
)
2019-08-23 12:47:44 -05:00
Duo Zhang
c066b06b7d
HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job ( #518 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-08-22 23:07:56 +08:00
Duo Zhang
21536f534b
HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error
2019-08-15 10:39:12 +08:00
Peter Somogyi
e7114f7bec
HBASE-22801 Maven build issue on Github PRs
2019-08-06 18:59:00 +02:00
Duo Zhang
28de85f364
HBASE-22719 Add debug support for github PR pre commit job
2019-07-22 13:49:48 +08:00
Josh Elser
3e779fcec3
HBASE-22563 Reduce old builds by half
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-10 19:18:04 -04:00
Sean Busbey
7611cc13dc
HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b4d5a9a8e1
)
2019-06-03 09:27:15 -05:00
zhangduo
8ef2fff2c1
HBASE-22506 Backport HBASE-22500 'Modify pom and jenkins jobs for hadoop versions' to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-03 10:09:28 +08:00
Peter Somogyi
68a01606ac
HBASE-22474 Add --mvn-custom-repo parameter to yetus calls
2019-05-26 18:13:44 +02:00
Guanghao Zhang
ef4cd68aeb
HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job
2019-05-24 12:13:36 +08:00
Guanghao Zhang
e86576ef0a
HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job
2019-05-24 12:13:32 +08:00
Duo Zhang
4ab2e1c094
HBASE-22413 Backport 'HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks' to branch-1
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-21 07:58:02 +08:00
Andrew Purtell
2a1b367845
HBASE-22430 hbase-vote should tee build and test output to console
2019-05-16 16:47:08 -07:00
Tak Lon (Stephen) Wu
4d577a0805
HBASE-22429 hbase-vote download step requires URL to end with '/' ( #243 )
2019-05-16 16:47:06 -07:00
Sean Busbey
58089be820
HBASE-22421 addendum remove bats
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-16 17:46:34 +02:00
Sean Busbey
1958b94f00
HBASE-22421 update ruby used to run rubocop on branch-1
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-15 08:35:27 +02:00
Sean Busbey
76858cf367
HBASE-22020 update nightly to yetus 0.9.0
...
Signed-off-by: stack <stack@apache.org>
2019-04-24 07:43:02 -05:00
Sean Busbey
3702e7f3de
HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
(cherry picked from commit 20ed78e6a4
)
2019-04-06 00:46:51 -05:00
Andrew Purtell
817d341474
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-05 14:38:06 -07:00
Apache9
fc9e2787a5
HBASE-22152 Addendum use hbase account instead of hadoop ( #112 )
2019-04-05 22:20:45 +08:00
Duo Zhang
aabcbbdef9
HBASE-22152 Create a jenkins file for yetus to processing GitHub PR
2019-04-04 22:15:53 +08:00
Andrew Purtell
5c32572a6e
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-03 16:32:02 -07:00
Andrew Purtell
38116c20e0
HBASE-22125 Fix more instances in make_rc.sh where we need -Dhttps.protocols=TLSv1.2
2019-03-28 10:36:20 -07:00
TAK LON WU
ee31b6a80b
HBASE-21963 Add a script for building and verifying release candidate
2019-03-18 20:09:55 +01:00
Peter Somogyi
cf87877fcf
HBASE-21711 Remove references to git.apache.org/hbase.git
2019-01-16 10:05:15 +01:00
Peter Somogyi
f9afd92548
HBASE-21547 Precommit uses master flaky list for other branches
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-02 08:41:46 +01:00
Michael Stack
9c47c74487
HBASE-21424 Change flakies and nightlies so scheduled less often
...
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
2018-11-01 10:13:46 -07:00
Sean Busbey
9050402ff2
HBASE-21103 nightly job should make sure cached yetus will run.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 5b6b85aed6
)
2018-10-11 10:33:03 -05:00
Mike Drob
ac94011677
HBASE-20764 build broken when latest commit is gpg signed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:53:34 -05:00
Sean Busbey
7f5de94ca9
HBASE-21189 flaky job should gather machine stats
...
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 5d14c1af65
)
2018-09-12 23:09:23 -05:00
Sean Busbey
0ac5999204
HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf'
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-08-21 09:47:12 -05:00
Sean Busbey
e500207503
HBASE-21074 JDK7 builds need to be done with TLSv1.2.
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-21 09:03:34 -05:00
Sean Busbey
8716ac2568
HBASE-20387 ADDENDUM backport findHangingTests.py changes from master to branches-1.
2018-08-16 23:55:28 -05:00
Sean Busbey
18840e9510
HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
...
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/Dockerfile
dev-support/Jenkinsfile
dev-support/flaky-tests/flaky-dashboard-template.html
dev-support/flaky-tests/report-flakies.py
For branches 1, includes a backport of the current version of report-flakies.py
and supporting files.
2018-08-16 23:24:11 -05:00
Andrew Purtell
203a3324e9
HBASE-20931 [branch-1] Add -Dhttps.protocols=TLSv1.2 to Maven command line in make_rc.sh
2018-07-24 15:04:08 -07:00
Mike Drob
61288f843c
HBASE-20905 pin pylint to 1.x in branch-1
2018-07-17 10:11:12 -05:00
Sean Busbey
43b51a36dd
HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-14 20:26:59 -05:00
Mike Drob
b86264156e
HBASE-19377 Update Java API CC version
...
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
2018-06-12 15:13:57 -05:00
Peter Somogyi
1f3957dda8
HBASE-20689 Docker fails to install rubocop for precommit
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-12 08:16:19 +02:00
Sean Busbey
d576e9a13f
HBASE-20501 update minimum supported Hadoop version to 2.7.1.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
src/main/asciidoc/_chapters/configuration.adoc
Conflicts:
dev-support/hbase-personality.sh
src/main/asciidoc/_chapters/configuration.adoc
2018-05-30 21:32:51 -05:00
Sean Busbey
416f28356c
HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:13:53 -05:00
Andrew Purtell
45d928e2c6
HBASE-20608 Remove build option of error prone profile for branch-1 after HBASE-12350
...
Disable our use of the errorProne profile for branch-1 in hbase-personality. It is
too taxing on the precommit builds.
2018-05-22 16:06:21 -07:00
Sean Busbey
9d35a70b15
HBASE-20591 nightly job needs to enable maven build system.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:43:34 -05:00
Sean Busbey
f37916253e
HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
...
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:34:16 -05:00
Sean Busbey
f70f47a032
HBASE-20335 ensure each stage of the nightly job gathers machine information.
...
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 23:18:50 -05:00
Sean Busbey
f6413d5594
HBASE-20379 shadedjars yetus plugin should add a footer link
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:49:35 -05:00
Sean Busbey
cad65df87e
HBASE-20112 register nightly junit over hadoop3 results with jenkins.
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:49:30 -05:00
Michael Stack
68726b0ee3
HBASE-20385 Purge md5-making from our little make_rc.sh script
2018-04-11 09:19:40 -07:00
Sean Busbey
ff3e562939
HBASE-20335 nightly job bash cleanup.
...
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:31:05 -05:00
Sean Busbey
358d451d96
HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:31:02 -05:00
Sean Busbey
de0dd9e821
HBASE-15466 test personality should recognize docs-only patch.
...
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:39:26 -05:00
Mike Drob
b54a439e50
HBASE-20153 Add error prone to precommit
2018-03-12 17:37:11 -05:00
Sean Busbey
55b3c0c21b
HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/Jenkinsfile
2018-03-09 17:24:23 -06:00
Mike Drob
eef6b36540
HBASE-20164 add hadoopcheck link to table footer
2018-03-09 15:41:56 -06:00
Sean Busbey
13519b8d6e
HBASE-18467 addendum parallel steps must account for SCM and marshalling results
...
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:24:57 -06:00
Sean Busbey
ac6af9f43a
HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/jenkins-scripts/generate-hbase-website.sh
2018-03-06 12:41:59 -06:00
Sean Busbey
2735f35b97
HBASE-20075 remove logic for branch-1.1 nightly testing
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:30:14 -06:00
Sean Busbey
01746c72ab
HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:30:10 -06:00
Sean Busbey
5102f5316c
HBASE-18467 report nightly results to devs via jira
...
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/Jenkinsfile
2018-03-01 13:15:35 -06:00
Alex Leblang
0cd89ed653
HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
...
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:56:51 -06:00
Josh Elser
15a2473b69
HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 10:01:19 -05:00
Michael Stack
a55f2c759b
HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM. Matching master and branch-2
2018-02-02 11:11:45 -08:00
Andrew Purtell
1a930cff6d
Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir"
...
This reverts commit b66a789ca3
.
2018-02-01 16:42:16 -08:00
Michael Stack
df317a7db3
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies
2018-01-30 22:27:49 -08:00
Michael Stack
b66a789ca3
HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir
2018-01-30 11:55:10 -08:00
Michael Stack
80f8a8d885
HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
...
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:37:09 -08:00
Apekshit Sharma
2e6bec6f2f
HBASE-19789 Not exclude flaky tests from nightly builds.
2018-01-16 10:10:48 -08:00
Apekshit Sharma
f547f6e7de
HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
...
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:45:18 -08:00
Apekshit Sharma
304b205246
HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE.
2017-12-21 10:55:50 -08:00
Apekshit Sharma
0a31209f91
HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master.
2017-12-20 18:00:23 -08:00
Apekshit Sharma
a1ec048d2d
HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck".
2017-12-13 00:40:26 -08:00
Andrew Purtell
14318d734e
HBASE-19420 Backport HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
...
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.
Slight modifications to developer.adoc for branch-1
2017-12-04 16:35:13 -08:00
Michael Stack
36a7029961
HBASE-19354 [branch-1] Build using a jdk that is beyond ubuntu trusty's openjdk-151
...
Amend our DockerFile so it gets jdks from azul repo.
2017-11-29 13:27:50 -08:00
Michael Stack
4fe4d755ce
HBASE-19368 [nightly] Make xml test non-voting in branch-1.2
2017-11-28 16:38:40 -08:00
Sean Busbey
bac254bd42
HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 23:12:19 -06:00
Sean Busbey
da8e6153d5
HBASE-19227 Nightly job should archive JVM dumpstream files.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-11 18:30:46 -06:00
Sean Busbey
a7447e015d
HBASE-19228 nightly job should gather machine stats.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:18 -06:00
Sean Busbey
17ac004add
HBASE-19189 Ad-hoc test job for running a subset of tests lots of times
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:12 -06:00
Sean Busbey
d1f8fc849a
HBASE-19184 Update nightly source artifact check to use git archive for making the tarball.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 09:03:32 -06:00
Andrew Purtell
c5ab70d193
HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1)
2017-11-07 12:35:46 -08:00
Sean Busbey
e61f6ff0ec
HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:33:22 -05:00
Sean Busbey
27d8a6d126
HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:32:48 -05:00
Sean Busbey
54497a88eb
HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:57:44 -05:00
Sean Busbey
3c62612374
HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:11:09 -05:00
Sean Busbey
19f74284c1
HBASE-19030 nightly runs should attempt to log test results after archiving.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:34:06 -05:00
Sean Busbey
490444c70d
HBASE-19070 temporarily make the mvnsite nightly test non-voting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:21:04 -05:00
Chia-Ping Tsai
39a791311a
HBASE-19066 Correct the directory of openjdk-8 for jenkins
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:21:37 -05:00
Chia-Ping Tsai
4bf71c3a1a
HBASE-19058. The wget isn't installed in building docker image
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:40:51 -05:00
Sean Busbey
be2daa12c8
HBASE-19039 refactor shadedjars test to only run on java changes.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:45:10 -05:00
Sean Busbey
6eb9f4ee8e
HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:45:03 -05:00
zhangduo
78014fdcc0
HBASE-19055 Backport HBASE-19042 to other active branches
2017-10-20 10:41:20 +08:00
Mike Drob
95e926100d
HBASE-19038 precommit mvn install should run from root on patch
2017-10-18 10:40:00 -05:00