Sean Busbey
d576e9a13f
HBASE-20501 update minimum supported Hadoop version to 2.7.1.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
src/main/asciidoc/_chapters/configuration.adoc
Conflicts:
dev-support/hbase-personality.sh
src/main/asciidoc/_chapters/configuration.adoc
2018-05-30 21:32:51 -05:00
Sean Busbey
416f28356c
HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:13:53 -05:00
Andrew Purtell
45d928e2c6
HBASE-20608 Remove build option of error prone profile for branch-1 after HBASE-12350
...
Disable our use of the errorProne profile for branch-1 in hbase-personality. It is
too taxing on the precommit builds.
2018-05-22 16:06:21 -07:00
Sean Busbey
9d35a70b15
HBASE-20591 nightly job needs to enable maven build system.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:43:34 -05:00
Sean Busbey
f37916253e
HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
...
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:34:16 -05:00
Sean Busbey
f70f47a032
HBASE-20335 ensure each stage of the nightly job gathers machine information.
...
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 23:18:50 -05:00
Sean Busbey
f6413d5594
HBASE-20379 shadedjars yetus plugin should add a footer link
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:49:35 -05:00
Sean Busbey
cad65df87e
HBASE-20112 register nightly junit over hadoop3 results with jenkins.
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:49:30 -05:00
Michael Stack
68726b0ee3
HBASE-20385 Purge md5-making from our little make_rc.sh script
2018-04-11 09:19:40 -07:00
Sean Busbey
ff3e562939
HBASE-20335 nightly job bash cleanup.
...
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:31:05 -05:00
Sean Busbey
358d451d96
HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:31:02 -05:00
Sean Busbey
de0dd9e821
HBASE-15466 test personality should recognize docs-only patch.
...
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:39:26 -05:00
Mike Drob
b54a439e50
HBASE-20153 Add error prone to precommit
2018-03-12 17:37:11 -05:00
Sean Busbey
55b3c0c21b
HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/Jenkinsfile
2018-03-09 17:24:23 -06:00
Mike Drob
eef6b36540
HBASE-20164 add hadoopcheck link to table footer
2018-03-09 15:41:56 -06:00
Sean Busbey
13519b8d6e
HBASE-18467 addendum parallel steps must account for SCM and marshalling results
...
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:24:57 -06:00
Sean Busbey
ac6af9f43a
HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/jenkins-scripts/generate-hbase-website.sh
2018-03-06 12:41:59 -06:00
Sean Busbey
2735f35b97
HBASE-20075 remove logic for branch-1.1 nightly testing
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:30:14 -06:00
Sean Busbey
01746c72ab
HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:30:10 -06:00
Sean Busbey
5102f5316c
HBASE-18467 report nightly results to devs via jira
...
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links
Signed-off-by: Mike Drob <mdrob@apache.org>
Conflicts:
dev-support/Jenkinsfile
2018-03-01 13:15:35 -06:00
Alex Leblang
0cd89ed653
HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
...
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:56:51 -06:00
Josh Elser
15a2473b69
HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 10:01:19 -05:00
Michael Stack
a55f2c759b
HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM. Matching master and branch-2
2018-02-02 11:11:45 -08:00
Andrew Purtell
1a930cff6d
Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir"
...
This reverts commit b66a789ca3
.
2018-02-01 16:42:16 -08:00
Michael Stack
df317a7db3
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies
2018-01-30 22:27:49 -08:00
Michael Stack
b66a789ca3
HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir
2018-01-30 11:55:10 -08:00
Michael Stack
80f8a8d885
HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
...
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:37:09 -08:00
Apekshit Sharma
2e6bec6f2f
HBASE-19789 Not exclude flaky tests from nightly builds.
2018-01-16 10:10:48 -08:00
Apekshit Sharma
f547f6e7de
HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
...
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:45:18 -08:00
Apekshit Sharma
304b205246
HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE.
2017-12-21 10:55:50 -08:00
Apekshit Sharma
0a31209f91
HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master.
2017-12-20 18:00:23 -08:00
Apekshit Sharma
a1ec048d2d
HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck".
2017-12-13 00:40:26 -08:00
Andrew Purtell
14318d734e
HBASE-19420 Backport HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
...
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.
Slight modifications to developer.adoc for branch-1
2017-12-04 16:35:13 -08:00
Michael Stack
36a7029961
HBASE-19354 [branch-1] Build using a jdk that is beyond ubuntu trusty's openjdk-151
...
Amend our DockerFile so it gets jdks from azul repo.
2017-11-29 13:27:50 -08:00
Michael Stack
4fe4d755ce
HBASE-19368 [nightly] Make xml test non-voting in branch-1.2
2017-11-28 16:38:40 -08:00
Sean Busbey
bac254bd42
HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 23:12:19 -06:00
Sean Busbey
da8e6153d5
HBASE-19227 Nightly job should archive JVM dumpstream files.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-11 18:30:46 -06:00
Sean Busbey
a7447e015d
HBASE-19228 nightly job should gather machine stats.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:18 -06:00
Sean Busbey
17ac004add
HBASE-19189 Ad-hoc test job for running a subset of tests lots of times
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:08:12 -06:00
Sean Busbey
d1f8fc849a
HBASE-19184 Update nightly source artifact check to use git archive for making the tarball.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 09:03:32 -06:00
Andrew Purtell
c5ab70d193
HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1)
2017-11-07 12:35:46 -08:00
Sean Busbey
e61f6ff0ec
HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:33:22 -05:00
Sean Busbey
27d8a6d126
HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:32:48 -05:00
Sean Busbey
54497a88eb
HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:57:44 -05:00
Sean Busbey
3c62612374
HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:11:09 -05:00
Sean Busbey
19f74284c1
HBASE-19030 nightly runs should attempt to log test results after archiving.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:34:06 -05:00
Sean Busbey
490444c70d
HBASE-19070 temporarily make the mvnsite nightly test non-voting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:21:04 -05:00
Chia-Ping Tsai
39a791311a
HBASE-19066 Correct the directory of openjdk-8 for jenkins
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:21:37 -05:00
Chia-Ping Tsai
4bf71c3a1a
HBASE-19058. The wget isn't installed in building docker image
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:40:51 -05:00
Sean Busbey
be2daa12c8
HBASE-19039 refactor shadedjars test to only run on java changes.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:45:10 -05:00
Sean Busbey
6eb9f4ee8e
HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:45:03 -05:00
zhangduo
78014fdcc0
HBASE-19055 Backport HBASE-19042 to other active branches
2017-10-20 10:41:20 +08:00
Mike Drob
95e926100d
HBASE-19038 precommit mvn install should run from root on patch
2017-10-18 10:40:00 -05:00
Apekshit Sharma
9908edc887
HBASE-19032 Set mimetype for patches uploaded by submit-patch.py
...
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
2017-10-17 15:44:12 -07:00
Mike Drob
aeffd3ad76
HBASE-18505 Yetus only run root when all modules changed
2017-10-13 12:13:01 -05:00
Sean Busbey
8d99b0cfe4
HBASE-18934 pick hadoop versions for precommit test after patch branch is determined.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-09 11:45:28 -05:00
Josh Elser
61173522db
HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality
2017-10-01 18:13:29 -05:00
Sean Busbey
c0b6aa5d20
HBASE-18833 Ensure precommit personality is up to date on all active branches
2017-09-20 06:00:07 -05:00
Tamas Penzes
50c67e9697
HBASE-18607: fix submit-patch.py to support utf8
...
one liner to support utf8 content
Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-08-25 00:04:57 -07:00
Sean Busbey
4279f0d2f0
HBASE-18527 Update nightly job to account for changes in jenkins plugins.
...
- Stop presuming job will be configured with checkout into a 'component' dir
- Disable autocheckout
- Specify checkout within 'component' dir
- leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:25:19 -05:00
Sean Busbey
695b30318e
HBASE-14220 nightly check that we can build a source tarball.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:17:58 -05:00
Sean Busbey
8c720ac688
HBASE-18426 nightly job should use independent stages to check supported jdks
...
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 12:12:58 -05:00
Alex Leblang
9b03c1424c
HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop
...
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems
Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-08-04 12:07:38 -05:00
Sean Busbey
6f1cc2c89f
HBASE-18147 POC jenkinsfile for nightly checks.
...
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile
Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-07-20 17:23:33 -05:00
zhangduo
395d9a08e3
HBASE-18159 Use OpenJDK7 instead of Oracle JDK7 in pre commit docker file
2017-06-06 09:43:48 +08:00
Josh Elser
58c504e701
HBASE-17985 Inline apt-get update calls in Yetus Dockerfile
2017-05-02 17:33:32 -04:00
zhangduo
e01ee2fd1d
HBASE-17074 PreCommit job always fails because of OOM
2016-11-15 08:29:44 +08:00
zhangduo
b2c5d84f7e
HBASE-16373 precommit needs a dockerfile with hbase prereq
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-10-03 11:04:45 -05:00
zhangduo
966aeb06a8
HBASE-16535 Use regex to exclude generated classes for findbugs
2016-08-31 14:42:38 +08:00
Dima Spivak
82ddc931fb
HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh
...
* Also some trivial cleanup of spacing to undo poor formatting decisions
of the past.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-19 07:30:10 -05:00
Dima Spivak
f280fa21fb
HBASE-15729 Remove old JDiff wrapper scripts in dev-support
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Conflicts:
dev-support/jdiffHBasePublicAPI.sh
2016-06-30 15:48:13 -05:00
Dima Spivak
7f56fb2de7
HBASE-16124 Make check_compatibility.sh less verbose when building HBase
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 15:48:13 -05:00
Dima Spivak
aa361a20ce
HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7
...
* This commit also fixes some stray tabs that got into the script at
some point.
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 15:48:13 -05:00
Dima Spivak
854e796ea9
HBASE-16073 update compatibility_checker for jacc dropping comma sep args
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 15:48:13 -05:00
Nick Dimiduk
13535f4d43
HBASE-15119 Include git SHA in check_compatibility reports
2016-06-30 15:48:13 -05:00
Elliott Clark
b6e2bc5ad1
HBASE-15725 make_patch.sh should add the branch name when -b is passed. -- addendum
2016-06-23 11:29:36 -07:00
Elliott Clark
c7e5672d4d
HBASE-15725 make_patch.sh should add the branch name when -b is passed.
2016-06-23 11:29:27 -07:00
Elliott Clark
28d1706d96
HBASE-14871 Allow specifying the base branch for make_patch
2016-06-23 11:29:20 -07:00
Apekshit
32258c2b3a
HBASE-15920 Backport submit-patch.py to branch-1 and earlier branches. This is combination of HBASE-15892 and HBASE-15909 and the fact that python-requirements.txt didn't exist in old branches. (Apekshit)
...
Change-Id: I35dba28c1053f26e1a5823195c22f22923dff007
Signed-off-by: stack <stack@apache.org>
2016-05-30 21:48:12 -07:00
Sean Busbey
77abf73549
HBASE-15895 Remove unmaintained jenkins build analysis tool.
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Dima Spivak <dspivak@cloudera.com>
Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Apekshit <apeksharma@gmail.com>
2016-05-27 16:41:25 -07:00
Nick Dimiduk
2c280c718a
HBASE-15738 Ensure artifacts in project dist area include required md5 file
2016-05-08 18:11:15 -07:00
stack
c0ad4cdd7a
HBASE-15021 hadoopqa doing false positives
2015-12-22 19:49:14 -08:00
stack
7ac9eb9d95
HBASE-15009 Update test-patch.sh on branches; to fix curtailed build report; ADDENDUM set +x permission on zombie script
2015-12-18 13:38:47 -08:00
stack
299ade435a
HBASE-15009 Update test-patch.sh on branches; to fix curtailed build report
2015-12-18 09:31:22 -08:00
Dima Spivak
9bf4777af5
HBASE-14930 check_compatibility.sh needs smarter exit codes
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-12-04 18:56:06 -08:00
stack
c936393591
HBASE-14349 pre-commit zombie finder is overly broad
2015-10-07 15:01:15 -07:00
Nick Dimiduk
58b3cfec0e
HBASE-14318 make_rc.sh should purge/re-resolve dependencies from local repository
2015-09-01 10:28:32 -07:00
Sean Busbey
9091409800
HBASE-14087 Ensure correct ASF headers for docs/code
...
* adds missing headers
* corrects some old-form headers to current
* restores proper header for guava copied LimitInputStream
* adds proper header for protobuf copied read/writeRawVarint
Conflicts:
bin/considerAsDead.sh
dev-support/rebase_all_git_branches.sh
2015-07-31 11:22:50 -07:00
Nick Dimiduk
a427f4c859
HBASE-13929 make_rc.sh publishes empty shaded artifacts
2015-06-17 19:40:34 -07:00
Gábor Lipták
9ee41bcd0a
HBASE-13666 Correct PDF renaming and bump version of maven-antrun-plugin
2015-06-17 19:00:21 -07:00
Nick Dimiduk
2f9851af26
HBASE-13761 Optimize FuzzyRowFilter (Vladimir Rodionov)
2015-05-28 10:17:46 -07:00
Nick Dimiduk
e69e55b3fd
HBASE-13600 check_compatibility.sh should ignore shaded jars
2015-04-30 11:57:25 -07:00
Andrew Purtell
019242abe4
HBASE-13341 Add option to disable filtering on interface annotations for the API compatibility report
2015-04-01 22:09:51 -07:00
Andrew Purtell
2d214c9e35
HBASE-13340 Include LimitedPrivate interfaces in the API compatibility report
2015-04-01 22:09:51 -07:00
Dima Spivak
4937dcad47
HBASE-12808 Use Java API Compliance Checker for binary/source compatibility
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-01 22:09:51 -07:00
Elliott Clark
650c9f27fd
HBASE-13342 Fix incorrect interface annotations
2015-03-27 00:22:04 -07:00
Andrew Purtell
387e4d20ab
HBASE-13059 Set executable bit for scripts in dev-support (Dima Spivak)
2015-02-17 13:39:38 -08:00
Enis Soztutar
b9f5c6b065
Commented out smart -p0 handling in dev-support/smart-apply-patch.sh until we fix our jenkins env
2015-01-29 15:39:29 -08:00
stack
fc2ef413fa
Add missing license
2014-10-23 21:47:18 -07:00
Misty Stanley-Jones
967f7e2b8d
HBASE-12249 Addendum - Convert tabs to spaces
2014-10-22 15:20:20 +10:00