Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,040 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

301 Commits

Author SHA1 Message Date
Andrew Purtell 2a1b367845
HBASE-22430 hbase-vote should tee build and test output to console 2019-05-16 16:47:08 -07:00
Tak Lon (Stephen) Wu 4d577a0805
HBASE-22429 hbase-vote download step requires URL to end with '/' (#243) 2019-05-16 16:47:06 -07:00
Sean Busbey 58089be820 HBASE-22421 addendum remove bats 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-16 17:46:34 +02:00
Sean Busbey 1958b94f00 HBASE-22421 update ruby used to run rubocop on branch-1 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-15 08:35:27 +02:00
Sean Busbey 76858cf367 HBASE-22020 update nightly to yetus 0.9.0 
Signed-off-by: stack <stack@apache.org>
 2019-04-24 07:43:02 -05:00
Sean Busbey 3702e7f3de HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in 
Signed-off-by: Apekshit Sharma <appy@apache.org>
(cherry picked from commit 20ed78e6a4)
 2019-04-06 00:46:51 -05:00
Andrew Purtell 817d341474
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-05 14:38:06 -07:00
Apache9 fc9e2787a5 HBASE-22152 Addendum use hbase account instead of hadoop (#112) 2019-04-05 22:20:45 +08:00
Duo Zhang aabcbbdef9 HBASE-22152 Create a jenkins file for yetus to processing GitHub PR 2019-04-04 22:15:53 +08:00
Andrew Purtell 5c32572a6e
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-03 16:32:02 -07:00
Andrew Purtell 38116c20e0
HBASE-22125 Fix more instances in make_rc.sh where we need -Dhttps.protocols=TLSv1.2 2019-03-28 10:36:20 -07:00
TAK LON WU ee31b6a80b HBASE-21963 Add a script for building and verifying release candidate 2019-03-18 20:09:55 +01:00
Peter Somogyi cf87877fcf HBASE-21711 Remove references to git.apache.org/hbase.git 2019-01-16 10:05:15 +01:00
Peter Somogyi f9afd92548 HBASE-21547 Precommit uses master flaky list for other branches 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-02 08:41:46 +01:00
Michael Stack 9c47c74487
HBASE-21424 Change flakies and nightlies so scheduled less often 
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
 2018-11-01 10:13:46 -07:00
Sean Busbey 9050402ff2 HBASE-21103 nightly job should make sure cached yetus will run. 
Signed-off-by: Mike Drob <mdrob@apache.org>
(cherry picked from commit 5b6b85aed6)
 2018-10-11 10:33:03 -05:00
Mike Drob ac94011677
HBASE-20764 build broken when latest commit is gpg signed 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-08 19:53:34 -05:00
Sean Busbey 7f5de94ca9 HBASE-21189 flaky job should gather machine stats 
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 5d14c1af65)
 2018-09-12 23:09:23 -05:00
Sean Busbey 0ac5999204 HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf' 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-08-21 09:47:12 -05:00
Sean Busbey e500207503 HBASE-21074 JDK7 builds need to be done with TLSv1.2. 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-21 09:03:34 -05:00
Sean Busbey 8716ac2568 HBASE-20387 ADDENDUM backport findHangingTests.py changes from master to branches-1. 2018-08-16 23:55:28 -05:00
Sean Busbey 18840e9510 HBASE-20387 turn flaky test tracking infra into per-branch pipeline. 
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Dockerfile
	dev-support/Jenkinsfile
	dev-support/flaky-tests/flaky-dashboard-template.html
	dev-support/flaky-tests/report-flakies.py

For branches 1, includes a backport of the current version of report-flakies.py
and supporting files.
 2018-08-16 23:24:11 -05:00
Andrew Purtell 203a3324e9 HBASE-20931 [branch-1] Add -Dhttps.protocols=TLSv1.2 to Maven command line in make_rc.sh 2018-07-24 15:04:08 -07:00
Mike Drob 61288f843c HBASE-20905 pin pylint to 1.x in branch-1 2018-07-17 10:11:12 -05:00
Sean Busbey 43b51a36dd HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-14 20:26:59 -05:00
Mike Drob b86264156e HBASE-19377 Update Java API CC version 
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
 2018-06-12 15:13:57 -05:00
Peter Somogyi 1f3957dda8 HBASE-20689 Docker fails to install rubocop for precommit 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-06-12 08:16:19 +02:00
Sean Busbey d576e9a13f HBASE-20501 update minimum supported Hadoop version to 2.7.1. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

 Conflicts:
	src/main/asciidoc/_chapters/configuration.adoc

 Conflicts:
	dev-support/hbase-personality.sh
	src/main/asciidoc/_chapters/configuration.adoc
 2018-05-30 21:32:51 -05:00
Sean Busbey 416f28356c HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-05-24 13:13:53 -05:00
Andrew Purtell 45d928e2c6 HBASE-20608 Remove build option of error prone profile for branch-1 after HBASE-12350 
Disable our use of the errorProne profile for branch-1 in hbase-personality. It is
too taxing on the precommit builds.
 2018-05-22 16:06:21 -07:00
Sean Busbey 9d35a70b15 HBASE-20591 nightly job needs to enable maven build system. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-05-22 17:43:34 -05:00
Sean Busbey f37916253e HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from. 
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-14 21:34:16 -05:00
Sean Busbey f70f47a032 HBASE-20335 ensure each stage of the nightly job gathers machine information. 
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 23:18:50 -05:00
Sean Busbey f6413d5594 HBASE-20379 shadedjars yetus plugin should add a footer link 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 10:49:35 -05:00
Sean Busbey cad65df87e HBASE-20112 register nightly junit over hadoop3 results with jenkins. 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 10:49:30 -05:00
Michael Stack 68726b0ee3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:19:40 -07:00
Sean Busbey ff3e562939 HBASE-20335 nightly job bash cleanup. 
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-11 01:31:05 -05:00
Sean Busbey 358d451d96 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven. 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
 2018-04-11 01:31:02 -05:00
Sean Busbey de0dd9e821 HBASE-15466 test personality should recognize docs-only patch. 
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-09 10:39:26 -05:00
Mike Drob b54a439e50 HBASE-20153 Add error prone to precommit 2018-03-12 17:37:11 -05:00
Sean Busbey 55b3c0c21b HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace 
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
 2018-03-09 17:24:23 -06:00
Mike Drob eef6b36540 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:41:56 -06:00
Sean Busbey 13519b8d6e HBASE-18467 addendum parallel steps must account for SCM and marshalling results 
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-07 22:24:57 -06:00
Sean Busbey ac6af9f43a HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp. 
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/jenkins-scripts/generate-hbase-website.sh
 2018-03-06 12:41:59 -06:00
Sean Busbey 2735f35b97 HBASE-20075 remove logic for branch-1.1 nightly testing 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-01 15:30:14 -06:00
Sean Busbey 01746c72ab HBASE-15151 ensure findbugs check runs in nightly tests on all branches. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-01 15:30:10 -06:00
Sean Busbey 5102f5316c HBASE-18467 report nightly results to devs via jira 
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	dev-support/Jenkinsfile
 2018-03-01 13:15:35 -06:00
Alex Leblang 0cd89ed653 HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found 
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-02-28 11:56:51 -06:00
Josh Elser 15a2473b69 HBASE-20089 Use the ASF recommended naming for SHA512 xsum files 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-02-27 10:01:19 -05:00
Michael Stack a55f2c759b HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM. Matching master and branch-2 2018-02-02 11:11:45 -08:00
Andrew Purtell 1a930cff6d Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir" 
This reverts commit b66a789ca3.
 2018-02-01 16:42:16 -08:00
Michael Stack df317a7db3 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies 2018-01-30 22:27:49 -08:00
Michael Stack b66a789ca3 HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir 2018-01-30 11:55:10 -08:00
Michael Stack 80f8a8d885 HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0 
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
 2018-01-29 22:37:09 -08:00
Apekshit Sharma 2e6bec6f2f HBASE-19789 Not exclude flaky tests from nightly builds. 2018-01-16 10:10:48 -08:00
Apekshit Sharma f547f6e7de HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs. 
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
 2017-12-21 17:45:18 -08:00
Apekshit Sharma 304b205246 HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE. 2017-12-21 10:55:50 -08:00
Apekshit Sharma 0a31209f91 HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master. 2017-12-20 18:00:23 -08:00
Apekshit Sharma a1ec048d2d HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". 2017-12-13 00:40:26 -08:00
Andrew Purtell 14318d734e HBASE-19420 Backport HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script 
Removes src.xml used building src tgz via hbase-assembly.

Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.

Slight modifications to developer.adoc for branch-1
 2017-12-04 16:35:13 -08:00
Michael Stack 36a7029961
HBASE-19354 [branch-1] Build using a jdk that is beyond ubuntu trusty's openjdk-151 
Amend our DockerFile so it gets jdks from azul repo.
 2017-11-29 13:27:50 -08:00
Michael Stack 4fe4d755ce
HBASE-19368 [nightly] Make xml test non-voting in branch-1.2 2017-11-28 16:38:40 -08:00
Sean Busbey bac254bd42 HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-13 23:12:19 -06:00
Sean Busbey da8e6153d5 HBASE-19227 Nightly job should archive JVM dumpstream files. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-11 18:30:46 -06:00
Sean Busbey a7447e015d HBASE-19228 nightly job should gather machine stats. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-09 15:08:18 -06:00
Sean Busbey 17ac004add HBASE-19189 Ad-hoc test job for running a subset of tests lots of times 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-09 15:08:12 -06:00
Sean Busbey d1f8fc849a HBASE-19184 Update nightly source artifact check to use git archive for making the tarball. 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-09 09:03:32 -06:00
Andrew Purtell c5ab70d193 HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1) 2017-11-07 12:35:46 -08:00
Sean Busbey e61f6ff0ec HBASE-19097 update nightly tests to use Apache Yetus 0.6.0 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-03 15:33:22 -05:00
Sean Busbey 27d8a6d126 HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script. 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-11-02 15:32:48 -05:00
Sean Busbey 54497a88eb HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-11-01 09:57:44 -05:00
Sean Busbey 3c62612374 HBASE-19098 compatibility checker should handle remotes named something other than 'origin'. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-10-26 16:11:09 -05:00
Sean Busbey 19f74284c1 HBASE-19030 nightly runs should attempt to log test results after archiving. 
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2017-10-25 10:34:06 -05:00
Sean Busbey 490444c70d HBASE-19070 temporarily make the mvnsite nightly test non-voting. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-24 12:21:04 -05:00
Chia-Ping Tsai 39a791311a HBASE-19066 Correct the directory of openjdk-8 for jenkins 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-10-24 09:21:37 -05:00
Chia-Ping Tsai 4bf71c3a1a HBASE-19058. The wget isn't installed in building docker image 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-10-20 20:40:51 -05:00
Sean Busbey be2daa12c8 HBASE-19039 refactor shadedjars test to only run on java changes. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-20 19:45:10 -05:00
Sean Busbey 6eb9f4ee8e HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-20 19:45:03 -05:00
zhangduo 78014fdcc0 HBASE-19055 Backport HBASE-19042 to other active branches 2017-10-20 10:41:20 +08:00
Mike Drob 95e926100d HBASE-19038 precommit mvn install should run from root on patch 2017-10-18 10:40:00 -05:00
Apekshit Sharma 9908edc887 HBASE-19032 Set mimetype for patches uploaded by submit-patch.py 
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
 2017-10-17 15:44:12 -07:00
Mike Drob aeffd3ad76 HBASE-18505 Yetus only run root when all modules changed 2017-10-13 12:13:01 -05:00
Sean Busbey 8d99b0cfe4 HBASE-18934 pick hadoop versions for precommit test after patch branch is determined. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2017-10-09 11:45:28 -05:00
Josh Elser 61173522db HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality 2017-10-01 18:13:29 -05:00
Sean Busbey c0b6aa5d20 HBASE-18833 Ensure precommit personality is up to date on all active branches 2017-09-20 06:00:07 -05:00
Tamas Penzes 50c67e9697 HBASE-18607: fix submit-patch.py to support utf8 
one liner to support utf8 content

Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-08-25 00:04:57 -07:00
Sean Busbey 4279f0d2f0 HBASE-18527 Update nightly job to account for changes in jenkins plugins. 
- Stop presuming job will be configured with checkout into a 'component' dir
 - Disable autocheckout
 - Specify checkout within 'component' dir
 - leave the workspace around on pipeline failure so we can browse it.
 2017-08-07 11:25:19 -05:00
Sean Busbey 695b30318e HBASE-14220 nightly check that we can build a source tarball. 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-08-06 12:17:58 -05:00
Sean Busbey 8c720ac688 HBASE-18426 nightly job should use independent stages to check supported jdks 
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step

Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-08-06 12:12:58 -05:00
Alex Leblang 9b03c1424c HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop 
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems

Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey

Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2017-08-04 12:07:38 -05:00
Sean Busbey 6f1cc2c89f HBASE-18147 POC jenkinsfile for nightly checks. 
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile

Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
 2017-07-20 17:23:33 -05:00
zhangduo 395d9a08e3 HBASE-18159 Use OpenJDK7 instead of Oracle JDK7 in pre commit docker file 2017-06-06 09:43:48 +08:00
Josh Elser 58c504e701 HBASE-17985 Inline apt-get update calls in Yetus Dockerfile 2017-05-02 17:33:32 -04:00
zhangduo e01ee2fd1d HBASE-17074 PreCommit job always fails because of OOM 2016-11-15 08:29:44 +08:00
zhangduo b2c5d84f7e HBASE-16373 precommit needs a dockerfile with hbase prereq 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-10-03 11:04:45 -05:00
zhangduo 966aeb06a8 HBASE-16535 Use regex to exclude generated classes for findbugs 2016-08-31 14:42:38 +08:00
Dima Spivak 82ddc931fb HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh 
* Also some trivial cleanup of spacing to undo poor formatting decisions
  of the past.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-07-19 07:30:10 -05:00
Dima Spivak f280fa21fb HBASE-15729 Remove old JDiff wrapper scripts in dev-support 
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	dev-support/jdiffHBasePublicAPI.sh
 2016-06-30 15:48:13 -05:00
Dima Spivak 7f56fb2de7 HBASE-16124 Make check_compatibility.sh less verbose when building HBase 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-06-30 15:48:13 -05:00
Dima Spivak aa361a20ce HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7 
* This commit also fixes some stray tabs that got into the script at
  some point.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-06-30 15:48:13 -05:00