Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,502 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

512 Commits

Author SHA1 Message Date
Duo Zhang 4b99816dd6
HBASE-23182 The create-release scripts are broken (#736) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2019-11-19 08:28:43 +08:00
Sean Busbey d5dcc090c1
HBASE-23228 Allow for jdk8 specific modules on branch-1 in precommit/nightly testing (#804) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-11-08 10:07:24 -06:00
Duo Zhang b53e9a325c HBASE-23236 Upgrade to yetus 0.11.1 
Signed-off-by: stack <stack@apache.org>
 2019-11-08 13:47:54 +08:00
Peter Somogyi fd9cfd789b
HBASE-23114 Use archiveArtifacts in Jenkinsfiles (#681) 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-10-10 13:27:50 +02:00
Michael Stack 57439e5bf5
HBASE-23137 [create-release] Add passing of PROJECT variable for when building other than core (#701) 2019-10-08 15:12:14 -07:00
Frederick Ayala 95c9911a9c HBASE-23031 Upgrade Yetus version in RM scripts (#692) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-10-06 11:24:35 +02:00
stack f69e7705e0 HBASE-23121 create-release is not pushing artifacts to repository.a.o 2019-10-04 15:32:17 -07:00
Duo Zhang f08a310ed9
HBASE-23118 [RELEASE SCRIPTS] Allow creating a RC from an existing tag[RELEASE SCRIPTS] Allow creating a RC from an existing tag (#686) 
Signed-off-by: stack <stack@apache.org>
 2019-10-04 13:39:27 +08:00
Michael Stack 7ee6d59ef8
HBASE-23092 Make the RM tooling in dev-tools/create-release generic (#671) 
Make the scripts generic. Adds an option that allows you specify
'project'. Defaults to 'hbase' for core. Pass 'hbase-thirdparty'
or 'hbase-operator-tools' etc.

This commit includes a bunch of bugfixes and miscellaneous
that came of trying to use the scripts making RCs.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-10-02 09:14:17 -07:00
Peter Somogyi 56489819bc
HBASE-23053 Disable concurrent nightly builds (#654) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-09-23 15:00:22 +02:00
Sean Busbey bcad0d9f98 HBASE-22955 Properly set jdk7 as JAVA_HOME for branches-1 precommit and nightly. (#621) 
master/branches-2 specific changes: work around yetus overwriting JAVA_HOME
in the container with the host JAVA_HOME.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 41990ba20a)
 2019-09-16 22:51:24 -05:00
Sean Busbey 1cb4f687c1
HBASE-23023 upgrade shellcheck used in dockerfile (#624) 
Signed-off-by: stack <stack@apache.org>
 2019-09-14 14:03:02 -05:00
Peter Somogyi 51b6ce391b
HBASE-22981 Remove unused flags for Yetus (#591) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-09-06 14:56:05 +02:00
Duo Zhang dfe5280d0c HBASE-22724 Addendum trim trailing spaces 2019-09-04 09:03:58 +08:00
Duo Zhang da144888d0
HBASE-22724 Add a emoji on the vote table for pre commit result on github (#568) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Stack <stack@apache.org>
 2019-09-04 08:52:28 +08:00
Rushabh 0438fdc0f6 HBASE-22852 Stop gpg agent daemons in hbase nightlies. (#525) 
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-26 16:30:22 -05:00
Gav 89e54f2899 HBASE-22913 Use Hadoop label for nightly builds (#532) 
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-24 16:51:26 +08:00
Sean Busbey 94155fe175 HBASE-22911 reduce concurrent PR builds. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-24 16:30:36 +08:00
meiyi 3b16ae2720 HBASE-22625 documet use scan snapshot feature (#496) 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-08-23 15:04:53 -07:00
Artem Ervits 74fb2040ea HBASE-22464 Improvements to hbase-vote script 
* wget should use timestamps to avoid re-downloading RC artifacts we already have.
* allow changing to maven profiles other than runAllTests for test step

Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-23 12:44:58 -05:00
Duo Zhang 288d1f2769
HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job (#518) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-22 23:07:05 +08:00
Duo Zhang d9d5f69fc6 HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error 2019-08-15 10:14:08 +08:00
stack 53db390f60 HBASE-22854 Remove +x shell spew from do-release-*.sh create-release scripts 2019-08-14 10:05:41 -07:00
Peter Somogyi 9d8271624e HBASE-22801 Maven build issue on Github PRs 2019-08-06 18:57:14 +02:00
Duo Zhang c9293b0b12 HBASE-22719 Add debug support for github PR pre commit job 2019-07-22 13:49:27 +08:00
stack ef44f30006 HBASE-21953 Point make_rc.sh at ./create-release/do-release-docker.sh instead 2019-06-12 07:54:30 -07:00
stack 8745d5e7e8 HBASE-21935 Replace make_rc.sh with customized spark/dev/create-release 
These scripts came originally from spark [1]. They were then
modified to suit hbase context. Supercedes the old
../make_rc.sh script because what is here is more comprehensive
doing more steps of the RM process as well as running in a
container so the RM build environment can be a constant.

It:
 * Tags release
 * Updates RELEASENOTES.md and CHANGES.md.
 * Sets version to the release version
 * Sets version to next SNAPSHOT version.
 * Builds, signs, and hashes all artifacts.
 * Generates the API report.
 * Pushes release tgzs to the dev dir in a apache dist.
 * Pushes to repository.apache.org staging.
 * Generates a vote email with filled-in fields.

The entry point is the do-release-docker.sh script. Pass -h to
see available options. For example, running below will do all
steps above using the 'rm' dir under Downloads as workspace:

 $ ./do-release-docker.sh  -d ~/Downloads/rm

1. https://github.com/apache/spark/tree/master/dev/create-release

Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-12 07:53:49 -07:00
Josh Elser 2f9d995163 HBASE-22563 Reduce old builds by half 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-06-10 18:49:16 -04:00
Sean Busbey b4d5a9a8e1 HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 09:16:34 -05:00
Sean Busbey 51c49a1784 HBASE-22497 Mark HBase 1.2 line as EOM 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 06:55:58 -05:00
Guanghao Zhang ab99e2486e HBASE-22522 The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows." 2019-06-02 22:07:49 +08:00
Guanghao Zhang 12584ebf46 HBASE-22490 (addendum) Nightly client integration test fails with hadoop-3 2019-05-31 14:46:16 +08:00
Duo Zhang e4f4ae835f HBASE-22500 Modify pom and jenkins jobs for hadoop versions 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-30 22:31:32 +08:00
Guanghao 70fb30cd56
HBASE-22490 Nightly client integration test fails with hadoop-3.0.3 2019-05-30 10:29:40 +08:00
zhangduo e919ca6ca7 HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test 2019-05-28 22:57:50 +08:00
Peter Somogyi 83b8472c9a HBASE-22474 Add --mvn-custom-repo parameter to yetus calls 2019-05-26 18:11:22 +02:00
Guanghao Zhang de579cd243 HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 09:23:20 +08:00
Guanghao Zhang 6b899ccbbc HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-23 20:57:23 +08:00
zhangduo b74df9b747 HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:54:29 +08:00
Duo Zhang 5a578f953b HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-05-17 10:01:51 +08:00
Andrew Purtell e1d023d54c
HBASE-22430 hbase-vote should tee build and test output to console 2019-05-16 16:45:53 -07:00
Tak Lon (Stephen) Wu 25a1c5a619 HBASE-22429 hbase-vote download step requires URL to end with '/' (#243) 2019-05-16 16:43:27 -07:00
Duo Zhang 083605df8f HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:20 +08:00
Sean Busbey 60dc5143f2 HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-05-13 11:21:16 -05:00
Sean Busbey b5a6fd14fa HBASE-22020 update nightly to yetus 0.9.0 
Signed-off-by: stack <stack@apache.org>
 2019-04-24 07:31:45 -05:00
zhangduo 86f9443eeb HBASE-22174 Remove error prone from our precommit javac check 2019-04-06 13:51:02 +08:00
Andrew Purtell 6abf408f33
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-05 14:36:52 -07:00
Apache9 28d1b76292 HBASE-22152 Addendum use hbase account instead of hadoop (#112) 2019-04-05 20:57:30 +08:00
Duo Zhang 5cc10c9a6d HBASE-22152 Create a jenkins file for yetus to processing GitHub PR 2019-04-04 22:15:20 +08:00
Andrew Purtell 49cfecb13d
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-03 16:30:20 -07:00
zhangduo c8d04cf127 HBASE-22100 False positive for error prone warnings in pre commit job 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-03-28 13:06:26 +08:00
TAK LON WU d4086bf5af HBASE-21963 Add a script for building and verifying release candidate 2019-03-18 19:55:50 +01:00
stack e536e6a2aa HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check 2019-03-13 13:01:30 -07:00
Peter Somogyi 400276e3ec HBASE-21711 Remove references to git.apache.org/hbase.git 2019-01-16 10:02:13 +01:00
Tommy Li 5675bb8542 HBASE-21712 Make submit-patch.py python3 compatible - ADDENDUM 
add future to python reqs
 2019-01-16 09:24:47 +01:00
Tommy Li 63a1fcbe46 HBASE-21712 : Make submit-patch.py python3 compatible 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-14 14:50:50 -08:00
Peter Somogyi 9158792265 HBASE-21685 Change repository urls to Gitbox 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-09 19:01:06 +01:00
Peter Somogyi 7377fcd29b Revert "HBASE-21668 SCM fetch times out for nightlies" 
This reverts commit 84c1f0887d.
 2019-01-08 08:46:46 +01:00
Peter Somogyi 84c1f0887d HBASE-21668 SCM fetch times out for nightlies 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-07 21:56:42 +01:00
Peter Somogyi f0b50a8f9b HBASE-21547 Precommit uses master flaky list for other branches 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-02 08:26:57 +01:00
Michael Stack 54172c9890 HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove exception for scala files in findbugs now that we don't have any.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
(cherry picked from commit 2792253322)
 2018-11-08 08:50:03 -06:00
Sean Busbey 56bd0a1864 Revert "HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide" 
This reverts commit 2792253322.

Bad commit metadata.
 2018-11-08 08:47:03 -06:00
Michael Stack 468c1e77bf HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove spark reference in dev-support findbugs excludes.
 2018-11-07 08:27:29 -08:00
Wellington Chevreuil 2792253322 HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-11-07 08:08:02 -08:00
Michael Stack ee55b558c0
HBASE-21424 Change flakies and nightlies so scheduled less often 
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
 2018-11-01 10:06:53 -07:00
Sean Busbey 42d7ddc678 HBASE-21103 nightly job should make sure cached yetus will run. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-10-11 10:29:07 -05:00
Mike Drob c9213f752e
HBASE-20764 build broken when latest commit is gpg signed 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-08 19:49:36 -05:00
Sean Busbey 5d14c1af65 HBASE-21189 flaky job should gather machine stats 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-09-12 23:08:31 -05:00
Sean Busbey 588ff921c1 HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf' 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-08-21 09:45:26 -05:00
Sean Busbey 23d54f8587 HBASE-21074 JDK7 builds need to be done with TLSv1.2. 
* for master and branches-2 we skip the jdk7 stuff

Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-21 09:14:48 -05:00
Sean Busbey f9793fafb7 HBASE-20387 turn flaky test tracking infra into per-branch pipeline. 
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-08-16 23:16:21 -05:00
Sean Busbey 346dd32185 HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-14 13:13:51 -05:00
Ankit Singhal 2eee7a3f8b HBASE-20910 Fix dev-support/submit-patch.py by opening file with 'b' mode 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-07-20 15:31:11 -07:00
Yu Li c55acb0b03 HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed 2018-07-12 10:16:11 +08:00
Sean Busbey 78da0e3669 HBASE-20334 add a test that verifies basic client and MR integration 2018-06-18 11:31:13 -07:00
Sean Busbey 04db900772 HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-14 20:24:29 -05:00
Mike Drob 8648af07d4
HBASE-19377 Update Java API CC version 
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
 2018-06-12 14:19:13 -05:00
Peter Somogyi b002b0b8b0 HBASE-20689 Docker fails to install rubocop for precommit 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-06-06 23:51:07 +02:00
Sean Busbey c19fbf2be0 HBASE-20501 update minimum supported Hadoop version to 2.7.1. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-30 21:22:42 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
Sean Busbey 1792f541c6 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-05-24 13:04:50 -05:00
Sean Busbey dace8ff2a4 HBASE-20591 nightly job needs to enable maven build system. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-05-22 17:40:56 -05:00
Mike Drob e6220c8b60 Revert "HBASE-20478 move hbaseanti import checks to checkstyle" 
Need to update version of checkstyle used for new features.

This reverts commit 90d103d6d5.
 2018-04-26 13:36:13 -05:00
Mike Drob 90d103d6d5 HBASE-20478 move hbaseanti import checks to checkstyle 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 09:28:59 -05:00
Nihal Jain d4768114e8 HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 07:54:25 -05:00
Sean Busbey f4a39043e2 HBASE-20388 nightly tests running on a feature branch should only comment on that feature branch's jira 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-21 13:50:40 -05:00
Nihal Jain 8219ec7493 HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-20 11:54:01 -05:00
Sean Busbey 0a31ea4858 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from. 
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-14 21:30:43 -05:00
Sean Busbey 7b7a2222b6 HBASE-20389 Move website building flags into a profile. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 22:43:19 -05:00
Sean Busbey f695ecb2db HBASE-20335 ensure each stage of the nightly job gathers machine information. 
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 22:42:37 -05:00
Sean Busbey 2f74afd6f4 HBASE-20379 shadedjars yetus plugin should add a footer link 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 10:40:35 -05:00
Sean Busbey 8f1ac01ad8 HBASE-20112 register nightly junit over hadoop3 results with jenkins. 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 10:37:50 -05:00
Mike Drob 70d23214fb HBASE-20356 Make skipping protoc possible 2018-04-12 13:31:54 -05:00
Michael Stack 3eda9f1bb3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:18:21 -07:00
Sean Busbey a2c1be9a76 HBASE-20335 nightly job bash cleanup. 
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-11 01:33:14 -05:00
Sean Busbey 83ee82d6a0 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven. 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
 2018-04-11 01:33:14 -05:00
Sean Busbey ee87de9bfd HBASE-15466 test personality should recognize docs-only patch. 
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-09 10:37:28 -05:00
Apekshit Sharma dcc840e8a5 HBASE-17730 Add documentation to upgrade coprocessors for 2.0 2018-04-04 13:08:22 -07:00
Apekshit Sharma 6318e3bf5f HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732. 2018-04-03 15:47:48 -07:00
Sean Busbey d8b550fabc HBASE-20308 Dockerfile for test must include git. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-28 18:07:36 -05:00