Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,534 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

518 Commits

Author SHA1 Message Date
Nick Dimiduk 85b0c8e6bc
HBASE-23763 Add 'new on release line report' for git/jira audit tool (#1104) 
Codify building the summary of what's new on a release line
branch (i.e., `branch-2`), but not yet released on earlier release
branches of that line.

Builds a cvs report that looks like https://home.apache.org/~ndimiduk/new_for_branch-2.csv
 2020-01-30 09:31:01 -08:00
Nick Dimiduk 5bada0b5d0
HBASE-22853 Git/Jira Release Audit Tool (#1088) 
* HBASE-22853 Git/Jira Release Audit Tool

This is an application for performing an audit between the histories
on our git branches and the `fixVersion` field set on issues in
JIRA. It does this by building a Sqlite database from the commits
found on each git branch, identifying Jira IDs and release tags, and
then requesting information about those issues from Jira. Once both
sources have been collected, queries can be performed against the
database to look for discrepancies between the sources of truth (and,
possibly, bugs in this script).

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-01-27 10:28:11 -08:00
stack a58f2a4a55 HBASE-23720 [create-release] Update yetus version used from 0.11.0 to 0.11.1 2020-01-22 18:07:53 -08:00
Josh Elser 04d789f1a7 HBASE-23347 Allow custom authentication methods for RPCs 
Decouple the HBase internals such that someone can implement
their own SASL-based authentication mechanism and plug it into
HBase RegionServers/Masters.

Comes with a design doc in dev-support/design-docs and an example in
hbase-examples known as "Shade" which uses a flat-password file
for authenticating users.

Closes #884

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-01-16 10:27:28 -05:00
Beata Sudi de87d72bb4 HBASE-22920 github pr testing job should use dev-support script (#883) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2019-12-13 15:56:20 -08:00
Sean Busbey 97e0107000
HBASE-23337 Release scripts should rely on maven for deploy. (#887) 
- switch to nexus-staging-maven-plugin for asf-release
- refactor release-build to use mvn deploy and its output.
- cleaned up some tabs in the root pom

Signed-off-by: stack <stack@apache.org>
 2019-12-02 06:39:24 -06:00
Duo Zhang 4b99816dd6
HBASE-23182 The create-release scripts are broken (#736) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2019-11-19 08:28:43 +08:00
Sean Busbey d5dcc090c1
HBASE-23228 Allow for jdk8 specific modules on branch-1 in precommit/nightly testing (#804) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-11-08 10:07:24 -06:00
Duo Zhang b53e9a325c HBASE-23236 Upgrade to yetus 0.11.1 
Signed-off-by: stack <stack@apache.org>
 2019-11-08 13:47:54 +08:00
Peter Somogyi fd9cfd789b
HBASE-23114 Use archiveArtifacts in Jenkinsfiles (#681) 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-10-10 13:27:50 +02:00
Michael Stack 57439e5bf5
HBASE-23137 [create-release] Add passing of PROJECT variable for when building other than core (#701) 2019-10-08 15:12:14 -07:00
Frederick Ayala 95c9911a9c HBASE-23031 Upgrade Yetus version in RM scripts (#692) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-10-06 11:24:35 +02:00
stack f69e7705e0 HBASE-23121 create-release is not pushing artifacts to repository.a.o 2019-10-04 15:32:17 -07:00
Duo Zhang f08a310ed9
HBASE-23118 [RELEASE SCRIPTS] Allow creating a RC from an existing tag[RELEASE SCRIPTS] Allow creating a RC from an existing tag (#686) 
Signed-off-by: stack <stack@apache.org>
 2019-10-04 13:39:27 +08:00
Michael Stack 7ee6d59ef8
HBASE-23092 Make the RM tooling in dev-tools/create-release generic (#671) 
Make the scripts generic. Adds an option that allows you specify
'project'. Defaults to 'hbase' for core. Pass 'hbase-thirdparty'
or 'hbase-operator-tools' etc.

This commit includes a bunch of bugfixes and miscellaneous
that came of trying to use the scripts making RCs.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-10-02 09:14:17 -07:00
Peter Somogyi 56489819bc
HBASE-23053 Disable concurrent nightly builds (#654) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-09-23 15:00:22 +02:00
Sean Busbey bcad0d9f98 HBASE-22955 Properly set jdk7 as JAVA_HOME for branches-1 precommit and nightly. (#621) 
master/branches-2 specific changes: work around yetus overwriting JAVA_HOME
in the container with the host JAVA_HOME.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 41990ba20a)
 2019-09-16 22:51:24 -05:00
Sean Busbey 1cb4f687c1
HBASE-23023 upgrade shellcheck used in dockerfile (#624) 
Signed-off-by: stack <stack@apache.org>
 2019-09-14 14:03:02 -05:00
Peter Somogyi 51b6ce391b
HBASE-22981 Remove unused flags for Yetus (#591) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-09-06 14:56:05 +02:00
Duo Zhang dfe5280d0c HBASE-22724 Addendum trim trailing spaces 2019-09-04 09:03:58 +08:00
Duo Zhang da144888d0
HBASE-22724 Add a emoji on the vote table for pre commit result on github (#568) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Stack <stack@apache.org>
 2019-09-04 08:52:28 +08:00
Rushabh 0438fdc0f6 HBASE-22852 Stop gpg agent daemons in hbase nightlies. (#525) 
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-26 16:30:22 -05:00
Gav 89e54f2899 HBASE-22913 Use Hadoop label for nightly builds (#532) 
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-24 16:51:26 +08:00
Sean Busbey 94155fe175 HBASE-22911 reduce concurrent PR builds. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-24 16:30:36 +08:00
meiyi 3b16ae2720 HBASE-22625 documet use scan snapshot feature (#496) 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-08-23 15:04:53 -07:00
Artem Ervits 74fb2040ea HBASE-22464 Improvements to hbase-vote script 
* wget should use timestamps to avoid re-downloading RC artifacts we already have.
* allow changing to maven profiles other than runAllTests for test step

Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-23 12:44:58 -05:00
Duo Zhang 288d1f2769
HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job (#518) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-22 23:07:05 +08:00
Duo Zhang d9d5f69fc6 HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error 2019-08-15 10:14:08 +08:00
stack 53db390f60 HBASE-22854 Remove +x shell spew from do-release-*.sh create-release scripts 2019-08-14 10:05:41 -07:00
Peter Somogyi 9d8271624e HBASE-22801 Maven build issue on Github PRs 2019-08-06 18:57:14 +02:00
Duo Zhang c9293b0b12 HBASE-22719 Add debug support for github PR pre commit job 2019-07-22 13:49:27 +08:00
stack ef44f30006 HBASE-21953 Point make_rc.sh at ./create-release/do-release-docker.sh instead 2019-06-12 07:54:30 -07:00
stack 8745d5e7e8 HBASE-21935 Replace make_rc.sh with customized spark/dev/create-release 
These scripts came originally from spark [1]. They were then
modified to suit hbase context. Supercedes the old
../make_rc.sh script because what is here is more comprehensive
doing more steps of the RM process as well as running in a
container so the RM build environment can be a constant.

It:
 * Tags release
 * Updates RELEASENOTES.md and CHANGES.md.
 * Sets version to the release version
 * Sets version to next SNAPSHOT version.
 * Builds, signs, and hashes all artifacts.
 * Generates the API report.
 * Pushes release tgzs to the dev dir in a apache dist.
 * Pushes to repository.apache.org staging.
 * Generates a vote email with filled-in fields.

The entry point is the do-release-docker.sh script. Pass -h to
see available options. For example, running below will do all
steps above using the 'rm' dir under Downloads as workspace:

 $ ./do-release-docker.sh  -d ~/Downloads/rm

1. https://github.com/apache/spark/tree/master/dev/create-release

Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-12 07:53:49 -07:00
Josh Elser 2f9d995163 HBASE-22563 Reduce old builds by half 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-06-10 18:49:16 -04:00
Sean Busbey b4d5a9a8e1 HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 09:16:34 -05:00
Sean Busbey 51c49a1784 HBASE-22497 Mark HBase 1.2 line as EOM 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 06:55:58 -05:00
Guanghao Zhang ab99e2486e HBASE-22522 The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows." 2019-06-02 22:07:49 +08:00
Guanghao Zhang 12584ebf46 HBASE-22490 (addendum) Nightly client integration test fails with hadoop-3 2019-05-31 14:46:16 +08:00
Duo Zhang e4f4ae835f HBASE-22500 Modify pom and jenkins jobs for hadoop versions 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-30 22:31:32 +08:00
Guanghao 70fb30cd56
HBASE-22490 Nightly client integration test fails with hadoop-3.0.3 2019-05-30 10:29:40 +08:00
zhangduo e919ca6ca7 HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test 2019-05-28 22:57:50 +08:00
Peter Somogyi 83b8472c9a HBASE-22474 Add --mvn-custom-repo parameter to yetus calls 2019-05-26 18:11:22 +02:00
Guanghao Zhang de579cd243 HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 09:23:20 +08:00
Guanghao Zhang 6b899ccbbc HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-23 20:57:23 +08:00
zhangduo b74df9b747 HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:54:29 +08:00
Duo Zhang 5a578f953b HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-05-17 10:01:51 +08:00
Andrew Purtell e1d023d54c
HBASE-22430 hbase-vote should tee build and test output to console 2019-05-16 16:45:53 -07:00
Tak Lon (Stephen) Wu 25a1c5a619 HBASE-22429 hbase-vote download step requires URL to end with '/' (#243) 2019-05-16 16:43:27 -07:00
Duo Zhang 083605df8f HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:20 +08:00
Sean Busbey 60dc5143f2 HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-05-13 11:21:16 -05:00
Sean Busbey b5a6fd14fa HBASE-22020 update nightly to yetus 0.9.0 
Signed-off-by: stack <stack@apache.org>
 2019-04-24 07:31:45 -05:00
zhangduo 86f9443eeb HBASE-22174 Remove error prone from our precommit javac check 2019-04-06 13:51:02 +08:00
Andrew Purtell 6abf408f33
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-05 14:36:52 -07:00
Apache9 28d1b76292 HBASE-22152 Addendum use hbase account instead of hadoop (#112) 2019-04-05 20:57:30 +08:00
Duo Zhang 5cc10c9a6d HBASE-22152 Create a jenkins file for yetus to processing GitHub PR 2019-04-04 22:15:20 +08:00
Andrew Purtell 49cfecb13d
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-03 16:30:20 -07:00
zhangduo c8d04cf127 HBASE-22100 False positive for error prone warnings in pre commit job 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-03-28 13:06:26 +08:00
TAK LON WU d4086bf5af HBASE-21963 Add a script for building and verifying release candidate 2019-03-18 19:55:50 +01:00
stack e536e6a2aa HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check 2019-03-13 13:01:30 -07:00
Peter Somogyi 400276e3ec HBASE-21711 Remove references to git.apache.org/hbase.git 2019-01-16 10:02:13 +01:00
Tommy Li 5675bb8542 HBASE-21712 Make submit-patch.py python3 compatible - ADDENDUM 
add future to python reqs
 2019-01-16 09:24:47 +01:00
Tommy Li 63a1fcbe46 HBASE-21712 : Make submit-patch.py python3 compatible 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-14 14:50:50 -08:00
Peter Somogyi 9158792265 HBASE-21685 Change repository urls to Gitbox 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-09 19:01:06 +01:00
Peter Somogyi 7377fcd29b Revert "HBASE-21668 SCM fetch times out for nightlies" 
This reverts commit 84c1f0887d.
 2019-01-08 08:46:46 +01:00
Peter Somogyi 84c1f0887d HBASE-21668 SCM fetch times out for nightlies 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-07 21:56:42 +01:00
Peter Somogyi f0b50a8f9b HBASE-21547 Precommit uses master flaky list for other branches 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-02 08:26:57 +01:00
Michael Stack 54172c9890 HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove exception for scala files in findbugs now that we don't have any.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
(cherry picked from commit 2792253322)
 2018-11-08 08:50:03 -06:00
Sean Busbey 56bd0a1864 Revert "HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide" 
This reverts commit 2792253322.

Bad commit metadata.
 2018-11-08 08:47:03 -06:00
Michael Stack 468c1e77bf HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove spark reference in dev-support findbugs excludes.
 2018-11-07 08:27:29 -08:00
Wellington Chevreuil 2792253322 HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-11-07 08:08:02 -08:00
Michael Stack ee55b558c0
HBASE-21424 Change flakies and nightlies so scheduled less often 
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
 2018-11-01 10:06:53 -07:00
Sean Busbey 42d7ddc678 HBASE-21103 nightly job should make sure cached yetus will run. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-10-11 10:29:07 -05:00
Mike Drob c9213f752e
HBASE-20764 build broken when latest commit is gpg signed 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-08 19:49:36 -05:00
Sean Busbey 5d14c1af65 HBASE-21189 flaky job should gather machine stats 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-09-12 23:08:31 -05:00
Sean Busbey 588ff921c1 HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf' 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-08-21 09:45:26 -05:00
Sean Busbey 23d54f8587 HBASE-21074 JDK7 builds need to be done with TLSv1.2. 
* for master and branches-2 we skip the jdk7 stuff

Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-21 09:14:48 -05:00
Sean Busbey f9793fafb7 HBASE-20387 turn flaky test tracking infra into per-branch pipeline. 
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-08-16 23:16:21 -05:00
Sean Busbey 346dd32185 HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-14 13:13:51 -05:00
Ankit Singhal 2eee7a3f8b HBASE-20910 Fix dev-support/submit-patch.py by opening file with 'b' mode 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-07-20 15:31:11 -07:00
Yu Li c55acb0b03 HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed 2018-07-12 10:16:11 +08:00
Sean Busbey 78da0e3669 HBASE-20334 add a test that verifies basic client and MR integration 2018-06-18 11:31:13 -07:00
Sean Busbey 04db900772 HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-14 20:24:29 -05:00
Mike Drob 8648af07d4
HBASE-19377 Update Java API CC version 
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
 2018-06-12 14:19:13 -05:00
Peter Somogyi b002b0b8b0 HBASE-20689 Docker fails to install rubocop for precommit 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-06-06 23:51:07 +02:00
Sean Busbey c19fbf2be0 HBASE-20501 update minimum supported Hadoop version to 2.7.1. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-30 21:22:42 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
Sean Busbey 1792f541c6 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-05-24 13:04:50 -05:00
Sean Busbey dace8ff2a4 HBASE-20591 nightly job needs to enable maven build system. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-05-22 17:40:56 -05:00
Mike Drob e6220c8b60 Revert "HBASE-20478 move hbaseanti import checks to checkstyle" 
Need to update version of checkstyle used for new features.

This reverts commit 90d103d6d5.
 2018-04-26 13:36:13 -05:00
Mike Drob 90d103d6d5 HBASE-20478 move hbaseanti import checks to checkstyle 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 09:28:59 -05:00
Nihal Jain d4768114e8 HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 07:54:25 -05:00
Sean Busbey f4a39043e2 HBASE-20388 nightly tests running on a feature branch should only comment on that feature branch's jira 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-21 13:50:40 -05:00
Nihal Jain 8219ec7493 HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-20 11:54:01 -05:00
Sean Busbey 0a31ea4858 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from. 
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-14 21:30:43 -05:00
Sean Busbey 7b7a2222b6 HBASE-20389 Move website building flags into a profile. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 22:43:19 -05:00
Sean Busbey f695ecb2db HBASE-20335 ensure each stage of the nightly job gathers machine information. 
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 22:42:37 -05:00
Sean Busbey 2f74afd6f4 HBASE-20379 shadedjars yetus plugin should add a footer link 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 10:40:35 -05:00
Sean Busbey 8f1ac01ad8 HBASE-20112 register nightly junit over hadoop3 results with jenkins. 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 10:37:50 -05:00
Mike Drob 70d23214fb HBASE-20356 Make skipping protoc possible 2018-04-12 13:31:54 -05:00
Michael Stack 3eda9f1bb3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:18:21 -07:00