Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,413 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

496 Commits

Author SHA1 Message Date
Gav 89e54f2899 HBASE-22913 Use Hadoop label for nightly builds (#532) 
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-24 16:51:26 +08:00
Sean Busbey 94155fe175 HBASE-22911 reduce concurrent PR builds. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-24 16:30:36 +08:00
meiyi 3b16ae2720 HBASE-22625 documet use scan snapshot feature (#496) 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-08-23 15:04:53 -07:00
Artem Ervits 74fb2040ea HBASE-22464 Improvements to hbase-vote script 
* wget should use timestamps to avoid re-downloading RC artifacts we already have.
* allow changing to maven profiles other than runAllTests for test step

Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-23 12:44:58 -05:00
Duo Zhang 288d1f2769
HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job (#518) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-08-22 23:07:05 +08:00
Duo Zhang d9d5f69fc6 HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error 2019-08-15 10:14:08 +08:00
stack 53db390f60 HBASE-22854 Remove +x shell spew from do-release-*.sh create-release scripts 2019-08-14 10:05:41 -07:00
Peter Somogyi 9d8271624e HBASE-22801 Maven build issue on Github PRs 2019-08-06 18:57:14 +02:00
Duo Zhang c9293b0b12 HBASE-22719 Add debug support for github PR pre commit job 2019-07-22 13:49:27 +08:00
stack ef44f30006 HBASE-21953 Point make_rc.sh at ./create-release/do-release-docker.sh instead 2019-06-12 07:54:30 -07:00
stack 8745d5e7e8 HBASE-21935 Replace make_rc.sh with customized spark/dev/create-release 
These scripts came originally from spark [1]. They were then
modified to suit hbase context. Supercedes the old
../make_rc.sh script because what is here is more comprehensive
doing more steps of the RM process as well as running in a
container so the RM build environment can be a constant.

It:
 * Tags release
 * Updates RELEASENOTES.md and CHANGES.md.
 * Sets version to the release version
 * Sets version to next SNAPSHOT version.
 * Builds, signs, and hashes all artifacts.
 * Generates the API report.
 * Pushes release tgzs to the dev dir in a apache dist.
 * Pushes to repository.apache.org staging.
 * Generates a vote email with filled-in fields.

The entry point is the do-release-docker.sh script. Pass -h to
see available options. For example, running below will do all
steps above using the 'rm' dir under Downloads as workspace:

 $ ./do-release-docker.sh  -d ~/Downloads/rm

1. https://github.com/apache/spark/tree/master/dev/create-release

Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-12 07:53:49 -07:00
Josh Elser 2f9d995163 HBASE-22563 Reduce old builds by half 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-06-10 18:49:16 -04:00
Sean Busbey b4d5a9a8e1 HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 09:16:34 -05:00
Sean Busbey 51c49a1784 HBASE-22497 Mark HBase 1.2 line as EOM 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 06:55:58 -05:00
Guanghao Zhang ab99e2486e HBASE-22522 The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows." 2019-06-02 22:07:49 +08:00
Guanghao Zhang 12584ebf46 HBASE-22490 (addendum) Nightly client integration test fails with hadoop-3 2019-05-31 14:46:16 +08:00
Duo Zhang e4f4ae835f HBASE-22500 Modify pom and jenkins jobs for hadoop versions 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-30 22:31:32 +08:00
Guanghao 70fb30cd56
HBASE-22490 Nightly client integration test fails with hadoop-3.0.3 2019-05-30 10:29:40 +08:00
zhangduo e919ca6ca7 HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test 2019-05-28 22:57:50 +08:00
Peter Somogyi 83b8472c9a HBASE-22474 Add --mvn-custom-repo parameter to yetus calls 2019-05-26 18:11:22 +02:00
Guanghao Zhang de579cd243 HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-24 09:23:20 +08:00
Guanghao Zhang 6b899ccbbc HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job 2019-05-23 20:57:23 +08:00
zhangduo b74df9b747 HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:54:29 +08:00
Duo Zhang 5a578f953b HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-05-17 10:01:51 +08:00
Andrew Purtell e1d023d54c
HBASE-22430 hbase-vote should tee build and test output to console 2019-05-16 16:45:53 -07:00
Tak Lon (Stephen) Wu 25a1c5a619 HBASE-22429 hbase-vote download step requires URL to end with '/' (#243) 2019-05-16 16:43:27 -07:00
Duo Zhang 083605df8f HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:20 +08:00
Sean Busbey 60dc5143f2 HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-05-13 11:21:16 -05:00
Sean Busbey b5a6fd14fa HBASE-22020 update nightly to yetus 0.9.0 
Signed-off-by: stack <stack@apache.org>
 2019-04-24 07:31:45 -05:00
zhangduo 86f9443eeb HBASE-22174 Remove error prone from our precommit javac check 2019-04-06 13:51:02 +08:00
Andrew Purtell 6abf408f33
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-05 14:36:52 -07:00
Apache9 28d1b76292 HBASE-22152 Addendum use hbase account instead of hadoop (#112) 2019-04-05 20:57:30 +08:00
Duo Zhang 5cc10c9a6d HBASE-22152 Create a jenkins file for yetus to processing GitHub PR 2019-04-04 22:15:20 +08:00
Andrew Purtell 49cfecb13d
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-03 16:30:20 -07:00
zhangduo c8d04cf127 HBASE-22100 False positive for error prone warnings in pre commit job 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-03-28 13:06:26 +08:00
TAK LON WU d4086bf5af HBASE-21963 Add a script for building and verifying release candidate 2019-03-18 19:55:50 +01:00
stack e536e6a2aa HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check 2019-03-13 13:01:30 -07:00
Peter Somogyi 400276e3ec HBASE-21711 Remove references to git.apache.org/hbase.git 2019-01-16 10:02:13 +01:00
Tommy Li 5675bb8542 HBASE-21712 Make submit-patch.py python3 compatible - ADDENDUM 
add future to python reqs
 2019-01-16 09:24:47 +01:00
Tommy Li 63a1fcbe46 HBASE-21712 : Make submit-patch.py python3 compatible 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-14 14:50:50 -08:00
Peter Somogyi 9158792265 HBASE-21685 Change repository urls to Gitbox 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-09 19:01:06 +01:00
Peter Somogyi 7377fcd29b Revert "HBASE-21668 SCM fetch times out for nightlies" 
This reverts commit 84c1f0887d.
 2019-01-08 08:46:46 +01:00
Peter Somogyi 84c1f0887d HBASE-21668 SCM fetch times out for nightlies 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-07 21:56:42 +01:00
Peter Somogyi f0b50a8f9b HBASE-21547 Precommit uses master flaky list for other branches 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-02 08:26:57 +01:00
Michael Stack 54172c9890 HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove exception for scala files in findbugs now that we don't have any.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
(cherry picked from commit 2792253322)
 2018-11-08 08:50:03 -06:00
Sean Busbey 56bd0a1864 Revert "HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide" 
This reverts commit 2792253322.

Bad commit metadata.
 2018-11-08 08:47:03 -06:00
Michael Stack 468c1e77bf HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors 
ADDENDUM: Remove spark reference in dev-support findbugs excludes.
 2018-11-07 08:27:29 -08:00
Wellington Chevreuil 2792253322 HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-11-07 08:08:02 -08:00
Michael Stack ee55b558c0
HBASE-21424 Change flakies and nightlies so scheduled less often 
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
 2018-11-01 10:06:53 -07:00
Sean Busbey 42d7ddc678 HBASE-21103 nightly job should make sure cached yetus will run. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-10-11 10:29:07 -05:00
Mike Drob c9213f752e
HBASE-20764 build broken when latest commit is gpg signed 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-08 19:49:36 -05:00
Sean Busbey 5d14c1af65 HBASE-21189 flaky job should gather machine stats 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-09-12 23:08:31 -05:00
Sean Busbey 588ff921c1 HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf' 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2018-08-21 09:45:26 -05:00
Sean Busbey 23d54f8587 HBASE-21074 JDK7 builds need to be done with TLSv1.2. 
* for master and branches-2 we skip the jdk7 stuff

Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-21 09:14:48 -05:00
Sean Busbey f9793fafb7 HBASE-20387 turn flaky test tracking infra into per-branch pipeline. 
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-08-16 23:16:21 -05:00
Sean Busbey 346dd32185 HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-08-14 13:13:51 -05:00
Ankit Singhal 2eee7a3f8b HBASE-20910 Fix dev-support/submit-patch.py by opening file with 'b' mode 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-07-20 15:31:11 -07:00
Yu Li c55acb0b03 HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed 2018-07-12 10:16:11 +08:00
Sean Busbey 78da0e3669 HBASE-20334 add a test that verifies basic client and MR integration 2018-06-18 11:31:13 -07:00
Sean Busbey 04db900772 HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-14 20:24:29 -05:00
Mike Drob 8648af07d4
HBASE-19377 Update Java API CC version 
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
 2018-06-12 14:19:13 -05:00
Peter Somogyi b002b0b8b0 HBASE-20689 Docker fails to install rubocop for precommit 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-06-06 23:51:07 +02:00
Sean Busbey c19fbf2be0 HBASE-20501 update minimum supported Hadoop version to 2.7.1. 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-30 21:22:42 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
Sean Busbey 1792f541c6 HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-05-24 13:04:50 -05:00
Sean Busbey dace8ff2a4 HBASE-20591 nightly job needs to enable maven build system. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-05-22 17:40:56 -05:00
Mike Drob e6220c8b60 Revert "HBASE-20478 move hbaseanti import checks to checkstyle" 
Need to update version of checkstyle used for new features.

This reverts commit 90d103d6d5.
 2018-04-26 13:36:13 -05:00
Mike Drob 90d103d6d5 HBASE-20478 move hbaseanti import checks to checkstyle 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 09:28:59 -05:00
Nihal Jain d4768114e8 HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 07:54:25 -05:00
Sean Busbey f4a39043e2 HBASE-20388 nightly tests running on a feature branch should only comment on that feature branch's jira 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-21 13:50:40 -05:00
Nihal Jain 8219ec7493 HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-20 11:54:01 -05:00
Sean Busbey 0a31ea4858 HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from. 
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-14 21:30:43 -05:00
Sean Busbey 7b7a2222b6 HBASE-20389 Move website building flags into a profile. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 22:43:19 -05:00
Sean Busbey f695ecb2db HBASE-20335 ensure each stage of the nightly job gathers machine information. 
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 22:42:37 -05:00
Sean Busbey 2f74afd6f4 HBASE-20379 shadedjars yetus plugin should add a footer link 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-13 10:40:35 -05:00
Sean Busbey 8f1ac01ad8 HBASE-20112 register nightly junit over hadoop3 results with jenkins. 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-13 10:37:50 -05:00
Mike Drob 70d23214fb HBASE-20356 Make skipping protoc possible 2018-04-12 13:31:54 -05:00
Michael Stack 3eda9f1bb3 HBASE-20385 Purge md5-making from our little make_rc.sh script 2018-04-11 09:18:21 -07:00
Sean Busbey a2c1be9a76 HBASE-20335 nightly job bash cleanup. 
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work

Signed-off-by: Michael Stack <stack@apache.org>
 2018-04-11 01:33:14 -05:00
Sean Busbey 83ee82d6a0 HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven. 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
 2018-04-11 01:33:14 -05:00
Sean Busbey ee87de9bfd HBASE-15466 test personality should recognize docs-only patch. 
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-09 10:37:28 -05:00
Apekshit Sharma dcc840e8a5 HBASE-17730 Add documentation to upgrade coprocessors for 2.0 2018-04-04 13:08:22 -07:00
Apekshit Sharma 6318e3bf5f HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732. 2018-04-03 15:47:48 -07:00
Sean Busbey d8b550fabc HBASE-20308 Dockerfile for test must include git. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-28 18:07:36 -05:00
Mike Drob 9342e0091d HBASE-20153 Add error prone to precommit 2018-03-12 16:06:57 -05:00
Sean Busbey 15da74ccee HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-09 17:22:00 -06:00
Mike Drob 28279697c2 HBASE-20164 add hadoopcheck link to table footer 2018-03-09 15:40:28 -06:00
Sean Busbey 8e0674a2eb HBASE-18467 addendum parallel steps must account for SCM and marshalling results 
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment

Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-07 22:12:36 -06:00
Sean Busbey ff7f5ecb0f HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-06 12:22:09 -06:00
Sean Busbey 485af49e53 HBASE-20070 addendum for missing echo. Website generation is failing. 2018-03-04 09:03:19 +05:30
Michael Stack 2b1b2c8490 HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and 
master
 2018-03-03 07:35:23 -08:00
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation 
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
 2018-03-02 09:25:10 -06:00
Sean Busbey c415ddb38c HBASE-20075 remove logic for branch-1.1 nightly testing 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-01 15:28:30 -06:00
Sean Busbey 383b7cc592 HBASE-15151 ensure findbugs check runs in nightly tests on all branches. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-01 15:21:40 -06:00
Sean Busbey ddc9af9027 HBASE-18467 report nightly results to devs via jira 
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-03-01 13:11:59 -06:00
Alex Leblang 96ebab748f HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found 
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-02-28 11:52:15 -06:00
Josh Elser e47d1e443e HBASE-20089 Use the ASF recommended naming for SHA512 xsum files 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-02-27 09:51:10 -05:00
Michael Stack a2bc19aa11 HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode proclimit and docker memlimit in nightly script... 2018-02-01 20:54:13 -08:00
Michael Stack cb7bfc21da HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; REAPPLY TO TEST 2018-02-01 20:27:28 -08:00
Michael Stack 18eec8c1a5 Revert "HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies" 
This reverts commit 2e6bc12441.
 2018-02-01 18:04:23 -08:00