51b6ce391b
HBASE-22981 Remove unused flags for Yetus ( #591 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-09-06 14:56:05 +02:00
dfe5280d0c
HBASE-22724 Addendum trim trailing spaces
2019-09-04 09:03:58 +08:00
da144888d0
HBASE-22724 Add a emoji on the vote table for pre commit result on github ( #568 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Stack <stack@apache.org>
2019-09-04 08:52:28 +08:00
0438fdc0f6
HBASE-22852 Stop gpg agent daemons in hbase nightlies. ( #525 )
...
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-08-26 16:30:22 -05:00
89e54f2899
HBASE-22913 Use Hadoop label for nightly builds ( #532 )
...
HBase, a Hadoop related project, must use the Hadoop label please.
This build, and others are starving the 'ubuntu' label which other projects need to use.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:51:26 +08:00
94155fe175
HBASE-22911 reduce concurrent PR builds.
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-24 16:30:36 +08:00
3b16ae2720
HBASE-22625 documet use scan snapshot feature ( #496 )
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-08-23 15:04:53 -07:00
74fb2040ea
HBASE-22464 Improvements to hbase-vote script
...
* wget should use timestamps to avoid re-downloading RC artifacts we already have.
* allow changing to maven profiles other than runAllTests for test step
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-08-23 12:44:58 -05:00
288d1f2769
HBASE-22891 Use HBaseQA in HBase-PreCommit-GitHub-PR job ( #518 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-08-22 23:07:05 +08:00
d9d5f69fc6
HBASE-22856 HBASE-Find-Flaky-Tests fails with pip error
2019-08-15 10:14:08 +08:00
53db390f60
HBASE-22854 Remove +x shell spew from do-release-*.sh create-release scripts
2019-08-14 10:05:41 -07:00
9d8271624e
HBASE-22801 Maven build issue on Github PRs
2019-08-06 18:57:14 +02:00
c9293b0b12
HBASE-22719 Add debug support for github PR pre commit job
2019-07-22 13:49:27 +08:00
ef44f30006
HBASE-21953 Point make_rc.sh at ./create-release/do-release-docker.sh instead
2019-06-12 07:54:30 -07:00
8745d5e7e8
HBASE-21935 Replace make_rc.sh with customized spark/dev/create-release
...
These scripts came originally from spark [1]. They were then
modified to suit hbase context. Supercedes the old
../make_rc.sh script because what is here is more comprehensive
doing more steps of the RM process as well as running in a
container so the RM build environment can be a constant.
It:
* Tags release
* Updates RELEASENOTES.md and CHANGES.md.
* Sets version to the release version
* Sets version to next SNAPSHOT version.
* Builds, signs, and hashes all artifacts.
* Generates the API report.
* Pushes release tgzs to the dev dir in a apache dist.
* Pushes to repository.apache.org staging.
* Generates a vote email with filled-in fields.
The entry point is the do-release-docker.sh script. Pass -h to
see available options. For example, running below will do all
steps above using the 'rm' dir under Downloads as workspace:
$ ./do-release-docker.sh -d ~/Downloads/rm
1. https://github.com/apache/spark/tree/master/dev/create-release
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-12 07:53:49 -07:00
2f9d995163
HBASE-22563 Reduce old builds by half
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-10 18:49:16 -04:00
b4d5a9a8e1
HBASE-22518 yetus personality is treating branch-1.4 like earlier branches for hadoopcheck
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 09:16:34 -05:00
51c49a1784
HBASE-22497 Mark HBase 1.2 line as EOM
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 06:55:58 -05:00
ab99e2486e
HBASE-22522 The integration test in master branch's nightly job has error "ERROR: Only found 1050 rows."
2019-06-02 22:07:49 +08:00
12584ebf46
HBASE-22490 (addendum) Nightly client integration test fails with hadoop-3
2019-05-31 14:46:16 +08:00
e4f4ae835f
HBASE-22500 Modify pom and jenkins jobs for hadoop versions
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 22:31:32 +08:00
70fb30cd56
HBASE-22490 Nightly client integration test fails with hadoop-3.0.3
2019-05-30 10:29:40 +08:00
e919ca6ca7
HBASE-22471 Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration test
2019-05-28 22:57:50 +08:00
83b8472c9a
HBASE-22474 Add --mvn-custom-repo parameter to yetus calls
2019-05-26 18:11:22 +02:00
de579cd243
HBASE-22462 (addendum) Should run a 'mvn install' at the end of hadoop check in pre commit job
2019-05-24 09:23:20 +08:00
6b899ccbbc
HBASE-22462 Should run a 'mvn install' at the end of hadoop check in pre commit job
2019-05-23 20:57:23 +08:00
b74df9b747
HBASE-22442 Nightly build is failing with hadoop 3.x
2019-05-19 07:54:29 +08:00
5a578f953b
HBASE-20970 Update hadoop check versions for hadoop3 in hbase-personality
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-17 10:01:51 +08:00
e1d023d54c
HBASE-22430 hbase-vote should tee build and test output to console
2019-05-16 16:45:53 -07:00
25a1c5a619
HBASE-22429 hbase-vote download step requires URL to end with '/' ( #243 )
2019-05-16 16:43:27 -07:00
083605df8f
HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks
2019-05-14 16:45:20 +08:00
60dc5143f2
HBASE-22406 skip generating rdoc when building gems in our docker image for running yetus
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-13 11:21:16 -05:00
b5a6fd14fa
HBASE-22020 update nightly to yetus 0.9.0
...
Signed-off-by: stack <stack@apache.org>
2019-04-24 07:31:45 -05:00
86f9443eeb
HBASE-22174 Remove error prone from our precommit javac check
2019-04-06 13:51:02 +08:00
6abf408f33
HBASE-20912 Add import order config in dev support for eclipse (Ankit Singhal and Tak Lon (Stephen) Wu)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-05 14:36:52 -07:00
28d1b76292
HBASE-22152 Addendum use hbase account instead of hadoop ( #112 )
2019-04-05 20:57:30 +08:00
5cc10c9a6d
HBASE-22152 Create a jenkins file for yetus to processing GitHub PR
2019-04-04 22:15:20 +08:00
49cfecb13d
HBASE-20911 correct Swtich/case indentation in formatter template for eclipse (Ankit Singhal)
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-03 16:30:20 -07:00
c8d04cf127
HBASE-22100 False positive for error prone warnings in pre commit job
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-03-28 13:06:26 +08:00
d4086bf5af
HBASE-21963 Add a script for building and verifying release candidate
2019-03-18 19:55:50 +01:00
e536e6a2aa
HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check
2019-03-13 13:01:30 -07:00
400276e3ec
HBASE-21711 Remove references to git.apache.org/hbase.git
2019-01-16 10:02:13 +01:00
5675bb8542
HBASE-21712 Make submit-patch.py python3 compatible - ADDENDUM
...
add future to python reqs
2019-01-16 09:24:47 +01:00
63a1fcbe46
HBASE-21712 : Make submit-patch.py python3 compatible
...
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-01-14 14:50:50 -08:00
9158792265
HBASE-21685 Change repository urls to Gitbox
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-09 19:01:06 +01:00
7377fcd29b
Revert "HBASE-21668 SCM fetch times out for nightlies"
...
This reverts commit 84c1f0887d
2019-01-08 08:46:46 +01:00
84c1f0887d
HBASE-21668 SCM fetch times out for nightlies
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-07 21:56:42 +01:00
f0b50a8f9b
HBASE-21547 Precommit uses master flaky list for other branches
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-02 08:26:57 +01:00
54172c9890
HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors
...
ADDENDUM: Remove exception for scala files in findbugs now that we don't have any.
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
(cherry picked from commit 2792253322
2018-11-08 08:50:03 -06:00
56bd0a1864
Revert "HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide"
...
This reverts commit 2792253322
2018-11-08 08:47:03 -06:00
468c1e77bf
HBASE-21443 [hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectors
...
ADDENDUM: Remove spark reference in dev-support findbugs excludes.
2018-11-07 08:27:29 -08:00
2792253322
HBASE-15557 Add guidance on HashTable/SyncTable to the RefGuide
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-11-07 08:08:02 -08:00
ee55b558c0
HBASE-21424 Change flakies and nightlies so scheduled less often
...
Have flakies run every four hours instead of every hour and
nightlies every 12 hours instead of every 6.
2018-11-01 10:06:53 -07:00
42d7ddc678
HBASE-21103 nightly job should make sure cached yetus will run.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-10-11 10:29:07 -05:00
c9213f752e
HBASE-20764 build broken when latest commit is gpg signed
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-08 19:49:36 -05:00
5d14c1af65
HBASE-21189 flaky job should gather machine stats
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-09-12 23:08:31 -05:00
588ff921c1
HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf'
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-08-21 09:45:26 -05:00
23d54f8587
HBASE-21074 JDK7 builds need to be done with TLSv1.2.
...
* for master and branches-2 we skip the jdk7 stuff
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-21 09:14:48 -05:00
f9793fafb7
HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
...
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-16 23:16:21 -05:00
346dd32185
HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-14 13:13:51 -05:00
2eee7a3f8b
HBASE-20910 Fix dev-support/submit-patch.py by opening file with 'b' mode
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-07-20 15:31:11 -07:00
c55acb0b03
HBASE-20838 Include hbase-server in precommit test if CommonFSUtils is changed
2018-07-12 10:16:11 +08:00
78da0e3669
HBASE-20334 add a test that verifies basic client and MR integration
2018-06-18 11:31:13 -07:00
04db900772
HBASE-20733 QABot should run checkstyle tests if the checkstyle configs change
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-14 20:24:29 -05:00
8648af07d4
HBASE-19377 Update Java API CC version
...
Compatibility checker complaining about hash collisions, newer versions
use longer id strings.
2018-06-12 14:19:13 -05:00
b002b0b8b0
HBASE-20689 Docker fails to install rubocop for precommit
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-06-06 23:51:07 +02:00
c19fbf2be0
HBASE-20501 update minimum supported Hadoop version to 2.7.1.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-30 21:22:42 -05:00
a110e1eff5
HBASE-20478 Update checkstyle to v8.2
...
Cannot go to latest (8.9) yet due to
https://github.com/checkstyle/checkstyle/issues/5279
* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
1792f541c6
HBASE-20638 nightly source artifact testing should fail the stage if it's going to report an error on jira
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-05-24 13:04:50 -05:00
dace8ff2a4
HBASE-20591 nightly job needs to enable maven build system.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-05-22 17:40:56 -05:00
e6220c8b60
Revert "HBASE-20478 move hbaseanti import checks to checkstyle"
...
Need to update version of checkstyle used for new features.
This reverts commit 90d103d6d5
2018-04-26 13:36:13 -05:00
90d103d6d5
HBASE-20478 move hbaseanti import checks to checkstyle
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 09:28:59 -05:00
d4768114e8
HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 07:54:25 -05:00
f4a39043e2
HBASE-20388 nightly tests running on a feature branch should only comment on that feature branch's jira
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-21 13:50:40 -05:00
8219ec7493
HBASE-20438 Add an HBase antipattern check for reintroducing commons-logging
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-20 11:54:01 -05:00
0a31ea4858
HBASE-20364 ensure jira comment from nightly reflects results of run comment comes from.
...
* in a post-step, build status can either be "null" or "SUCCESS" to indicate success.
* before we do an scm checkout for stages that post to the comment, set a default "we failed ¯\_(ツ)_/¯" comment.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-14 21:30:43 -05:00
7b7a2222b6
HBASE-20389 Move website building flags into a profile.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 22:43:19 -05:00
f695ecb2db
HBASE-20335 ensure each stage of the nightly job gathers machine information.
...
* fix archiving for src tarball stage's machine info
* stop nightly wrapper desroying the output dir.
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 22:42:37 -05:00
2f74afd6f4
HBASE-20379 shadedjars yetus plugin should add a footer link
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-13 10:40:35 -05:00
8f1ac01ad8
HBASE-20112 register nightly junit over hadoop3 results with jenkins.
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-13 10:37:50 -05:00
70d23214fb
HBASE-20356 Make skipping protoc possible
2018-04-12 13:31:54 -05:00
3eda9f1bb3
HBASE-20385 Purge md5-making from our little make_rc.sh script
2018-04-11 09:18:21 -07:00
a2c1be9a76
HBASE-20335 nightly job bash cleanup.
...
* Ensure Jenkins steps that invoke bash inline set -e
* machine stats script should check that passed directory will work
Signed-off-by: Michael Stack <stack@apache.org>
2018-04-11 01:33:14 -05:00
83ee82d6a0
HBASE-20068 personality tests for Apache Yetus should use the maven plugin to exec maven.
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Reid Chan <reidddchan@outlook.com>
2018-04-11 01:33:14 -05:00
ee87de9bfd
HBASE-15466 test personality should recognize docs-only patch.
...
* add a new test to build the refguide specifically instead of site
* check for changes to src/main/asciidoc or src/main/xslt and run that test and only that test
* check for changes to the hbase-default.xml file and build the refguide if found (but maybe other tests too)
* fallback to relying on the yetus default for other changes
* fix some missing start_clock entries that cause longer-than-actual reported test time.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-04-09 10:37:28 -05:00
dcc840e8a5
HBASE-17730 Add documentation to upgrade coprocessors for 2.0
2018-04-04 13:08:22 -07:00
6318e3bf5f
HBASE-17730 Migration to 2.0 for coprocessors. Upload AsciiDoc for coprocessor design improvements made in HBASE-17732.
2018-04-03 15:47:48 -07:00
d8b550fabc
HBASE-20308 Dockerfile for test must include git.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-28 18:07:36 -05:00
9342e0091d
HBASE-20153 Add error prone to precommit
2018-03-12 16:06:57 -05:00
15da74ccee
HBASE-20162 [nightly] depending on pipeline execution we sometimes refer to the wrong workspace
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-09 17:22:00 -06:00
28279697c2
HBASE-20164 add hadoopcheck link to table footer
2018-03-09 15:40:28 -06:00
8e0674a2eb
HBASE-18467 addendum parallel steps must account for SCM and marshalling results
...
* do a scm checkout on the stages that need access to source.
* ensure our install job runs on the ubuntu label
* copy jira comments to main workspace
* simplify the jira comment
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-07 22:12:36 -06:00
ff7f5ecb0f
HBASE-20134 dev-support scripts should use mktemp instead of hard-coding /tmp.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-06 12:22:09 -06:00
485af49e53
HBASE-20070 addendum for missing echo. Website generation is failing.
2018-03-04 09:03:19 +05:30
2b1b2c8490
HBASE-20122 Up timeout on nightlies to 9 hours from 8 on branch-2 and
...
master
2018-03-03 07:35:23 -08:00
2a65066b35
HBASE-20070 refactor website generation
...
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
c415ddb38c
HBASE-20075 remove logic for branch-1.1 nightly testing
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-01 15:28:30 -06:00
383b7cc592
HBASE-15151 ensure findbugs check runs in nightly tests on all branches.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 15:21:40 -06:00
ddc9af9027
HBASE-18467 report nightly results to devs via jira
...
- rely on parallel pipeline to ensure all stages always run
- define non-CPS jira commenting function
- comment on jiras in the changeset with summary and links
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-03-01 13:11:59 -06:00
96ebab748f
HBASE-20106 [api compliance chacker] Fix Bug Where Branch Isn't Found
...
While git rev-parse, sometimes the branch cannot be found unless
the remote is specified. This fix tries to use "origin" if the
remote is not specified and the branch is not found.
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-02-28 11:52:15 -06:00
e47d1e443e
HBASE-20089 Use the ASF recommended naming for SHA512 xsum files
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-27 09:51:10 -05:00
a2bc19aa11
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; AMENDMENT hardcode proclimit and docker memlimit in nightly script...
2018-02-01 20:54:13 -08:00
cb7bfc21da
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies; REAPPLY TO TEST
2018-02-01 20:27:28 -08:00
18eec8c1a5
Revert "HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies"
...
This reverts commit 2e6bc12441
2018-02-01 18:04:23 -08:00
5f5ddf5541
HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- remove docker mem sizing for the moment...
2018-02-01 16:39:27 -08:00
0db7db3cd1
HBASE-19901 Up yetus proclimit on nightlies; ADDENDUM -- up proclimit from 6k to 10k and set Docker memory limit of 20G (default is 4G)
2018-02-01 14:08:04 -08:00
2e6bc12441
HBASE-19901 HBASE-19901 Up yetus proclimit on nightlies
2018-01-30 22:25:24 -08:00
08bcd64c25
Revert "HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir"
...
Doesn't work. Reverting.
This reverts commit 1ca06d9eea
2018-01-30 12:01:52 -08:00
1ca06d9eea
HBASE-19899 Dump ulimit -a, fd count, and free output at end of build into system dir
2018-01-30 11:53:09 -08:00
67f91f1282
HBASE-19892 Checking patch attach and yetus 0.7.0 and move to Yetus 0.7.0
...
One-liner that ups our yetus version from 0.6.0 to 0.7.0.
2018-01-29 22:34:40 -08:00
9b8d7e0aef
HBASE-19891 Up nightly test run timeout from 6 hours to 8
2018-01-29 22:14:47 -08:00
9917244be2
HBASE-19789 Not exclude flaky tests from nightly builds.
2018-01-16 10:07:48 -08:00
4ddfecac56
HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
...
M dev-support/make_rc.sh
Disable checkstyle building site. Its an issue being fixed over in HBASE-19780
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
The clusterid was being set into the process only after the
regionserver registers with the Master. That can be too late for some
test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
as it goes to run which could be before Master had called its run
method which is regionserver run method which then calls back to the
master to register itself... and only then do we set the clusterid.
HBASE-19694 changed start order which made it so this test failed.
Setting the clusterid right after we set it in zk makes the test pass.
Another change was that backup masters were not going down on stop.
Backup masters were sleeping for the default zk period which is 90
seconds. They were not being woken up to check for stop. On stop
master now tells active master manager.
M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
Prevent creation of acl table. Messes up our being able to go down
promptly.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
Disabled for now because it wants to run with regions on the Master...
currently broke!
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
Add a bit of debugging.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
Disabled. Fails 40% of the time.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
Disabled. Fails 33% of the time.
Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:56 -08:00
8ae2a2150b
HBASE-19674: Improve make_patch.sh
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2018-01-07 14:41:40 +01:00
9d02e37a8a
HBASE-19659 Enable -x in make_rc.sh so logs where it is in execution
2017-12-28 14:31:54 -08:00
a4272a9f08
HBASE-19570 Add hadoop3 tests to Nightly master/branch-2 runs.
...
Jenkins fails the whole build immediately if any stage fails. Hadoop2 tests run before Hadoop3 tests.
So Hadoop3 tests will run only if hadoop2 tests pass.
2017-12-21 17:44:04 -08:00
6cefabee26
HBASE-19571 Renames OUTPUTDIR to OUTPUT_DIR and OUTPUT_RELATIVE to OUTPUT_DIR_RELATIVE.
2017-12-21 10:46:43 -08:00
dc5ec061b5
HBASE-19491 Improvements to Nighly runs: Fixes findbugs tests, Exclude flaky tests from master.
2017-12-20 17:58:08 -08:00
2a5e5e9e2c
HBASE-19526 Update hadoop version to 3.0 GA
2017-12-17 19:10:04 -08:00
1b822b60b5
HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". Updates hadoop version to 3.0.0-beta1.
2017-12-12 23:22:04 -08:00
5b7f9c2535
HBASE-19382 Update report-flakies.py script to handle yetus builds.
2017-11-29 22:21:10 -08:00
7406c83ef6
HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 22:35:10 -06:00
41f6bf6b89
HBASE-19246 Trivial fix in findHangingTests.py to make it not stop on finding 'bad string'.
2017-11-13 11:44:43 -08:00
35a1e43348
HBASE-19227 Nightly job should archive JVM dumpstream files.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 23:18:18 -06:00
ead8f9364c
HBASE-19229 Nightly script to check source artifact should not do a destructive git operation without opt-in
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 16:16:15 -06:00
36233e72c1
HBASE-19228 nightly job should gather machine stats.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:06:24 -06:00
b71544fe4d
HBASE-19189 Ad-hoc test job for running a subset of tests lots of times
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-09 15:02:13 -06:00
7bdff754f0
HBASE-19184 Update nightly source artifact check to use git archive for making the tarball.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-09 08:28:29 -06:00
46408e021d
HBASE-19203 Update Hadoop version used for build to 2.7.4 (from 2.5.1)
2017-11-07 12:37:36 -08:00
3e4b86d4d6
HBASE-19097 update nightly tests to use Apache Yetus 0.6.0
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-03 15:32:35 -05:00
4857cbd762
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script; AMENDMENT adding generation of hashes
2017-11-03 10:06:55 -07:00
4edfa06564
HBASE-19152 Update refguide 'how to build an RC' and the make_rc.sh script
...
Removes src.xml used building src tgz via hbase-assembly.
Use git archive instead going forward. Updates developer release candidate
documentation and the make_rc.sh script.
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-03 09:52:28 -07:00
0ff9dabe6c
HBASE-19124 Move nightly test of source artifact creation from Jenkinsfile to a script.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-02 15:31:19 -05:00
91273e7b0e
HBASE-19137 Nightly test should make junit reports optional rather than attempt archive after reporting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-01 09:55:32 -05:00
60aa1c228a
HBASE-19098 compatibility checker should handle remotes named something other than 'origin'.
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-10-26 16:09:17 -05:00
5255ae6dfa
HBASE-19030 nightly runs should attempt to log test results after archiving.
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-10-25 10:32:13 -05:00
eee3b0180e
HBASE-19054 switch precommit image to one from maven
...
Amending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 14:51:16 -05:00
cda2949b81
HBASE-19070 temporarily make the mvnsite nightly test non-voting.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-24 12:06:58 -05:00
a31e8e34ea
HBASE-19066 Correct the directory of openjdk-8 for jenkins
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-24 09:18:47 -05:00
cb5c4776de
HBASE-19058. The wget isn't installed in building docker image
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-10-20 20:35:33 -05:00
b10ad9e97f
HBASE-19039 refactor shadedjars test to only run on java changes.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:20 -05:00
dd4dbae764
HBASE-19060 precommit plugin test 'hadoopcheck' should only run when java or maven files change.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-20 19:35:14 -05:00
5facaded90
HBASE-16338 Remove Jackson1 deps
...
* Change imports from org.codehaus to com.fasterxml
* Exclude transitive jackson1 from hadoop and others
* Minor test cleanup to add assert messages, fix some parameter order
* Add anti-pattern check for using jackson 1 imports
* Add explicit non-null serialization directive to ScannerModel
2017-10-20 09:20:12 -05:00
af479c580c
HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-19 15:53:52 -05:00
4a7b430397
Revert "HBASE-19042 Oracle Java 8u144 downloader broken in precommit check"
...
This reverts commit 9e688117ba
2017-10-19 16:03:28 +08:00
9e688117ba
HBASE-19042 Oracle Java 8u144 downloader broken in precommit check
2017-10-19 15:32:48 +08:00
3acb081787
HBASE-18418 Remove apache_hbase_topology from dev-support
2017-10-18 14:08:26 -07:00
c16eb7881f
HBASE-19038 precommit mvn install should run from root on patch
2017-10-18 10:41:17 -05:00
5368fd5bf0
HBASE-19032 Set mimetype for patches uploaded by submit-patch.py
...
Change-Id: I38e6417dddd4e2525cd6a929922b2612c91d660d
2017-10-17 15:43:07 -07:00
f6a8a76b50
HBASE-18505 Yetus only run root when all modules changed
2017-10-13 12:12:07 -05:00
087edf0172
HBASE-18934 pick hadoop versions for precommit test after patch branch is determined.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-10-09 11:31:55 -05:00
869b90c612
HBASE-17441 Fix invalid quoting around hadoop-3 build in yetus personality
2017-10-01 15:46:24 -04:00
b5b4108fce
HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732; MINOR AMENDMENT adding README to design-doc dir
2017-09-28 13:24:40 -07:00
74d0adce61
HBASE-18884 Coprocessor Design Improvements follow up of HBASE-17732
...
- Change Service Coprocessor#getService() to List<Service> Coprocessor#getServices()
- Checkin the finalized design doc into repo
- Added example to javadoc of Coprocessor base interface on how to implement one in the new design
2017-09-28 10:25:47 -07:00
efb95a1794
HBASE-18834 fix shellcheck warning on hbase personality
...
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
2017-09-18 08:54:37 -05:00
4b124913f0
HBASE-17823 Migrate to Apache Yetus Audience Annotations
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2017-09-12 20:53:30 -05:00
79d9f7a734
HBASE-18760 Make hbase-shaded-check-invariants part of precommit
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-09-10 23:11:01 -05:00
5d60123f3e
HBASE-18674 upgrading to commons-lang3
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-09-05 09:46:10 -07:00
47a5614edd
Revert "HBASE-18674 upgrading to commons-lang3"
...
Premature push
This reverts commit 5dacc85122
2017-08-28 16:41:34 -07:00
5dacc85122
HBASE-18674 upgrading to commons-lang3
2017-08-28 15:57:12 -07:00
158f3da167
HBASE-18607: fix submit-patch.py to support utf8
...
one liner to support utf8 content
Change-Id: I57508879bea25aa5ae69e01e777b91a7160aafc8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-08-25 00:04:19 -07:00
c37432fefb
HBASE-18563 Fix RAT License complaint about website jenkins scripts
2017-08-10 20:08:03 -05:00
6114824b53
HBASE-18548 Move sources of website gen and check jobs into source control
2017-08-10 14:48:14 -07:00
7e7461e42a
HBASE-18527 Update nightly job to account for changes in jenkins plugins.
...
- Stop presuming job will be configured with checkout into a 'component' dir
- Disable autocheckout
- Specify checkout within 'component' dir
- leave the workspace around on pipeline failure so we can browse it.
2017-08-07 11:24:00 -05:00
2a717459bd
HBASE-14220 nightly check that we can build a source tarball.
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-06 12:01:47 -05:00
04424ad65f
HBASE-18426 nightly job should use independent stages to check supported jdks
...
* Jenkinsfile that works for all current branches.
* adds dev-support script for setting parameters for our yetus nightly invocation
* quiets the "zip test results" step
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-06 11:59:45 -05:00
7da47509d2
HBASE-15042 Moved site materials to standard Maven place
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-08-05 15:22:46 +08:00
2bde7a1077
HBASE-18020 Update API Compliance Checker to Incorporate Improvements Done in Hadoop
...
- Converted to python
- Updated to most recent release of Java ACC
- Added ability to include known number of problems
Author: Andrew Wang
Amending-Author: Alex Leblang
Amending-Author: Sean Busbey
Signed-off-by: Dima Spivak <dimaspivak@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-08-04 12:05:10 -05:00
bdc94b1d6b
HBASE-18147 POC jenkinsfile for nightly checks.
...
* adds ruby tools to dockerfile
* adds rubocop to dockerfile
* adds ruby-lint to dockerfile
* adds perlcritic to dockerfile
Signed-off-by: Alex Leblang <awleblang@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2017-07-20 17:07:33 -05:00
ea0062fa54
HBASE-18376 Add debug logs to hbase-personality.sh to make it possible to debug this issue.
...
Change-Id: I172b95ed6a387ddb507abc6645a0c3aa704321fc
2017-07-14 12:33:42 -07:00
500592dfd0
HBASE-18339 Update to hadoop3-alpha4
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-07-13 10:03:03 -05:00
7d08c78103
HBASE-18341 (addendum) Replace '.' in test names with '_' when using them as html ids since
...
dot have special significance in CSS selectors.
Without it, we weren't able to select elements and add svg (trends columns) to them.
Change-Id: Ia63ff0851f0a2fad0789a24edf2f0ad00060d578
2017-07-10 12:04:05 -07:00
590f02aad0
HBASE-18341 Generalize regex matchers in findHangingTests.py script to match new consoleText of trunk build.
...
Change-Id: I0a4215827d3d561eef3f583da666c617f690d934
2017-07-08 00:50:20 -07:00
30d06dfe3a
HBASE-18327 redo test-patch personality 'hadoopcheck' to better account for feature branches
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-07-07 23:07:50 -04:00
58b377751a
HBASE-18179 Add new hadoop releases to the pre commit hadoop check
2017-06-14 14:20:01 +08:00
f5768b4306
HBASE-18200 Set hadoop check versions for branch-2 and branch-2.x in pre commit
2017-06-13 16:31:34 +08:00
7a535f5843
HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
...
Use https for fetching d3 since builds.apache.org is also https. Otherwise d3 script is not loaded (unless browser is explicitly told to do so) and the fancy status markers are not drawn.
Change-Id: I97f7402141717da77499d09e44b05ecdd35c5a6f
2017-05-19 00:29:37 -07:00
7a0a66072d
HBASE-18076 (addendum) Flaky dashboard improvement: Add status markers to show trends of failure/success
...
Change-Id: I43851c52723de3d89ea4ca5fa49c86a178afba26
2017-05-18 19:10:19 -07:00
c51c36fd1f
HBASE-18076 Flaky dashboard improvement: Add status markers to show trends of failure/success.
2017-05-18 19:03:11 -07:00
841bb00655
HBASE-18044 Fix bug in report-flakies.py where if counter is set outside for loop, it cannot be overwritten inside loop.
...
http://stackoverflow.com/questions/7537439/how-to-increment-a-variable-on-a-for-loop-in-jinja-template
Change-Id: Ic404d6360fb646e6490d1487374520f9550b76b4
2017-05-15 14:15:57 -07:00
757bf379c1
HBASE-17985 Inline apt-get update calls in Yetus Dockerfile
2017-05-02 17:33:18 -04:00
fe3c32ebd5
HBASE-17809 cleanup unused class
2017-03-23 14:15:28 +08:00
41be3bc2cc
HBASE-17593 Update hadoop 3 version to 3.0.0-alpha2.
...
Change-Id: Ic5411229aaab3d645dc6751ecfbbda1b2d93a4b9
2017-02-06 12:18:21 -08:00
8f8daafee0
HBASE-17228 precommit grep -c ERROR may grab non errors I tested this by doing `cat /tmp/some_file_with_ERROR_combos|grep -c '\[ERROR\]'
...
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-02 08:51:21 -08:00
8d52d23c77
HBASE-17074 PreCommit job always fails because of OOM
2016-11-15 08:29:24 +08:00
c3b98b87fb
HBASE-16955 Fixup precommit protoc check to do new distributed protos and pb 3.1.0 build
2016-11-08 12:49:12 -08:00
339017f0f6
HBASE_16963 Fixup our hbase-personality post YETUS-322 flip verify_
...
result codes
This patch is about updating our hbase-personality for yetus.
Basic yetus methods flipped what was true and false but we did
not adjust our usage in accordance on an update. See
YETUS-322 flip verify_ result codes. I need this in place so I
can prove that there is nothing I have to do for this the parent
issue HBASE-16955 after I commit HBASE-16952, the revamp of how
we do proto generation. After HBASE-16952 the protoc check will do the
right thing in all cases (pb2.5 vs pb3.1 and we run the protoc
in any module that has protos in it)
2016-10-28 15:34:50 -07:00
187ff190ed
HBASE-16887 Allow setting different hadoopcheck versions in precommit for different branches
2016-10-24 09:58:21 +08:00
1b005f30e4
HBASE-16733 add hadoop 3.0.0-alpha1 to precommit checks
2016-10-18 01:30:03 -07:00
de7316b11e
HBASE-16720 Sort build ids in flaky dashboard.
...
Change-Id: Ie44c7d699486a3468c92351c0e2146151e722764
2016-09-27 15:40:43 -07:00
2765b9d9d9
HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes)
2016-09-24 16:07:25 -07:00
7bda5151ee
HBASE-16591 Add a docker file only contains java 8 for running pre commit on master
2016-09-11 13:02:36 +08:00
1da0a48f6b
HBASE-16535 Use regex to exclude generated classes for findbugs
2016-08-31 14:42:32 +08:00
0d6c4d92ed
HBASE-16434
...
- Add date and count of flaky tests
- Sort tests by decreasing order of flakyness
- Internal links to each job's results
- Correct calculation of total bad runs for a test
- Fixes pylint errors
Change-Id: I12ebc32ccec14c5ff389464b4de8ae93653c876c
2016-08-19 09:55:29 -07:00
7999bb9bd3
HBASE-16384 Update report-flakies.py script to allow specifying a list of build ids to be excluded.
...
Also fixes some pylint errors.
Change-Id: I4620756c277c36a1ddb6d6cbd4d3e380da8442d7
2016-08-17 13:45:22 -07:00
ccf5d27d7a
HBASE-12721 Create Docker container cluster infrastructure to enable better testing
...
Amending-Author: Sean Busbey <busbey@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-17 12:03:47 -07:00
938ee73e7c
HBASE-15882 Upgrade to yetus precommit 0.3.0
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-08-06 01:23:20 -05:00
9454daf25b
HBASE-16241 Allow specification of annotations to use when running check_compatibility.sh
...
* Also some trivial cleanup of spacing to undo poor formatting decisions
of the past.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-19 07:27:32 -05:00
1fbded61c1
HBASE-16124 Make check_compatibility.sh less verbose when building HBase
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-30 10:21:16 -05:00
294c2dae9e
HBASE-16129 check_compatibility.sh is broken when using Java API Compliance Checker v1.7
...
* This commit also fixes some stray tabs that got into the script at
some point.
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-29 11:26:52 -05:00
Peter Somogyi
Duo Zhang
Rushabh
Gav
Sean Busbey
meiyi
Artem Ervits
stack
Josh Elser
Guanghao Zhang
Andrew Purtell
Tak Lon (Stephen) Wu
Apache9
Tommy Li
Wellington Chevreuil
Mike Drob
Ankit Singhal
Yu Li
Nihal Jain
Apekshit Sharma
Alex Leblang
Niels Basjes
Misty Stanley-Jones
Chia-Ping Tsai
Dima Spivak
Umesh Agashe
Tamas Penzes
Esteban Gutierrez
Jan Hentschel
Jonathan M Hsieh
Jerry He
Dima Spivak
Jurriaan Mous