Commit Graph

575 Commits

Author SHA1 Message Date
Michael Stack 7a532f8328
HBASE-25380 [create-release] Add timestamping to log output (#2758)
Added logging of timestamp so we can tell where we are spending time.
Added context to the README copied from head of entrance script.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-12-09 16:54:18 -08:00
Michael Stack 7851438379
HBASE-25376 [create-release] Fix double .asc (#2755)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-12-09 12:18:08 -08:00
z-york fbe338de1a
HBASE-25362 Fix quoting in hbase-vote to avoid voting build failures (#2737)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Stephen Wu <taklwu@apache.org>
2020-12-08 23:34:18 -08:00
stack b26395f3bb HBASE-25354 Update create-release scripts; rotted
README
 Add note on ssh-agent.

dev-support/create-release/do-release.sh
 move gpg check to non-docker context. Also cleanup tmp files when done.

dev-support/create-release/hbase-rm/Dockerfile
dev-support/create-release/mac-sshd-gpg-agent/Dockerfile
 Hack to update packages... the old ones  no longer available.

dev-support/create-release/release-util.sh
 Allow that there are no JIRA changes in a release. Good for testing.
2020-12-04 09:00:32 -08:00
Michael Stack c9156e7891
HBASE-25284 Check-in "Enable memstore replication..." design (#2680)
Update the design document to the state as of not. Adds a paragraph
on the preamble. See discussion on end of HBASE-25284.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-11-21 08:45:44 -08:00
Sean Busbey ca129e99ce
HBASE-25083 further HBase 1.y releases should have Hadoop 2.10 as a minimum version. (#2656) 2020-11-17 08:49:00 -06:00
stack bac459d693 HBASE-25284 Check-in "Enable memstore replication..." design 2020-11-14 09:12:03 -08:00
Viraj Jasani 4bd9ee43a4
HBASE-25245 : Fixing incorrect maven and jdk names for generate-hbase-website
Closes #2624

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-11-04 16:09:38 +05:30
Nick Dimiduk 7a41247ef7
HBASE-25228 Delete dev-support/jenkins_precommit_jira_yetus.sh (#2611)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-11-02 13:11:09 -08:00
Nick Dimiduk eee1cf7ff6 HBASE-24200 Upgrade to Yetus 0.12.0
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-29 15:45:01 -07:00
Nick Dimiduk 259fe1984a
HBASE-24845 Git/Jira Release Audit: limit branches when building audit db (#2238)
Populating the audit database with release tag information from git is
time consuming. Until that's sorted out, give the user a flag for
limiting which branches they want to be reviewed.

Signed-off-by:  Andrew Purtell <apurtell@apache.org >
2020-10-29 09:21:18 -07:00
Duo Zhang 200343c59c
HBASE-25203 Change the reference url to flaky list in our jenkins jobs (#2566)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-10-20 17:00:06 +08:00
Guanghao Zhang 28f2c176ec
HBASE-25204 Nightly job failed as the name of jdk and maven changed (#2567)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-20 16:58:43 +08:00
Duo Zhang 90052ccf1b
HBASE-25194 Do not publish workspace in flaky find job (#2564)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-10-20 11:51:34 +08:00
Nick Dimiduk bc20203965
"HBASE-25144 Add Hadoop-3.3.0 to personality hadoopcheck" try again (#2536)
Due to HBASE-23834, HBASE-19256, HADOOP-16152, HBase 2.2.x and 2.3.x
cannot run on Hadoop 3.3.0, or any Hadoop version that has upgraded to
Jetty 9.4.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-13 10:18:47 +08:00
Qi Yu c367e91aff
HBASE-25162 Make flaky tests run more aggressively (#2525)
Change the trigger interval from 12h to 4h

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-10 16:09:39 +08:00
Duo Zhang f34ba06468
HBASE-25163 Increase the timeout value for nightly jobs (#2512)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-10-10 08:22:12 +08:00
Nick Dimiduk a8c49a6463
HBASE-25144 Add Hadoop-3.3.0 to personality hadoopcheck (#2492)
Now that Hadoop 3.3.0 is released, let's figure out where it goes in
our testing matrix. Start by adding it to precommit checks.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Matt Foley <mattf@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-10-06 12:00:56 -07:00
Nick Dimiduk 16251dbb53
HBASE-25143 Remove branch-1.3 from precommit and docs (#2491)
Following the announcement [0] to EOL branch-1.3, update the precommit
script to not consider this branch any longer, and refresh mentions of
this branch in the doc.

[0]: https://lists.apache.org/thread.html/r9552e9085aaac2a43f8b26b866d34825a84a9be7f19118ac560d14de%40%3Cuser.hbase.apache.org%3E

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-10-05 11:51:59 -07:00
Duo Zhang 11a336a74a Revert "HBASE-25134 Migrate HBase PreCommit jenkins job from Hadoop to hbase (#2488)"
This reverts commit 5351aca8a1.
2020-10-01 22:15:15 +08:00
Duo Zhang 5351aca8a1
HBASE-25134 Migrate HBase PreCommit jenkins job from Hadoop to hbase (#2488) 2020-10-01 14:33:02 +08:00
Duo Zhang e663f098d8
HBASE-25133 Migrate HBase Nightly jenkins job from Hadoop to hbase (#2487) 2020-10-01 14:32:49 +08:00
Duo Zhang 1ce1cf66dd
HBASE-25132 Migrate flaky test jenkins job from Hadoop to hbase (#2485) 2020-10-01 14:30:27 +08:00
Duo Zhang 9d6af969ac HBASE-25107 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-29 15:25:14 +08:00
Duo Zhang 3aa612f0fe Revert "HBASE-25017 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)"
This reverts commit fbef545989.
2020-09-29 15:25:05 +08:00
Duo Zhang fbef545989
HBASE-25017 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-28 20:01:43 +08:00
Nick Dimiduk c86b0655a3 HBASE-25085 Add support for java properties to hbase-vote.sh
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Tak-Lon (Stephen) Wu <taklwu@apache.org>
2020-09-25 15:21:24 -07:00
Istvan Toth d1a3b66074
HBASE-25081 Up the container nproc uplimit to 30000 (#2439) 2020-09-22 08:53:15 -07:00
Nick Dimiduk 5e12c0aae5
HBASE-25061 Update default URL to KEYS file in `hbase-vote.sh` (#2416)
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-18 13:20:44 -07:00
Duo Zhang b3dfc8f714
HBASE-25021 Nightly job should skip hadoop-2 integration test for master (#2409)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-17 08:48:11 +08:00
Abhey 979edfe720
HBASE-24809 Fix broken Apache Yetus documentation links
Closes #2335

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-31 20:57:58 +05:30
Duo Zhang 1231ac0784
HBASE-24799 Do not call make_binary_release for hbase-thirdparty in release scripts (#2177)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-08-19 11:28:33 +08:00
Guanghao Zhang d2eb69df77 HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:50:25 +08:00
Nick Dimiduk b8fd621201 HBASE-24568 do-release need not wait for tag
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Matt Foley <mattf@apache.org>
2020-08-12 13:26:44 -07:00
Sean Busbey 6de8a75433
HBASE-24869 migrate website generation to new asf jenkins
closes #2246

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-12 09:48:41 -05:00
Duo Zhang 6fd7dcef28
HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 08:41:16 +08:00
Duo Zhang 206d0a02f2
HBASE-24838 The pre commit job fails to archive surefire reports (#2224)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-08-10 09:53:16 +08:00
Sean Busbey 3470feed91
HBASE-24476 release scripts should provide timing information (#2145)
Signed-off-by: Matt Foley <mattf@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-08-01 22:43:46 -05:00
Sean Busbey fe5571bfe6
HBASE-24572 release scripts should try to use a keyid when refering to GPG keys. (#2001)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-08-01 22:28:23 -05:00
Peter Somogyi 6c9534c804
HBASE-24711 Previous RC Release notes are not removed (#2046)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-10 18:24:04 +02:00
pengmq1 be57e40f36
HBASE-24289 Heterogeneous Storage for Date Tiered Compaction (#1730)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-30 15:10:04 +08:00
Sean Busbey 982bd5fadd
HBASE-24651 release script utils should set local user when GPG_KEY is defined.
closes #1992

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-29 23:05:08 -05:00
Nick Dimiduk 1378776a91
HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" (#1965)
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.

[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-25 21:24:10 +08:00
Sean Busbey 497862bb47
HBASE-23339 release scripts should use host gpg-agent when running in container.
* put together a docker container that can use host gpg-agent forwarded over ssh.
* use gpg-agent forwarding container on OS X and directly forward the agent on Linux
* clean up the release container on exit
* use docker mounts instead of the deprecated volume syntax
* use image names within our project namespace
* update README to walk through running on GCE with gpg-agent forwarding

closes #1620

Signed-off-by: Matt Foley <mattf@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-25 00:39:43 -05:00
Nick Dimiduk 90b339a4f2
HBASE-24567 Create release should url-encode all characters when building git uri
By default, `urllib.quote` will skipp over `/` characters, which are
valid for use in passwords.

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Matt Foley <mattf@apache.org>
2020-06-22 15:22:21 -07:00
Sean Busbey 2eb993a0f0
HBASE-24458 release scripts using docker should specify needed disk consistency
closes #1813

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-06-04 19:33:44 -05:00
bsglz 7b7e25a50b
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 (#1797)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 17:33:18 +05:30
Bharath Vissapragada 2382f90679
HBASE-24422: Remove hbase-native-client code from the master branch (#1766)
There is not much value in having this code in the master branch.
This code has it's dedicated git repo at
https://github.com/apache/hbase-native-client.

It was already removed from branch-1 (HBASE-19419) and branch-2
(HBASE-19176)

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-05-24 16:19:58 -07:00
Sean Busbey a9fefd7f53
HBASE-24297 release scripts should be able to use a custom git repo
* adds a optional -r [repo] arg
* if the passed repo is on the local filesystem, creates a container mount
* when cloning a local repo configure git to share objects with the local repo instead of copying
* when cloning a local repo in a container configure the clone to have a remote that will work back on the host.

closes #1725

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-05-22 22:24:12 -05:00
Sean Busbey 8ff8e70edf
HBASE-24296 install yetus as a part of building the rm docker image.
* non-zero exit for usage
* in non-docker mode prompt for yetus install location
* make sure we exit if YETUS_HOME does not actually point at a yetus install.

closes #1726

Signed-off-by: Matt Foley <mattf@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-05-22 22:24:03 -05:00