Commit Graph

583 Commits

Author SHA1 Message Date
Michael Stack 54eae0fc5c
HBASE-25473 [create-release] checkcompatibility.py failing with "KeyError: 'binary'" (#2862)
Exclude hbase-shaded-testing-util*.jar from checkcompatibility; this
jar can not be unzipped on a case-insensitive filesystem. Added
some means of debug into the checkcompatibility to help when
cryptic failures.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-01-08 14:45:45 -08:00
Nick Dimiduk 84c4033b1a
HBASE-25489 improve performance of --parse-release-tags (#2867)
Profiler shows a lot of time spent in the UPDATE SQL statement. Remove the tight loop and let SQL
do a bulk-update instead.

Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-01-08 14:43:56 -08:00
Michael Stack 8f55a2bb51
HBASE-25487 [create-release] changes.md update broken (#2864)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2021-01-08 12:38:45 -08:00
Nick Dimiduk 2444d26890
HBASE-25468 Update git-jira-audit fallback_actions file with recent exceptions (#2852)
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
2021-01-07 09:44:33 -08:00
stack a5eb8f1f70 HBASE-25438 Update create-release mvn in Dockerfile; its 3.6.0; make … (#2807)
Addendum. Missing -L on added curl.
2021-01-05 19:39:39 -08:00
Michael Stack 2e21da7597
HBASE-25437 Update refguide RC section; point at the dev-tools/create-releases/README.txt rather than repeat its content (#2804)
M dev-support/create-release/README.txt
 Remove redundant text. Add some extra help around figuring state of
 gpg-agent.

M dev-support/create-release/do-release.sh
 Undo my mistaken commit where I undid test of gpg signing if under docker

M dev-support/create-release/release-build.sh
 Handle '-h'

M src/main/asciidoc/_chapters/developer.adoc
 Point to the README.txt under dev-tools/create-release rather than
 repeat the text in here. Be more insistent about using scripts.
2021-01-02 11:34:55 -08:00
Michael Stack 1ca49ea50c
HBASE-25438 Update create-release mvn in Dockerfile; its 3.6.0; make … (#2807) 2021-01-02 11:32:47 -08:00
Lokesh Khurana f8bd22827a
HBASE-24620 : Add a ClusterManager which submits command to ZooKeeper and its Agent which picks and execute those Commands (#2299)
Signed-off-by: Aman Poonia <apoonia@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-21 15:33:36 +05:30
Michael Stack 7a532f8328
HBASE-25380 [create-release] Add timestamping to log output (#2758)
Added logging of timestamp so we can tell where we are spending time.
Added context to the README copied from head of entrance script.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-12-09 16:54:18 -08:00
Michael Stack 7851438379
HBASE-25376 [create-release] Fix double .asc (#2755)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-12-09 12:18:08 -08:00
z-york fbe338de1a
HBASE-25362 Fix quoting in hbase-vote to avoid voting build failures (#2737)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Stephen Wu <taklwu@apache.org>
2020-12-08 23:34:18 -08:00
stack b26395f3bb HBASE-25354 Update create-release scripts; rotted
README
 Add note on ssh-agent.

dev-support/create-release/do-release.sh
 move gpg check to non-docker context. Also cleanup tmp files when done.

dev-support/create-release/hbase-rm/Dockerfile
dev-support/create-release/mac-sshd-gpg-agent/Dockerfile
 Hack to update packages... the old ones  no longer available.

dev-support/create-release/release-util.sh
 Allow that there are no JIRA changes in a release. Good for testing.
2020-12-04 09:00:32 -08:00
Michael Stack c9156e7891
HBASE-25284 Check-in "Enable memstore replication..." design (#2680)
Update the design document to the state as of not. Adds a paragraph
on the preamble. See discussion on end of HBASE-25284.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-11-21 08:45:44 -08:00
Sean Busbey ca129e99ce
HBASE-25083 further HBase 1.y releases should have Hadoop 2.10 as a minimum version. (#2656) 2020-11-17 08:49:00 -06:00
stack bac459d693 HBASE-25284 Check-in "Enable memstore replication..." design 2020-11-14 09:12:03 -08:00
Viraj Jasani 4bd9ee43a4
HBASE-25245 : Fixing incorrect maven and jdk names for generate-hbase-website
Closes #2624

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-11-04 16:09:38 +05:30
Nick Dimiduk 7a41247ef7
HBASE-25228 Delete dev-support/jenkins_precommit_jira_yetus.sh (#2611)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-11-02 13:11:09 -08:00
Nick Dimiduk eee1cf7ff6 HBASE-24200 Upgrade to Yetus 0.12.0
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-29 15:45:01 -07:00
Nick Dimiduk 259fe1984a
HBASE-24845 Git/Jira Release Audit: limit branches when building audit db (#2238)
Populating the audit database with release tag information from git is
time consuming. Until that's sorted out, give the user a flag for
limiting which branches they want to be reviewed.

Signed-off-by:  Andrew Purtell <apurtell@apache.org >
2020-10-29 09:21:18 -07:00
Duo Zhang 200343c59c
HBASE-25203 Change the reference url to flaky list in our jenkins jobs (#2566)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-10-20 17:00:06 +08:00
Guanghao Zhang 28f2c176ec
HBASE-25204 Nightly job failed as the name of jdk and maven changed (#2567)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-20 16:58:43 +08:00
Duo Zhang 90052ccf1b
HBASE-25194 Do not publish workspace in flaky find job (#2564)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-10-20 11:51:34 +08:00
Nick Dimiduk bc20203965
"HBASE-25144 Add Hadoop-3.3.0 to personality hadoopcheck" try again (#2536)
Due to HBASE-23834, HBASE-19256, HADOOP-16152, HBase 2.2.x and 2.3.x
cannot run on Hadoop 3.3.0, or any Hadoop version that has upgraded to
Jetty 9.4.

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-13 10:18:47 +08:00
Qi Yu c367e91aff
HBASE-25162 Make flaky tests run more aggressively (#2525)
Change the trigger interval from 12h to 4h

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-10-10 16:09:39 +08:00
Duo Zhang f34ba06468
HBASE-25163 Increase the timeout value for nightly jobs (#2512)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-10-10 08:22:12 +08:00
Nick Dimiduk a8c49a6463
HBASE-25144 Add Hadoop-3.3.0 to personality hadoopcheck (#2492)
Now that Hadoop 3.3.0 is released, let's figure out where it goes in
our testing matrix. Start by adding it to precommit checks.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Matt Foley <mattf@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-10-06 12:00:56 -07:00
Nick Dimiduk 16251dbb53
HBASE-25143 Remove branch-1.3 from precommit and docs (#2491)
Following the announcement [0] to EOL branch-1.3, update the precommit
script to not consider this branch any longer, and refresh mentions of
this branch in the doc.

[0]: https://lists.apache.org/thread.html/r9552e9085aaac2a43f8b26b866d34825a84a9be7f19118ac560d14de%40%3Cuser.hbase.apache.org%3E

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-10-05 11:51:59 -07:00
Duo Zhang 11a336a74a Revert "HBASE-25134 Migrate HBase PreCommit jenkins job from Hadoop to hbase (#2488)"
This reverts commit 5351aca8a1.
2020-10-01 22:15:15 +08:00
Duo Zhang 5351aca8a1
HBASE-25134 Migrate HBase PreCommit jenkins job from Hadoop to hbase (#2488) 2020-10-01 14:33:02 +08:00
Duo Zhang e663f098d8
HBASE-25133 Migrate HBase Nightly jenkins job from Hadoop to hbase (#2487) 2020-10-01 14:32:49 +08:00
Duo Zhang 1ce1cf66dd
HBASE-25132 Migrate flaky test jenkins job from Hadoop to hbase (#2485) 2020-10-01 14:30:27 +08:00
Duo Zhang 9d6af969ac HBASE-25107 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-29 15:25:14 +08:00
Duo Zhang 3aa612f0fe Revert "HBASE-25017 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)"
This reverts commit fbef545989.
2020-09-29 15:25:05 +08:00
Duo Zhang fbef545989
HBASE-25017 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-28 20:01:43 +08:00
Nick Dimiduk c86b0655a3 HBASE-25085 Add support for java properties to hbase-vote.sh
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Tak-Lon (Stephen) Wu <taklwu@apache.org>
2020-09-25 15:21:24 -07:00
Istvan Toth d1a3b66074
HBASE-25081 Up the container nproc uplimit to 30000 (#2439) 2020-09-22 08:53:15 -07:00
Nick Dimiduk 5e12c0aae5
HBASE-25061 Update default URL to KEYS file in `hbase-vote.sh` (#2416)
Co-authored-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-18 13:20:44 -07:00
Duo Zhang b3dfc8f714
HBASE-25021 Nightly job should skip hadoop-2 integration test for master (#2409)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-17 08:48:11 +08:00
Abhey 979edfe720
HBASE-24809 Fix broken Apache Yetus documentation links
Closes #2335

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-31 20:57:58 +05:30
Duo Zhang 1231ac0784
HBASE-24799 Do not call make_binary_release for hbase-thirdparty in release scripts (#2177)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-08-19 11:28:33 +08:00
Guanghao Zhang d2eb69df77 HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-13 16:50:25 +08:00
Nick Dimiduk b8fd621201 HBASE-24568 do-release need not wait for tag
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Matt Foley <mattf@apache.org>
2020-08-12 13:26:44 -07:00
Sean Busbey 6de8a75433
HBASE-24869 migrate website generation to new asf jenkins
closes #2246

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-12 09:48:41 -05:00
Duo Zhang 6fd7dcef28
HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-11 08:41:16 +08:00
Duo Zhang 206d0a02f2
HBASE-24838 The pre commit job fails to archive surefire reports (#2224)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-08-10 09:53:16 +08:00
Sean Busbey 3470feed91
HBASE-24476 release scripts should provide timing information (#2145)
Signed-off-by: Matt Foley <mattf@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-08-01 22:43:46 -05:00
Sean Busbey fe5571bfe6
HBASE-24572 release scripts should try to use a keyid when refering to GPG keys. (#2001)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-08-01 22:28:23 -05:00
Peter Somogyi 6c9534c804
HBASE-24711 Previous RC Release notes are not removed (#2046)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-10 18:24:04 +02:00
pengmq1 be57e40f36
HBASE-24289 Heterogeneous Storage for Date Tiered Compaction (#1730)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-06-30 15:10:04 +08:00
Sean Busbey 982bd5fadd
HBASE-24651 release script utils should set local user when GPG_KEY is defined.
closes #1992

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-06-29 23:05:08 -05:00