18343 Commits

Author SHA1 Message Date
Xiaolin Ha
7d78979c49 HBASE-27897 ConnectionImplementation#locateRegionInMeta should pause and retry when taking user region lock failed (#5258)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-06-07 17:13:27 +08:00
Jack-cc
e3e6f4ceea HBASE-27899 Beautify the output information of the getStats method in ReplicationSource (#5269)
Signed-off-by: 874645213@qq.com <jiancong123~>
Co-authored-by: 874645213@qq.com <jiancong123~>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3df01ea9b6de69de38bd82304c37ee274839d91f)
2023-06-06 22:21:35 +08:00
Rahul Agarkar
61a876f5a9
HBASE-27820: HBase is not starting due to Jersey library conflicts wi… (#5210) (#5261)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-06-01 14:09:47 +01:00
Shuhei Yamasaki
53a637da3a HBASE-27876 Only generate SBOM when releasing (#5251)
Move CycloneDX plugin to profile section

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 256e5e9cd8d36c6cc25e3d0b100929ac974e2093)
2023-05-24 23:25:23 +08:00
dependabot[bot]
c34dc76d40 HBASE-27880 Bump requests from 2.28.1 to 2.31.0 in /dev-support/flaky-tests (#5250)
Bumps [requests](https://github.com/psf/requests) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 22526a6339afa230679bcf08fa1c917b04cdac6d)
(cherry picked from commit 6aeaaa119869b202fdf3d5aa3bb85ef344e37eb8)
2023-05-23 22:58:41 +08:00
Duo Zhang
34f724c32a HBASE-27277 TestRaceBetweenSCPAndTRSP fails in pre commit (#5248)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dc30ca552b37c864b962fbeaaed548523f30573b)
2023-05-23 22:50:35 +08:00
Wellington Ramos Chevreuil
4348695644 HBASE-27874 Problem in flakey generated report causes pre-commit run to fail (#5244)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewew-by: Kota-SH <shanmukhaharipriya@gmail.com>
(cherry picked from commit 0ba562ab4d2045e7377e8dea9dff94fb560b3ab3)
2023-05-22 14:49:07 +08:00
Shuhei Yamasaki
d196e63aaf HBASE-27634 Builds emit errors related to SBOM parsing (#5246)
Update CycloneDX version

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 49bdf6140eabcdbe2b1619bfb0f4de7f69b32c15)
2023-05-21 19:52:52 +08:00
guluo
fd4a1c6383 HBASE-27848:Should fast-fail if unmatched column family exists when using ImportTsv (#5225)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit ce29f97a809a849bf067fa3571fd775fb596fc10)
2023-05-21 19:49:05 +08:00
Duo Zhang
364cb370df HBASE-27870 Eliminate the 'WARNING: package jdk.internal.util.random not in java.base' when running UTs with jdk11 (#5242)
Signed-off-by: Tianhang Tang <tianhang@apache.org>
(cherry picked from commit 71d7996047001d0be56915bbabed1fb0e552192b)
2023-05-18 23:20:47 +08:00
Duo Zhang
fcda18cbd0 HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237)
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8b8c684bcc0060af0d9244dba86b6a46d2cdc30e)
2023-05-15 10:44:51 +08:00
Duo Zhang
4169b61766 HBASE-27865 TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule (#5238)
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit fd4f984d87dc189f7afc6ddc50d5373e23b46ad5)
2023-05-15 10:44:46 +08:00
Duo Zhang
180d7ce5ce HBASE-27863 Add hadoop 3.3.5 check in our personality script (#5236)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b28feeb989bec9709fcfbaa5066669cedea77bda)
2023-05-15 10:44:40 +08:00
Jonathan Albrecht
3a68cddaab HBASE-27858 Update surefire version to 3.1.0 and use SurefireForkNodeFactory (#5234)
Surefire version updated from 3.0.0-M6 -> 3.1.0.

SurefireForkNodeFactory is a new strategy to control how the forked
nodes communicate with the main maven process. It uses a tcp channel
instead of pipes and fixes some corrupted messages seen in the s390x
build.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 67612cc264dd44845e0797178e0b7678376b7cbe)
2023-05-13 19:03:07 +08:00
Shuhei Yamasaki
9198494aa4 HBASE-27860 Fix build error against Hadoop 3.3.5 (#5233)
Add packages for hadoop-3.3.5

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bee09bbd61e077fd398cd534ed28e2305a66c85c)
2023-05-13 09:08:55 +08:00
Jonathan Albrecht
4df157dbd7 HBASE-27857 Fix timeout exception handling in HBaseClassTestRule. (#5231)
HBaseClassTestRule applies a timeout and a system exit rule to tests.
The timeout rule throws an exception if it hits the timeout threshold.
Since the timeout rule is applied after the system exit rule, the
system exit rule does not see the exception and does not re-enable
the system exit behavior which can cause maven to hang on some
tests.

This change applies the timeout rule before the system exit rule so
that normal system exit can be restored before the surefire forked
node is shutdown.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 220eacf7c56f00a9c8746295fbc46db8a7a66da2)
2023-05-13 09:08:26 +08:00
Ruanhui
357866b020 HBASE-27844 changed type names to avoid conflicts with built-in types (#5223)
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d49df8b7a96cbeca60c09f837f2cd4f2067f9ddf)
2023-05-08 23:22:16 +08:00
Ray Mattingly
05de158ccf HBASE-27799: RpcThrottlingException wait interval message is misleading between 0-1s (#5192)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-05-04 14:33:26 -04:00
Duo Zhang
458d74671a HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 78610decaa5b6b5eca8c770e0eb33f73f27b83a9)
2023-05-04 23:14:45 +08:00
Duo Zhang
0b8fa5adb3 HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216)
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 89e80da57f29b501ffe9ca852bca8dcd3462ef86)
2023-05-04 22:51:57 +08:00
Duo Zhang
af7816932f HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b59eb9640749bfb1bc22bbcb4a36921b79ad176f)
2023-05-04 22:25:13 +08:00
Duo Zhang
3d949e535a HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 4e69921a001decc73a3fb0bc0d7e94789b440afb)
2023-05-04 22:21:57 +08:00
Nihal Jain
d23bd5fda8
HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5217) 2023-05-03 18:29:54 +05:30
Andor Molnár
2bd56661fc
HBASE-27810. Check if event processor is already shut down (#5212) 2023-05-01 21:19:09 +05:30
Nick Dimiduk
c02eb87239 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum for branch-2.4,5) 2023-05-01 17:45:58 +02:00
Nick Dimiduk
ed76779b90 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum)
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
2023-05-01 17:45:58 +02:00
Nick Dimiduk
1d3d900957 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-01 17:45:58 +02:00
Duo Zhang
a417e5e61e HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208)
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c469c31041151481d6b5c5381393599)
2023-05-01 21:47:47 +08:00
Duo Zhang
34b5d64ae0 HBASE-27818 Split TestReplicationDroppedTables (#5206)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d1208f543f936d477ff751b06e2ab73)
2023-04-28 10:00:21 +08:00
Nihal Jain
14bee69f77 HBASE-20804 Document and add tests for HBaseConfTool (#5190)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f9308944bd57f34da64746adfda75f093b825)
2023-04-23 23:43:52 +08:00
haosen chen
0e224b1ef6 HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e242f5d8b9fb55b9d406c3ba54b5cb92)
2023-04-23 23:34:25 +08:00
Kota-SH
81671f2b3f HBASE-27422: Support replication for hbase:acl (#4827)
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry-picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
2023-04-14 10:55:17 +01:00
Bryan Beaudreault
6b6902d2b9 HBASE-27768 Race conditions in BlockingRpcConnection (#5154)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-04-10 15:30:03 -04:00
tianhang
c1743794ac HBASE-27713 Remove numRegions in Region Metrics (#5107)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e4984776e2ee13ae4df1de4c000f35a58ad59)
2023-04-08 15:09:45 +08:00
Nick Dimiduk
34e05b7ce4 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c6486468f6b19f7419c9a263ed81d8bdc7)
2023-04-08 11:05:48 +08:00
chenglei
dbb222cad4
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up (#5163)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-07 16:45:01 +08:00
Bryan Beaudreault
67db87d879 HBASE-27704 Quotas can drastically overflow configured limit (#5153)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-03 17:12:43 -04:00
Bryan Beaudreault
dedf1f9fbe HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-03 17:12:39 -04:00
Tak Lon (Stephen) Wu
cc57d676cd Preparing development version 2.4.18-SNAPSHOT
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-03-31 18:03:45 +00:00
Tak Lon (Stephen) Wu
7fd096f39b Preparing hbase release 2.4.17RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2.4.17RC0 rel/2.4.17
2023-03-31 18:03:27 +00:00
Rishabh Murarka
912b6d18c0 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147)
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
2023-03-29 14:33:24 +05:30
dependabot[bot]
b0b03732d3 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb4338876b8d7da9dcad7383bdf1fc9c90c87)
2023-03-24 21:57:08 +08:00
Duo Zhang
e95b47e856 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119)
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50578144d3e0916c33d4532bb8644763)
2023-03-24 17:59:21 +08:00
Duo Zhang
00fc40ab9b HBASE-26866 Shutdown WAL may abort region server (#4254)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a7636958970d37bfcd775fd55e8de98177)
2023-03-24 16:09:03 +08:00
Xiaolin Ha
007eacc69e HBASE-26526 Introduce a timeout to shutdown of WAL (#3297)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cbc322b0824d2d755bcf4191c3a525ed)
2023-03-24 16:08:41 +08:00
Nick Dimiduk
39c4d01c87 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-22 15:19:18 +01:00
Xiaolin Ha
8b0ae80da9 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:11:30 +08:00
Victor
de375bc6c8
HBASE-27684: add client metrics related to user region lock. (#5081) (#5133)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
2023-03-21 16:46:00 -07:00
xuzifu666
4ebf6c8d55 HBASE-27736 HFileSystem.getLocalFs is not used (#5125)
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e848d34db432526dee86289439594510)
2023-03-21 22:57:04 +08:00
Nihal Jain
7fa8f4d309
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired (#5118) 2023-03-20 15:13:31 -07:00