Commit Graph

18731 Commits

Author SHA1 Message Date
Yash Dodeja bf07ff4013 HBASE-27812 Provide option in HBase UI to disable stack trace for security (#5205)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit cf9684de44)
2023-05-21 19:48:32 +08:00
Duo Zhang e70b468519 HBASE-27870 Eliminate the 'WARNING: package jdk.internal.util.random not in java.base' when running UTs with jdk11 (#5242)
Signed-off-by: Tianhang Tang <tianhang@apache.org>
(cherry picked from commit 71d7996047)
2023-05-18 23:19:31 +08:00
Duo Zhang 2fc73585a7 HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237)
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8b8c684bcc)
2023-05-15 10:39:49 +08:00
Duo Zhang 409bafbf9c HBASE-27865 TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule (#5238)
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit fd4f984d87)
2023-05-15 10:39:41 +08:00
Duo Zhang 7ab5896256 HBASE-27863 Add hadoop 3.3.5 check in our personality script (#5236)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b28feeb989)
2023-05-15 10:39:19 +08:00
Jonathan Albrecht caa0f3a189 HBASE-27858 Update surefire version to 3.1.0 and use SurefireForkNodeFactory (#5234)
Surefire version updated from 3.0.0-M6 -> 3.1.0.

SurefireForkNodeFactory is a new strategy to control how the forked
nodes communicate with the main maven process. It uses a tcp channel
instead of pipes and fixes some corrupted messages seen in the s390x
build.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 67612cc264)
2023-05-13 19:01:25 +08:00
Shuhei Yamasaki 6f7663a78d HBASE-27860 Fix build error against Hadoop 3.3.5 (#5233)
Add packages for hadoop-3.3.5

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bee09bbd61)
2023-05-13 09:08:40 +08:00
Jonathan Albrecht 4aab6bb959 HBASE-27857 Fix timeout exception handling in HBaseClassTestRule. (#5231)
HBaseClassTestRule applies a timeout and a system exit rule to tests.
The timeout rule throws an exception if it hits the timeout threshold.
Since the timeout rule is applied after the system exit rule, the
system exit rule does not see the exception and does not re-enable
the system exit behavior which can cause maven to hang on some
tests.

This change applies the timeout rule before the system exit rule so
that normal system exit can be restored before the surefire forked
node is shutdown.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 220eacf7c5)
2023-05-13 09:08:09 +08:00
Kota-SH 40a8a2a651 HBASE-27852: Interrupt BucketCachePersister thread when BucketCache is shutdown (#5230)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit e343584b50)
2023-05-12 12:09:30 +01:00
Jonathan Albrecht 026ff18053 HBASE-27851 Fix TestListTablesByState which is silently failing due to a surefire bug (#5227)
surefire version 3.0.0-M6 has a bug where tests end up being removed from
the test results if they fail with a long exception message. See:

https://issues.apache.org/jira/browse/SUREFIRE-2079

TestListTablesByState is currently failing due to an error. However,
it is being missed because of the surefire bug. I found this while testing
the final surfire 3.0.0 version which fixes the bug and the test then
shows up as failing.

Co-authored-by: Jonathan Albrecht <jonathan.albrecht@ibm.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 55aff4ceef)
2023-05-11 23:13:33 +08:00
bsglz 9990d121b6 HBASE-27788 Skip family comparing when compare cells inner the store 2023-05-10 10:51:53 +08:00
Kota-SH a4eb499f62
HBASE-27752: Update the list of prefetched files upon region movement (#5194) (#5222)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit ece8d014af)
2023-05-09 20:55:09 +01:00
Ruanhui d89bb1cfd8 HBASE-27844 changed type names to avoid conflicts with built-in types (#5223)
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d49df8b7a9)
2023-05-08 23:21:59 +08:00
Jonathan Albrecht bcd2dfa9b3 HBASE-27838 Update zstd-jni from version 1.5.4-2 -> 1.5.5-2. (#5220)
Note: This version includes a fix that prevented zstd-jni from
running on s390x.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5d2b6956e5)
2023-05-05 12:02:46 +08:00
Ray Mattingly 0b7252bcfa HBASE-27799: RpcThrottlingException wait interval message is misleading between 0-1s (#5192)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-05-04 14:12:37 -04:00
Duo Zhang 2eee1cc7e4 HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 78610decaa)
2023-05-04 23:03:26 +08:00
Duo Zhang 1df5e40f73 HBASE-27823 Addendum fix compile error 2023-05-04 23:03:26 +08:00
Duo Zhang 558913ea1a HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216)
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 89e80da57f)
2023-05-04 22:35:15 +08:00
Duo Zhang 438d93b30f HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b59eb96407)
2023-05-04 22:24:56 +08:00
Duo Zhang 835077fa35 HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 4e69921a00)
2023-05-04 22:05:42 +08:00
Duo Zhang bf20017148
HBASE-27806 Addendum fix error prone error (#5214) 2023-05-03 19:52:01 +08:00
Nick Dimiduk b776c121d0 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum)
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
2023-05-01 17:45:05 +02:00
Nick Dimiduk da81079365 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-01 17:45:05 +02:00
Duo Zhang ce4a2bf77f HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208)
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c)
2023-05-01 21:22:09 +08:00
Andor Molnár de3d0aefe1 HBASE-27810. Check if the executor has already been shut down before submitting new job (#5207)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a6e89bf624)
2023-04-28 16:47:29 +02:00
Nihal Jain adfcea8073 HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-28 19:39:03 +05:30
Nick Dimiduk 0fb5053a43 HBASE-27808 Change flatten mode for oss in our pom file (#5201)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2cfa6822a)
2023-04-28 11:40:13 +08:00
Duo Zhang aa7486d598 HBASE-27818 Split TestReplicationDroppedTables (#5206)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d)
2023-04-28 10:00:02 +08:00
Nihal Jain 7434374900 HBASE-20804 Document and add tests for HBaseConfTool (#5190)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f930894)
2023-04-23 23:43:35 +08:00
haosen chen 157df067a4 HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e2)
2023-04-23 23:34:08 +08:00
Duo Zhang fe2992a312 HBASE-27806 Support dynamic reinitializing replication peer storage (#5195)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 18ae733b15)
2023-04-23 23:15:27 +08:00
Ray Mattingly e9ffc1b07e
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-21 21:20:04 -07:00
chenglei 0787199feb
HBASE-27785 Encapsulate and centralize totalBufferUsed in ReplicationSourceManager (#5196)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-21 21:52:40 +08:00
Duo Zhang 92a2868f37
HBASE-27783 Implement a shell command to disable all peer modification (#5182)(#5191)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-21 09:57:28 +08:00
Bryan Beaudreault 2ad3a804c8 HBASE-27787 Downgrade noisy info log in NettyRpcConnection when TLS enabled (#5169)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-18 14:33:29 -04:00
Nihal Jain f6900f8c63 HBASE-27791 Upgrade vega and its related js libraries (#5173)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-18 12:15:07 +02:00
Andrew Purtell 95c72bf38c HBASE-27796 Improve MemcachedBlockCache (#5181)
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-17 14:13:04 -07:00
Duo Zhang 04a4ac5ae9 HBASE-27728 Implement a tool to migrate replication peer data between different storage implementation (#5179)
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 31c4aea48c)

Conflicts:
	hbase-client/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationPeerConfig.java
	hbase-replication/src/test/java/org/apache/hadoop/hbase/replication/ReplicationPeerStorageTestBase.java
2023-04-17 22:47:52 +08:00
Ray Mattingly 1ae057b89f
HBASE-27536: Include more request information in slowlog for Scans (#5166)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-04-16 10:11:35 -04:00
Kota-SH b75c72d925 HBASE-27422: Support replication for hbase:acl (#4827)
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa14537)
2023-04-14 10:27:19 +01:00
Duo Zhang 3e6e9c5cca HBASE-27727 Implement filesystem based Replication peer storage (#5165)
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit a71105997f)
2023-04-13 19:45:20 +08:00
Bryan Beaudreault 08489365a5
HBASE-27768 Race conditions in BlockingRpcConnection (#5154)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-04-10 15:23:03 -04:00
Bryan Beaudreault a67a8f7fd3 HBASE-27780 FileChangeWatcher improvements (#5164)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-08 10:25:32 -04:00
tianhang 6305c7a4f2 HBASE-27713 Remove numRegions in Region Metrics (#5107)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e498477)
2023-04-08 15:09:25 +08:00
Nick Dimiduk f8c234e8d0 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c648)
2023-04-08 11:05:33 +08:00
chenglei 62ea717b31
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up (#5160)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-06 21:37:10 +08:00
bsglz 85793655d3 HBASE-27765 Add biggest cell related info into web ui (#5151)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a363b76d81)
2023-04-05 23:18:13 +08:00
Bryan Beaudreault cc00b8b8a8 HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-31 09:17:30 -04:00
Bryan Beaudreault 9f4b31e619
HBASE-27704 Quotas can drastically overflow configured limit (#5153)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-30 09:13:00 -04:00
Bryan Beaudreault e77e3ffa8f
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5152)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-30 09:12:26 -04:00