Commit Graph

9434 Commits

Author SHA1 Message Date
Liangjun He 679dfcfd4f HBASE-27274 Re-enable the disabled tests when implementing HBASE-27212 (#5178)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang 8fe691c705 HBASE-27775 Use a separate WAL provider for hbase:replication table (#5157)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-15 22:53:48 +08:00
Liangjun He 650350a749 HBASE-27623 Start a new ReplicationSyncUp after the previous failed (#5150)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang 000e64abda HBASE-27216 Revisit the ReplicationSyncUp tool (#4966)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang 7c74f9e8c5 HBASE-27430 Should disable replication log cleaner when migrating replication queue data (#4901)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang dfb125f3b2 HBASE-27429 Add exponential retry backoff support for MigrateReplicationQueueFromZkToTableProcedure
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-15 22:53:48 +08:00
LiangJun He ffad1ff727 HBASE-27217 Revisit the DumpReplicationQueues tool (#4810)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang 0d57ee147e HBASE-27218 Support rolling upgrading (#4808)
Signed-off-by: Yu Li <liyu@apache.org>
2023-05-15 22:53:48 +08:00
LiangJun He 5f95a914b6 HBASE-27405 Fix the replication hfile/log cleaner report that the replication table does not exist (#4811)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang c01c8e45b4 HBASE-27392 Add a new procedure type for implementing some global operations such as migration (#4803)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2023-05-15 22:53:48 +08:00
Duo Zhang 7044150545 HBASE-27215 Add support for sync replication (#4762)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-05-15 22:53:48 +08:00
Duo Zhang 6d0311c1d9 HBASE-27214 Implement the new replication hfile/log cleaner (#4722)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2023-05-15 22:53:48 +08:00
Duo Zhang f81bdebedb HBASE-27213 Add support for claim queue operation (#4708)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2023-05-15 22:53:48 +08:00
Duo Zhang e2d8db6dfc HBASE-27212 Implement a new table based replication queue storage and make the minimum replication system work (#4672)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2023-05-15 22:53:48 +08:00
Duo Zhang 8b8c684bcc
HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237)
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2023-05-15 10:35:40 +08:00
Kota-SH e343584b50
HBASE-27852: Interrupt BucketCachePersister thread when BucketCache is shutdown (#5230)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-05-12 10:43:27 +01:00
Jonathan Albrecht 55aff4ceef
HBASE-27851 Fix TestListTablesByState which is silently failing due to a surefire bug (#5227)
surefire version 3.0.0-M6 has a bug where tests end up being removed from
the test results if they fail with a long exception message. See:

https://issues.apache.org/jira/browse/SUREFIRE-2079

TestListTablesByState is currently failing due to an error. However,
it is being missed because of the surefire bug. I found this while testing
the final surfire 3.0.0 version which fixes the bug and the test then
shows up as failing.

Co-authored-by: Jonathan Albrecht <jonathan.albrecht@ibm.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-11 23:08:12 +08:00
alan.zhao 5cea8112fd
HBASE-27733 hfile split occurs during bulkload, the new HFile file does not specify favored nodes (#5121)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-05-10 21:47:20 +08:00
bsglz 5d82d4f746
HBASE-27788 Skip family comparing when compare cells inner the store (#5171)
* HBASE-27788 Skip family comparing when compare cells inner the store
2023-05-10 10:15:07 +08:00
Ruanhui d49df8b7a9
HBASE-27844 changed type names to avoid conflicts with built-in types (#5223)
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-08 21:32:21 +08:00
Kota-SH dca0622b62 HBASE-27752: Update the list of prefetched files upon region movement (#5194)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-05-05 09:55:17 +01:00
Wellington Ramos Chevreuil ab8880d3be Revert "HBASE-27752: Update the list of prefetched files upon region movement (#5194)"
This reverts commit ece8d014af.
2023-05-05 09:54:28 +01:00
Kota-SH ece8d014af
HBASE-27752: Update the list of prefetched files upon region movement (#5194)
Co-authored-by: Shanmukha Kota <skota@cloudera.com>
2023-05-04 16:00:32 +01:00
Duo Zhang 78610decaa
HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:59:40 +08:00
Duo Zhang 89e80da57f
HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216)
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:59:07 +08:00
Duo Zhang b59eb96407
HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:58:38 +08:00
Duo Zhang 4e69921a00
HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:58:20 +08:00
Duo Zhang 21d61cfa1c
HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208)
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-01 21:14:46 +08:00
Duo Zhang 1ced254b8d
HBASE-27818 Split TestReplicationDroppedTables (#5206)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-28 09:58:05 +08:00
Nihal Jain a1f2b4e1d0
HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-25 09:42:01 +05:30
haosen chen 95f83cb8e2
HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-23 23:20:47 +08:00
Nihal Jain e86f930894
HBASE-20804 Document and add tests for HBaseConfTool (#5190)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-23 23:20:12 +08:00
Duo Zhang 18ae733b15
HBASE-27806 Support dynamic reinitializing replication peer storage (#5195)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-23 22:25:31 +08:00
Ray Mattingly ced4ff1804
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-21 21:16:57 -07:00
chenglei 269586c4cf
HBASE-27785 Encapsulate and centralize totalBufferUsed in Replication… (#5168)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-21 20:59:16 +08:00
Duo Zhang f5ee958ead HBASE-27783 Addendum forward port the test improvement when backporting to branch-2 2023-04-20 15:25:59 +08:00
Duo Zhang 398c5ef313
HBASE-27783 Implement a shell command to disable all peer modification (#5182)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-19 22:07:29 +08:00
Nick Dimiduk 63471efa25
HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-17 14:22:04 +02:00
Nihal Jain 24c471a0b3
HBASE-27791 Upgrade vega and its related js libraries (#5173)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-17 12:46:07 +02:00
Ray Mattingly 2b098b0819
HBASE-27536: Include more request information in slowlog for Scans (#5155)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-04-16 10:03:53 -04:00
Kota-SH 856fa14537
HBASE-27422: Support replication for hbase:acl (#4827)
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-14 10:19:29 +01:00
Duo Zhang a71105997f
HBASE-27727 Implement filesystem based Replication peer storage (#5165)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-13 18:58:02 +08:00
Nick Dimiduk f36587c648
HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-08 11:02:09 +08:00
chenglei a370099aaa
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may … (#5158)
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-06 21:14:33 +08:00
bsglz a363b76d81
HBASE-27765 Add biggest cell related info into web ui (#5151)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-05 21:42:13 +08:00
Bryan Beaudreault e5620e26a2
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5141)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-29 16:20:29 -04:00
Bryan Beaudreault c52f4b286c
HBASE-27704 Quotas can drastically overflow configured limit (#5099)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-29 16:19:13 -04:00
Xiaolin Ha f5437b9ceb
HBASE-27333 Abort RS when the hostname is different from master seen (#4732)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-03-28 15:17:16 +08:00
Bryan Beaudreault c825c960d6
HBASE-27532 Add block bytes scanned metrics (#5067)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-27 16:03:15 -04:00
Kota-SH a6dad700db
HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-03-27 10:49:55 +01:00