Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,721 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

9433 Commits

Author SHA1 Message Date
Duo Zhang 8fe691c705 HBASE-27775 Use a separate WAL provider for hbase:replication table (#5157) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-15 22:53:48 +08:00
Liangjun He 650350a749 HBASE-27623 Start a new ReplicationSyncUp after the previous failed (#5150) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang 000e64abda HBASE-27216 Revisit the ReplicationSyncUp tool (#4966) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang 7c74f9e8c5 HBASE-27430 Should disable replication log cleaner when migrating replication queue data (#4901) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang dfb125f3b2 HBASE-27429 Add exponential retry backoff support for MigrateReplicationQueueFromZkToTableProcedure 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-15 22:53:48 +08:00
LiangJun He ffad1ff727 HBASE-27217 Revisit the DumpReplicationQueues tool (#4810) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang 0d57ee147e HBASE-27218 Support rolling upgrading (#4808) 
Signed-off-by: Yu Li <liyu@apache.org>
 2023-05-15 22:53:48 +08:00
LiangJun He 5f95a914b6 HBASE-27405 Fix the replication hfile/log cleaner report that the replication table does not exist (#4811) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang c01c8e45b4 HBASE-27392 Add a new procedure type for implementing some global operations such as migration (#4803) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang 7044150545 HBASE-27215 Add support for sync replication (#4762) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang 6d0311c1d9 HBASE-27214 Implement the new replication hfile/log cleaner (#4722) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang f81bdebedb HBASE-27213 Add support for claim queue operation (#4708) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang e2d8db6dfc HBASE-27212 Implement a new table based replication queue storage and make the minimum replication system work (#4672) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang 8b8c684bcc
HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237) 
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 10:35:40 +08:00
Kota-SH e343584b50
HBASE-27852: Interrupt BucketCachePersister thread when BucketCache is shutdown (#5230) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-05-12 10:43:27 +01:00
Jonathan Albrecht 55aff4ceef
HBASE-27851 Fix TestListTablesByState which is silently failing due to a surefire bug (#5227) 
surefire version 3.0.0-M6 has a bug where tests end up being removed from
the test results if they fail with a long exception message. See:

https://issues.apache.org/jira/browse/SUREFIRE-2079

TestListTablesByState is currently failing due to an error. However,
it is being missed because of the surefire bug. I found this while testing
the final surfire 3.0.0 version which fixes the bug and the test then
shows up as failing.

Co-authored-by: Jonathan Albrecht <jonathan.albrecht@ibm.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-11 23:08:12 +08:00
alan.zhao 5cea8112fd
HBASE-27733 hfile split occurs during bulkload, the new HFile file does not specify favored nodes (#5121) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-05-10 21:47:20 +08:00
bsglz 5d82d4f746
HBASE-27788 Skip family comparing when compare cells inner the store (#5171) 
* HBASE-27788 Skip family comparing when compare cells inner the store
 2023-05-10 10:15:07 +08:00
Ruanhui d49df8b7a9
HBASE-27844 changed type names to avoid conflicts with built-in types (#5223) 
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-08 21:32:21 +08:00
Kota-SH dca0622b62 HBASE-27752: Update the list of prefetched files upon region movement (#5194) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-05-05 09:55:17 +01:00
Wellington Ramos Chevreuil ab8880d3be Revert "HBASE-27752: Update the list of prefetched files upon region movement (#5194)" 
This reverts commit ece8d014af.
 2023-05-05 09:54:28 +01:00
Kota-SH ece8d014af
HBASE-27752: Update the list of prefetched files upon region movement (#5194) 
Co-authored-by: Shanmukha Kota <skota@cloudera.com>
 2023-05-04 16:00:32 +01:00
Duo Zhang 78610decaa
HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:59:40 +08:00
Duo Zhang 89e80da57f
HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216) 
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:59:07 +08:00
Duo Zhang b59eb96407
HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:58:38 +08:00
Duo Zhang 4e69921a00
HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:58:20 +08:00
Duo Zhang 21d61cfa1c
HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-01 21:14:46 +08:00
Duo Zhang 1ced254b8d
HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-28 09:58:05 +08:00
Nihal Jain a1f2b4e1d0
HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-25 09:42:01 +05:30
haosen chen 95f83cb8e2
HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-23 23:20:47 +08:00
Nihal Jain e86f930894
HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-23 23:20:12 +08:00
Duo Zhang 18ae733b15
HBASE-27806 Support dynamic reinitializing replication peer storage (#5195) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-23 22:25:31 +08:00
Ray Mattingly ced4ff1804
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-21 21:16:57 -07:00
chenglei 269586c4cf
HBASE-27785 Encapsulate and centralize totalBufferUsed in Replication… (#5168) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-21 20:59:16 +08:00
Duo Zhang f5ee958ead HBASE-27783 Addendum forward port the test improvement when backporting to branch-2 2023-04-20 15:25:59 +08:00
Duo Zhang 398c5ef313
HBASE-27783 Implement a shell command to disable all peer modification (#5182) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-19 22:07:29 +08:00
Nick Dimiduk 63471efa25
HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-17 14:22:04 +02:00
Nihal Jain 24c471a0b3
HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-17 12:46:07 +02:00
Ray Mattingly 2b098b0819
HBASE-27536: Include more request information in slowlog for Scans (#5155) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-04-16 10:03:53 -04:00
Kota-SH 856fa14537
HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-14 10:19:29 +01:00
Duo Zhang a71105997f
HBASE-27727 Implement filesystem based Replication peer storage (#5165) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-13 18:58:02 +08:00
Nick Dimiduk f36587c648
HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-08 11:02:09 +08:00
chenglei a370099aaa
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may … (#5158) 
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-06 21:14:33 +08:00
bsglz a363b76d81
HBASE-27765 Add biggest cell related info into web ui (#5151) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-05 21:42:13 +08:00
Bryan Beaudreault e5620e26a2
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5141) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-29 16:20:29 -04:00
Bryan Beaudreault c52f4b286c
HBASE-27704 Quotas can drastically overflow configured limit (#5099) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-29 16:19:13 -04:00
Xiaolin Ha f5437b9ceb
HBASE-27333 Abort RS when the hostname is different from master seen (#4732) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-03-28 15:17:16 +08:00
Bryan Beaudreault c825c960d6
HBASE-27532 Add block bytes scanned metrics (#5067) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-03-27 16:03:15 -04:00
Kota-SH a6dad700db
HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-03-27 10:49:55 +01:00
Duo Zhang 230fdc0b50
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-24 14:17:39 +08:00