Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,749 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

9064 Commits

Author SHA1 Message Date
Xiaolin Ha b6aef4499f
HBASE-27897 ConnectionImplementation#locateRegionInMeta should pause and retry when taking user region lock failed (#5258) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-06-07 16:31:39 +08:00
Jack-cc c7abf17568 HBASE-27899 Beautify the output information of the getStats method in ReplicationSource (#5269) 
Signed-off-by: 874645213@qq.com <jiancong123~>
Co-authored-by: 874645213@qq.com <jiancong123~>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3df01ea9b6)
 2023-06-06 22:21:10 +08:00
Ruanhui 854ecd7c8c HBASE-27855 Support dynamic adjustment of flusher count (#5247) 
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 40976b0969)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
 2023-06-06 22:15:01 +08:00
Ray Mattingly 9f8bc937d8
HBASE-27798: Client side should back off based on wait interval in RpcThrottlingException (#5226) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-06-05 17:54:55 -04:00
Wellington Ramos Chevreuil d43dfcce90
HBASE-27871 Meta replication stuck forever if wal it's still reading gets rolled and deleted (#5241) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed by: Andor Molnár <andor@cloudera.com>
Reviewed by: Shanmukha Kota <skota@cloudera.com>
 2023-06-05 21:33:48 +01:00
Duo Zhang 2323747695 HBASE-27793 Addendum fix spotless error 2023-06-01 14:18:20 +08:00
Duo Zhang 282d2a7cf9 HBASE-27793 Addendum fix spotless issue 
(cherry picked from commit abc517f75a)
 2023-05-27 22:02:06 +08:00
Andrew Purtell b6d063550a HBASE-27867 Close the L1 victim handler race (#5239) 
When we evict a block from L1 and move it to L2 there is a brief window of
time where we have removed the block from the L1 map and yet the victim
handler has not completed execution. Some read-your-write use cases can be
significantly impacted even though the window is small.

Victim handling can be made atomic with respect to the unmapping operation.
The upside is there will be no L1+L2 misses during the transition. The
downside is if the victim handler takes a long time to execute – currently
they are all very fast, so only a theoretical risk – then other removals or
insertions in L1 can block until it completes.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-05-25 16:46:46 -07:00
Andrew Purtell 24160a45ae HBASE-27843 If moveAndClose fails HFileArchiver should delete any incomplete archive side changes (#5240) 
When HFiles are placed on a filesystem other than HDFS a rename operation can be
a non-atomic file copy operation. It can take a long time to copy a large hfile
and if interrupted there may be a partially copied file present at the destination.

If we fail to “rename” the files into the archive we will continue to fail
indefinitely. Before larger changes are considered, perhaps to StoreFileTracker, we
should mitigate this problem.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-05-25 15:43:59 -07:00
Rajeshbabu Chintaguntla f8453f5f4d HBASE-27793 Make HBCK be able to report unknown servers (#5229) 
Co-authored-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
 2023-05-25 09:05:05 +05:30
Duo Zhang 093097e591 HBASE-27277 TestRaceBetweenSCPAndTRSP fails in pre commit (#5248) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dc30ca552b)
 2023-05-23 22:50:19 +08:00
Duo Zhang 2fc73585a7 HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237) 
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8b8c684bcc)
 2023-05-15 10:39:49 +08:00
Kota-SH 40a8a2a651 HBASE-27852: Interrupt BucketCachePersister thread when BucketCache is shutdown (#5230) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit e343584b50)
 2023-05-12 12:09:30 +01:00
Jonathan Albrecht 026ff18053 HBASE-27851 Fix TestListTablesByState which is silently failing due to a surefire bug (#5227) 
surefire version 3.0.0-M6 has a bug where tests end up being removed from
the test results if they fail with a long exception message. See:

https://issues.apache.org/jira/browse/SUREFIRE-2079

TestListTablesByState is currently failing due to an error. However,
it is being missed because of the surefire bug. I found this while testing
the final surfire 3.0.0 version which fixes the bug and the test then
shows up as failing.

Co-authored-by: Jonathan Albrecht <jonathan.albrecht@ibm.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 55aff4ceef)
 2023-05-11 23:13:33 +08:00
bsglz 9990d121b6 HBASE-27788 Skip family comparing when compare cells inner the store 2023-05-10 10:51:53 +08:00
Kota-SH a4eb499f62
HBASE-27752: Update the list of prefetched files upon region movement (#5194) (#5222) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit ece8d014af)
 2023-05-09 20:55:09 +01:00
Ruanhui d89bb1cfd8 HBASE-27844 changed type names to avoid conflicts with built-in types (#5223) 
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d49df8b7a9)
 2023-05-08 23:21:59 +08:00
Duo Zhang 2eee1cc7e4 HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 78610decaa)
 2023-05-04 23:03:26 +08:00
Duo Zhang 1df5e40f73 HBASE-27823 Addendum fix compile error 2023-05-04 23:03:26 +08:00
Duo Zhang 558913ea1a HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216) 
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 89e80da57f)
 2023-05-04 22:35:15 +08:00
Duo Zhang 438d93b30f HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b59eb96407)
 2023-05-04 22:24:56 +08:00
Duo Zhang 835077fa35 HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 4e69921a00)
 2023-05-04 22:05:42 +08:00
Duo Zhang bf20017148
HBASE-27806 Addendum fix error prone error (#5214) 2023-05-03 19:52:01 +08:00
Nick Dimiduk da81079365 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-01 17:45:05 +02:00
Duo Zhang ce4a2bf77f HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c)
 2023-05-01 21:22:09 +08:00
Nihal Jain adfcea8073 HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-28 19:39:03 +05:30
Duo Zhang aa7486d598 HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d)
 2023-04-28 10:00:02 +08:00
Nihal Jain 7434374900 HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f930894)
 2023-04-23 23:43:35 +08:00
haosen chen 157df067a4 HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e2)
 2023-04-23 23:34:08 +08:00
Duo Zhang fe2992a312 HBASE-27806 Support dynamic reinitializing replication peer storage (#5195) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 18ae733b15)
 2023-04-23 23:15:27 +08:00
Ray Mattingly e9ffc1b07e
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-21 21:20:04 -07:00
chenglei 0787199feb
HBASE-27785 Encapsulate and centralize totalBufferUsed in ReplicationSourceManager (#5196) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-21 21:52:40 +08:00
Duo Zhang 92a2868f37
HBASE-27783 Implement a shell command to disable all peer modification (#5182)(#5191) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-21 09:57:28 +08:00
Nihal Jain f6900f8c63 HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-18 12:15:07 +02:00
Ray Mattingly 1ae057b89f
HBASE-27536: Include more request information in slowlog for Scans (#5166) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-04-16 10:11:35 -04:00
Kota-SH b75c72d925 HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa14537)
 2023-04-14 10:27:19 +01:00
Duo Zhang 3e6e9c5cca HBASE-27727 Implement filesystem based Replication peer storage (#5165) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit a71105997f)
 2023-04-13 19:45:20 +08:00
Nick Dimiduk f8c234e8d0 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c648)
 2023-04-08 11:05:33 +08:00
chenglei 62ea717b31
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up (#5160) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-06 21:37:10 +08:00
bsglz 85793655d3 HBASE-27765 Add biggest cell related info into web ui (#5151) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a363b76d81)
 2023-04-05 23:18:13 +08:00
Bryan Beaudreault 9f4b31e619
HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-30 09:13:00 -04:00
Bryan Beaudreault e77e3ffa8f
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5152) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-30 09:12:26 -04:00
Xiaolin Ha 45e3451997
HBASE-27333 Abort RS when the hostname is different from master seen (#4732) (#5148) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-03-29 11:42:32 +08:00
Bryan Beaudreault e33afb4524
HBASE-27532 Add block bytes scanned metrics (#5146) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-03-28 13:56:37 -04:00
Kota-SH 61e18a3d6c HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-03-27 10:57:57 +01:00
Duo Zhang 17d15a135a HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50)
 2023-03-24 17:43:30 +08:00
Duo Zhang 3b24b3b969 HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a763)
 2023-03-24 15:59:29 +08:00
Xiaolin Ha 62fc8c81a3 HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cb)
 2023-03-24 15:58:49 +08:00
Xiaolin Ha d4edfe404e HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:10:56 +08:00
xuzifu666 a10cbf8319 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e8)
 2023-03-21 22:55:16 +08:00