Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,265 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

8759 Commits

Author SHA1 Message Date
Duo Zhang 9f5ef981f9 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4)
 2022-05-18 20:51:37 +08:00
Nick Dimiduk c47a2c3841 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:42 +02:00
litao c4d7d55958 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a)
 2022-05-17 10:44:40 +05:30
Rushabh Shah 4ba62c82f8 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:23 -07:00
Tak Lon (Stephen) Wu 603f3f5d0c HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:30:39 -07:00
Duo Zhang 3ed733e865 HBASE-26999 Addendum fix spotless errors 2022-05-13 10:01:05 +08:00
Wellington Chevreuil d55c90ee87 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 11:12:06 +01:00
Duo Zhang 28f848a35e Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)" 
Revert due to failure spotless:check

This reverts commit aa31b0f695.
 2022-05-12 11:11:55 +01:00
Wellington Ramos Chevreuil ea37b782e1 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-12 11:11:42 +01:00
Wellington Ramos Chevreuil cdc0975d2e HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 7b7f57619b)
 2022-05-09 15:15:04 +01:00
skysiders 38cd57c951
HBASE-26994 MasterFileSystem create directory without permission check (#4391) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-08 13:29:10 -07:00
Rushabh Shah ffbdac12ca HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 2022-05-07 17:43:24 +00:00
litao 139fa2cff9
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-05 23:35:46 -07:00
Nick Dimiduk 48b1587d34 HBASE-26648 Improve fidelity of RegionLocator spans (addendum) 
Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.
 2022-05-03 13:47:35 +02:00
Nick Dimiduk ede80fb108 HBASE-26648 Improve fidelity of RegionLocator spans 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-03 13:47:35 +02:00
d-c-manning 44884eaa81 HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
 2022-05-02 11:05:40 -07:00
Duo Zhang 1aea663c6d HBASE-26899 Run spotless:apply 2022-05-01 22:52:40 +08:00
d-c-manning adc9d07385 HBASE-26988 dynamic configuration of loadbalance.bytable (#4384) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
 2022-04-29 15:28:23 -07:00
d-c-manning 6556350d4f HBASE-22349 slop in StochasticLoadBalancer (#4371) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
 2022-04-28 14:35:01 -07:00
liangxs 27c3584f90 HBASE-26975 Add on heap and off heap memstore info in rs web UI (#4368) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit cdf81ea5cc)
 2022-04-28 23:15:27 +08:00
liangxs abedac5a2d HBASE-26980 Update javadoc of BucketCache.java (#4374) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c02e7553d4)
 2022-04-28 23:12:07 +08:00
Andrew Purtell 4b2ac4b38e HBASE-26979 StoreFileListFile logs frequent stacktraces at INFO level (#4373) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/storefiletracker/StoreFileListFile.java
 2022-04-27 18:03:50 -07:00
Bri Augenreich 3439c5bd90 HBASE-26581 Add metrics for failed replication edits (#4347) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-26 17:46:26 -04:00
Wellington Ramos Chevreuil 47c62a9165 HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366) 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c6)
 2022-04-25 14:20:14 +01:00
Ruanhui e2ac5a9338 HBASE-26942 cache region locations when getAllRegionLocations (#4364) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-22 15:31:53 -04:00
Bryan Beaudreault dc86de467b HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-04-22 08:58:35 -04:00
Duo Zhang cd51da1d5a HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted (#4352) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 35aa57e445)
 2022-04-17 23:27:10 +08:00
Duo Zhang 450a54bed8 HBASE-26938 Compaction failures after StoreFileTracker integration (#4350) 
Introduce a StoreFileWriterCreationTracker to track the store files being written

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 48c4a4626e)
 2022-04-17 22:53:36 +08:00
Duo Zhang 07531728b1 HBASE-26946 TestRetainAssignmentOnRestartSplitWithoutZk infinite loop (#4344) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2622fa05a6)
 2022-04-16 13:24:07 +08:00
Pankaj 3510db4d2d HBASE-26944 Possible resource leak while creating new region scanner (#4339) 
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 62e3efccef)
 2022-04-15 11:40:39 +05:30
Duo Zhang 785a54661f Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)" 
This reverts commit 29ce27c5d5.
 2022-04-13 11:53:00 +08:00
Duo Zhang 29ce27c5d5 HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8247b7c722)
 2022-04-13 11:10:39 +08:00
eomiks f4ec10b958 HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on (#4295) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ac9e0be27)
 2022-04-12 20:32:31 +08:00
huaxiangsun 43af814d1a
HBASE-26618 Involving primary meta region in meta scan with CatalogRe… (#4321) (#4327) 
Signed-off-by: Michael Stack <stack@apache.org>
 2022-04-11 10:28:55 -07:00
Duo Zhang 913dd9c305 HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless (#4324) 
Signed-off-by: Yulin Niu <niuyulin@apache.org
(cherry picked from commit 3ae0d9012c)
 2022-04-09 23:21:21 +08:00
Andrew Purtell abb1bf2617 Revert "HBASE-26306 Backport "HBASE-26220 Use P2P communicate between region servers to sync the list for bootstrap node" to branch-2 (#3727)" 
This reverts commit 10584d70d2.

See HBASE-26937 for discussion.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 2022-04-08 09:14:01 -07:00
Duo Zhang 5288220f2c HBASE-26928 Fix several indentation problems (#4323) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e68c61dd54)
 2022-04-06 15:14:19 +08:00
Wellington Ramos Chevreuil beed73be39 HBASE-26927 Add snapshot scanner UT with SFT and some cleanups to Tes… (#4322) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(cherry picked from commit ae3718be0f)
 2022-04-05 17:53:53 +01:00
weimingdiit eaa1c7fed3 HBASE-26924 Fix log parameter error and spelling error (#4318) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 003c572246)
 2022-04-04 20:27:21 +08:00
bsglz a8d637402c HBASE-26885 Addendum throw exception instead of return in TRSP to let the procedure retry (#4299) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7f9d1f2259)
 2022-04-04 20:27:17 +08:00
Duo Zhang f74d41486f HBASE-26921 Rewrite the counting cells part in TestMultiVersions (#4316) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 3e09e87fad)
 2022-04-03 23:09:33 +08:00
Duo Zhang 787cc87794 HBASE-26920 Fix missing braces warnings in TestProcedureMember (#4315) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 78676bb85e)
 2022-04-03 23:09:32 +08:00
Duo Zhang 8650de2c3c HBASE-26919 Rewrite the counting rows part in TestFromClientSide4 (#4314) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4e12eee531)
 2022-04-03 23:09:32 +08:00
Nick Dimiduk 235308d8bf HBASE-26545 Implement tracing of scan 
* on `AsyncTable`, both `scan` and `scanAll` methods should result in `SCAN` table operations.
* the span of the `SCAN` table operation should have children representing all the RPC calls
  involved in servicing the scan.
* when a user provides custom implementation of `AdvancedScanResultConsumer`, any spans emitted
  from the callback methods should also be tied to the span that represents the `SCAN` table
  operation. This is easily done because these callbacks are executed on the RPC thread.
* when a user provides a custom implementation of `ScanResultConsumer`, any spans emitted from the
  callback methods should be also be tied to the span that represents the `SCAN` table
  operation. This accomplished by carefully passing the span instance around after it is created.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-04-01 12:47:33 +02:00
chenglei 69ea6f579f
HBASE-26811 Secondary replica may be disabled for read incorrectly forever (#4309) 2022-04-01 11:28:29 +08:00
chenglei 2bf81c6647
HBASE-26812 ShortCircuitingClusterConnection fails to close RegionScanners when making short-circuited calls (#4307) 2022-04-01 10:42:40 +08:00
Duo Zhang 75c81c7338 HBASE-26245 Store region server list in master local region (#4136) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit bb1bbddf74)
(cherry picked from commit 27111421d9)
 2022-03-31 22:27:07 +08:00
bsglz e56388a34c HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276) 
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM
 2022-03-29 10:09:25 +08:00
d-c-manning a28e7ac52d HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-28 11:49:40 -07:00
Xiaolin Ha f0088df551 HBASE-26872 Load rate calculator for cost functions should be more precise (#4253) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
 2022-03-28 23:32:42 +08:00