Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,682 Commits 95 Branches 866 Tags
Commit Graph

8922 Commits

Author SHA1 Message Date
Nick Dimiduk
1e6d93a789 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:27 +02:00
litao
31f4b422ab HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a221f9f36ce7c8905d9ed063c6e9eac)
 2022-05-17 10:38:15 +05:30
Rushabh Shah
7bc7eb5f48 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:19 -07:00
Tak Lon (Stephen) Wu
43e8c11989 HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:14:17 -07:00
Duo Zhang
62dbae2914 HBASE-26999 Addendum fix spotless errors 2022-05-13 09:57:26 +08:00
Wellington Chevreuil
930bc5368c HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 10:53:19 +01:00
Duo Zhang
e3359efe7a Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)" 
Revert due to failure spotless:check

This reverts commit aa31b0f695ab02015a7a183aaf10ac9963a22ddb.
 2022-05-12 10:53:10 +01:00
Wellington Ramos Chevreuil
b7647d8d5f HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-12 10:52:47 +01:00
Wellington Ramos Chevreuil
7b7f57619b HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-09 11:00:26 +01:00
skysiders
ad2180b75d
HBASE-26994 MasterFileSystem create directory without permission check (#4391) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-08 13:28:40 -07:00
Rushabh Shah
f5a08063b6
HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-07 10:38:17 -07:00
litao
91eab0b657
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-05 23:35:09 -07:00
LiangJun He
cb61d6a4bd HBASE-26977 HMaster's ShutdownHook does not take effect, if tablesOnMaster is false (#4397) 
Signed-off-by: Yu Li <liyu@apache.org>
 2022-05-05 21:55:50 +08:00
Nick Dimiduk
1b5c881ffb HBASE-26648 Improve fidelity of RegionLocator spans (addendum) 
Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.
 2022-05-03 13:40:42 +02:00
Nick Dimiduk
a38716ca2a HBASE-26648 Improve fidelity of RegionLocator spans 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-03 13:40:42 +02:00
d-c-manning
be8a9a5920 HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
 2022-05-02 10:51:37 -07:00
Duo Zhang
1a5b1b266c HBASE-26899 Run spotless:apply 2022-05-01 22:41:49 +08:00
d-c-manning
afb8afd26c HBASE-26988 dynamic configuration of loadbalance.bytable (#4384) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
 2022-04-29 15:55:16 -07:00
LiangJun He
e9c9418d1d HBASE-26943 HMaster page style display confusion (#4369) 
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-04-29 15:59:53 +08:00
d-c-manning
fd2e7205ac HBASE-22349 slop in StochasticLoadBalancer (#4371) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
 2022-04-28 12:38:50 -07:00
liangxs
895e0f474a HBASE-26975 Add on heap and off heap memstore info in rs web UI (#4368) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit cdf81ea5cca16cec3b854ac67bc08c43c489918b)
 2022-04-28 23:15:10 +08:00
liangxs
ea5c5da1b3 HBASE-26980 Update javadoc of BucketCache.java (#4374) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c02e7553d46ddfb3b0911240f6edd4b900b869b6)
 2022-04-28 23:11:51 +08:00
Andrew Purtell
6813a5c502 HBASE-26979 StoreFileListFile logs frequent stacktraces at INFO level (#4373) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-04-27 18:02:18 -07:00
Bri Augenreich
c2baa1fb7b HBASE-26581 Add metrics for failed replication edits (#4347) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-26 17:44:01 -04:00
Wellington Ramos Chevreuil
c9d833ed5e HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366) 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c67757c8029ae5e546ba1f2d1e9a4299)
 2022-04-25 14:18:57 +01:00
Ruanhui
8d17241ce0
HBASE-26942 cache region locations when getAllRegionLocations (#4364) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-22 15:30:26 -04:00
Bryan Beaudreault
2240025349
HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-04-22 08:56:52 -04:00
Duo Zhang
085c65107e HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted (#4352) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 35aa57e4452c6f0a7f5037371edca64163913345)
 2022-04-17 23:26:56 +08:00
Duo Zhang
ae8eccd5c0 HBASE-26938 Compaction failures after StoreFileTracker integration (#4350) 
Introduce a StoreFileWriterCreationTracker to track the store files being written

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 48c4a4626e54724beb4ed46becbedbe292841dc4)
 2022-04-17 22:44:44 +08:00
Duo Zhang
bbe048c1e5 HBASE-26946 TestRetainAssignmentOnRestartSplitWithoutZk infinite loop (#4344) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2622fa05a6aa9e0b57d9d15cf243af11927e9a2d)
 2022-04-16 13:23:57 +08:00
Pankaj
c76daa1cc8 HBASE-26944 Possible resource leak while creating new region scanner (#4339) 
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 62e3efccef766e580642a8b7cb5654c96e47687d)
 2022-04-15 11:37:58 +05:30
Duo Zhang
b405a6f119 Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)" 
This reverts commit f8b2ac05185fd1b7b13a7b559136f01345bccaf2.
 2022-04-13 11:53:19 +08:00
Duo Zhang
f8b2ac0518 HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8247b7c722f95f94afd5cb9d9b80c9ce5f61a7de)
 2022-04-13 11:10:25 +08:00
eomiks
52ca440ad6 HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on (#4295) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ac9e0be27afe312116943842855fdb776dce958)
 2022-04-12 20:31:48 +08:00
huaxiangsun
f9abe3d8f1
HBASE-26618 Involving primary meta region in meta scan with CatalogRe… (#4321) (#4326) 
Signed-off-by: Michael Stack <stack@apache.org>
 2022-04-11 10:27:15 -07:00
Duo Zhang
e7eb628025 HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless (#4324) 
Signed-off-by: Yulin Niu <niuyulin@apache.org
(cherry picked from commit 3ae0d9012c6a0132147f2cd1a96337213bbf2b8d)
 2022-04-09 23:13:49 +08:00
Duo Zhang
197b8d48ec HBASE-26928 Fix several indentation problems (#4323) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e68c61dd54c3f85ef5d7611956d75c0c29c9cdbb)
 2022-04-06 15:14:03 +08:00
Tak Lon (Stephen) Wu
87555093cf
HBASE-26882 Backport "HBASE-26810 Add dynamic configuration support f… (#4278) 
- Include HBASE-25288 that has the configuration manager registration in HMaster

Signed-off-by: Ankit Singhal <ankit@apache.org>
 2022-04-05 10:06:13 -07:00
Wellington Ramos Chevreuil
1c14046ee0 HBASE-26927 Add snapshot scanner UT with SFT and some cleanups to Tes… (#4322) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(cherry picked from commit ae3718be0fa11127cb272ddf305f8a0753f4603d)
 2022-04-05 17:52:30 +01:00
bsglz
8ef1ae32e6 HBASE-26885 Addendum throw exception instead of return in TRSP to let the procedure retry (#4299) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7f9d1f2259da5851b532ae93aaea75126c706688)
 2022-04-04 20:26:48 +08:00
weimingdiit
3b383806be HBASE-26924 Fix log parameter error and spelling error (#4318) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 003c572246749bfaee4d81bdbd7bddd73d6759c3)
 2022-04-04 20:26:41 +08:00
Duo Zhang
ab9ccabe8f HBASE-26921 Rewrite the counting cells part in TestMultiVersions (#4316) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 3e09e87fada270fa93e36f9aeb04a9cc4106a2ee)
 2022-04-03 23:04:51 +08:00
Duo Zhang
1560b4149c HBASE-26920 Fix missing braces warnings in TestProcedureMember (#4315) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 78676bb85e826314e2ebd11524b05428481a0b51)
 2022-04-03 23:04:43 +08:00
Duo Zhang
0b87621a38 HBASE-26919 Rewrite the counting rows part in TestFromClientSide4 (#4314) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4e12eee53176df9c09737a738f2645967080f449)
 2022-04-03 23:04:36 +08:00
chenglei
4311974758
HBASE-26811 Secondary replica may be disabled for read incorrectly forever (#4308) 2022-04-01 11:20:48 +08:00
Nick Dimiduk
489af42792
HBASE-26545 Implement tracing of scan 
* on `AsyncTable`, both `scan` and `scanAll` methods should result in `SCAN` table operations.
* the span of the `SCAN` table operation should have children representing all the RPC calls
  involved in servicing the scan.
* when a user provides custom implementation of `AdvancedScanResultConsumer`, any spans emitted
  from the callback methods should also be tied to the span that represents the `SCAN` table
  operation. This is easily done because these callbacks are executed on the RPC thread.
* when a user provides a custom implementation of `ScanResultConsumer`, any spans emitted from the
  callback methods should be also be tied to the span that represents the `SCAN` table
  operation. This accomplished by carefully passing the span instance around after it is created.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-31 17:29:51 +02:00
Duo Zhang
98db15acd2 HBASE-26245 Store region server list in master local region (#4136) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit bb1bbddf748416411938f57f1b846ceba1c99528)
(cherry picked from commit 27111421d9e884278f575c7292f739e87273acee)
 2022-03-31 22:26:40 +08:00
chenglei
1a85588265
HBASE-26812 ShortCircuitingClusterConnection fails to close RegionSca… (#4243) 2022-03-31 20:04:01 +08:00
bsglz
af5624bb8e HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276) 
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM

(cherry picked from commit 1efd8fe53c13cdbfde7cb3d0ff7ebea7b8b7d3bb)
 2022-03-29 10:18:15 +08:00
d-c-manning
0dbcf8f263 HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-28 11:47:11 -07:00