Commit Graph

8869 Commits

Author SHA1 Message Date
Ruanhui d79d812dd0 HBASE-27157 Potential race condition in WorkerAssigner (#4577)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit f76d8554ca)
2022-07-06 12:39:48 +08:00
tianhang b59c8b8dcb HBASE-27171 Fix Annotation Error in HRegionFileSystem (#4588)
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6031a3a8d4)
2022-07-06 12:39:06 +08:00
Duo Zhang e047ef8c68
HBASE-23330: Fix delegation token fetch with MasterRegistry (#1084) (#4598)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit d8b3f55518)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>
2022-07-06 08:10:50 +08:00
Bryan Beaudreault 57a3781160 HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse (#4592)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-04 16:37:29 -04:00
Duo Zhang 20f247934a HBASE-27169 TestSeparateClientZKCluster is flaky (#4587)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 03c23beb57)
2022-07-01 22:13:21 +08:00
BukrosSzabolcs 0727015bf5
HBASE-22749 Distributed MOB compactions (#4581)
* HBASE-22749 Distributed MOB compactions

- MOB compaction is now handled in-line with per-region compaction on region
  servers
- regions with mob data store per-hfile metadata about which mob hfiles are
  referenced
- admin requested major compaction will also rewrite MOB files; periodic RS
  initiated major compaction will not
- periodically a chore in the master will initiate a major compaction that
  will rewrite MOB values to ensure it happens. controlled by
  'hbase.mob.compaction.chore.period'. default is weekly
- control how many RS the chore requests major compaction on in parallel
  with 'hbase.mob.major.compaction.region.batch.size'. default is as
  parallel as possible.
- periodic chore in master will scan backing hfiles from regions to get the
  set of referenced mob hfiles and archive those that are no longer
  referenced. control period with 'hbase.master.mob.cleaner.period'
- Optionally, RS that are compacting mob files can limit write
  amplification by not rewriting values from mob hfiles over a certain size
  limit. opt-in by setting 'hbase.mob.compaction.type' to 'optimized'.
  control threshold by 'hbase.mob.compactions.max.file.size'.
  default is 1GiB
- Should smoothly integrate with existing MOB users via rolling upgrade.
  will delay old MOB file cleanup until per-region compaction has managed
  to compact each region at least once so that used mob hfile metadata can
  be gathered.

* HBASE-22749 Distributed MOB compactions

fix RestrictedApi

Co-authored-by: Vladimir Rodionov <vrodionov@apache.org>

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-30 20:44:45 +01:00
Ishika d2509d709b HBASE-26218 Add logs in Canary tool (#4501)
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit acfbc3ff7d)
2022-06-30 23:28:26 +08:00
Andrew Purtell e4d2895cad HBASE-27166 WAL value compression minor improvements (#4584)
A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.

Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-28 12:53:30 -07:00
Duo Zhang bd08ebb21c HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded (#4579)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit d7f6861e8d)
2022-06-26 15:27:28 +08:00
Bryan Beaudreault f06ac9192b
HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-24 07:40:42 -04:00
Andrew Purtell da76941b0e HBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525)
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
   preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
  name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
  This allows the user to add a custom implementation, perhaps for debugging.

Also updates ReflectionUtils with a new helper method.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestNettyRpcServer.java
2022-06-23 15:18:32 -07:00
Bryan Beaudreault 409a7a44e8
HBASE-26945 Quotas causes too much load on meta for large clusters (#4576)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-23 16:47:09 -04:00
Kerasone d129b56f26 HBASE-27001 The deleted variable cannot be printed out (#4479)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0)
2022-06-23 22:43:05 +05:30
Pankaj c74bf8b6e2
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4569)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-23 22:22:57 +05:30
litao ed96746747
HBASE-27098 Fix link for field comments (#4499)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-21 18:30:50 -07:00
LiangJun He 666aa064e7
HBASE-27028 Add a shell command for flushing master local region (#4539)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 13:25:35 +08:00
xiaozhang0319 18400ac3bd HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1)
2022-06-21 00:14:23 +08:00
SiCheng-Zheng e1de804ba1 HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e)
2022-06-20 23:48:45 +08:00
Xiaolin Ha f7d2d12ac1 HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-18 02:07:38 +08:00
litao ef0ff2729c
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:19:38 -07:00
Viraj Jasani b8f0c61ed7 Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2022-06-12 10:24:02 -07:00
Nick Dimiduk 9b8bb580b9
HBASE-26366 Provide meaningful parent spans to ZK interactions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 16:26:37 +02:00
Nick Dimiduk 1dcee76e07
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:46:48 +02:00
Nick Dimiduk b3c9ef34b7 HBASE-27066 The Region Visualizer display failed
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:25 +02:00
Nick Dimiduk 33f633a0b1 Revert "HBASE-27066 The Region Visualizer display failed (#4472)"
This reverts commit 5e54c6daf6.
2022-06-09 13:09:25 +02:00
litao 63a35facad
HBASE-27092 Regionserver table on Master UI is broken (#4495)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-07 17:39:27 -07:00
liuzhuang2017 fd6e6e0cbb HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec)
2022-06-06 13:41:57 +08:00
BukrosSzabolcs ef221846e5 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-05 20:01:57 +01:00
skysiders 286c9c3327
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:29:43 -07:00
Huaxiang Sun 58aaed19b0 Revert "HBASE-26962: Add mob info in web UI (#4359)"
This reverts commit 7a02cbfd7e.
2022-06-02 14:04:27 -07:00
huaxiangsun 672b0a5f5c
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4464)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 12:35:11 -07:00
Duo Zhang f97af48d30 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac)
2022-06-03 00:10:53 +08:00
Xiaolin Ha f61ac22f02 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f)
2022-06-03 00:08:30 +08:00
liangxs 7a02cbfd7e HBASE-26962: Add mob info in web UI (#4359)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d03004060d)
2022-06-03 00:05:22 +08:00
LiangJun He 8270b5df5e HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4)
2022-06-02 21:38:59 +08:00
litao b21930f3fa HBASE-27037 Display the region server state on the Web UI (#4432)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit db992083af)
2022-06-02 21:33:07 +08:00
Andrew Purtell 59700babd0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:41 -07:00
litao f4f3e63f9f HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:50:33 -07:00
Andrew Purtell cfba2f2b14 HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:38 -07:00
Istvan Toth 7fbfb10649 HBASE-27069 Hbase SecureBulkload permission regression (#4475)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 4ce85aa39f)
2022-05-31 10:07:23 +01:00
litao 5e54c6daf6 HBASE-27066 The Region Visualizer display failed (#4472)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:56:32 -07:00
Sergey Soldatov 50dd9619b0 HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:11:18 +01:00
Xiaolin Ha 56b81b42d8
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 15:51:52 +08:00
Xiaolin Ha 200cbcc34f
HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460)
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2022-05-24 14:26:09 +08:00
d-c-manning b00e3032a6 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
2022-05-21 09:23:05 -07:00
Xiaolin Ha 8bc55f8308 HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:34:17 -07:00
Nick Dimiduk 2cae259f36
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4455)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:13:57 -07:00
Andrew Purtell 7af82cf164 HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:11:19 -07:00
Duo Zhang b9b5302929 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4)
2022-05-18 20:47:20 +08:00
Nick Dimiduk 1e6d93a789 HBASE-26986 Trace a one-shot execution of a Master procedure
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-18 13:08:27 +02:00
litao 31f4b422ab HBASE-27032 The draining region servers metric description is incorrect (#4428)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a)
2022-05-17 10:38:15 +05:30
Rushabh Shah 7bc7eb5f48 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-13 18:25:19 -07:00
Tak Lon (Stephen) Wu 43e8c11989 HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414)
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
2022-05-13 13:14:17 -07:00
Duo Zhang 62dbae2914 HBASE-26999 Addendum fix spotless errors 2022-05-13 09:57:26 +08:00
Wellington Chevreuil 930bc5368c HBASE-27021 StoreFileInfo should set its initialPath in a consistent way
(Amending spotless errors after revert by Duo)
2022-05-12 10:53:19 +01:00
Duo Zhang e3359efe7a Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)"
Revert due to failure spotless:check

This reverts commit aa31b0f695.
2022-05-12 10:53:10 +01:00
Wellington Ramos Chevreuil b7647d8d5f HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-12 10:52:47 +01:00
Wellington Ramos Chevreuil 7b7f57619b HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-09 11:00:26 +01:00
skysiders ad2180b75d
HBASE-26994 MasterFileSystem create directory without permission check (#4391)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:28:40 -07:00
Rushabh Shah f5a08063b6
HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-07 10:38:17 -07:00
litao 91eab0b657
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-05 23:35:09 -07:00
LiangJun He cb61d6a4bd HBASE-26977 HMaster's ShutdownHook does not take effect, if tablesOnMaster is false (#4397)
Signed-off-by: Yu Li <liyu@apache.org>
2022-05-05 21:55:50 +08:00
Nick Dimiduk 1b5c881ffb HBASE-26648 Improve fidelity of RegionLocator spans (addendum)
Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.
2022-05-03 13:40:42 +02:00
Nick Dimiduk a38716ca2a HBASE-26648 Improve fidelity of RegionLocator spans
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-03 13:40:42 +02:00
d-c-manning be8a9a5920 HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2022-05-02 10:51:37 -07:00
Duo Zhang 1a5b1b266c HBASE-26899 Run spotless:apply 2022-05-01 22:41:49 +08:00
d-c-manning afb8afd26c HBASE-26988 dynamic configuration of loadbalance.bytable (#4384)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/StochasticLoadBalancer.java
2022-04-29 15:55:16 -07:00
LiangJun He e9c9418d1d HBASE-26943 HMaster page style display confusion (#4369)
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-29 15:59:53 +08:00
d-c-manning fd2e7205ac HBASE-22349 slop in StochasticLoadBalancer (#4371)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
2022-04-28 12:38:50 -07:00
liangxs 895e0f474a HBASE-26975 Add on heap and off heap memstore info in rs web UI (#4368)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit cdf81ea5cc)
2022-04-28 23:15:10 +08:00
liangxs ea5c5da1b3 HBASE-26980 Update javadoc of BucketCache.java (#4374)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c02e7553d4)
2022-04-28 23:11:51 +08:00
Andrew Purtell 6813a5c502 HBASE-26979 StoreFileListFile logs frequent stacktraces at INFO level (#4373)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-27 18:02:18 -07:00
Bri Augenreich c2baa1fb7b HBASE-26581 Add metrics for failed replication edits (#4347)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-26 17:44:01 -04:00
Wellington Ramos Chevreuil c9d833ed5e HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366)
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c6)
2022-04-25 14:18:57 +01:00
Ruanhui 8d17241ce0
HBASE-26942 cache region locations when getAllRegionLocations (#4364)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-22 15:30:26 -04:00
Bryan Beaudreault 2240025349
HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-22 08:56:52 -04:00
Duo Zhang 085c65107e HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted (#4352)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 35aa57e445)
2022-04-17 23:26:56 +08:00
Duo Zhang ae8eccd5c0 HBASE-26938 Compaction failures after StoreFileTracker integration (#4350)
Introduce a StoreFileWriterCreationTracker to track the store files being written

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 48c4a4626e)
2022-04-17 22:44:44 +08:00
Duo Zhang bbe048c1e5 HBASE-26946 TestRetainAssignmentOnRestartSplitWithoutZk infinite loop (#4344)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2622fa05a6)
2022-04-16 13:23:57 +08:00
Pankaj c76daa1cc8 HBASE-26944 Possible resource leak while creating new region scanner (#4339)
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 62e3efccef)
2022-04-15 11:37:58 +05:30
Duo Zhang b405a6f119 Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)"
This reverts commit f8b2ac0518.
2022-04-13 11:53:19 +08:00
Duo Zhang f8b2ac0518 HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8247b7c722)
2022-04-13 11:10:25 +08:00
eomiks 52ca440ad6 HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on (#4295)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ac9e0be27)
2022-04-12 20:31:48 +08:00
huaxiangsun f9abe3d8f1
HBASE-26618 Involving primary meta region in meta scan with CatalogRe… (#4321) (#4326)
Signed-off-by: Michael Stack <stack@apache.org>
2022-04-11 10:27:15 -07:00
Duo Zhang e7eb628025 HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless (#4324)
Signed-off-by: Yulin Niu <niuyulin@apache.org
(cherry picked from commit 3ae0d9012c)
2022-04-09 23:13:49 +08:00
Duo Zhang 197b8d48ec HBASE-26928 Fix several indentation problems (#4323)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e68c61dd54)
2022-04-06 15:14:03 +08:00
Tak Lon (Stephen) Wu 87555093cf
HBASE-26882 Backport "HBASE-26810 Add dynamic configuration support f… (#4278)
- Include HBASE-25288 that has the configuration manager registration in HMaster

Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-04-05 10:06:13 -07:00
Wellington Ramos Chevreuil 1c14046ee0 HBASE-26927 Add snapshot scanner UT with SFT and some cleanups to Tes… (#4322)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(cherry picked from commit ae3718be0f)
2022-04-05 17:52:30 +01:00
bsglz 8ef1ae32e6 HBASE-26885 Addendum throw exception instead of return in TRSP to let the procedure retry (#4299)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7f9d1f2259)
2022-04-04 20:26:48 +08:00
weimingdiit 3b383806be HBASE-26924 Fix log parameter error and spelling error (#4318)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 003c572246)
2022-04-04 20:26:41 +08:00
Duo Zhang ab9ccabe8f HBASE-26921 Rewrite the counting cells part in TestMultiVersions (#4316)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 3e09e87fad)
2022-04-03 23:04:51 +08:00
Duo Zhang 1560b4149c HBASE-26920 Fix missing braces warnings in TestProcedureMember (#4315)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 78676bb85e)
2022-04-03 23:04:43 +08:00
Duo Zhang 0b87621a38 HBASE-26919 Rewrite the counting rows part in TestFromClientSide4 (#4314)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4e12eee531)
2022-04-03 23:04:36 +08:00
chenglei 4311974758
HBASE-26811 Secondary replica may be disabled for read incorrectly forever (#4308) 2022-04-01 11:20:48 +08:00
Nick Dimiduk 489af42792
HBASE-26545 Implement tracing of scan
* on `AsyncTable`, both `scan` and `scanAll` methods should result in `SCAN` table operations.
* the span of the `SCAN` table operation should have children representing all the RPC calls
  involved in servicing the scan.
* when a user provides custom implementation of `AdvancedScanResultConsumer`, any spans emitted
  from the callback methods should also be tied to the span that represents the `SCAN` table
  operation. This is easily done because these callbacks are executed on the RPC thread.
* when a user provides a custom implementation of `ScanResultConsumer`, any spans emitted from the
  callback methods should be also be tied to the span that represents the `SCAN` table
  operation. This accomplished by carefully passing the span instance around after it is created.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-31 17:29:51 +02:00
Duo Zhang 98db15acd2 HBASE-26245 Store region server list in master local region (#4136)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit bb1bbddf74)
(cherry picked from commit 27111421d9)
2022-03-31 22:26:40 +08:00
chenglei 1a85588265
HBASE-26812 ShortCircuitingClusterConnection fails to close RegionSca… (#4243) 2022-03-31 20:04:01 +08:00
bsglz af5624bb8e HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276)
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM

(cherry picked from commit 1efd8fe53c)
2022-03-29 10:18:15 +08:00
d-c-manning 0dbcf8f263 HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-28 11:47:11 -07:00
Xiaolin Ha 170570b799 HBASE-26872 Load rate calculator for cost functions should be more precise (#4253)
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2022-03-28 23:38:30 +08:00