Commit Graph

9197 Commits

Author SHA1 Message Date
Andrew Purtell 4f88a3c4bb
HBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525)
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
   preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
  name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
  This allows the user to add a custom implementation, perhaps for debugging.

Also updates ReflectionUtils with a new helper method.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-23 15:13:29 -07:00
Kerasone b8558d30d0
HBASE-27001 The deleted variable cannot be printed out (#4479)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>


Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-23 22:41:32 +05:30
Bryan Beaudreault e84cd3dd6a
HBASE-26945 Quotas causes too much load on meta for large clusters (#4567)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-23 10:34:29 -04:00
Bryan Beaudreault 59e5c610e3 HBASE-26790 Addendum ensure test is not flaky due to async caching 2022-06-23 10:22:55 -04:00
Bryan Beaudreault 50f11151fd
HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4565)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-23 08:24:49 -04:00
Pankaj 342183e596
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4515)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-23 12:51:48 +05:30
chenglei de804938b9
HBASE-27062 Remove ThreadPool in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection (#4560) 2022-06-22 20:01:56 +08:00
chenglei 902bc3ed70
Revert "HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)" (#4559) 2022-06-22 19:38:48 +08:00
chenglei 34ba2c51cf
HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)
* HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection
2022-06-22 19:33:05 +08:00
litao 9da2a3fead
HBASE-27098 Fix link for field comments (#4499)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-21 18:29:34 -07:00
BukrosSzabolcs 5cf728da5a
HBASE-26969:Eliminate MOB renames when SFT is enabled (#4418)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-21 10:18:55 +01:00
xiaozhang0319 b498efdbc1
HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 00:13:33 +08:00
SiCheng-Zheng a0a018d6c3 HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e)
2022-06-20 23:48:33 +08:00
Xiaolin Ha 89bda2c322
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-17 23:35:26 +08:00
litao 5e5d18bf21
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:18:18 -07:00
Duo Zhang 02990894ab
HBASE-27121 Set version as 3.0.0-alpha-3 in master in prep for first RC of 3.0.0-alpha-3 (#4535)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-06-15 10:51:31 +08:00
LiangJun He c6298c709a HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 00:48:25 +08:00
Yu Li 86b7b027b7 Revert "HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)"
This reverts commit 5d0f4dc729 to correct signed-off info.
2022-06-15 00:47:28 +08:00
LiangJun He 5d0f4dc729 HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 00:41:24 +08:00
LiangJun He 002c92cd7a
HBASE-27028 Add a shell command for flushing master local region (#4457)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-13 11:09:05 +08:00
Viraj Jasani 5e34cdf1ef
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-12 10:22:42 -07:00
Nick Dimiduk ed7e15dc91
HBASE-26366 Provide meaningful parent spans to ZK interactions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 16:25:55 +02:00
Nick Dimiduk e191fe9219
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:46:24 +02:00
Nick Dimiduk 414cfb30f6 HBASE-27066 The Region Visualizer display failed
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 12:56:38 +02:00
Nick Dimiduk 02cc63e524 Revert "HBASE-27066 The Region Visualizer display failed (#4472)"
This reverts commit 5c116d239f.
2022-06-09 12:56:38 +02:00
litao 9342653691
HBASE-27092 Regionserver table on Master UI is broken (#4495)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-07 17:37:48 -07:00
liuzhuang2017 12a9e6e5ec
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-06 13:37:58 +08:00
BukrosSzabolcs 7184949cea
HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-05 19:51:28 +01:00
chenglei d57159f31c
HBASE-26993 Make the new framework for region replication could work for SKIP_WAL (#4392)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 16:39:17 +08:00
skysiders c0e8243c8b
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:28:22 -07:00
Duo Zhang 313a37f7ac
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-06-02 23:55:23 +08:00
liangxs d03004060d
HBASE-26962: Add mob info in web UI (#4359)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 23:53:03 +08:00
Xiaolin Ha 80f410ec3f
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 23:52:14 +08:00
litao ac8b51718f
HBASE-27036 Displays the number of decommissioned region server for status command (#4431)
add decommissionedServers to cluster metric

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org
2022-06-02 23:51:39 +08:00
LiangJun He 15002fccb4
HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 21:27:25 +08:00
litao db992083af
HBASE-27037 Display the region server state on the Web UI (#4432)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 21:19:45 +08:00
Duo Zhang 99e4e3ea3e
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 08:30:52 -07:00
Andrew Purtell 540fe8bbfa
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:04 -07:00
litao d532135a26
HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:49:49 -07:00
Andrew Purtell 88d9c4bef4
HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:06 -07:00
Istvan Toth 4ce85aa39f
HBASE-27069 Hbase SecureBulkload permission regression (#4475)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-31 09:52:35 +01:00
litao 5c116d239f
HBASE-27066 The Region Visualizer display failed (#4472)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:53:50 -07:00
Sergey Soldatov fdf054de2c
HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:01:21 +01:00
Duo Zhang 286f6c5af4 HBASE-26649 Addendum fix spotless error 2022-05-25 21:28:47 +08:00
Xiaolin Ha bc21967946
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 09:53:48 +08:00
huaxiangsun 623f8affe2
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-23 08:54:00 -07:00
Xiaolin Ha 1aa07d5e6b
HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:32:58 -07:00
Nick Dimiduk bf5f0c7e7f
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4451)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:13:23 -07:00
Andrew Purtell 42a64f2a4d
HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:10:42 -07:00
Duo Zhang 487cf301a4
HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-18 20:29:06 +08:00