Commit Graph

19514 Commits

Author SHA1 Message Date
wenwj0 ad13675db3
HBASE-27101 support commons-crypto version 1.1.0 (#4506)
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-06 18:57:15 +08:00
Duo Zhang 6f4a0476f2 HBASE-27148 Addendum uncomment the shutdown code in TestVerifyReplicationCrossDiffHdfs 2022-07-06 14:48:08 +08:00
Duo Zhang 41972cb460
HBASE-27148 Move minimum hadoop 3 support version to 3.2.3 (#4561)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-06 12:49:47 +08:00
Ruanhui f76d8554ca
HBASE-27157 Potential race condition in WorkerAssigner (#4577)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
2022-07-06 10:59:13 +08:00
tianhang 6031a3a8d4
HBASE-27171 Fix Annotation Error in HRegionFileSystem (#4588)
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-06 10:58:34 +08:00
Bryan Beaudreault f3f292fad4
HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse (#4592)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-04 16:18:45 -04:00
Andrew Purtell 724bf7837a HBASE-27174 Update downloads.xml for release 2.4.13
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-01 12:54:21 -07:00
Duo Zhang 03c23beb57
HBASE-27169 TestSeparateClientZKCluster is flaky (#4587)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-01 22:09:01 +08:00
Ishika acfbc3ff7d
HBASE-26218 Add logs in Canary tool (#4501)
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-30 21:53:20 +08:00
Duo Zhang c07c393565
HBASE-27164 Add 3.0.0-alpha-3 to download page (#4583)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-06-29 11:07:33 +08:00
Duo Zhang 9bcb7493e0
HBASE-27165 Set version as 3.0.0-alpha-4-SNAPSHOT in master (#4582)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-06-29 11:04:21 +08:00
Ruanhui 9c2bc55350
HBASE-27158 Add namespace column family to UNDELETABLE_META_COLUMNFAMILIES (#4578)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-29 10:27:53 +08:00
Andrew Purtell ca34bdccc3
HBASE-27166 WAL value compression minor improvements (#4584)
A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.

Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-28 12:49:25 -07:00
Duo Zhang d7f6861e8d
HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded (#4579)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-26 15:22:25 +08:00
Andrew Purtell 42853aae57 Revert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted"
This reverts commit f526609331.

See also HBASE-27151 TestMultiRespectsLimits.testBlockMultiLimits repeatable failure
2022-06-25 10:58:25 -07:00
huaxiangsun d447fa01ba
HBASE-27025 Change Hbase book's description for 74.7.3. Load Balancing META table load (#4530)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 08:01:24 -07:00
Bryan Beaudreault 25c56caec8
HBASE-27060 Allow sharing connections between AggregationClient instances (#4566)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 10:47:33 -04:00
Duo Zhang b1691a5318
HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
2022-06-24 22:29:17 +08:00
Duo Zhang c0e7e98ec7
HBASE-26095 Modify our ref guide to mention the deprecation of HBTU and also how to make use of the new TestingHBaseCluster (#4542)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-24 12:45:00 +08:00
Andrew Purtell 4f88a3c4bb
HBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525)
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
   preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
  name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
  This allows the user to add a custom implementation, perhaps for debugging.

Also updates ReflectionUtils with a new helper method.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-23 15:13:29 -07:00
Kerasone b8558d30d0
HBASE-27001 The deleted variable cannot be printed out (#4479)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>


Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-23 22:41:32 +05:30
Bryan Beaudreault e84cd3dd6a
HBASE-26945 Quotas causes too much load on meta for large clusters (#4567)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-23 10:34:29 -04:00
Bryan Beaudreault 59e5c610e3 HBASE-26790 Addendum ensure test is not flaky due to async caching 2022-06-23 10:22:55 -04:00
Bryan Beaudreault 50f11151fd
HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4565)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-23 08:24:49 -04:00
Pankaj 342183e596
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4515)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-23 12:51:48 +05:30
Duo Zhang 9bae50f83c
HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-06-22 22:38:12 +08:00
chenglei de804938b9
HBASE-27062 Remove ThreadPool in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection (#4560) 2022-06-22 20:01:56 +08:00
chenglei 902bc3ed70
Revert "HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)" (#4559) 2022-06-22 19:38:48 +08:00
chenglei 34ba2c51cf
HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplication… (#4463)
* HBASE-27062 ThreadPool is unnecessary in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection
2022-06-22 19:33:05 +08:00
litao 9da2a3fead
HBASE-27098 Fix link for field comments (#4499)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-21 18:29:34 -07:00
Tak Lon (Stephen) Wu 33ea96cdf7
HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 13:38:09 -07:00
BukrosSzabolcs 5cf728da5a
HBASE-26969:Eliminate MOB renames when SFT is enabled (#4418)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-21 10:18:55 +01:00
xiaozhang0319 b498efdbc1
HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 00:13:33 +08:00
SiCheng-Zheng a0a018d6c3 HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e)
2022-06-20 23:48:33 +08:00
Xiaolin Ha 89bda2c322
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-17 23:35:26 +08:00
litao 5e5d18bf21
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:18:18 -07:00
XinSun b365748485
HBASE-26956 ExportSnapshot tool supports removing TTL (#4351)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-15 15:04:17 +08:00
xicm 7fc1674933 HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 10:54:55 +08:00
Duo Zhang 183399776f Revert "HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)"
This reverts commit 11ae7208dd.
2022-06-15 10:53:48 +08:00
Duo Zhang 02990894ab
HBASE-27121 Set version as 3.0.0-alpha-3 in master in prep for first RC of 3.0.0-alpha-3 (#4535)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-06-15 10:51:31 +08:00
Duo Zhang 11ae7208dd
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 10:48:48 +08:00
LiangJun He c6298c709a HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 00:48:25 +08:00
Yu Li 86b7b027b7 Revert "HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)"
This reverts commit 5d0f4dc729 to correct signed-off info.
2022-06-15 00:47:28 +08:00
LiangJun He 5d0f4dc729 HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 00:41:24 +08:00
Mohammad Arshad f526609331 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-13 14:19:11 +02:00
itstitus 302034223c
Purging references to ports 60010 and 60030 from the book
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-06-13 13:07:15 +02:00
Sean Busbey 5360fffc82
HBASE-27106 update asciidoctor site building. (#4522)
- update asciidoctor maven plugin to latest
- update the asciidoctor pdf dependency to latest
- allow the plugin to use its own version of jruby

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-06-13 10:46:10 +02:00
LiangJun He 002c92cd7a
HBASE-27028 Add a shell command for flushing master local region (#4457)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-13 11:09:05 +08:00
Viraj Jasani 5e34cdf1ef
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-12 10:22:42 -07:00
Andrew Purtell 3e98869925
HBASE-27097 SimpleRpcServer is broken (#4521)
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:40:40 -07:00