wenwj0
b72b5c66c8
HBASE-27101 support commons-crypto version 1.1.0 ( #4506 )
...
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit ad13675db3
)
2022-07-06 19:19:38 +08:00
tianhang
10d8609d17
HBASE-27171 Fix Annotation Error in HRegionFileSystem ( #4588 )
...
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6031a3a8d4
)
2022-07-06 12:39:29 +08:00
Duo Zhang
baddedf783
HBASE-23330: Fix delegation token fetch with MasterRegistry ( #1084 ) ( #4598 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit d8b3f55518
)
Co-authored-by: Bharath Vissapragada <bharathv@apache.org>
2022-07-06 11:54:00 +08:00
Bryan Beaudreault
e3963458b1
HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse ( #4592 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-04 16:48:07 -04:00
Duo Zhang
fec317560f
HBASE-27169 TestSeparateClientZKCluster is flaky ( #4587 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 03c23beb57
)
2022-07-01 22:13:33 +08:00
Ishika
a9e346fba7
HBASE-26218 Add logs in Canary tool ( #4501 )
...
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit acfbc3ff7d
)
2022-06-30 23:28:37 +08:00
Andrew Purtell
cdc4e892ee
HBASE-27166 WAL value compression minor improvements ( #4584 )
...
A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.
Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-28 12:53:38 -07:00
Duo Zhang
9537f07ee5
HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded ( #4579 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit d7f6861e8d
)
2022-06-26 15:29:42 +08:00
Bryan Beaudreault
642ebf8474
HBASE-27060 Addendum spotless fix ( #4580 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-06-25 17:29:18 -04:00
Andrew Purtell
28a5083095
Revert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted"
...
This reverts commit 50e2499354
.
See also HBASE-27151 TestMultiRespectsLimits.testBlockMultiLimits repeatable failure
2022-06-25 10:56:14 -07:00
Bryan Beaudreault
6884dbbe49
HBASE-27060 Addendum fix HBaseTestingUtility import in test
2022-06-25 01:56:38 -04:00
Bryan Beaudreault
50390ec114
HBASE-27060 Allow sharing connections between AggregationClient instances ( #4566 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 10:50:43 -04:00
Duo Zhang
03a1180275
HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator ( #4571 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a5318
)
2022-06-24 22:37:40 +08:00
Bryan Beaudreault
2b36963d46
HBASE-26790 getAllRegionLocations can cache locations with null hostname ( #4575 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-24 07:41:55 -04:00
Andrew Purtell
b2a68291f3
HBASE-27111 Make Netty channel bytebuf allocator configurable. ( #4525 )
...
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
This allows the user to add a custom implementation, perhaps for debugging.
Also updates ReflectionUtils with a new helper method.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestNettyRpcServer.java
2022-06-23 15:18:43 -07:00
Bryan Beaudreault
b379d8e2cf
HBASE-26945 Quotas causes too much load on meta for large clusters ( #4576 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-23 16:48:07 -04:00
Kerasone
2b7347f23c
HBASE-27001 The deleted variable cannot be printed out ( #4479 )
...
* The deleted variable cannot be printed out, add it
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0
)
2022-06-23 22:44:27 +05:30
Pankaj
31acc8510f
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout ( #4569 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit c74bf8b6e2
)
2022-06-23 22:24:53 +05:30
Duo Zhang
b47ca399c5
HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 ( #4552 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c
)
2022-06-22 23:19:10 +08:00
litao
8828d07c87
HBASE-27098 Fix link for field comments ( #4499 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-21 18:31:35 -07:00
Tak Lon (Stephen) Wu
f8159330aa
HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell ( #4554 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 13:41:14 -07:00
LiangJun He
53b57d686b
HBASE-27028 Add a shell command for flushing master local region ( #4539 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 666aa064e7
)
2022-06-21 13:35:38 +08:00
XinSun
135348192c
HBASE-26956 ExportSnapshot tool supports removing TTL ( #4538 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 09:27:09 +08:00
xiaozhang0319
b9d6d370f2
HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds ( #4500 )
...
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1
)
2022-06-21 00:14:36 +08:00
SiCheng-Zheng
5833756e5e
HBASE-27128 when open archiveRetries totalLogSize calculation mistake ( #4546 )
...
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-20 23:45:35 +08:00
Xiaolin Ha
a7083d93cb
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound ( #4541 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-18 02:08:37 +08:00
litao
fa1b3eed99
HBASE-27117 Update the method comments for RegionServerAccounting ( #4532 )
2022-06-16 17:20:02 -07:00
xicm
591fda9fe4
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster ( #4534 )
...
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
(cherry picked from commit 7fc1674933
)
Conflicts:
hbase-testing-util/src/main/java/org/apache/hadoop/hbase/testing/TestingHBaseClusterImpl.java
2022-06-15 13:44:38 +08:00
Mohammad Arshad
50e2499354
HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
...
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-13 14:21:17 +02:00
Nick Dimiduk
ac7622c398
HBASE-26366 Provide meaningful parent spans to ZK interactions
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-13 10:33:49 +02:00
Viraj Jasani
9741f1a5c1
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #3117 )" ( #4524 )
...
This reverts commit f3a48d1910
.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2022-06-12 10:25:23 -07:00
Andrew Purtell
2ef58ab52f
HBASE-27097 SimpleRpcServer is broken ( #4521 )
...
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.
Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:42:18 -07:00
Duo Zhang
adea9bdd95
Revert "HBASE-27084 Add spotless:check in mvn verify stage ( #4482 )"
...
This reverts commit 278939cd83
.
2022-06-12 00:12:59 +08:00
wenwj0
c645e21686
HBASE-26923 PerformanceEvaluation support encryption option ( #4489 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5
)
Conflicts:
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
2022-06-11 21:30:24 +08:00
Nick Dimiduk
f4a4f0c05e
HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:57:52 +02:00
Nick Dimiduk
cc2af766d6
HBASE-27095 HbckChore should produce a report
...
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:47:08 +02:00
Andrew Purtell
b7d7be0156
HBASE-27103 All MR UTs are broken because of ClassNotFound ( #4514 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:01:21 -07:00
Nick Dimiduk
7ead4b1617
HBASE-27066 The Region Visualizer display failed
...
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:38 +02:00
Nick Dimiduk
d24f4ce2f0
Revert "HBASE-27066 The Region Visualizer display failed ( #4472 )"
...
This reverts commit 8b9df125a3
.
2022-06-09 13:09:38 +02:00
wangzhi
5cc614f23f
HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block ( #4496 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad
)
2022-06-07 12:18:46 +08:00
Bryan Beaudreault
046e51085f
HBASE-27038 CellComparator should extend Serializable ( #4492 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:47:30 -04:00
Duo Zhang
278939cd83
HBASE-27084 Add spotless:check in mvn verify stage ( #4482 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c53
)
2022-06-06 23:48:38 +08:00
liuzhuang2017
19f67d22d4
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. ( #4481 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec
)
2022-06-06 13:42:08 +08:00
BukrosSzabolcs
8139cf6477
HBASE-27017: MOB snapshot is broken when FileBased SFT is used ( #4466 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-06 00:29:27 +01:00
huaxiangsun
5a13ad8137
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() ( #4442 ) ( #4484 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 15:27:00 -07:00
skysiders
0c5d6601da
HBASE-26985 check permission for SecureBulkLoadManager ( #4379 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:30:12 -07:00
Duo Zhang
2625c67e73
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing ( #4449 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac
)
2022-06-03 00:11:10 +08:00
Xiaolin Ha
8bf5256c24
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) ( #4405 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f
)
2022-06-03 00:08:45 +08:00
LiangJun He
a93b7cd654
HBASE-27039 Some methods of MasterRegion should be annotated for testing only ( #4433 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4
)
2022-06-02 21:39:13 +08:00
Duo Zhang
b5dcb7d3a1
HBASE-27023 Fix license issues after running spotless:apply ( #4458 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99
)
2022-06-02 20:24:08 +08:00