Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,350 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18350 Commits

Author SHA1 Message Date
chenglei 8d0776c7b8
HBASE-26950 Use AsyncConnection in ReplicationSink (#4607) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2022-07-09 11:29:05 +08:00
Duo Zhang 3ca0f746fc HBASE-27148 Move minimum hadoop 3 support version to 3.2.3 (#4561) (#4599) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 41972cb460)
 2022-07-08 17:28:14 +08:00
Norman Maurer ecf758b9ab HBASE-27180 Fix multiple possible buffer leaks (#4597) 
* Fix multiple possible buffer leaks

Motivation:

When using ByteBuf you need to be very careful about releasing it as otherwise you might leak data. There were various places in the code-base where such a leak could happen.

Modifications:

- Fix possible buffer leaks
- Ensure we call touch(...) so its easier to debug buffer leaks

Result:

Fix buffer leaks

* Formatting

* Revert some changes as requested

* revert touch

* Also release checksum and header buffers

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2197b3806b)
 2022-07-08 08:27:30 +08:00
Bryan Beaudreault 94fc45ef76 HBASE-27078 Allow configuring a separate timeout for meta scans (#4585) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-07 16:48:28 -04:00
Duo Zhang 3ca8484c56 HBASE-26708 Netty leak detected and OutOfDirectMemoryError due to direct memory buffering with SASL implementation (#4596) 
Co-authored-by: Norman Maurer <norman_maurer@apple.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 816e919e95)
 2022-07-07 16:04:33 +08:00
Ujjawal 6870b9e168
HBASE-27175 - Failure to cleanup WAL split dir log should be at INFO level (#4593) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-07-06 16:34:52 -07:00
Bryan Beaudreault 7a2a66c9b0 HBASE-27048 Addendum spotless fix 2022-07-06 13:52:14 -04:00
Bryan Beaudreault efe0e14744 HBASE-27048 Server side scanner time limit should account for time in queue (#4562) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-06 13:47:15 -04:00
Nick Dimiduk 8296bb488c
HBASE-27172 Upgrade OpenTelemetry dependency to 1.15.0 
- the agent jar dropped the `-all` classifier after 1.8.0

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-06 13:55:34 +02:00
wenwj0 b72b5c66c8 HBASE-27101 support commons-crypto version 1.1.0 (#4506) 
Co-authored-by: wenwj0 <wenweijian2@huawei.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit ad13675db3)
 2022-07-06 19:19:38 +08:00
tianhang 10d8609d17 HBASE-27171 Fix Annotation Error in HRegionFileSystem (#4588) 
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6031a3a8d4)
 2022-07-06 12:39:29 +08:00
Duo Zhang baddedf783 HBASE-23330: Fix delegation token fetch with MasterRegistry (#1084) (#4598) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit d8b3f55518)

Co-authored-by: Bharath Vissapragada <bharathv@apache.org>
 2022-07-06 11:54:00 +08:00
Bryan Beaudreault e3963458b1 HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse (#4592) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-07-04 16:48:07 -04:00
Duo Zhang fec317560f HBASE-27169 TestSeparateClientZKCluster is flaky (#4587) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 03c23beb57)
 2022-07-01 22:13:33 +08:00
Ishika a9e346fba7 HBASE-26218 Add logs in Canary tool (#4501) 
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit acfbc3ff7d)
 2022-06-30 23:28:37 +08:00
Andrew Purtell cdc4e892ee HBASE-27166 WAL value compression minor improvements (#4584) 
A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.

Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-28 12:53:38 -07:00
Duo Zhang 9537f07ee5 HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded (#4579) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit d7f6861e8d)
 2022-06-26 15:29:42 +08:00
Bryan Beaudreault 642ebf8474 HBASE-27060 Addendum spotless fix (#4580) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-06-25 17:29:18 -04:00
Andrew Purtell 28a5083095 Revert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted" 
This reverts commit 50e2499354.

See also HBASE-27151 TestMultiRespectsLimits.testBlockMultiLimits repeatable failure
 2022-06-25 10:56:14 -07:00
Bryan Beaudreault 6884dbbe49 HBASE-27060 Addendum fix HBaseTestingUtility import in test 2022-06-25 01:56:38 -04:00
Bryan Beaudreault 50390ec114 HBASE-27060 Allow sharing connections between AggregationClient instances (#4566) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-24 10:50:43 -04:00
Duo Zhang 03a1180275 HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a5318)
 2022-06-24 22:37:40 +08:00
Bryan Beaudreault 2b36963d46 HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-24 07:41:55 -04:00
Andrew Purtell b2a68291f3 HBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525) 
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
   preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
  name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
  This allows the user to add a custom implementation, perhaps for debugging.

Also updates ReflectionUtils with a new helper method.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestNettyRpcServer.java
 2022-06-23 15:18:43 -07:00
Bryan Beaudreault b379d8e2cf HBASE-26945 Quotas causes too much load on meta for large clusters (#4576) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-06-23 16:48:07 -04:00
Kerasone 2b7347f23c HBASE-27001 The deleted variable cannot be printed out (#4479) 
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0)
 2022-06-23 22:44:27 +05:30
Pankaj 31acc8510f HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4569) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit c74bf8b6e2)
 2022-06-23 22:24:53 +05:30
Duo Zhang b47ca399c5 HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c)
 2022-06-22 23:19:10 +08:00
litao 8828d07c87
HBASE-27098 Fix link for field comments (#4499) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-21 18:31:35 -07:00
Tak Lon (Stephen) Wu f8159330aa HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-21 13:41:14 -07:00
LiangJun He 53b57d686b HBASE-27028 Add a shell command for flushing master local region (#4539) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 666aa064e7)
 2022-06-21 13:35:38 +08:00
XinSun 135348192c HBASE-26956 ExportSnapshot tool supports removing TTL (#4538) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-21 09:27:09 +08:00
xiaozhang0319 b9d6d370f2 HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500) 
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1)
 2022-06-21 00:14:36 +08:00
SiCheng-Zheng 5833756e5e
HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546) 
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-20 23:45:35 +08:00
Xiaolin Ha a7083d93cb HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-18 02:08:37 +08:00
litao fa1b3eed99
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:20:02 -07:00
xicm 591fda9fe4 HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534) 
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
(cherry picked from commit 7fc1674933)

Conflicts:
	hbase-testing-util/src/main/java/org/apache/hadoop/hbase/testing/TestingHBaseClusterImpl.java
 2022-06-15 13:44:38 +08:00
Mohammad Arshad 50e2499354 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2022-06-13 14:21:17 +02:00
Nick Dimiduk ac7622c398
HBASE-26366 Provide meaningful parent spans to ZK interactions 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-13 10:33:49 +02:00
Viraj Jasani 9741f1a5c1 Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524) 
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
 2022-06-12 10:25:23 -07:00
Andrew Purtell 2ef58ab52f HBASE-27097 SimpleRpcServer is broken (#4521) 
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-11 10:42:18 -07:00
Duo Zhang adea9bdd95 Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)" 
This reverts commit 278939cd83.
 2022-06-12 00:12:59 +08:00
wenwj0 c645e21686 HBASE-26923 PerformanceEvaluation support encryption option (#4489) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
 2022-06-11 21:30:24 +08:00
Nick Dimiduk f4a4f0c05e HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-10 15:57:52 +02:00
Nick Dimiduk cc2af766d6
HBASE-27095 HbckChore should produce a report 
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-10 15:47:08 +02:00
Andrew Purtell b7d7be0156 HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
 2022-06-09 10:01:21 -07:00
Nick Dimiduk 7ead4b1617 HBASE-27066 The Region Visualizer display failed 
Reviewed-by: litao <tomleescut@gmail.com>
 2022-06-09 13:09:38 +02:00
Nick Dimiduk d24f4ce2f0 Revert "HBASE-27066 The Region Visualizer display failed (#4472)" 
This reverts commit 8b9df125a3.
 2022-06-09 13:09:38 +02:00
wangzhi 5cc614f23f HBASE-27093 AsyncNonMetaRegionLocator：put Complete CompletableFuture outside lock block (#4496) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad)
 2022-06-07 12:18:46 +08:00
Bryan Beaudreault 046e51085f HBASE-27038 CellComparator should extend Serializable (#4492) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-06 17:47:30 -04:00