Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,701 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18701 Commits

Author SHA1 Message Date
Ishika d2509d709b HBASE-26218 Add logs in Canary tool (#4501) 
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit acfbc3ff7d)
 2022-06-30 23:28:26 +08:00
Andrew Purtell e4d2895cad HBASE-27166 WAL value compression minor improvements (#4584) 
A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.

Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-28 12:53:30 -07:00
Duo Zhang bd08ebb21c HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded (#4579) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit d7f6861e8d)
 2022-06-26 15:27:28 +08:00
Bryan Beaudreault c0a8647c53
HBASE-27060 Addendum spotless fix (#4580) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-06-25 17:28:09 -04:00
Andrew Purtell a9f9701b72 Revert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted" 
This reverts commit 96693e8b40.

See also HBASE-27151 TestMultiRespectsLimits.testBlockMultiLimits repeatable failure
 2022-06-25 10:57:47 -07:00
Bryan Beaudreault 3ed78a039b HBASE-27060 Addendum fix HBaseTestingUtility import in test 2022-06-25 01:45:08 -04:00
Bryan Beaudreault 5c273dacd0 HBASE-27060 Allow sharing connections between AggregationClient instances (#4566) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-24 10:50:13 -04:00
Duo Zhang e8f04a8a7f HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a5318)
 2022-06-24 22:37:27 +08:00
Bryan Beaudreault f06ac9192b
HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-24 07:40:42 -04:00
Andrew Purtell da76941b0e HBASE-27111 Make Netty channel bytebuf allocator configurable. (#4525) 
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
   preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
  name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
  This allows the user to add a custom implementation, perhaps for debugging.

Also updates ReflectionUtils with a new helper method.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestNettyRpcServer.java
 2022-06-23 15:18:32 -07:00
Bryan Beaudreault 409a7a44e8
HBASE-26945 Quotas causes too much load on meta for large clusters (#4576) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-06-23 16:47:09 -04:00
Kerasone d129b56f26 HBASE-27001 The deleted variable cannot be printed out (#4479) 
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0)
 2022-06-23 22:43:05 +05:30
Pankaj c74bf8b6e2
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4569) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-06-23 22:22:57 +05:30
Duo Zhang b570d2e81d HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c)
 2022-06-22 22:42:52 +08:00
litao ed96746747
HBASE-27098 Fix link for field comments (#4499) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-21 18:30:50 -07:00
Tak Lon (Stephen) Wu d28f06a560 HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-21 13:39:20 -07:00
LiangJun He 666aa064e7
HBASE-27028 Add a shell command for flushing master local region (#4539) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-21 13:25:35 +08:00
XinSun bdaa4486f3
HBASE-26956 ExportSnapshot tool supports removing TTL (#4538) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-21 09:19:08 +08:00
xiaozhang0319 18400ac3bd HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500) 
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1)
 2022-06-21 00:14:23 +08:00
SiCheng-Zheng e1de804ba1 HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546) 
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e)
 2022-06-20 23:48:45 +08:00
Xiaolin Ha f7d2d12ac1 HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-18 02:07:38 +08:00
litao ef0ff2729c
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:19:38 -07:00
xicm 3b9491b43f HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534) 
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
(cherry picked from commit 7fc1674933)

Conflicts:
	hbase-testing-util/src/main/java/org/apache/hadoop/hbase/testing/TestingHBaseClusterImpl.java
 2022-06-15 13:44:16 +08:00
Mohammad Arshad 96693e8b40 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2022-06-13 14:21:03 +02:00
Viraj Jasani b8f0c61ed7 Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524) 
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
 2022-06-12 10:24:02 -07:00
Andrew Purtell 18a1a4bdac HBASE-27097 SimpleRpcServer is broken (#4521) 
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-11 10:41:38 -07:00
Duo Zhang b21377f76b Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)" 
This reverts commit eca7c6056c.
 2022-06-12 00:12:32 +08:00
wenwj0 57d31224f6 HBASE-26923 PerformanceEvaluation support encryption option (#4489) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
 2022-06-11 21:14:40 +08:00
Nick Dimiduk 9b8bb580b9
HBASE-26366 Provide meaningful parent spans to ZK interactions 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-10 16:26:37 +02:00
Nick Dimiduk 6a5fb76188 HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-10 15:56:18 +02:00
Nick Dimiduk 1dcee76e07
HBASE-27095 HbckChore should produce a report 
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-10 15:46:48 +02:00
Andrew Purtell 27f9182246 HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
 2022-06-09 10:01:11 -07:00
Nick Dimiduk b3c9ef34b7 HBASE-27066 The Region Visualizer display failed 
Reviewed-by: litao <tomleescut@gmail.com>
 2022-06-09 13:09:25 +02:00
Nick Dimiduk 33f633a0b1 Revert "HBASE-27066 The Region Visualizer display failed (#4472)" 
This reverts commit 5e54c6daf6.
 2022-06-09 13:09:25 +02:00
litao 63a35facad
HBASE-27092 Regionserver table on Master UI is broken (#4495) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-07 17:39:27 -07:00
wangzhi a2dc48a033 HBASE-27093 AsyncNonMetaRegionLocator：put Complete CompletableFuture outside lock block (#4496) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad)
 2022-06-07 12:18:36 +08:00
Bryan Beaudreault 50e2ef24d5 HBASE-27038 CellComparator should extend Serializable (#4492) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-06 17:45:20 -04:00
Duo Zhang eca7c6056c HBASE-27084 Add spotless:check in mvn verify stage (#4482) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c53)
 2022-06-06 23:48:25 +08:00
liuzhuang2017 fd6e6e0cbb HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec)
 2022-06-06 13:41:57 +08:00
BukrosSzabolcs ef221846e5 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-06-05 20:01:57 +01:00
Sean Busbey bb8b80e7a9 HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378) 
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit d1149f7e20)
 2022-06-05 00:32:43 -05:00
skysiders 286c9c3327
HBASE-26985 check permission for SecureBulkLoadManager (#4379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-02 15:29:43 -07:00
Huaxiang Sun 58aaed19b0 Revert "HBASE-26962: Add mob info in web UI (#4359)" 
This reverts commit 7a02cbfd7e.
 2022-06-02 14:04:27 -07:00
huaxiangsun 672b0a5f5c
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4464) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-02 12:35:11 -07:00
Duo Zhang f97af48d30 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac)
 2022-06-03 00:10:53 +08:00
Xiaolin Ha f61ac22f02 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f)
 2022-06-03 00:08:30 +08:00
liangxs 7a02cbfd7e HBASE-26962: Add mob info in web UI (#4359) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d03004060d)
 2022-06-03 00:05:22 +08:00
LiangJun He 8270b5df5e HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4)
 2022-06-02 21:38:59 +08:00
litao b21930f3fa HBASE-27037 Display the region server state on the Web UI (#4432) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit db992083af)
 2022-06-02 21:33:07 +08:00
Duo Zhang 40c2743a0c HBASE-27023 Fix license issues after running spotless:apply (#4458) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99)
 2022-06-02 20:20:43 +08:00