Commit Graph

19521 Commits

Author SHA1 Message Date
LiangJun He 5d0f4dc729 HBASE-27091 Speed up the loading of table descriptor from filesystem (#4493)
Signed-off-by: Yu Li <liyu@apache.org>
2022-06-15 00:41:24 +08:00
Mohammad Arshad f526609331 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-13 14:19:11 +02:00
itstitus 302034223c
Purging references to ports 60010 and 60030 from the book
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-06-13 13:07:15 +02:00
Sean Busbey 5360fffc82
HBASE-27106 update asciidoctor site building. (#4522)
- update asciidoctor maven plugin to latest
- update the asciidoctor pdf dependency to latest
- allow the plugin to use its own version of jruby

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-06-13 10:46:10 +02:00
LiangJun He 002c92cd7a
HBASE-27028 Add a shell command for flushing master local region (#4457)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-13 11:09:05 +08:00
Viraj Jasani 5e34cdf1ef
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-12 10:22:42 -07:00
Andrew Purtell 3e98869925
HBASE-27097 SimpleRpcServer is broken (#4521)
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:40:40 -07:00
Duo Zhang 9c846f4873 Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
This reverts commit a060e71c53.
2022-06-12 00:12:05 +08:00
wenwj0 b7065c1cf5
HBASE-26923 PerformanceEvaluation support encryption option (#4489)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-11 20:10:25 +08:00
Nick Dimiduk ed7e15dc91
HBASE-26366 Provide meaningful parent spans to ZK interactions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 16:25:55 +02:00
Nick Dimiduk 6b21d3ff11 HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:51:44 +02:00
Nick Dimiduk e191fe9219
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:46:24 +02:00
Andrew Purtell c24ba54147
HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:00:10 -07:00
Nick Dimiduk 414cfb30f6 HBASE-27066 The Region Visualizer display failed
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 12:56:38 +02:00
Nick Dimiduk 02cc63e524 Revert "HBASE-27066 The Region Visualizer display failed (#4472)"
This reverts commit 5c116d239f.
2022-06-09 12:56:38 +02:00
litao 9342653691
HBASE-27092 Regionserver table on Master UI is broken (#4495)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-07 17:37:48 -07:00
wangzhi 176c43c5ad
HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-07 12:17:52 +08:00
Bryan Beaudreault 93996bd578
HBASE-27038 CellComparator should extend Serializable (#4492)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:44:13 -04:00
Duo Zhang a060e71c53
HBASE-27084 Add spotless:check in mvn verify stage (#4482)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-06 19:49:34 +08:00
liuzhuang2017 12a9e6e5ec
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-06 13:37:58 +08:00
BukrosSzabolcs 7184949cea
HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-05 19:51:28 +01:00
Sean Busbey d1149f7e20
HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-06-05 00:15:59 -05:00
chenglei d57159f31c
HBASE-26993 Make the new framework for region replication could work for SKIP_WAL (#4392)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 16:39:17 +08:00
skysiders c0e8243c8b
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:28:22 -07:00
Duo Zhang 313a37f7ac
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-06-02 23:55:23 +08:00
liangxs d03004060d
HBASE-26962: Add mob info in web UI (#4359)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 23:53:03 +08:00
Xiaolin Ha 80f410ec3f
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 23:52:14 +08:00
litao ac8b51718f
HBASE-27036 Displays the number of decommissioned region server for status command (#4431)
add decommissionedServers to cluster metric

Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org
2022-06-02 23:51:39 +08:00
LiangJun He 15002fccb4
HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 21:27:25 +08:00
litao db992083af
HBASE-27037 Display the region server state on the Web UI (#4432)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 21:19:45 +08:00
Duo Zhang e555ac4a99
HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-02 20:18:00 +08:00
Duo Zhang 99e4e3ea3e
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 08:30:52 -07:00
Andrew Purtell 540fe8bbfa
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:04 -07:00
Andrew Purtell f356bf1c91
HBASE-27067 Upgrade pyjwt to version 2.4.0 or later for dev-support/git-jira-release-audit (#4473)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-31 11:52:52 -07:00
litao d532135a26
HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:49:49 -07:00
Andrew Purtell 88d9c4bef4
HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:06 -07:00
Istvan Toth 4ce85aa39f
HBASE-27069 Hbase SecureBulkload permission regression (#4475)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-31 09:52:35 +01:00
litao 5c116d239f
HBASE-27066 The Region Visualizer display failed (#4472)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:53:50 -07:00
Andrew Purtell cf0ed2e1be
HBASE-27065 Build against Hadoop 3.3.3 (#4467)
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:03:23 -07:00
Andrew Purtell 9fcaf854ed
HBASE-26854 Shell startup logs a bunch of noise (#4469)
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:00:41 -07:00
Sergey Soldatov fdf054de2c
HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:01:21 +01:00
Duo Zhang 286f6c5af4 HBASE-26649 Addendum fix spotless error 2022-05-25 21:28:47 +08:00
Tak Lon (Stephen) Wu 194f8c2c41
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:27:15 -07:00
Xiaolin Ha bc21967946
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 09:53:48 +08:00
huaxiangsun 623f8affe2
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-23 08:54:00 -07:00
bitterfox 1be2c83b3d
HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-22 11:32:17 +08:00
Junegunn Choi 2b573ae377
HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-22 11:31:48 +08:00
litao 63fe279b45
HBASE-27047 Fix typo for metric drainingRegionServers (#4441)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-22 11:28:01 +08:00
d-c-manning cec35b6e80
HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-21 09:17:04 -07:00
Xiaolin Ha 1aa07d5e6b
HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:32:58 -07:00