18376 Commits

Author SHA1 Message Date
Andrew Purtell
18a1a4bdac HBASE-27097 SimpleRpcServer is broken (#4521)
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:41:38 -07:00
Duo Zhang
b21377f76b Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
This reverts commit eca7c6056ca211a57fa3d09aef2321121d611b84.
2022-06-12 00:12:32 +08:00
wenwj0
57d31224f6 HBASE-26923 PerformanceEvaluation support encryption option (#4489)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5297074e79e5c58b3ee1ba5fd1a7f55)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
2022-06-11 21:14:40 +08:00
Nick Dimiduk
9b8bb580b9
HBASE-26366 Provide meaningful parent spans to ZK interactions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 16:26:37 +02:00
Nick Dimiduk
6a5fb76188 HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:56:18 +02:00
Nick Dimiduk
1dcee76e07
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:46:48 +02:00
Andrew Purtell
27f9182246 HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:01:11 -07:00
Nick Dimiduk
b3c9ef34b7 HBASE-27066 The Region Visualizer display failed
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:25 +02:00
Nick Dimiduk
33f633a0b1 Revert "HBASE-27066 The Region Visualizer display failed (#4472)"
This reverts commit 5e54c6daf6544087e45a3274cd9cc75c023d4cdb.
2022-06-09 13:09:25 +02:00
litao
63a35facad
HBASE-27092 Regionserver table on Master UI is broken (#4495)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-07 17:39:27 -07:00
wangzhi
a2dc48a033 HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad1aab01eb2d2b05c0cb90132e8d19b1)
2022-06-07 12:18:36 +08:00
Bryan Beaudreault
50e2ef24d5 HBASE-27038 CellComparator should extend Serializable (#4492)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:45:20 -04:00
Duo Zhang
eca7c6056c HBASE-27084 Add spotless:check in mvn verify stage (#4482)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c530556743189c9ee8b01a90e0f2891af)
2022-06-06 23:48:25 +08:00
liuzhuang2017
fd6e6e0cbb HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec7e3c86b60ae818d736b9f83fb69604)
2022-06-06 13:41:57 +08:00
BukrosSzabolcs
ef221846e5 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-05 20:01:57 +01:00
Sean Busbey
bb8b80e7a9 HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit d1149f7e2009ae993cf95ba7eafe2e5999bee54b)
2022-06-05 00:32:43 -05:00
skysiders
286c9c3327
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:29:43 -07:00
Huaxiang Sun
58aaed19b0 Revert "HBASE-26962: Add mob info in web UI (#4359)"
This reverts commit 7a02cbfd7ee6418594a1cd241e10b54a0c837e23.
2022-06-02 14:04:27 -07:00
huaxiangsun
672b0a5f5c
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4464)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 12:35:11 -07:00
Duo Zhang
f97af48d30 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac780a36b51064372868a31849df6727)
2022-06-03 00:10:53 +08:00
Xiaolin Ha
f61ac22f02 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3fddf35f77b1e3f2b352110d296a2415)
2022-06-03 00:08:30 +08:00
liangxs
7a02cbfd7e HBASE-26962: Add mob info in web UI (#4359)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d03004060da4084ff858d999faca6d8a4244d8a5)
2022-06-03 00:05:22 +08:00
LiangJun He
8270b5df5e HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4abb187467a9355f436d533928da7ef)
2022-06-02 21:38:59 +08:00
litao
b21930f3fa HBASE-27037 Display the region server state on the Web UI (#4432)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit db992083aff354cc7bc5cee96af7db45d2852531)
2022-06-02 21:33:07 +08:00
Duo Zhang
40c2743a0c HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99419401e293385e78816f4c3f87e771)
2022-06-02 20:20:43 +08:00
Andrew Purtell
bcf3cd55fd Amend HBASE-27082 spotless:apply
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 10:50:44 -07:00
Duo Zhang
716a56c849 HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
2022-06-01 09:17:34 -07:00
Andrew Purtell
6dd1a6bef0 HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 19:56:16 -07:00
Duo Zhang
e69da68f97 HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 (#3457)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-05-31 18:27:16 -07:00
Andrew Purtell
59700babd0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:41 -07:00
litao
f4f3e63f9f HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:50:33 -07:00
Andrew Purtell
cfba2f2b14 HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:38 -07:00
Istvan Toth
7fbfb10649 HBASE-27069 Hbase SecureBulkload permission regression (#4475)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 4ce85aa39ffe353ec0d23dd7dd96e1052ac6af81)
2022-05-31 10:07:23 +01:00
litao
5e54c6daf6 HBASE-27066 The Region Visualizer display failed (#4472)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:56:32 -07:00
Andrew Purtell
779e9859dc
HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471)
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:03:41 -07:00
Andrew Purtell
20895c7ec5 HBASE-26854 Shell startup logs a bunch of noise (#4469)
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:01:13 -07:00
Sergey Soldatov
50dd9619b0 HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:11:18 +01:00
Tak Lon (Stephen) Wu
02c1fef889 HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:29:17 -07:00
Xiaolin Ha
56b81b42d8
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 15:51:52 +08:00
Xiaolin Ha
200cbcc34f
HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460)
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2022-05-24 14:26:09 +08:00
Duo Zhang
4260e3afb7 HBASE-26933 Addendum remove unused resources and links on site 2022-05-22 16:10:52 +08:00
Duo Zhang
778ae2d655
HBASE-26933 Remove all ref guide stuff on branch other than master (#4426)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-05-22 15:12:52 +08:00
Junegunn Choi
d8d1089649 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377be926922f48238c4da45a2289f318f)
2022-05-22 15:07:15 +08:00
litao
bc40edecfc HBASE-27047 Fix typo for metric drainingRegionServers (#4441)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b457c0775a986a096027b82c18e868d80)
2022-05-22 15:02:34 +08:00
bitterfox
a6b1c7e234 HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3dc8306050f67828c9c2e361f19481c6)
2022-05-22 11:35:45 +08:00
d-c-manning
b00e3032a6 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
2022-05-21 09:23:05 -07:00
Xiaolin Ha
8bc55f8308 HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:34:17 -07:00
Nick Dimiduk
2cae259f36
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4455)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:13:57 -07:00
Andrew Purtell
7af82cf164 HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:11:19 -07:00
Andrew Purtell
a836fc86e8 HBASE-27050 Support unit test pattern matching again (#4447)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:09:01 -07:00