Commit Graph

18327 Commits

Author SHA1 Message Date
Viraj Jasani b8f0c61ed7 Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2022-06-12 10:24:02 -07:00
Andrew Purtell 18a1a4bdac HBASE-27097 SimpleRpcServer is broken (#4521)
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:41:38 -07:00
Duo Zhang b21377f76b Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
This reverts commit eca7c6056c.
2022-06-12 00:12:32 +08:00
wenwj0 57d31224f6 HBASE-26923 PerformanceEvaluation support encryption option (#4489)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
2022-06-11 21:14:40 +08:00
Nick Dimiduk 9b8bb580b9
HBASE-26366 Provide meaningful parent spans to ZK interactions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 16:26:37 +02:00
Nick Dimiduk 6a5fb76188 HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:56:18 +02:00
Nick Dimiduk 1dcee76e07
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:46:48 +02:00
Andrew Purtell 27f9182246 HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:01:11 -07:00
Nick Dimiduk b3c9ef34b7 HBASE-27066 The Region Visualizer display failed
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:25 +02:00
Nick Dimiduk 33f633a0b1 Revert "HBASE-27066 The Region Visualizer display failed (#4472)"
This reverts commit 5e54c6daf6.
2022-06-09 13:09:25 +02:00
litao 63a35facad
HBASE-27092 Regionserver table on Master UI is broken (#4495)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-07 17:39:27 -07:00
wangzhi a2dc48a033 HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad)
2022-06-07 12:18:36 +08:00
Bryan Beaudreault 50e2ef24d5 HBASE-27038 CellComparator should extend Serializable (#4492)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:45:20 -04:00
Duo Zhang eca7c6056c HBASE-27084 Add spotless:check in mvn verify stage (#4482)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c53)
2022-06-06 23:48:25 +08:00
liuzhuang2017 fd6e6e0cbb HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec)
2022-06-06 13:41:57 +08:00
BukrosSzabolcs ef221846e5 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-05 20:01:57 +01:00
Sean Busbey bb8b80e7a9 HBASE-26983 Upgrade JRuby to 9.3.4.0 (#4378)
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit d1149f7e20)
2022-06-05 00:32:43 -05:00
skysiders 286c9c3327
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:29:43 -07:00
Huaxiang Sun 58aaed19b0 Revert "HBASE-26962: Add mob info in web UI (#4359)"
This reverts commit 7a02cbfd7e.
2022-06-02 14:04:27 -07:00
huaxiangsun 672b0a5f5c
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4464)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 12:35:11 -07:00
Duo Zhang f97af48d30 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac)
2022-06-03 00:10:53 +08:00
Xiaolin Ha f61ac22f02 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f)
2022-06-03 00:08:30 +08:00
liangxs 7a02cbfd7e HBASE-26962: Add mob info in web UI (#4359)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d03004060d)
2022-06-03 00:05:22 +08:00
LiangJun He 8270b5df5e HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4)
2022-06-02 21:38:59 +08:00
litao b21930f3fa HBASE-27037 Display the region server state on the Web UI (#4432)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit db992083af)
2022-06-02 21:33:07 +08:00
Duo Zhang 40c2743a0c HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99)
2022-06-02 20:20:43 +08:00
Andrew Purtell bcf3cd55fd Amend HBASE-27082 spotless:apply
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 10:50:44 -07:00
Duo Zhang 716a56c849 HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
2022-06-01 09:17:34 -07:00
Andrew Purtell 6dd1a6bef0 HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 19:56:16 -07:00
Duo Zhang e69da68f97 HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 (#3457)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-05-31 18:27:16 -07:00
Andrew Purtell 59700babd0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:41 -07:00
litao f4f3e63f9f HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:50:33 -07:00
Andrew Purtell cfba2f2b14 HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:38 -07:00
Istvan Toth 7fbfb10649 HBASE-27069 Hbase SecureBulkload permission regression (#4475)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 4ce85aa39f)
2022-05-31 10:07:23 +01:00
litao 5e54c6daf6 HBASE-27066 The Region Visualizer display failed (#4472)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:56:32 -07:00
Andrew Purtell 779e9859dc
HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471)
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:03:41 -07:00
Andrew Purtell 20895c7ec5 HBASE-26854 Shell startup logs a bunch of noise (#4469)
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:01:13 -07:00
Sergey Soldatov 50dd9619b0 HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:11:18 +01:00
Tak Lon (Stephen) Wu 02c1fef889 HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:29:17 -07:00
Xiaolin Ha 56b81b42d8
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 15:51:52 +08:00
Xiaolin Ha 200cbcc34f
HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460)
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2022-05-24 14:26:09 +08:00
Duo Zhang 4260e3afb7 HBASE-26933 Addendum remove unused resources and links on site 2022-05-22 16:10:52 +08:00
Duo Zhang 778ae2d655
HBASE-26933 Remove all ref guide stuff on branch other than master (#4426)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-05-22 15:12:52 +08:00
Junegunn Choi d8d1089649 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377)
2022-05-22 15:07:15 +08:00
litao bc40edecfc HBASE-27047 Fix typo for metric drainingRegionServers (#4441)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b45)
2022-05-22 15:02:34 +08:00
bitterfox a6b1c7e234 HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3d)
2022-05-22 11:35:45 +08:00
d-c-manning b00e3032a6 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
2022-05-21 09:23:05 -07:00
Xiaolin Ha 8bc55f8308 HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:34:17 -07:00
Nick Dimiduk 2cae259f36
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4455)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:13:57 -07:00
Andrew Purtell 7af82cf164 HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:11:19 -07:00