c645e21686
HBASE-26923 PerformanceEvaluation support encryption option ( #4489 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5
2022-06-11 21:30:24 +08:00
f4a4f0c05e
HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:57:52 +02:00
cc2af766d6
HBASE-27095 HbckChore should produce a report
...
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:47:08 +02:00
b7d7be0156
HBASE-27103 All MR UTs are broken because of ClassNotFound ( #4514 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:01:21 -07:00
7ead4b1617
HBASE-27066 The Region Visualizer display failed
...
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:38 +02:00
d24f4ce2f0
Revert "HBASE-27066 The Region Visualizer display failed ( #4472 )"
...
This reverts commit 8b9df125a3
2022-06-09 13:09:38 +02:00
5cc614f23f
HBASE-27093 AsyncNonMetaRegionLocator：put Complete CompletableFuture outside lock block ( #4496 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad
2022-06-07 12:18:46 +08:00
046e51085f
HBASE-27038 CellComparator should extend Serializable ( #4492 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:47:30 -04:00
278939cd83
HBASE-27084 Add spotless:check in mvn verify stage ( #4482 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c53
2022-06-06 23:48:38 +08:00
19f67d22d4
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. ( #4481 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec
2022-06-06 13:42:08 +08:00
8139cf6477
HBASE-27017: MOB snapshot is broken when FileBased SFT is used ( #4466 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-06 00:29:27 +01:00
5a13ad8137
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() ( #4442 ) ( #4484 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 15:27:00 -07:00
0c5d6601da
HBASE-26985 check permission for SecureBulkLoadManager ( #4379 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:30:12 -07:00
2625c67e73
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing ( #4449 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac
2022-06-03 00:11:10 +08:00
8bf5256c24
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) ( #4405 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f
2022-06-03 00:08:45 +08:00
a93b7cd654
HBASE-27039 Some methods of MasterRegion should be annotated for testing only ( #4433 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4
2022-06-02 21:39:13 +08:00
b5dcb7d3a1
HBASE-27023 Fix license issues after running spotless:apply ( #4458 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99
2022-06-02 20:24:08 +08:00
d2d3d64c6c
Amend HBASE-27082 spotless:apply
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 10:49:35 -07:00
267e9fa48a
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility ( #4480 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
2022-06-01 09:30:17 -07:00
b7158a87ea
Preparing development version 2.5.1-SNAPSHOT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 20:06:32 -07:00
2da2dd917f
Preparing hbase release 2.5.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 20:06:29 -07:00
4d6636dfea
HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 19:53:58 -07:00
0af4b5f1b0
HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 ( #3457 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-05-31 18:27:09 -07:00
2f63d99c48
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE ( #4476 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:45 -07:00
f0dcbe78a7
HBASE-27068 NPE occurs when the active master has not yet been elected ( #4474 )
...
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:50:36 -07:00
2a59ebffaa
HBASE-27064 CME in TestRegionNormalizerWorkQueue ( #4468 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:43 -07:00
7f7c42e33e
HBASE-27069 Hbase SecureBulkload permission regression ( #4475 )
...
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-31 10:10:28 +01:00
8b9df125a3
HBASE-27066 The Region Visualizer display failed ( #4472 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:56:39 -07:00
e172b983ca
HBASE-27065 [branch-2] Build against Hadoop 3.3.3 ( #4471 )
...
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.
Also exclude leveldbjni-all to avoid a LICENSE file generation error.
Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.
Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:04:35 -07:00
1813fc8bf4
HBASE-26854 Shell startup logs a bunch of noise ( #4469 )
...
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:01:19 -07:00
c9fc396dfa
HBASE-27061 two phase bulkload is broken when SFT is in use. ( #4465 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 13:55:31 +01:00
20aaa1e961
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode ( #4452 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:30:58 -07:00
e1843af1d5
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner ( #4403 ) ( #4461 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 15:52:54 +08:00
4be25a3a61
HBASE-26320 Implement a separate thread pool for the LogCleaner ( #3712 ) ( #4460 )
...
This avoids starvation when the archive directory is large and takes a long time
to iterate through.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2022-05-24 14:34:47 +08:00
2294834a04
HBASE-26933 Addendum remove unused resources and links on site
...
(cherry picked from commit 4260e3afb7
2022-05-22 16:33:09 +08:00
0f0f2d1015
HBASE-26933 Remove all ref guide stuff on branch other than master ( #4426 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 778ae2d655
2022-05-22 15:16:03 +08:00
84a79dfbd4
HBASE-27030 Fix undefined local variable error in draining_servers.rb ( #4427 )
...
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.
NameError: undefined local variable or method `admin' for main:Object
getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
addServers at /opt/khp/hbase/bin/draining_servers.rb:88
<main> at /opt/khp/hbase/bin/draining_servers.rb:146
This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377
2022-05-22 15:07:28 +08:00
cdf6076801
HBASE-27047 Fix typo for metric drainingRegionServers ( #4441 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b45
2022-05-22 15:03:22 +08:00
b83e03abc2
HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory ( #4425 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3d
2022-05-22 11:36:05 +08:00
188dfeec5f
HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky ( #4454 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
2022-05-21 09:24:42 -07:00
f81bb8b6ec
HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner ( #4437 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:34:21 -07:00
8bbba7353e
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky ( #4456 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:14:15 -07:00
f982e6d39c
HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky ( #4448 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:11:23 -07:00
bad3f20a80
HBASE-27050 Support unit test pattern matching again ( #4447 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:09:05 -07:00
96182e2cf9
HBASE-27018 Add a tool command list_liveservers ( #4416 )
...
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-19 15:49:36 -07:00
8487e8d2cf
HBASE-27006 Move nightly integration testing to new larger test node class. ( #4438 )
...
(cherry picked from commit 76d20fc48a
2022-05-19 11:48:41 -05:00
6774487750
HBASE-27024 The User API and Developer API links are broken on hbase.apache.org ( #4424 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a
2022-05-18 21:17:23 +08:00
9f5ef981f9
HBASE-27045 Disable TestClusterScopeQuotaThrottle ( #4440 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4
2022-05-18 20:51:37 +08:00
c47a2c3841
HBASE-26986 Trace a one-shot execution of a Master procedure
...
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-18 13:08:42 +02:00
6bf8db8ec8
Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted ( #4394 )"
...
This reverts commit 04956ffe7e
2022-05-18 13:05:09 +02:00
wenwj0
Nick Dimiduk
Andrew Purtell
wangzhi
Bryan Beaudreault
Duo Zhang
liuzhuang2017
BukrosSzabolcs
huaxiangsun
skysiders
Xiaolin Ha
LiangJun He
litao
Istvan Toth
Sergey Soldatov
Tak Lon (Stephen) Wu
Junegunn Choi
bitterfox
d-c-manning
Sean Busbey