e1de804ba1
HBASE-27128 when open archiveRetries totalLogSize calculation mistake ( #4546 )
...
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e
2022-06-20 23:48:45 +08:00
f7d2d12ac1
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound ( #4541 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-18 02:07:38 +08:00
ef0ff2729c
HBASE-27117 Update the method comments for RegionServerAccounting ( #4532 )
2022-06-16 17:19:38 -07:00
3b9491b43f
HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster ( #4534 )
...
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
(cherry picked from commit 7fc1674933
2022-06-15 13:44:16 +08:00
96693e8b40
HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
...
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-13 14:21:03 +02:00
b8f0c61ed7
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #3117 )" ( #4524 )
...
This reverts commit f3a48d1910
2022-06-12 10:24:02 -07:00
18a1a4bdac
HBASE-27097 SimpleRpcServer is broken ( #4521 )
...
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.
Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:41:38 -07:00
b21377f76b
Revert "HBASE-27084 Add spotless:check in mvn verify stage ( #4482 )"
...
This reverts commit eca7c6056c
2022-06-12 00:12:32 +08:00
57d31224f6
HBASE-26923 PerformanceEvaluation support encryption option ( #4489 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5
2022-06-11 21:14:40 +08:00
9b8bb580b9
HBASE-26366 Provide meaningful parent spans to ZK interactions
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 16:26:37 +02:00
6a5fb76188
HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:56:18 +02:00
1dcee76e07
HBASE-27095 HbckChore should produce a report
...
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:46:48 +02:00
27f9182246
HBASE-27103 All MR UTs are broken because of ClassNotFound ( #4514 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:01:11 -07:00
b3c9ef34b7
HBASE-27066 The Region Visualizer display failed
...
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:25 +02:00
33f633a0b1
Revert "HBASE-27066 The Region Visualizer display failed ( #4472 )"
...
This reverts commit 5e54c6daf6
2022-06-09 13:09:25 +02:00
63a35facad
HBASE-27092 Regionserver table on Master UI is broken ( #4495 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-07 17:39:27 -07:00
a2dc48a033
HBASE-27093 AsyncNonMetaRegionLocator：put Complete CompletableFuture outside lock block ( #4496 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad
2022-06-07 12:18:36 +08:00
50e2ef24d5
HBASE-27038 CellComparator should extend Serializable ( #4492 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:45:20 -04:00
eca7c6056c
HBASE-27084 Add spotless:check in mvn verify stage ( #4482 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c53
2022-06-06 23:48:25 +08:00
fd6e6e0cbb
HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. ( #4481 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec
2022-06-06 13:41:57 +08:00
ef221846e5
HBASE-27017: MOB snapshot is broken when FileBased SFT is used ( #4466 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-05 20:01:57 +01:00
bb8b80e7a9
HBASE-26983 Upgrade JRuby to 9.3.4.0 ( #4378 )
...
- Update JRuby
- Replace java_kind_of since it has been removed
- update jcoding / joni to match jruby
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit d1149f7e20
2022-06-05 00:32:43 -05:00
286c9c3327
HBASE-26985 check permission for SecureBulkLoadManager ( #4379 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:29:43 -07:00
58aaed19b0
Revert "HBASE-26962: Add mob info in web UI ( #4359 )"
...
This reverts commit 7a02cbfd7e
2022-06-02 14:04:27 -07:00
672b0a5f5c
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() ( #4442 ) ( #4464 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 12:35:11 -07:00
f97af48d30
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing ( #4449 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac
2022-06-03 00:10:53 +08:00
f61ac22f02
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) ( #4405 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f
2022-06-03 00:08:30 +08:00
7a02cbfd7e
HBASE-26962: Add mob info in web UI ( #4359 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d03004060d
2022-06-03 00:05:22 +08:00
8270b5df5e
HBASE-27039 Some methods of MasterRegion should be annotated for testing only ( #4433 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4
2022-06-02 21:38:59 +08:00
b21930f3fa
HBASE-27037 Display the region server state on the Web UI ( #4432 )
...
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit db992083af
2022-06-02 21:33:07 +08:00
40c2743a0c
HBASE-27023 Fix license issues after running spotless:apply ( #4458 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99
2022-06-02 20:20:43 +08:00
bcf3cd55fd
Amend HBASE-27082 spotless:apply
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 10:50:44 -07:00
716a56c849
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility ( #4480 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
2022-06-01 09:17:34 -07:00
6dd1a6bef0
HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 19:56:16 -07:00
e69da68f97
HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 ( #3457 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-05-31 18:27:16 -07:00
59700babd0
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE ( #4476 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:41 -07:00
f4f3e63f9f
HBASE-27068 NPE occurs when the active master has not yet been elected ( #4474 )
...
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:50:33 -07:00
cfba2f2b14
HBASE-27064 CME in TestRegionNormalizerWorkQueue ( #4468 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:38 -07:00
7fbfb10649
HBASE-27069 Hbase SecureBulkload permission regression ( #4475 )
...
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 4ce85aa39f
2022-05-31 10:07:23 +01:00
5e54c6daf6
HBASE-27066 The Region Visualizer display failed ( #4472 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:56:32 -07:00
779e9859dc
HBASE-27065 [branch-2] Build against Hadoop 3.3.3 ( #4471 )
...
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.
Also exclude leveldbjni-all to avoid a LICENSE file generation error.
Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.
Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:03:41 -07:00
20895c7ec5
HBASE-26854 Shell startup logs a bunch of noise ( #4469 )
...
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:01:13 -07:00
50dd9619b0
HBASE-27061 two phase bulkload is broken when SFT is in use. ( #4465 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:11:18 +01:00
02c1fef889
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode ( #4452 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:29:17 -07:00
56b81b42d8
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner ( #4403 ) ( #4461 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 15:51:52 +08:00
200cbcc34f
HBASE-26320 Implement a separate thread pool for the LogCleaner ( #3712 ) ( #4460 )
...
This avoids starvation when the archive directory is large and takes a long time
to iterate through.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2022-05-24 14:26:09 +08:00
4260e3afb7
HBASE-26933 Addendum remove unused resources and links on site
2022-05-22 16:10:52 +08:00
778ae2d655
HBASE-26933 Remove all ref guide stuff on branch other than master ( #4426 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-05-22 15:12:52 +08:00
d8d1089649
HBASE-27030 Fix undefined local variable error in draining_servers.rb ( #4427 )
...
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.
NameError: undefined local variable or method `admin' for main:Object
getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
addServers at /opt/khp/hbase/bin/draining_servers.rb:88
<main> at /opt/khp/hbase/bin/draining_servers.rb:146
This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377
2022-05-22 15:07:15 +08:00
bc40edecfc
HBASE-27047 Fix typo for metric drainingRegionServers ( #4441 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b45
2022-05-22 15:02:34 +08:00
SiCheng-Zheng
Xiaolin Ha
litao
xicm
Mohammad Arshad
Viraj Jasani
Andrew Purtell
Duo Zhang
wenwj0
Nick Dimiduk
wangzhi
Bryan Beaudreault
liuzhuang2017
BukrosSzabolcs
Sean Busbey
skysiders
Huaxiang Sun
huaxiangsun
liangxs
LiangJun He
Istvan Toth
Sergey Soldatov
Tak Lon (Stephen) Wu
Junegunn Choi