EungsopYoo
45fd3f628a
HBASE-27547 Close store file readers after region warmup ( #4942 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-28 22:12:18 +08:00
Andrew Purtell
01e5eac80b
HBASE-27588 "Instantiating StoreFileTracker impl" INFO level logging is too chatty ( #4989 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-25 14:40:24 -08:00
Wellington Ramos Chevreuil
ea4cb641d7
HBASE-27551 Add config options to delay assignment to retain last region location ( #4945 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-24 02:36:50 +00:00
Bryan Beaudreault
cc4fd8bebb
HBASE-27579 CatalogJanitor can cause data loss due to errors during cleanMergeRegion ( #4986 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 12:29:16 -05:00
curie71
913cf6b96d
HBASE-27528 log duplication issues in MasterRpcServices. ( #4951 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 15:53:32 +08:00
BukrosSzabolcs
ad8f28e297
HBASE-27493: Allow namespace admins to clone snapshots created by them ( #4885 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-18 11:01:56 +01:00
Andrew Purtell
71d0862d84
HBASE-27561 hbase.master.port is ignored in processing of hbase.masters ( #4952 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 13:20:03 -08:00
Nick Dimiduk
da261344cc
HBASE-27568 ChaosMonkey add support for JournalNodes ( #4963 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 09:55:18 +08:00
Viraj Jasani
cc54d22fb4
HBASE-27529 Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink ( #4924 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-16 10:46:14 -08:00
Peter Somogyi
dff8e50849
HBASE-27565 Make the initial corePoolSize configurable for ChoreService ( #4958 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 14:41:41 +01:00
liuzhongjun
c1b9d8ba06
HBASE-27560 fix consistencyCheck did not report the hole on last region ( #4950 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-11 18:03:20 +08:00
Liangjun He
4add5250ed
HBASE-27489 Fix several problems after HBASE-27304 ( #4903 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-10 14:35:55 +08:00
Duo Zhang
3f1087fe82
HBASE-27485 HBaseTestingUtility minicluster requires log4j2 ( #4941 )
...
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
2023-01-04 11:06:47 +08:00
chenglei
7ef63b65f0
HBASE-27539 Encapsulate and centralise access to ref count through StoreFileInfo ( #4928 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-24 17:52:39 +08:00
Duo Zhang
dcfde79f7e
HBASE-27514 Move some persistent states from zookeeper to master region ( #4925 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-12-22 12:04:24 +08:00
Bryan Beaudreault
d7b214b379
HBASE-27233 Read blocks into off-heap if caching is disabled for read ( #4931 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-12-21 12:34:25 -05:00
Wellington Ramos Chevreuil
222ec684d6
HBASE-27474 Evict blocks on split/merge; Avoid caching reference/hlinks if compaction is enabled ( #4868 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-12-16 18:41:05 +00:00
Ray Mattingly
c30f53c1e9
HBASE-27253 make slowlog configurations dynamic ( #4926 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 17:52:49 -05:00
Bri Augenreich
105a2749f4
HBASE-27390 getClusterMetrics NullPointerException when ServerTask status null ( #4853 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 09:46:21 -05:00
chenglei
578fa6ad08
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush f… ( #4912 )
...
* HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 10:18:22 +08:00
Victor
320eca20fb
HBASE-27466: Making metrics instance containing one or more connections. ( #4874 )
...
Signed-off-by: David Manning <67607031+d-c-manning@users.noreply.github.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-12-01 18:02:00 -08:00
Ruanhui
bb9f43c6f9
HBASE-27463 Reset sizeOfLogQueue when refresh replication source ( #4863 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2022-11-27 23:07:40 +08:00
Wellington Ramos Chevreuil
a5ff289d7a
HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction ( #4882 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-11-25 21:58:23 +00:00
Peter Somogyi
1ddb5bb43c
HBASE-27506 Optionally disable sorting directories by size in CleanerChore ( #4896 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-11-25 15:31:56 +01:00
Ruanhui
2f4758ee59
HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize ( #4846 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-23 20:09:41 +08:00
Charles Connell
47996d6c21
HBASE-27496 Optionally limit the amount of plans executed in the Normalizer ( #4888 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-22 13:08:01 -05:00
Bryan Beaudreault
9462933179
HBASE-27408 Improve BucketAllocatorException log to always include HFile name ( #4886 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-21 08:21:29 -05:00
Tak Lon (Stephen) Wu
f68b61a027
HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse ( #4887 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-11-20 14:44:39 -08:00
chenglei
7b0ac6451d
HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size ( #4881 )
...
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-17 23:13:12 +08:00
YiweiLi4
a2075f51a8
HBASE-27479 fix flaky test testClone in TestTaskMonitor ( #4876 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-17 21:10:53 +08:00
mrzhao
d7c4447dd2
HBASE-27379 fix numOpenConnections metric is one less than the actual ( #4884 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-16 14:51:55 +08:00
Xin Sun
e5463e8f4e
HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table ( #4865 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 11:10:37 +08:00
Andor Molnár
047f4e22e0
HBASE-27347 Port FileWatcher from ZK to autodetect keystore/truststore changes in TLS connections ( #4869 )
...
Signed-off-by: wchevreuil@apache.org
2022-11-11 11:22:14 +00:00
Duo Zhang
5c6ff7dc47
HBASE-27443 Use java11 in the general check of our jenkins job ( #4845 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2022-11-07 23:14:26 +08:00
LiangJun He
186679f5a6
HBASE-27444 Add tool commands list_enabled_tables and list_disabled_tables ( #4849 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-06 00:25:37 +08:00
Ruanhui
1bebf8699f
HBASE-27414 Adjust hfilelink alternative paths order ( #4847 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
2022-11-05 22:45:10 +08:00
Rushabh Shah
655f19c645
HBASE-26913 Replication Observability Framework ( #4556 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-11-03 11:27:08 -07:00
Ruanhui
cfbf80d1c4
HBASE-27458 Use ReadWriteLock for region scanner readpoint map ( #4859 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-03 16:15:48 +08:00
LiangJun He
dc4fa05a2b
HBASE-27448 Add an admin method to get replication enabled state ( #4855 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-31 00:02:46 +08:00
tianliuliu
d187f6908e
HBASE-27440 fix table HistogramMetrics leak in table metrics map ( #4838 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-24 18:42:58 +08:00
Duo Zhang
2fc879e863
HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line ( #4836 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-10-24 11:50:48 +08:00
Duo Zhang
dad9a7da92
HBASE-27437 TestHeapSize is flaky ( #4841 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-10-24 10:27:33 +08:00
Kota-SH
c881eb1ff0
HBASE-27363: Fix the config key name for PREFETCH_PERSISTENCE_PATH_KEY and spotbugs ( #4774 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-21 15:05:06 +08:00
Luca Kovács
dffc8e0fbe
HBASE-27406 Make /prometheus endpoint accessible from HBase UI ( #4833 )
...
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-10-20 12:50:12 +02:00
chenglei
de1c2fc7ed
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed ( #4834 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-20 18:09:58 +08:00
d-c-manning
5cacece790
HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent ( #4830 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:18:37 -07:00
Andrew Purtell
8d2efc8aaa
HBASE-27411 Update and clean up bcprov-jdk15on dependency ( #4817 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-10-10 15:55:57 -07:00
Duo Zhang
4b45256910
HBASE-27401 Addendum fix more javadoc issues
2022-10-07 00:54:05 +08:00
Rajeshbabu Chintaguntla
54a82302b4
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag
2022-10-06 16:39:22 +05:30
Duo Zhang
63cdd026f0
HBASE-27401 Clean up current broken 'n's in our javadoc ( #4812 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-06 18:17:34 +08:00
Rajeshbabu Chintaguntla
5ffb29688d
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure
2022-10-06 11:14:23 +05:30
SiCheng-Zheng
eb6b2745c5
HBASE-27309 Add major compact table or region operation on master web table page ( #4793 )
...
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-04 23:10:25 +08:00
Bryan Beaudreault
fa54381cb2
HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance ( #4813 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-04 08:27:01 -04:00
Rajeshbabu Chintaguntla
14b3899a2e
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time ( #4805 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
2022-10-03 11:16:22 +05:30
Bryan Beaudreault
5baeacb7d6
HBASE-27280 Add mutual authentication support to TLS ( #4796 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
2022-09-23 08:36:20 -04:00
Wellington Ramos Chevreuil
da87a8e70c
HBASE-27386 Use encoded size for calculating compression ratio in block size predicator ( #4795 )
...
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-09-23 10:33:27 +01:00
LiangJun He
cc4268a7d2
HBASE-27304 Support using IP to expose master/rs servers for some special scenarios ( #4713 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-22 10:17:08 +08:00
chenglei
de127bde84
HBASE-27303 (addendum)Unnecessary replication to secondary region replicas should avoid when WAL.sync throws Exception ( #4792 )
2022-09-21 11:29:10 +08:00
SiCheng-Zheng
8bc6a5954a
HBASE-27310 Add disabled table is displayed red on master web tables list ( #4755 )
...
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-20 17:10:06 +08:00
Wellington Ramos Chevreuil
3f4734edae
HBASE-27370 Avoid decompressing blocks when reading from bucket cache… ( #4781 )
...
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-09-20 09:15:17 +01:00
Duo Zhang
6f0761a668
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 ( #4787 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-16 22:57:54 +08:00
Duo Zhang
460bb47c04
HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize ( #4779 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-09-15 15:27:06 +08:00
Abhradeep Kundu
efc757577a
HBASE-27317 Rectifying the option for columnfamily as mandatory ( #4773 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-09-14 13:41:02 +02:00
Duo Zhang
f3f88ff6c1
HBASE-27360 The trace related assertions are flaky for async client tests ( #4767 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-09-09 22:41:55 +08:00
Kota-SH
2bfa540be5
HBASE-27313: Persist list of Hfiles names for which prefetch is done ( #4726 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-08 11:36:39 +01:00
chenglei
a26cbf1057
HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check ( #4768 )
...
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-08 16:39:12 +08:00
Bryan Beaudreault
ee58f177f0
HBASE-27224 HFile tool statistic sampling produces misleading results ( #4638 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Clay Baenziger <cwb@clayb.net>
2022-09-06 15:04:32 -04:00
Michael Stack
1b5403cf7d
HBASE-27340 Artifacts with resolved profiles ( #4740 ) ( #4761 )
...
(Forward port from branch-2; simplified by the fact that there
is no hadoop-2.0 profile on master branch)
Make it so our published poms carry the minimum needed to run
an hbase; the published pom has no profiles -- the profiles
specified at build time are resolved, their dependencies inlined,
and then they are stripped -- and no build-time, or plugins
dependencies or properties, etc. Resultant poms have explicit
hadoop lib versions baked in -- no more being able to choose
hbase with hadoop2 or haddop3 at downstream build time by setting
a '-Dhadoop.profile=X.0'.
Pattern is to add profiles when none in sub-modules when
the flatten plugin complains it can't resolve an hadoop
dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
Adding the profile in the sub-module make it so the flatten
plugin can figure 'hadoop.version' definitively.
(In master there is only the hadoop-3.0 profile).
Another spin on the above happens when profiles already exist
in submodule but the flatten plugin is complaining it can't
figure figure version on an hadoop dependency NOT under
profiles. Below, we move the delinquent hadoop dependency under
existing profiles (minikdc was the usual dependency outside
profiles in sub-modules that flatten complained about).
Sometimes, moving an hadoop dependency under a profile, there
would be excludes on the local dependency. If the parent pom
excludes section was missing the local excludes, we added them
up to the parent module so all excluding is done up there in
the parent profile dependencyManagement section.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-06 23:06:13 +08:00
Xiaolin Ha
72c1a84750
HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools ( #4731 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:13:34 +08:00
Duo Zhang
3d39482339
HBASE-27314 Addendum fix spotless errors
2022-09-04 18:07:14 +08:00
binlijin
d21be92fd0
HBASE-27314 Make index block be customized and configured ( #4718 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-03 15:52:43 +08:00
Andor Molnár
b60d2eb0b6
HBASE-27342 Use Hadoop Credentials API to retrieve passwords of TLS key/trust stores ( #4747 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-08-31 12:53:18 +02:00
Xiaolin Ha
32a945aa9f
HBASE-27152 Under compaction mark may leak ( #4725 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-29 11:49:02 +08:00
LiangJun He
fa02350a27
HBASE-27336 The region visualizer shows 'undefined' region server ( #4736 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-28 22:34:33 +08:00
Duo Zhang
37651ee1b0
HBASE-27321 The ReplicationLogCleaner is not thread safe but can be called from different threads at the same time ( #4730 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-27 23:41:28 +08:00
Ujjawal
06728e554c
HBASE-25922 - Disabled sanity checks ignored on snapshot restore ( #4533 )
...
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-26 08:25:59 -04:00
Ruanhui
92cf962fee
HBASE-27325 the bulkload max call queue size can be update to a wrong value ( #4728 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-25 10:59:52 +08:00
Yutong Xiao
b44bfc52cc
HBASE-27246 RSGroupMappingScript#getRSGroup has thread safety problem ( #4657 )
...
Co-authored-by: Sean Xiao Yutong <sean.xiaoyt@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 15:23:21 +08:00
chenglei
a0481d100f
HBASE-27303 Unnecessary replication to secondary region replicas should avoid when WAL.sync throws Exception ( #4707 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 10:25:42 +08:00
Duo Zhang
950ad8dd3e
HBASE-27311 The implementation of syncReplicationPeerLock is incomplete ( #4715 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-23 15:02:17 +08:00
Ruanhui
00a719e76f
HBASE-27305 add an option to skip file splitting when bulkload hfiles ( #4709 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 21:14:30 +08:00
tianhang
f238a92b6d
HBASE-27129 Add a config that allows us to configure region-level storage policies ( #4547 )
...
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 10:06:14 +08:00
LiangJun He
61cd63c7b6
HBASE-27104 Add a tool command list_unknownservers ( #4523 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-20 21:48:58 +08:00
Fantasy-Jay
32c135d8a5
HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime ( #4710 )
...
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-20 20:50:40 +08:00
Duo Zhang
116458ab04
HBASE-27279 Addendum fix TestSaslTlsIPCRejectPlainText
2022-08-16 21:43:03 +08:00
Duo Zhang
2b9d36869f
HBASE-27279 Make SslHandler work with SaslWrapHandler/SaslUnwrapHandler ( #4705 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
2022-08-16 21:05:42 +08:00
Wellington Ramos Chevreuil
eaa47c5cd4
HBASE-27264 Add options to consider compressed size when delimiting blocks during hfile writes ( #4675 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-08-15 22:35:35 +01:00
liangxs
8ec02c025e
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… ( #4376 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
2022-08-15 11:09:36 -07:00
huaxiangsun
73759be396
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose ( #4695 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-12 12:17:14 -07:00
Duo Zhang
3309108ca7
HBASE-27278 Improve TestTlsIPC to reuse existing IPC test code ( #4682 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-12 12:17:29 +08:00
SiCheng-Zheng
6b2e9d14a7
HBASE-27248 WALPrettyPrinter add print timestamp ( #4659 )
...
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-10 21:10:21 +08:00
Bryan Beaudreault
bfa53f5609
HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters ( #4669 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-09 15:18:55 -04:00
Duo Zhang
5919b30b6d
HBASE-27283 Use readTO instead of hard coded RpcClient.DEFAULT_SOCKET_TIMEOUT_READ when creating ReadTimeoutHandler in NettyRpcConnection ( #4685 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-08-09 16:18:23 +08:00
chaijunjie0101
d6641626a9
HBASE-27282 CME in AuthManager causes region server crash ( #4684 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-09 09:52:31 +08:00
Abhradeep Kundu
54f2106f33
HBASE-27265 : Tool to read StoreFileTrackerFile ( #4673 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-08 11:43:06 +01:00
SiCheng-Zheng
4ebf71982c
HBASE-27270 Add bulkloadExecutor.resizeQueues ( #4677 )
...
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-08 18:14:49 +08:00
Andor Molnár
f8dcf07055
HBASE-26666 Add native TLS encryption support to RPC server/client ( #4666 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-06 19:09:54 -04:00
Duo Zhang
486d19e99f
HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big ( #4679 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-08-06 20:08:07 +08:00
LiangJun He
2dc26082be
HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect ( #4678 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-04 22:42:36 +08:00
Nick Dimiduk
d734acc00e
HBASE-27153 Improvements to read-path tracing
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-02 14:09:09 +02:00
Bryan Beaudreault
e8c14ee308
HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI ( #4667 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:28:28 -04:00
Duo Zhang
0c4263a18b
HBASE-27185 Rewrite NettyRpcServer to decode rpc request with netty handler ( #4624 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-27 09:00:42 +08:00
Andrew Purtell
9ba868d2ad
HBASE-27087 TestQuotaThrottle times out
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 14:09:48 -07:00
Bryan Beaudreault
277058e18d
HBASE-27229 BucketCache statistics should not count evictions by hfile ( #4639 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 16:59:57 -04:00
Duo Zhang
8b091c4061
HBASE-27222 Purge FutureReturnValueIgnored warnings from error prone ( #4634 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 23:42:37 +08:00
Bryan Beaudreault
ebd189157e
HBASE-27225 Add BucketAllocator bucket size statistic logging ( #4637 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-25 20:54:40 -04:00
Wellington Ramos Chevreuil
d5ed8f59e5
HBASE-27232 Fix checking for encoded block size when deciding if bloc… ( #4640 )
...
Signed-off-by: Andor Molnár <andor@cloudera.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-25 11:17:16 +01:00
chenglei
0ae42ddaee
HBASE-27230 RegionServer should be aborted when WAL.sync throws Timeo… ( #4641 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-24 15:08:03 +08:00
Duo Zhang
31fc97edee
HBASE-27075 TestUpdateRSGroupConfiguration.testCustomOnlineConfigChangeInRSGroup is flaky ( #4636 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-21 14:26:52 +08:00
Duo Zhang
75a05b5cd0
Revert "HBASE-27152 Under compaction mark may leak ( #4568 )"
...
This reverts commit da27a67a1e
.
2022-07-21 09:02:40 +08:00
Xiaolin Ha
da27a67a1e
HBASE-27152 Under compaction mark may leak ( #4568 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-20 08:49:10 +08:00
Duo Zhang
acf144717b
HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 10:00:43 +08:00
Andrew Purtell
745142adb1
HBASE-27195 Clean up netty worker/thread pool configuration ( #4619 )
...
The configuration settings "hbase.netty.worker.count" and
"hbase.netty.eventloop.rpcserver.thread.count" appear to duplicate each
other.
Also, formalizes another setting found in NettyEventLoopGroupConfig,
"hbase.netty.nativetransport".
Also, native epoll is not limited to amd64. aarch64 supports it too.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-18 15:48:40 -07:00
Duo Zhang
9ab0b1504f
HBASE-27211 Data race in MonitoredTaskImpl could cause split wal failure ( #4630 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-18 19:25:06 +08:00
SiCheng-Zheng
ff8eb59709
HBASE-27144 Add special rpc handlers for bulkload operations ( #4558 )
...
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-17 21:21:58 +08:00
Bryan Beaudreault
70a2ee1716
HBASE-27053 IOException during caching of uncompressed block to the block cache ( #4610 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
2022-07-16 17:30:55 -04:00
Andrew Purtell
01b45e285d
Amend HBASE-27194 Add test coverage for SimpleRpcServer ( #4616 )
...
When backporting to branch-2 it was discovered that the order of tear
down operations requires the KDC to be torn down first, although on
master branch the original code did not produce the same errors (a NPE
in KDC#stop). Forward port the difference for maintainability.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-13 11:23:07 -07:00
Andrew Purtell
84f0d145d7
HBASE-27194 Add test coverage for SimpleRpcServer ( #4616 )
...
Add test coverage for SimpleRpcServer.
Improve the way we test both SimpleRpcServer and NettyRpcServer. Use
LoadTestKVGenerator to generate random values with varying sizes between
1000 bytes and 1M bytes, and also to verify them when reading the values
back.
Add secure test coverage for both SimpleRpcServer and NettyRpcServer.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-13 09:28:30 -07:00
Duo Zhang
2662607b71
HBASE-27193 TestZooKeeper is flaky ( #4615 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2022-07-13 10:32:01 +08:00
Andrew Purtell
7cb7100de5
HBASE-27161 Improve TestMultiRespectsLimits ( #4586 )
...
TestMultiRespectLimits submits a put with an empty value. This appears
to not be what was intended. Instead, use a single byte.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-12 11:19:35 -07:00
Andrew Purtell
ed32043da0
HBASE-27097 SimpleRpcServer is broken ( #4613 )
...
Replace BufferChain#write(channel,int) with a simpler #write(channel)
implementation that does not attempt to "chunk" data to be written. This
method was used exclusively by SimpleRpcServer. The code was unnecessarily
complex and caused short writes when values were large, so was corrected
and simplified. Any difference in performance from this change will be
limited to SimpleRpcServer. Testing under load confirms the fix and does
not show significant regression.
SimpleRpcServer and its related code is now also marked as @Deprecated.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-12 11:07:23 -07:00
Duo Zhang
648bb6d0eb
HBASE-27192 The retry number for TestSeparateClientZKCluster is too small ( #4614 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-07-12 19:08:41 +08:00
Bryan Beaudreault
886e31952f
HBASE-27149 Server should close scanner if client times out before results are ready ( #4604 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:22:00 -04:00
Bryan Beaudreault
6e66e78177
HBASE-27188 Report maxStoreFileCount in jmx ( #4609 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:11:58 -04:00
Bryan Beaudreault
779c4e2316
HBASE-27186 Report block cache size metrics separately for L1 and L2 ( #4608 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:00:04 -04:00
Duo Zhang
5bc8670322
HBASE-27189 NettyServerRpcConnection is not properly closed when the netty channel is closed ( #4611 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-12 09:40:19 +08:00
Bryan Beaudreault
6886d02a91
HBASE-27078 Allow configuring a separate timeout for meta scans ( #4557 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-07 10:02:14 -04:00
Duo Zhang
816e919e95
HBASE-26708 Netty leak detected and OutOfDirectMemoryError due to direct memory buffering with SASL implementation ( #4596 )
...
Co-authored-by: Norman Maurer <norman_maurer@apple.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-07 15:55:26 +08:00
Duo Zhang
1643c45770
HBASE-27157 Addendum fix compile error after revert
2022-07-07 10:26:13 +08:00
Duo Zhang
0116aff9c0
Revert "HBASE-27157 Potential race condition in WorkerAssigner ( #4577 )"
...
This reverts commit f76d8554ca
.
2022-07-07 08:36:21 +08:00
Ujjawal
a31cc931fd
HBASE-27175 - Failure to cleanup WAL split dir log should be at INFO level ( #4593 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-06 16:32:52 -07:00
Bryan Beaudreault
b9706916cc
HBASE-27048 Server side scanner time limit should account for time in queue ( #4562 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-06 11:57:37 -04:00
Duo Zhang
6f4a0476f2
HBASE-27148 Addendum uncomment the shutdown code in TestVerifyReplicationCrossDiffHdfs
2022-07-06 14:48:08 +08:00
Duo Zhang
41972cb460
HBASE-27148 Move minimum hadoop 3 support version to 3.2.3 ( #4561 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-06 12:49:47 +08:00
Ruanhui
f76d8554ca
HBASE-27157 Potential race condition in WorkerAssigner ( #4577 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
2022-07-06 10:59:13 +08:00
tianhang
6031a3a8d4
HBASE-27171 Fix Annotation Error in HRegionFileSystem ( #4588 )
...
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-06 10:58:34 +08:00
Bryan Beaudreault
f3f292fad4
HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse ( #4592 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-07-04 16:18:45 -04:00
Duo Zhang
03c23beb57
HBASE-27169 TestSeparateClientZKCluster is flaky ( #4587 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-01 22:09:01 +08:00
Ishika
acfbc3ff7d
HBASE-26218 Add logs in Canary tool ( #4501 )
...
Co-authored-by: Ishika Soni <isoni@isoni-ltmag9r.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-30 21:53:20 +08:00
Duo Zhang
9bcb7493e0
HBASE-27165 Set version as 3.0.0-alpha-4-SNAPSHOT in master ( #4582 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-06-29 11:04:21 +08:00
Ruanhui
9c2bc55350
HBASE-27158 Add namespace column family to UNDELETABLE_META_COLUMNFAMILIES ( #4578 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-29 10:27:53 +08:00
Andrew Purtell
ca34bdccc3
HBASE-27166 WAL value compression minor improvements ( #4584 )
...
A larger IO buffer for absorbing WALCodec writes can improve the compression
ratio of larger values, because the compressor will be given a larger internal
buffer over which there will be more match opportunities. Does not impact the
ability to read existing written files.
Also, reset the BAOS internal buffer on the way out of compress() so potential
large-ish buffers do not linger on the heap longer than necessary.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-28 12:49:25 -07:00
Duo Zhang
d7f6861e8d
HBASE-27160 ClientZKSyncer.deleteDataForClientZkUntilSuccess should break from the loop when deletion is succeeded ( #4579 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-26 15:22:25 +08:00
Andrew Purtell
4f88a3c4bb
HBASE-27111 Make Netty channel bytebuf allocator configurable. ( #4525 )
...
Support site configuration of the bytebuf allocator that Netty will use for
NettyRpcServer channels. Property name is 'hbase.netty.rpcserver.allocator'.
Default is no value, which is equivalent to "pooled". Valid values are:
- "pooled": use PooledByteBufAllocator
- "unpooled": use UnpooledByteBufAllocator
- "heap": use HeapByteBufAllocator, which is a PooledByteBufAllocator that
preferentially allocates buffers on heap wherever possible
- <class>: If the value is none of the recognized labels, treat it as a class
name implementing org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator.
This allows the user to add a custom implementation, perhaps for debugging.
Also updates ReflectionUtils with a new helper method.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-23 15:13:29 -07:00
Kerasone
b8558d30d0
HBASE-27001 The deleted variable cannot be printed out ( #4479 )
...
* The deleted variable cannot be printed out, add it
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-23 22:41:32 +05:30
Bryan Beaudreault
e84cd3dd6a
HBASE-26945 Quotas causes too much load on meta for large clusters ( #4567 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-23 10:34:29 -04:00
Bryan Beaudreault
59e5c610e3
HBASE-26790 Addendum ensure test is not flaky due to async caching
2022-06-23 10:22:55 -04:00
Bryan Beaudreault
50f11151fd
HBASE-26790 getAllRegionLocations can cache locations with null hostname ( #4565 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-23 08:24:49 -04:00
Pankaj
342183e596
HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout ( #4515 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-23 12:51:48 +05:30
chenglei
de804938b9
HBASE-27062 Remove ThreadPool in HBaseInterClusterReplicationEndpoint when use AsyncClusterConnection ( #4560 )
2022-06-22 20:01:56 +08:00