Commit Graph

9286 Commits

Author SHA1 Message Date
Bryan Beaudreault 5baeacb7d6
HBASE-27280 Add mutual authentication support to TLS (#4796)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
2022-09-23 08:36:20 -04:00
Wellington Ramos Chevreuil da87a8e70c
HBASE-27386 Use encoded size for calculating compression ratio in block size predicator (#4795)
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-09-23 10:33:27 +01:00
LiangJun He cc4268a7d2
HBASE-27304 Support using IP to expose master/rs servers for some special scenarios (#4713)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-22 10:17:08 +08:00
chenglei de127bde84
HBASE-27303 (addendum)Unnecessary replication to secondary region replicas should avoid when WAL.sync throws Exception (#4792) 2022-09-21 11:29:10 +08:00
SiCheng-Zheng 8bc6a5954a
HBASE-27310 Add disabled table is displayed red on master web tables list (#4755)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-20 17:10:06 +08:00
Wellington Ramos Chevreuil 3f4734edae
HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781)
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-09-20 09:15:17 +01:00
Duo Zhang 6f0761a668
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-16 22:57:54 +08:00
Duo Zhang 460bb47c04
HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-09-15 15:27:06 +08:00
Abhradeep Kundu efc757577a
HBASE-27317 Rectifying the option for columnfamily as mandatory (#4773)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-09-14 13:41:02 +02:00
Duo Zhang f3f88ff6c1
HBASE-27360 The trace related assertions are flaky for async client tests (#4767)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-09-09 22:41:55 +08:00
Kota-SH 2bfa540be5
HBASE-27313: Persist list of Hfiles names for which prefetch is done (#4726)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-08 11:36:39 +01:00
chenglei a26cbf1057
HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check (#4768)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-08 16:39:12 +08:00
Bryan Beaudreault ee58f177f0
HBASE-27224 HFile tool statistic sampling produces misleading results (#4638)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by:  Clay Baenziger <cwb@clayb.net>
2022-09-06 15:04:32 -04:00
Michael Stack 1b5403cf7d
HBASE-27340 Artifacts with resolved profiles (#4740) (#4761)
(Forward port from branch-2; simplified by the fact that there
is no hadoop-2.0 profile on master branch)

    Make it so our published poms carry the minimum needed to run
    an hbase; the published pom has no profiles -- the profiles
    specified at build time are resolved, their dependencies inlined,
    and then they are stripped -- and no build-time, or plugins
    dependencies or properties, etc. Resultant poms have explicit
    hadoop lib versions baked in -- no more being able to choose
    hbase with hadoop2 or haddop3 at downstream build time by setting
    a '-Dhadoop.profile=X.0'.

    Pattern is to add profiles when none in sub-modules when
    the flatten plugin complains it can't resolve an hadoop
    dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
    Adding the profile in the sub-module make it so the flatten
    plugin can figure 'hadoop.version' definitively.
    (In master there is only the hadoop-3.0 profile).

    Another spin on the above happens when profiles already exist
    in submodule but the flatten plugin is complaining it can't
    figure figure version on an hadoop dependency NOT under
    profiles. Below, we move the delinquent hadoop dependency under
    existing profiles (minikdc was the usual dependency outside
    profiles in sub-modules that flatten complained about).

    Sometimes, moving an hadoop dependency under a profile, there
    would be excludes on the local dependency. If the parent pom
    excludes section was missing the local excludes, we added them
    up to the parent module so all excluding is done up there in
    the parent profile dependencyManagement section.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-06 23:06:13 +08:00
Xiaolin Ha 72c1a84750
HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools (#4731)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:13:34 +08:00
Duo Zhang 3d39482339 HBASE-27314 Addendum fix spotless errors 2022-09-04 18:07:14 +08:00
binlijin d21be92fd0
HBASE-27314 Make index block be customized and configured (#4718)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-03 15:52:43 +08:00
Andor Molnár b60d2eb0b6
HBASE-27342 Use Hadoop Credentials API to retrieve passwords of TLS key/trust stores (#4747)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-08-31 12:53:18 +02:00
Xiaolin Ha 32a945aa9f
HBASE-27152 Under compaction mark may leak (#4725)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-29 11:49:02 +08:00
LiangJun He fa02350a27
HBASE-27336 The region visualizer shows 'undefined' region server (#4736)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-28 22:34:33 +08:00
Duo Zhang 37651ee1b0
HBASE-27321 The ReplicationLogCleaner is not thread safe but can be called from different threads at the same time (#4730)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-27 23:41:28 +08:00
Ujjawal 06728e554c
HBASE-25922 - Disabled sanity checks ignored on snapshot restore (#4533)
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-26 08:25:59 -04:00
Ruanhui 92cf962fee
HBASE-27325 the bulkload max call queue size can be update to a wrong value (#4728)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-25 10:59:52 +08:00
Yutong Xiao b44bfc52cc
HBASE-27246 RSGroupMappingScript#getRSGroup has thread safety problem (#4657)
Co-authored-by: Sean Xiao Yutong <sean.xiaoyt@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 15:23:21 +08:00
chenglei a0481d100f
HBASE-27303 Unnecessary replication to secondary region replicas should avoid when WAL.sync throws Exception (#4707)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-24 10:25:42 +08:00
Duo Zhang 950ad8dd3e
HBASE-27311 The implementation of syncReplicationPeerLock is incomplete (#4715)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-08-23 15:02:17 +08:00
Ruanhui 00a719e76f
HBASE-27305 add an option to skip file splitting when bulkload hfiles (#4709)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 21:14:30 +08:00
tianhang f238a92b6d
HBASE-27129 Add a config that allows us to configure region-level storage policies (#4547)
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-22 10:06:14 +08:00
LiangJun He 61cd63c7b6
HBASE-27104 Add a tool command list_unknownservers (#4523)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-20 21:48:58 +08:00
Fantasy-Jay 32c135d8a5
HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime (#4710)
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-20 20:50:40 +08:00
Duo Zhang 116458ab04 HBASE-27279 Addendum fix TestSaslTlsIPCRejectPlainText 2022-08-16 21:43:03 +08:00
Duo Zhang 2b9d36869f
HBASE-27279 Make SslHandler work with SaslWrapHandler/SaslUnwrapHandler (#4705)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: Andor Molnár <andor@cloudera.com>
2022-08-16 21:05:42 +08:00
Wellington Ramos Chevreuil eaa47c5cd4
HBASE-27264 Add options to consider compressed size when delimiting blocks during hfile writes (#4675)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-08-15 22:35:35 +01:00
liangxs 8ec02c025e
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… (#4376)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
2022-08-15 11:09:36 -07:00
huaxiangsun 73759be396
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose (#4695)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-12 12:17:14 -07:00
Duo Zhang 3309108ca7
HBASE-27278 Improve TestTlsIPC to reuse existing IPC test code (#4682)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-12 12:17:29 +08:00
SiCheng-Zheng 6b2e9d14a7
HBASE-27248 WALPrettyPrinter add print timestamp (#4659)
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-10 21:10:21 +08:00
Bryan Beaudreault bfa53f5609
HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters (#4669)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-09 15:18:55 -04:00
Duo Zhang 5919b30b6d
HBASE-27283 Use readTO instead of hard coded RpcClient.DEFAULT_SOCKET_TIMEOUT_READ when creating ReadTimeoutHandler in NettyRpcConnection (#4685)
Signed-off-by: Xin Sun <ddupgs@gmail.com
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-08-09 16:18:23 +08:00
chaijunjie0101 d6641626a9
HBASE-27282 CME in AuthManager causes region server crash (#4684)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-09 09:52:31 +08:00
Abhradeep Kundu 54f2106f33
HBASE-27265 : Tool to read StoreFileTrackerFile (#4673)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-08 11:43:06 +01:00
SiCheng-Zheng 4ebf71982c
HBASE-27270 Add bulkloadExecutor.resizeQueues (#4677)
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-08 18:14:49 +08:00
Andor Molnár f8dcf07055
HBASE-26666 Add native TLS encryption support to RPC server/client (#4666)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-08-06 19:09:54 -04:00
Duo Zhang 486d19e99f
HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big (#4679)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-08-06 20:08:07 +08:00
LiangJun He 2dc26082be
HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect (#4678)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-04 22:42:36 +08:00
Nick Dimiduk d734acc00e HBASE-27153 Improvements to read-path tracing
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-02 14:09:09 +02:00
Bryan Beaudreault e8c14ee308
HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:28:28 -04:00
Duo Zhang 0c4263a18b
HBASE-27185 Rewrite NettyRpcServer to decode rpc request with netty handler (#4624)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-07-27 09:00:42 +08:00
Andrew Purtell 9ba868d2ad HBASE-27087 TestQuotaThrottle times out
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 14:09:48 -07:00
Bryan Beaudreault 277058e18d
HBASE-27229 BucketCache statistics should not count evictions by hfile (#4639)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 16:59:57 -04:00