b9ec644e51
HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent ( #4830 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:42 -07:00
66873ca5a6
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection ( #2514 ) ( #4826 )
...
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-10-13 22:07:46 +08:00
050f3e1ef5
HBASE-27401 Addendum fix more javadoc issues
...
(cherry picked from commit 4b45256910
2022-10-07 00:55:26 +08:00
fb988373c1
HBASE-27401 Clean up current broken 'n's in our javadoc ( #4812 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0
2022-10-06 23:01:14 +08:00
33872f7791
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag
2022-10-06 16:41:20 +05:30
d18d368445
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure
2022-10-06 06:54:56 +05:30
a3e0182cef
HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time
2022-10-05 03:32:49 +05:30
4c9185b37d
HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance ( #4813 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-04 08:30:15 -04:00
3aad87664d
HBASE-27370 Avoid decompressing blocks when reading from bucket cache… ( #4781 )
...
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-09-20 10:58:58 +01:00
ca86eea482
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 ( #4787 ) ( #4790 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-19 07:56:47 +08:00
df5c1ca854
HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize ( #4779 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04
2022-09-15 15:35:44 +08:00
18c23f75f5
HBASE-27314 Make index block be customized and configured ( #4763 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-13 10:10:10 +08:00
c1cad7f653
HBASE-27360 The trace related assertions are flaky for async client tests ( #4767 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f3f88ff6c1
2022-09-09 23:03:16 +08:00
fa11c8024e
HBASE-27362 CompactSplit.requestCompactionInternal may bypass compactionsEnabled check ( #4768 )
...
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a26cbf1057
2022-09-08 16:44:02 +08:00
6f6857b83f
HBASE-27224 HFile tool statistic sampling produces misleading results ( #4638 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Clay Baenziger <cwb@clayb.net>
2022-09-06 15:37:52 -04:00
890d6dedfe
HBASE-27332 Remove RejectedExecutionHandler for long/short compaction thread pools ( #4731 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-05 21:16:23 +08:00
81ba1231dc
HBASE-22939 SpaceQuotas - Bulkload from different hdfs failed when space quotas are turned on. ( #4749 )
...
Signed-off-by: Sakthi <sakthi@apache.org>
2022-08-31 15:50:10 +02:00
b0edb77b72
HBASE-27152 Under compaction mark may leak ( #4725 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-30 01:20:28 +08:00
a40d645312
HBASE-27336 The region visualizer shows 'undefined' region server ( #4736 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fa02350a27
2022-08-28 22:53:00 +08:00
13841f52f0
HBASE-25922 - Disabled sanity checks ignored on snapshot restore ( #4533 )
...
Co-authored-by: Ujjawal Kumar <u.kumar@ukumar-ltmit1s.internal.salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2022-08-26 08:58:21 -04:00
a97a5c7cc4
HBASE-26882 "HBASE-26810 Add dynamic configuration support for system coprocessors" to branch-2
2022-08-23 14:06:38 +02:00
51576ae45a
HBASE-27305 add an option to skip file splitting when bulkload hfiles ( #4709 )
...
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 00a719e76f
2022-08-22 22:45:55 +08:00
78f587f559
HBASE-27104 Add a tool command list_unknownservers ( #4714 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1bd0b581cb
2022-08-22 21:26:19 +08:00
3984891114
HBASE-27129 Add a config that allows us to configure region-level storage policies ( #4547 )
...
Co-authored-by: Tang Tianhang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f238a92b6d
2022-08-22 10:07:41 +08:00
f2345af6d8
HBASE-27206 Clean up error-prone findings in hbase-common ( #4645 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit fbe3b90e0c
2022-08-21 21:36:25 +08:00
46ffdabd13
HBASE-27268 In trace log mode, the client does not print callId/startTime and the server does not print receiveTime ( #4710 )
...
Co-authored-by: jay.zhu <jay.zhu@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 32c135d8a5
2022-08-20 21:09:53 +08:00
9f3c52265d
HBASE-26969:Eliminate MOB renames when SFT is enabled
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
closes #4712
2022-08-19 12:24:27 +02:00
e239f70f2d
HBASE-25970 MOB data loss - incorrect concatenation of MOB_FILE_REFS ( #3355 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-08-19 12:17:30 +02:00
a9f4ec3759
HBASE-24163 MOB compactor implementations should use format specifiers when calling String.format
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-08-17 13:58:31 +02:00
e595f154d1
HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone ( #4617 ) ( #4704 )
...
* HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone (#1446 )
* Reorganize MOB compaction tests for more reuse.
* Add tests for mob compaction after snapshot clone operations
* note the original table used to write a given mob hfile and use that to find it later.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
* spotless:apply to fix HBaseTestingUtility
* Fix error-prone errors
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Co-authored-by: Andrew Purtell <apurtell@apache.org>
Co-authored-by: Sean Busbey <busbey@apache.org>
2022-08-15 13:16:00 -07:00
3980e6d087
HBASE-26982 Add index and bloom filter statistics of LruBlockCache on… ( #4376 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: stack <stack@apache.org>
2022-08-15 11:12:34 -07:00
7f6f184f06
HBASE-27296 Some Cell's implementation of toString() such as IndividualBytesFieldCell prints out value and tags which is too verbose ( #4695 ) ( #4702 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-15 09:16:51 -07:00
5a606837fc
HBASE-27248 WALPrettyPrinter add print timestamp ( #4659 )
...
Co-authored-by: SiCheng-Zheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6b2e9d14a7
2022-08-10 21:31:06 +08:00
c0717c7383
HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters ( #4669 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-09 15:28:43 -04:00
187c084cf2
HBASE-27283 Use readTO instead of hard coded RpcClient.DEFAULT_SOCKET_TIMEOUT_READ when creating ReadTimeoutHandler in NettyRpcConnection ( #4685 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 5919b30b6d
2022-08-09 16:23:08 +08:00
97d87b011f
HBASE-27282 CME in AuthManager causes region server crash ( #4684 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d6641626a9
2022-08-09 09:57:40 +08:00
0a36504848
HBASE-27273 Should stop autoRead and skip all the bytes when rpc request too big ( #4679 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 486d19e99f
2022-08-06 20:31:38 +08:00
a7f8dde815
HBASE-27269 The implementation of TestReplicationStatus.waitOnMetricsReport is incorrect ( #4678 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2dc26082be
2022-08-04 23:17:30 +08:00
472e81098e
HBASE-27153 Improvements to read-path tracing
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-02 14:10:05 +02:00
7aa46f03f4
HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI ( #4667 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:33:44 -04:00
ce1455c365
HBASE-27087 TestQuotaThrottle times out
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 14:11:32 -07:00
25136c39f9
HBASE-27229 BucketCache statistics should not count evictions by hfile ( #4639 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-26 17:10:41 -04:00
88f957b323
HBASE-27222 Purge FutureReturnValueIgnored warnings from error prone ( #4634 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 8b091c4061
2022-07-26 23:45:29 +08:00
4e4ebe99c5
HBASE-27225 Add BucketAllocator bucket size statistic logging ( #4637 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-25 21:02:23 -04:00
a6a75ef43d
HBASE-27075 TestUpdateRSGroupConfiguration.testCustomOnlineConfigChangeInRSGroup is flaky ( #4636 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 31fc97edee
2022-07-21 14:52:59 +08:00
cf4da36954
Revert "HBASE-27152 Under compaction mark may leak ( #4568 )"
...
This reverts commit 3ebb4360b9
2022-07-21 09:04:37 +08:00
3ebb4360b9
HBASE-27152 Under compaction mark may leak ( #4568 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit da27a67a1e
2022-07-20 08:52:10 +08:00
25c375e186
HBASE-20499 Replication/Priority executors can use specific max queue length as default value instead of general maxQueueLength
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
(cherry picked from commit 6d080762ef
2022-07-19 13:57:47 +08:00
9c3528d730
HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 10:03:26 +08:00
a321fb2eee
HBASE-27195 Clean up netty worker/thread pool configuration ( #4619 )
...
The configuration settings "hbase.netty.worker.count" and
"hbase.netty.eventloop.rpcserver.thread.count" appear to duplicate each
other.
Also, formalizes another setting found in NettyEventLoopGroupConfig,
"hbase.netty.nativetransport".
Also, native epoll is not limited to amd64. aarch64 supports it too.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcServer.java
2022-07-18 17:43:40 -07:00
d-c-manning
binlijin
Duo Zhang
Rajeshbabu Chintaguntla
Bryan Beaudreault
Wellington Ramos Chevreuil
chenglei
Bryan Beaudreault
Xiaolin Ha
Istvan Toth
LiangJun He
Ujjawal
Tak Lon (Stephen) Wu
Ruanhui
tianhang
Andrew Purtell
Fantasy-Jay
BukrosSzabolcs
Peter Somogyi
Sean Busbey
huaxiangsun
liangxs
SiCheng-Zheng
chaijunjie0101
Nick Dimiduk
Nihal Jain