856fa14537
HBASE-27422: Support replication for hbase:acl ( #4827 )
...
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-14 10:19:29 +01:00
a71105997f
HBASE-27727 Implement filesystem based Replication peer storage ( #5165 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-13 18:58:02 +08:00
f36587c648
HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion ( #5110 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-08 11:02:09 +08:00
a370099aaa
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may … ( #5158 )
...
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-06 21:14:33 +08:00
a363b76d81
HBASE-27765 Add biggest cell related info into web ui ( #5151 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-05 21:42:13 +08:00
e5620e26a2
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable ( #5141 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-29 16:20:29 -04:00
c52f4b286c
HBASE-27704 Quotas can drastically overflow configured limit ( #5099 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-29 16:19:13 -04:00
f5437b9ceb
HBASE-27333 Abort RS when the hostname is different from master seen ( #4732 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-03-28 15:17:16 +08:00
c825c960d6
HBASE-27532 Add block bytes scanned metrics ( #5067 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-27 16:03:15 -04:00
a6dad700db
HBASE-27750: Update the list of prefetched Hfiles upon block eviction ( #5140 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-03-27 10:49:55 +01:00
230fdc0b50
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory ( #5119 )
...
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.
Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-24 14:17:39 +08:00
7d6a79b768
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues ( #5074 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:07:31 +08:00
dd3b1630e8
HBASE-27736 HFileSystem.getLocalFs is not used ( #5125 )
...
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-21 22:46:15 +08:00
201846b726
HBASE-27646 Should not use pread when prefetching in HFilePreadReader ( #5063 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 12:44:01 +08:00
997d132601
HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl' config ( #5096 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-20 10:36:14 +08:00
e6977a9597
HBASE-27718 The regionStateNode only need remove once in regionOffline ( #5106 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-19 20:14:52 +08:00
3c2c685892
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. ( #5114 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-19 19:58:20 +08:00
d5c86243e1
HBASE-27671 Client should not be able to restore/clone a snapshot aft… ( #5109 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-18 00:06:28 -07:00
58cb1f4799
HBASE-27686: Recovery of BucketCache and Prefetched data after RS Crash ( #5080 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2023-03-16 14:27:55 +00:00
1f2e1f5b3a
HBASE-27715 Refactoring the long tryAdvanceEntry method in WALEntryStream ( #5105 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-03-15 21:47:25 +08:00
c8bee238fc
HBASE-27716 Fix TestWALOpenAfterDNRollingStart ( #5102 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-15 10:40:03 +08:00
ce7b1d4e4f
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations ( #5101 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-15 10:39:33 +08:00
e48c4485db
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication ( #5055 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2023-03-10 21:54:20 +08:00
c013c7c72c
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 ( #5082 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-10 21:45:44 +08:00
0491524eb1
HBASE-27615 Add group of regionServer on Master webUI ( #5010 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-09 17:10:11 +08:00
8bdabed85c
HBASE-27690 Fix a misspell in TestRegionStateStore ( #5090 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-08 23:23:50 +08:00
16864c705c
HBASE-27681 Refactor Table Latency Metrics ( #5072 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-07 12:03:37 -05:00
37858bb6b0
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 11:52:20 +08:00
59fdaa28f7
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream ( #5064 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-04 21:46:45 +08:00
d2b0074f7a
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped ( #5056 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:01 -05:00
43aa9b33f1
HBASE-27673 Fix mTLS client hostname verification ( #5065 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-28 18:39:47 +01:00
ef6a1130d0
HBASE-24781 Clean up peer metrics when disabling peer ( #4997 )
...
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
2023-02-28 13:13:49 +08:00
d1fede72c3
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes ( #5059 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-28 09:47:37 +08:00
4bee21e96b
HBASE-27660 Ignore invalid hostname when getNetworkInterfaces ( #5052 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:11:42 +08:00
10037df035
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-27 11:13:54 +01:00
f20efafbc1
HBASE-27650 Merging empty regions corrupts meta cache ( #5037 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-26 16:39:48 -05:00
4a9cf99b2f
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file ( #5032 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-26 16:14:25 +08:00
bc31e68e85
HBASE-27661 Set size of systable queue in UT ( #5053 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 23:15:09 +08:00
22dbb7afc3
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
...
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-02-21 13:47:27 +01:00
cf179d3fb9
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5039 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:42:00 +08:00
2bbe036e29
HBASE-27637 Zero length value would cause value compressor read nothing and not advance the position of the InputStream ( #5025 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-15 12:00:08 +08:00
8ba56cccd3
HBASE-21521 Expose master startup status via web UI ( #4788 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-13 18:55:55 +08:00
e71253f4d8
HBASE-27602 Remove the impact of operating env on testHFileCleaning ( #5003 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-11 19:39:03 +08:00
833b10e8ba
HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file ( #5016 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-02-11 19:34:17 +08:00
a854cba59f
HBASE-27619 Bulkload fails when trying to bulkload files with invalid names after HBASE-26707 ( #5014 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 12:40:00 +00:00
d2c5af11ea
HBASE-27590 Change Iterable to List in SnapshotFileCache ( #4995 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-09 11:20:35 +01:00
1a9e465e35
HBASE-27534 Addendum fix test crash ( #5011 )
2023-02-07 17:05:01 -05:00
fa6b5d17c2
HBASE-27534 Determine too large requests by response block size rather than just cell size ( #5007 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-05 16:54:21 -05:00
7b26b2aefe
HBASE-27570 Unify tracking of block IO across all read request types ( #5004 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:14:05 -05:00
95039f08b1
HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding ( #5006 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:12:29 -05:00
Kota-SH
Duo Zhang
Nick Dimiduk
chenglei
bsglz
Bryan Beaudreault
Xiaolin Ha
xuzifu666
chaijunjie0101
slfan1989
Nihal Jain
alan.zhao
tianhang
Balazs Meszaros
Yuta Imazu
okumin
huaxiangsun
Wellington Ramos Chevreuil
Peter Somogyi