Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,679 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

9404 Commits

Author SHA1 Message Date
haosen chen 95f83cb8e2
HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-23 23:20:47 +08:00
Nihal Jain e86f930894
HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-23 23:20:12 +08:00
Duo Zhang 18ae733b15
HBASE-27806 Support dynamic reinitializing replication peer storage (#5195) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-23 22:25:31 +08:00
Ray Mattingly ced4ff1804
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-21 21:16:57 -07:00
chenglei 269586c4cf
HBASE-27785 Encapsulate and centralize totalBufferUsed in Replication… (#5168) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-21 20:59:16 +08:00
Duo Zhang f5ee958ead HBASE-27783 Addendum forward port the test improvement when backporting to branch-2 2023-04-20 15:25:59 +08:00
Duo Zhang 398c5ef313
HBASE-27783 Implement a shell command to disable all peer modification (#5182) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-19 22:07:29 +08:00
Nick Dimiduk 63471efa25
HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-17 14:22:04 +02:00
Nihal Jain 24c471a0b3
HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-17 12:46:07 +02:00
Ray Mattingly 2b098b0819
HBASE-27536: Include more request information in slowlog for Scans (#5155) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-04-16 10:03:53 -04:00
Kota-SH 856fa14537
HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-14 10:19:29 +01:00
Duo Zhang a71105997f
HBASE-27727 Implement filesystem based Replication peer storage (#5165) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-13 18:58:02 +08:00
Nick Dimiduk f36587c648
HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-08 11:02:09 +08:00
chenglei a370099aaa
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may … (#5158) 
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-06 21:14:33 +08:00
bsglz a363b76d81
HBASE-27765 Add biggest cell related info into web ui (#5151) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-05 21:42:13 +08:00
Bryan Beaudreault e5620e26a2
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5141) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-29 16:20:29 -04:00
Bryan Beaudreault c52f4b286c
HBASE-27704 Quotas can drastically overflow configured limit (#5099) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-29 16:19:13 -04:00
Xiaolin Ha f5437b9ceb
HBASE-27333 Abort RS when the hostname is different from master seen (#4732) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-03-28 15:17:16 +08:00
Bryan Beaudreault c825c960d6
HBASE-27532 Add block bytes scanned metrics (#5067) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-03-27 16:03:15 -04:00
Kota-SH a6dad700db
HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-03-27 10:49:55 +01:00
Duo Zhang 230fdc0b50
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-24 14:17:39 +08:00
Xiaolin Ha 7d6a79b768
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:07:31 +08:00
xuzifu666 dd3b1630e8
HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-21 22:46:15 +08:00
Xiaolin Ha 201846b726
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 12:44:01 +08:00
Duo Zhang 997d132601
HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl' config (#5096) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2023-03-20 10:36:14 +08:00
chaijunjie0101 e6977a9597
HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-19 20:14:52 +08:00
slfan1989 3c2c685892
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. (#5114) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-19 19:58:20 +08:00
Nihal Jain d5c86243e1
HBASE-27671 Client should not be able to restore/clone a snapshot aft… (#5109) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-18 00:06:28 -07:00
Kota-SH 58cb1f4799
HBASE-27686: Recovery of BucketCache and Prefetched data after RS Crash (#5080) 
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2023-03-16 14:27:55 +00:00
Duo Zhang 1f2e1f5b3a
HBASE-27715 Refactoring the long tryAdvanceEntry method in WALEntryStream (#5105) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-03-15 21:47:25 +08:00
Duo Zhang c8bee238fc
HBASE-27716 Fix TestWALOpenAfterDNRollingStart (#5102) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2023-03-15 10:40:03 +08:00
Duo Zhang ce7b1d4e4f
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2023-03-15 10:39:33 +08:00
Duo Zhang e48c4485db
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication (#5055) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2023-03-10 21:54:20 +08:00
alan.zhao c013c7c72c
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5082) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-10 21:45:44 +08:00
tianhang 0491524eb1
HBASE-27615 Add group of regionServer on Master webUI (#5010) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-03-09 17:10:11 +08:00
tianhang 8bdabed85c
HBASE-27690 Fix a misspell in TestRegionStateStore (#5090) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-08 23:23:50 +08:00
tianhang 16864c705c
HBASE-27681 Refactor Table Latency Metrics (#5072) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-07 12:03:37 -05:00
Xiaolin Ha 37858bb6b0
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 11:52:20 +08:00
alan.zhao 59fdaa28f7
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-04 21:46:45 +08:00
Bryan Beaudreault d2b0074f7a
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-28 14:02:01 -05:00
Balazs Meszaros 43aa9b33f1
HBASE-27673 Fix mTLS client hostname verification (#5065) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-02-28 18:39:47 +01:00
Yuta Imazu ef6a1130d0
HBASE-24781 Clean up peer metrics when disabling peer (#4997) 
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
 2023-02-28 13:13:49 +08:00
Duo Zhang d1fede72c3
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-02-28 09:47:37 +08:00
tianhang 4bee21e96b
HBASE-27660 Ignore invalid hostname when getNetworkInterfaces (#5052) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-27 20:11:42 +08:00
okumin 10037df035
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-02-27 11:13:54 +01:00
Bryan Beaudreault f20efafbc1
HBASE-27650 Merging empty regions corrupts meta cache (#5037) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-26 16:39:48 -05:00
Duo Zhang 4a9cf99b2f
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-02-26 16:14:25 +08:00
tianhang bc31e68e85
HBASE-27661 Set size of systable queue in UT (#5053) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-25 23:15:09 +08:00
huaxiangsun 22dbb7afc3
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names 
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-02-21 13:47:27 +01:00
chenglei cf179d3fb9
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5039) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-02-20 17:42:00 +08:00