Commit Graph

9368 Commits

Author SHA1 Message Date
tianhang 16864c705c
HBASE-27681 Refactor Table Latency Metrics (#5072)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-07 12:03:37 -05:00
Xiaolin Ha 37858bb6b0
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 11:52:20 +08:00
alan.zhao 59fdaa28f7
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-04 21:46:45 +08:00
Bryan Beaudreault d2b0074f7a
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:01 -05:00
Balazs Meszaros 43aa9b33f1
HBASE-27673 Fix mTLS client hostname verification (#5065)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-28 18:39:47 +01:00
Yuta Imazu ef6a1130d0
HBASE-24781 Clean up peer metrics when disabling peer (#4997)
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
2023-02-28 13:13:49 +08:00
Duo Zhang d1fede72c3
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-28 09:47:37 +08:00
tianhang 4bee21e96b
HBASE-27660 Ignore invalid hostname when getNetworkInterfaces (#5052)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:11:42 +08:00
okumin 10037df035
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-27 11:13:54 +01:00
Bryan Beaudreault f20efafbc1
HBASE-27650 Merging empty regions corrupts meta cache (#5037)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-26 16:39:48 -05:00
Duo Zhang 4a9cf99b2f
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-26 16:14:25 +08:00
tianhang bc31e68e85
HBASE-27661 Set size of systable queue in UT (#5053)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 23:15:09 +08:00
huaxiangsun 22dbb7afc3
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-02-21 13:47:27 +01:00
chenglei cf179d3fb9
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5039)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:42:00 +08:00
Duo Zhang 2bbe036e29
HBASE-27637 Zero length value would cause value compressor read nothing and not advance the position of the InputStream (#5025)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-15 12:00:08 +08:00
Xiaolin Ha 8ba56cccd3
HBASE-21521 Expose master startup status via web UI (#4788)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-13 18:55:55 +08:00
tianhang e71253f4d8
HBASE-27602 Remove the impact of operating env on testHFileCleaning (#5003)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-11 19:39:03 +08:00
Duo Zhang 833b10e8ba
HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file (#5016)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-02-11 19:34:17 +08:00
Wellington Ramos Chevreuil a854cba59f
HBASE-27619 Bulkload fails when trying to bulkload files with invalid names after HBASE-26707 (#5014)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 12:40:00 +00:00
Peter Somogyi d2c5af11ea
HBASE-27590 Change Iterable to List in SnapshotFileCache (#4995)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-09 11:20:35 +01:00
Bryan Beaudreault 1a9e465e35
HBASE-27534 Addendum fix test crash (#5011) 2023-02-07 17:05:01 -05:00
Bryan Beaudreault fa6b5d17c2
HBASE-27534 Determine too large requests by response block size rather than just cell size (#5007)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-05 16:54:21 -05:00
Bryan Beaudreault 7b26b2aefe
HBASE-27570 Unify tracking of block IO across all read request types (#5004)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:14:05 -05:00
Bryan Beaudreault 95039f08b1
HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding (#5006)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:12:29 -05:00
tianhang a3686eb052
HBASE-27595 ThreadGroup is removed since Hadoop 3.2.4 (#5001)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-02 14:15:44 +08:00
Bryan Beaudreault 76207257bb
HBASE-27558 Scan quotas and limits should account for total block IO (#4967)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-30 09:27:45 -05:00
chaijunjie0101 382681e2d6 HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected(#4820)
Close #4820

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-29 17:19:08 +08:00
Duo Zhang bd7a78add5
HBASE-27598 Upgrade mockito to 4.x (#4998)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2023-01-29 11:29:51 +08:00
EungsopYoo 45fd3f628a
HBASE-27547 Close store file readers after region warmup (#4942)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-28 22:12:18 +08:00
Andrew Purtell 01e5eac80b
HBASE-27588 "Instantiating StoreFileTracker impl" INFO level logging is too chatty (#4989)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-25 14:40:24 -08:00
Wellington Ramos Chevreuil ea4cb641d7
HBASE-27551 Add config options to delay assignment to retain last region location (#4945)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-24 02:36:50 +00:00
Bryan Beaudreault cc4fd8bebb
HBASE-27579 CatalogJanitor can cause data loss due to errors during cleanMergeRegion (#4986)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 12:29:16 -05:00
curie71 913cf6b96d
HBASE-27528 log duplication issues in MasterRpcServices. (#4951)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 15:53:32 +08:00
BukrosSzabolcs ad8f28e297
HBASE-27493: Allow namespace admins to clone snapshots created by them (#4885)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-18 11:01:56 +01:00
Andrew Purtell 71d0862d84
HBASE-27561 hbase.master.port is ignored in processing of hbase.masters (#4952)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 13:20:03 -08:00
Nick Dimiduk da261344cc
HBASE-27568 ChaosMonkey add support for JournalNodes (#4963)
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 09:55:18 +08:00
Viraj Jasani cc54d22fb4
HBASE-27529 Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink (#4924)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-16 10:46:14 -08:00
Peter Somogyi dff8e50849
HBASE-27565 Make the initial corePoolSize configurable for ChoreService (#4958)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 14:41:41 +01:00
liuzhongjun c1b9d8ba06
HBASE-27560 fix consistencyCheck did not report the hole on last region (#4950)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-11 18:03:20 +08:00
Liangjun He 4add5250ed
HBASE-27489 Fix several problems after HBASE-27304 (#4903)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-10 14:35:55 +08:00
Duo Zhang 3f1087fe82
HBASE-27485 HBaseTestingUtility minicluster requires log4j2 (#4941)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
2023-01-04 11:06:47 +08:00
chenglei 7ef63b65f0
HBASE-27539 Encapsulate and centralise access to ref count through StoreFileInfo (#4928)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-24 17:52:39 +08:00
Duo Zhang dcfde79f7e
HBASE-27514 Move some persistent states from zookeeper to master region (#4925)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-12-22 12:04:24 +08:00
Bryan Beaudreault d7b214b379
HBASE-27233 Read blocks into off-heap if caching is disabled for read (#4931)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-12-21 12:34:25 -05:00
Wellington Ramos Chevreuil 222ec684d6
HBASE-27474 Evict blocks on split/merge; Avoid caching reference/hlinks if compaction is enabled (#4868)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-12-16 18:41:05 +00:00
Ray Mattingly c30f53c1e9
HBASE-27253 make slowlog configurations dynamic (#4926)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 17:52:49 -05:00
Bri Augenreich 105a2749f4
HBASE-27390 getClusterMetrics NullPointerException when ServerTask status null (#4853)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 09:46:21 -05:00
chenglei 578fa6ad08
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush f… (#4912)
* HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 10:18:22 +08:00
Victor 320eca20fb
HBASE-27466: Making metrics instance containing one or more connections. (#4874)
Signed-off-by: David Manning <67607031+d-c-manning@users.noreply.github.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-12-01 18:02:00 -08:00
Ruanhui bb9f43c6f9
HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2022-11-27 23:07:40 +08:00