huaxiangsun
9a69a69648
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
...
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-06 11:02:12 +01:00
Xiaolin Ha
1ac6f1689f
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 ) ( #5085 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 14:21:22 +08:00
Xiaolin Ha
505a901fed
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression ( #5075 ) ( #5083 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 12:53:30 +08:00
alan.zhao
f1e970d3d4
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream ( #5064 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7
)
2023-03-04 21:58:59 +08:00
Jan Hentschel
6bc84de563
HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-03 10:40:03 +01:00
Xiaolin Ha
0c85952a8f
HBASE-27458 Use ReadWriteLock for region scanner readpoint map ( #4859 ) ( #5073 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-02 13:49:02 +08:00
Minwoo Kang
13e06c7184
HBASE-23561 acquire lock before update regionsMap ( #1263 )
...
Addendum: tie add and delete of regionMap and encodedRegionsMap
Signed-off-by: stack <stack@apache.org>
2023-03-01 15:10:18 +01:00
Minwoo Kang
5f54d9cbad
HBASE-23561 Look up of Region in Master by encoded region name is O(n) ( #1193 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-01 15:10:18 +01:00
Balazs Meszaros
9a23d4a3b2
HBASE-27673 Fix mTLS client hostname verification ( #5066 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-01 12:20:06 +01:00
Bryan Beaudreault
7fef94a6cd
HBASE-27666 Addendum fix import in test
2023-02-28 14:23:24 -05:00
Bryan Beaudreault
63e3f17c9f
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped ( #5056 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:46 -05:00
okumin
d3e02cb69a
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-28 14:36:25 +01:00
Yuta Imazu
840c62e532
HBASE-24781 Clean up peer metrics when disabling peer ( #4997 )
...
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0
)
2023-02-28 13:35:00 +08:00
Duo Zhang
5b6d9de54c
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes ( #5059 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3
)
2023-02-28 10:02:46 +08:00
Bryan Beaudreault
53d3e78432
HBASE-27650 Merging empty regions corrupts meta cache (branch-2) ( #5038 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:40:19 -05:00
Nick Dimiduk
3b6d8c3394
HBASE-23102: Improper Usage of Map putIfAbsent ( #828 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
2023-02-27 11:23:36 +01:00
Duo Zhang
82c4ccefd3
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file ( #5032 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f
)
2023-02-26 16:18:33 +08:00
Bryan Beaudreault
a6ca9cb61e
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions ( #5058 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 14:53:09 -05:00
tianhang
a571852a09
HBASE-27661 Set size of systable queue in UT ( #5053 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e85
)
2023-02-25 23:38:14 +08:00
Victor
0747f0c934
HBASE-15242: add client side metrics for timeout and remote exceptions. ( #5023 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-24 16:25:41 -08:00
chenglei
3f25f33bc3
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5046 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 18:21:42 +08:00
chenglei
5aab852a6d
Revert "HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5041 )" ( #5045 )
...
This reverts commit f87c6b8505
.
2023-02-20 18:17:20 +08:00
chenglei
f87c6b8505
HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5041 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:59:45 +08:00
Kerasone
3a5fc6dad6
HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 ( #5034 )
...
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121
)
2023-02-18 10:48:14 +08:00
Bryan Beaudreault
beab1eb208
HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent ( #5031 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 19:18:19 -05:00
tianhang
301dd240c7
HBASE-27643 [JDK17] Add-opens java.util.concurrent ( #5028 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e3
)
2023-02-17 21:17:15 +08:00
tianhang
3b8d7ad512
HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT ( #5029 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 21:12:33 +08:00
Xiaolin Ha
4b9214c75f
HBASE-21521 Expose master startup status via web UI ( #4788 ) ( #5021 ) ( #5026 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-16 09:31:32 +08:00
Duo Zhang
ee618d5fdf
HBASE-27637 Zero length value would cause value compressor read nothing and not advance the position of the InputStream ( #5025 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 2bbe036e29
)
2023-02-15 12:15:01 +08:00
Duo Zhang
1fb311f22a
HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file ( #5016 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 833b10e8ba
)
2023-02-11 19:54:57 +08:00
tianhang
7402ebb3a0
HBASE-27602 Remove the impact of operating env on testHFileCleaning ( #5003 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e71253f4d8
)
2023-02-11 19:41:34 +08:00
Nihal Jain
4ac84b8aa0
HBASE-27626 Suppress noisy logging in client.ConnectionImplementation ( #5019 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 10:29:32 -08:00
Peter Somogyi
0d88f75b80
HBASE-27590 Change Iterable to List in SnapshotFileCache ( #4995 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d2c5af11ea
)
2023-02-09 15:20:47 +01:00
Wellington Ramos Chevreuil
1dd0dc3c9a
HBASE-27619 Bulkload fails when trying to bulkload files with invalid names after HBASE-26707 ( #5014 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 09:19:58 -04:00
Bryan Beaudreault
721f1b159a
HBASE-27534 Addendum fix branch-2 compile issue
2023-02-08 16:10:37 -05:00
Bryan Beaudreault
3436ab9d29
HBASE-27534 Addendum fix test crash ( #5011 )
2023-02-08 10:56:41 -05:00
Bryan Beaudreault
3358db1f97
HBASE-27534 Determine too large requests by response block size rather than just cell size ( #5007 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-05 17:28:53 -05:00
Bryan Beaudreault
8809c880dd
HBASE-27570 Unify tracking of block IO across all read request types ( #5004 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:35:53 -05:00
Bryan Beaudreault
f619001dff
HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding ( #5006 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:20:17 -05:00
Duo Zhang
ac744298fb
HBASE-27608 Use lowercase image reference name in our docker file ( #5005 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit bbc20f3611
)
2023-02-03 11:39:16 +08:00
Duo Zhang
da410e2150
HBASE-27598 Addendum remove references to mockito-core.version in pom
...
(cherry picked from commit 55b4bbc057
)
2023-02-02 22:17:43 +08:00
tianhang
2bb8897f76
HBASE-27595 ThreadGroup is removed since Hadoop 3.2.4 ( #5001 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a3686eb052
)
2023-02-02 14:21:30 +08:00
tianhang
20a26dd043
HBASE-27581 [JDK17] Fix failure TestHBaseTestingUtil#testResolvePortConflict ( #4991 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e72cc6ee0
)
2023-01-31 11:20:42 +08:00
Bryan Beaudreault
47887225d0
HBASE-27558 Scan quotas and limits should account for total block IO ( #4967 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-30 13:23:26 -05:00
chaijunjie0101
3a98d87030
HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected( #4820 )
...
Close #4820
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 382681e2d6
)
2023-01-29 17:39:39 +08:00
Duo Zhang
35cca16e74
HBASE-27598 Upgrade mockito to 4.x ( #4998 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit bd7a78add5
)
2023-01-29 12:22:18 +08:00
EungsopYoo
79ecc22a74
HBASE-27547 Close store file readers after region warmup ( #4942 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 45fd3f628a
)
2023-01-28 23:21:31 +08:00
Rajeshbabu Chintaguntla
feee45d244
HBASE-27585 Bump up jruby to 9.3.9.0 and related joni and jcodings to 2.1.43 and 1.0.57 respectively ( #4992 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry picked from commit 235864056c
)
2023-01-28 10:55:57 +08:00
tianhang
e13a9867ed
HBASE-27591 [JDK17] Fix failure TestImmutableScan#testScanCopyConstructor ( #4994 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 06f294e637
)
2023-01-27 23:06:38 +08:00
Rajeshbabu Chintaguntla
6494123300
HBASE-27586 Bump up commons-codec to 1.15 ( #4993 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry picked from commit 5516fb86b6
)
2023-01-27 23:06:04 +08:00