cec0556263
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication ( #5055 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit e48c4485db
2023-03-10 23:03:17 +08:00
e180aa10df
HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner ( #5078 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468
2023-03-09 10:49:42 +08:00
43fc4bfcd8
HBASE-27681 Refactor Table Latency Metrics ( #5093 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-08 10:13:14 -05:00
9a69a69648
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
...
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-06 11:02:12 +01:00
1ac6f1689f
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 ) ( #5085 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 14:21:22 +08:00
505a901fed
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression ( #5075 ) ( #5083 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 12:53:30 +08:00
f1e970d3d4
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream ( #5064 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7
2023-03-04 21:58:59 +08:00
6bc84de563
HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-03 10:40:03 +01:00
0c85952a8f
HBASE-27458 Use ReadWriteLock for region scanner readpoint map ( #4859 ) ( #5073 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-02 13:49:02 +08:00
13e06c7184
HBASE-23561 acquire lock before update regionsMap ( #1263 )
...
Addendum: tie add and delete of regionMap and encodedRegionsMap
Signed-off-by: stack <stack@apache.org>
2023-03-01 15:10:18 +01:00
5f54d9cbad
HBASE-23561 Look up of Region in Master by encoded region name is O(n) ( #1193 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-01 15:10:18 +01:00
9a23d4a3b2
HBASE-27673 Fix mTLS client hostname verification ( #5066 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-01 12:20:06 +01:00
7fef94a6cd
HBASE-27666 Addendum fix import in test
2023-02-28 14:23:24 -05:00
63e3f17c9f
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped ( #5056 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:46 -05:00
d3e02cb69a
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-28 14:36:25 +01:00
840c62e532
HBASE-24781 Clean up peer metrics when disabling peer ( #4997 )
...
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0
2023-02-28 13:35:00 +08:00
5b6d9de54c
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes ( #5059 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3
2023-02-28 10:02:46 +08:00
53d3e78432
HBASE-27650 Merging empty regions corrupts meta cache (branch-2) ( #5038 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:40:19 -05:00
3b6d8c3394
HBASE-23102: Improper Usage of Map putIfAbsent ( #828 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
2023-02-27 11:23:36 +01:00
82c4ccefd3
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file ( #5032 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f
2023-02-26 16:18:33 +08:00
a6ca9cb61e
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions ( #5058 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 14:53:09 -05:00
a571852a09
HBASE-27661 Set size of systable queue in UT ( #5053 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e85
2023-02-25 23:38:14 +08:00
0747f0c934
HBASE-15242: add client side metrics for timeout and remote exceptions. ( #5023 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-24 16:25:41 -08:00
3f25f33bc3
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5046 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 18:21:42 +08:00
5aab852a6d
Revert "HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5041 )" ( #5045 )
...
This reverts commit f87c6b8505
2023-02-20 18:17:20 +08:00
f87c6b8505
HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5041 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:59:45 +08:00
3a5fc6dad6
HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 ( #5034 )
...
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121
2023-02-18 10:48:14 +08:00
beab1eb208
HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent ( #5031 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 19:18:19 -05:00
301dd240c7
HBASE-27643 [JDK17] Add-opens java.util.concurrent ( #5028 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e3
2023-02-17 21:17:15 +08:00
3b8d7ad512
HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT ( #5029 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 21:12:33 +08:00
4b9214c75f
HBASE-21521 Expose master startup status via web UI ( #4788 ) ( #5021 ) ( #5026 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-16 09:31:32 +08:00
ee618d5fdf
HBASE-27637 Zero length value would cause value compressor read nothing and not advance the position of the InputStream ( #5025 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 2bbe036e29
2023-02-15 12:15:01 +08:00
1fb311f22a
HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file ( #5016 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 833b10e8ba
2023-02-11 19:54:57 +08:00
7402ebb3a0
HBASE-27602 Remove the impact of operating env on testHFileCleaning ( #5003 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e71253f4d8
2023-02-11 19:41:34 +08:00
4ac84b8aa0
HBASE-27626 Suppress noisy logging in client.ConnectionImplementation ( #5019 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 10:29:32 -08:00
0d88f75b80
HBASE-27590 Change Iterable to List in SnapshotFileCache ( #4995 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d2c5af11ea
2023-02-09 15:20:47 +01:00
1dd0dc3c9a
HBASE-27619 Bulkload fails when trying to bulkload files with invalid names after HBASE-26707 ( #5014 )
...
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 09:19:58 -04:00
721f1b159a
HBASE-27534 Addendum fix branch-2 compile issue
2023-02-08 16:10:37 -05:00
3436ab9d29
HBASE-27534 Addendum fix test crash ( #5011 )
2023-02-08 10:56:41 -05:00
3358db1f97
HBASE-27534 Determine too large requests by response block size rather than just cell size ( #5007 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-05 17:28:53 -05:00
8809c880dd
HBASE-27570 Unify tracking of block IO across all read request types ( #5004 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:35:53 -05:00
f619001dff
HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding ( #5006 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:20:17 -05:00
ac744298fb
HBASE-27608 Use lowercase image reference name in our docker file ( #5005 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit bbc20f3611
2023-02-03 11:39:16 +08:00
da410e2150
HBASE-27598 Addendum remove references to mockito-core.version in pom
...
(cherry picked from commit 55b4bbc057
2023-02-02 22:17:43 +08:00
2bb8897f76
HBASE-27595 ThreadGroup is removed since Hadoop 3.2.4 ( #5001 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a3686eb052
2023-02-02 14:21:30 +08:00
20a26dd043
HBASE-27581 [JDK17] Fix failure TestHBaseTestingUtil#testResolvePortConflict ( #4991 )
...
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e72cc6ee0
2023-01-31 11:20:42 +08:00
47887225d0
HBASE-27558 Scan quotas and limits should account for total block IO ( #4967 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-30 13:23:26 -05:00
3a98d87030
HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected( #4820 )
...
Close #4820
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 382681e2d6
2023-01-29 17:39:39 +08:00
35cca16e74
HBASE-27598 Upgrade mockito to 4.x ( #4998 )
...
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit bd7a78add5
2023-01-29 12:22:18 +08:00
79ecc22a74
HBASE-27547 Close store file readers after region warmup ( #4942 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 45fd3f628a
2023-01-28 23:21:31 +08:00
Duo Zhang
Rajeshbabu Chintaguntla
tianhang
huaxiangsun
Xiaolin Ha
alan.zhao
Jan Hentschel
Minwoo Kang
Balazs Meszaros
Bryan Beaudreault
Bryan Beaudreault
okumin
Yuta Imazu
Nick Dimiduk
Victor
chenglei
Kerasone
Nihal Jain
Peter Somogyi
Wellington Ramos Chevreuil
chaijunjie0101
EungsopYoo