Xiaolin Ha
d4edfe404e
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues ( #5074 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:10:56 +08:00
xuzifu666
a10cbf8319
HBASE-27736 HFileSystem.getLocalFs is not used ( #5125 )
...
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e8
)
2023-03-21 22:55:16 +08:00
Nick Dimiduk
29dfd005cf
HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2023-03-21 15:23:43 +01:00
Victor
ff9754049b
HBASE-27684: add client metrics related to user region lock. ( #5081 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
2023-03-20 22:36:08 -07:00
Nick Dimiduk
e7a958a45f
HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM
...
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.
`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2023-03-20 15:36:33 +01:00
Xiaolin Ha
873f8987f1
HBASE-27646 Should not use pread when prefetching in HFilePreadReader ( #5063 ) ( #5122 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 19:26:17 +08:00
Duo Zhang
81dffda0d3
HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl' config ( #5096 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 997d132601
)
2023-03-20 11:05:02 +08:00
chaijunjie0101
a6b99faa00
HBASE-27718 The regionStateNode only need remove once in regionOffline ( #5106 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a9597
)
2023-03-19 20:19:37 +08:00
slfan1989
8f6d6b9ec3
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. ( #5114 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3c2c685892
)
2023-03-19 20:05:44 +08:00
Nihal Jain
b1a00be1bc
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired ( #5117 ) ( #5109 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-18 00:07:16 -07:00
Bryan Beaudreault
5de1e4f88e
HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers ( #5115 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-17 15:24:28 -04:00
Kota-SH
d136c6d7c5
HBASE-27686: Recovery of BucketCache and Prefetched data after RS Crash ( #5080 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 58cb1f4799
)
2023-03-16 15:44:59 +00:00
Nick Dimiduk
59434e9cd4
HBASE-27708 CPU hot-spot resolving User subject
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-16 13:57:02 +01:00
Nick Dimiduk
dbb78388e5
HBASE-27652 Client-side lock contention around Configuration when using read replica regions ( #5036 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-15 16:07:48 +01:00
Duo Zhang
ef8a981f22
HBASE-27715 Refactoring the long tryAdvanceEntry method in WALEntryStream ( #5105 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 1f2e1f5b3a
)
2023-03-15 21:49:45 +08:00
Duo Zhang
b5dcd48c64
HBASE-27716 Fix TestWALOpenAfterDNRollingStart ( #5102 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit c8bee238fc
)
2023-03-15 11:03:59 +08:00
Duo Zhang
e051400a6d
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations ( #5101 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4f
)
2023-03-15 10:53:46 +08:00
alan.zhao
6920e72f50
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 ( #5097 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-15 08:17:18 +08:00
tianhang
24653dd105
HBASE-27615 Add group of regionServer on Master webUI ( #5098 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-14 11:55:18 +08:00
Horváth Dóra
0f67503b9d
HBASE-27685 Enable code coverage reporting to SonarQube in HBase ( #5076 )
...
(cherry picked from commit 72d5a46899
)
2023-03-10 20:16:08 +01:00
Duo Zhang
cec0556263
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication ( #5055 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit e48c4485db
)
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplaySyncReplicationWALCallable.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/WALEntryStream.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestProtobufLog.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/ProtobufLogTestHelper.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestCombinedAsyncWriter.java
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestSyncReplicationActive.java
hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSyncReplicationWALProvider.java
hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
2023-03-10 23:03:17 +08:00
Rajeshbabu Chintaguntla
e180aa10df
HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner ( #5078 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468
)
2023-03-09 10:49:42 +08:00
tianhang
43fc4bfcd8
HBASE-27681 Refactor Table Latency Metrics ( #5093 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-08 10:13:14 -05:00
huaxiangsun
9a69a69648
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
...
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-06 11:02:12 +01:00
Xiaolin Ha
1ac6f1689f
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 ) ( #5085 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 14:21:22 +08:00
Xiaolin Ha
505a901fed
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression ( #5075 ) ( #5083 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 12:53:30 +08:00
alan.zhao
f1e970d3d4
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream ( #5064 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7
)
2023-03-04 21:58:59 +08:00
Jan Hentschel
6bc84de563
HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-03 10:40:03 +01:00
Xiaolin Ha
0c85952a8f
HBASE-27458 Use ReadWriteLock for region scanner readpoint map ( #4859 ) ( #5073 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-02 13:49:02 +08:00
Minwoo Kang
13e06c7184
HBASE-23561 acquire lock before update regionsMap ( #1263 )
...
Addendum: tie add and delete of regionMap and encodedRegionsMap
Signed-off-by: stack <stack@apache.org>
2023-03-01 15:10:18 +01:00
Minwoo Kang
5f54d9cbad
HBASE-23561 Look up of Region in Master by encoded region name is O(n) ( #1193 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-01 15:10:18 +01:00
Balazs Meszaros
9a23d4a3b2
HBASE-27673 Fix mTLS client hostname verification ( #5066 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-01 12:20:06 +01:00
Bryan Beaudreault
7fef94a6cd
HBASE-27666 Addendum fix import in test
2023-02-28 14:23:24 -05:00
Bryan Beaudreault
63e3f17c9f
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped ( #5056 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:46 -05:00
okumin
d3e02cb69a
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-28 14:36:25 +01:00
Yuta Imazu
840c62e532
HBASE-24781 Clean up peer metrics when disabling peer ( #4997 )
...
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0
)
2023-02-28 13:35:00 +08:00
Duo Zhang
5b6d9de54c
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes ( #5059 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3
)
2023-02-28 10:02:46 +08:00
Bryan Beaudreault
53d3e78432
HBASE-27650 Merging empty regions corrupts meta cache (branch-2) ( #5038 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:40:19 -05:00
Nick Dimiduk
3b6d8c3394
HBASE-23102: Improper Usage of Map putIfAbsent ( #828 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
2023-02-27 11:23:36 +01:00
Duo Zhang
82c4ccefd3
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file ( #5032 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f
)
2023-02-26 16:18:33 +08:00
Bryan Beaudreault
a6ca9cb61e
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions ( #5058 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 14:53:09 -05:00
tianhang
a571852a09
HBASE-27661 Set size of systable queue in UT ( #5053 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e85
)
2023-02-25 23:38:14 +08:00
Victor
0747f0c934
HBASE-15242: add client side metrics for timeout and remote exceptions. ( #5023 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-24 16:25:41 -08:00
chenglei
3f25f33bc3
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5046 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 18:21:42 +08:00
chenglei
5aab852a6d
Revert "HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5041 )" ( #5045 )
...
This reverts commit f87c6b8505
.
2023-02-20 18:17:20 +08:00
chenglei
f87c6b8505
HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor ( #5041 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:59:45 +08:00
Kerasone
3a5fc6dad6
HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 ( #5034 )
...
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121
)
2023-02-18 10:48:14 +08:00
Bryan Beaudreault
beab1eb208
HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent ( #5031 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 19:18:19 -05:00
tianhang
301dd240c7
HBASE-27643 [JDK17] Add-opens java.util.concurrent ( #5028 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e3
)
2023-02-17 21:17:15 +08:00
tianhang
3b8d7ad512
HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT ( #5029 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 21:12:33 +08:00