753eaefa29
HBASE-27726 Handling of ruby shell SyntaxError exceptions ( #5147 )
...
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
2023-03-29 14:23:15 +05:30
45e3451997
HBASE-27333 Abort RS when the hostname is different from master seen ( #4732 ) ( #5148 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-03-29 11:42:32 +08:00
e33afb4524
HBASE-27532 Add block bytes scanned metrics ( #5146 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-28 13:56:37 -04:00
61e18a3d6c
HBASE-27750: Update the list of prefetched Hfiles upon block eviction ( #5140 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-03-27 10:57:57 +01:00
6d9ac13f80
HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 ( #5136 )
...
Bumps [jettison](https://github.com/jettison-json/jettison ) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases )
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4 )
---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb43388
2023-03-24 21:56:49 +08:00
17d15a135a
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory ( #5119 )
...
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.
Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50
2023-03-24 17:43:30 +08:00
3b24b3b969
HBASE-26866 Shutdown WAL may abort region server ( #4254 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a763
2023-03-24 15:59:29 +08:00
62fc8c81a3
HBASE-26526 Introduce a timeout to shutdown of WAL ( #3297 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cb
2023-03-24 15:58:49 +08:00
dd3cdf13cf
HBASE-27744 Update compression dependencies ( #5137 )
...
Update compression codec dependencies:
- aircompressor 0.21 -> 0.24
- brotli4j 1.8.0 -> 1.11.0
- snappy 1.1.8.4 -> 1.1.9.1
- zstd-jni 1.5.0-4 -> 1.5.4-2
and add a new supplemental model for new brotli4j dependency.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-23 13:10:28 -07:00
29ca26a765
HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon
...
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.
https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-22 14:24:07 +01:00
d4edfe404e
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues ( #5074 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:10:56 +08:00
a10cbf8319
HBASE-27736 HFileSystem.getLocalFs is not used ( #5125 )
...
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e8
2023-03-21 22:55:16 +08:00
29dfd005cf
HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2023-03-21 15:23:43 +01:00
ff9754049b
HBASE-27684: add client metrics related to user region lock. ( #5081 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
2023-03-20 22:36:08 -07:00
e7a958a45f
HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM
...
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.
`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2023-03-20 15:36:33 +01:00
873f8987f1
HBASE-27646 Should not use pread when prefetching in HFilePreadReader ( #5063 ) ( #5122 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 19:26:17 +08:00
81dffda0d3
HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl' config ( #5096 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 997d132601
2023-03-20 11:05:02 +08:00
a6b99faa00
HBASE-27718 The regionStateNode only need remove once in regionOffline ( #5106 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a9597
2023-03-19 20:19:37 +08:00
8f6d6b9ec3
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. ( #5114 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3c2c685892
2023-03-19 20:05:44 +08:00
b1a00be1bc
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired ( #5117 ) ( #5109 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-18 00:07:16 -07:00
5de1e4f88e
HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers ( #5115 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-17 15:24:28 -04:00
d136c6d7c5
HBASE-27686: Recovery of BucketCache and Prefetched data after RS Crash ( #5080 )
...
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 58cb1f4799
2023-03-16 15:44:59 +00:00
59434e9cd4
HBASE-27708 CPU hot-spot resolving User subject
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-16 13:57:02 +01:00
dbb78388e5
HBASE-27652 Client-side lock contention around Configuration when using read replica regions ( #5036 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-15 16:07:48 +01:00
ef8a981f22
HBASE-27715 Refactoring the long tryAdvanceEntry method in WALEntryStream ( #5105 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 1f2e1f5b3a
2023-03-15 21:49:45 +08:00
b5dcd48c64
HBASE-27716 Fix TestWALOpenAfterDNRollingStart ( #5102 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit c8bee238fc
2023-03-15 11:03:59 +08:00
e051400a6d
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations ( #5101 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4f
2023-03-15 10:53:46 +08:00
6920e72f50
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 ( #5097 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-15 08:17:18 +08:00
24653dd105
HBASE-27615 Add group of regionServer on Master webUI ( #5098 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-14 11:55:18 +08:00
0f67503b9d
HBASE-27685 Enable code coverage reporting to SonarQube in HBase ( #5076 )
...
(cherry picked from commit 72d5a46899
2023-03-10 20:16:08 +01:00
cec0556263
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication ( #5055 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit e48c4485db
2023-03-10 23:03:17 +08:00
e180aa10df
HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner ( #5078 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468
2023-03-09 10:49:42 +08:00
43fc4bfcd8
HBASE-27681 Refactor Table Latency Metrics ( #5093 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-08 10:13:14 -05:00
9a69a69648
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
...
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-06 11:02:12 +01:00
1ac6f1689f
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 ) ( #5085 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 14:21:22 +08:00
505a901fed
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression ( #5075 ) ( #5083 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 12:53:30 +08:00
f1e970d3d4
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream ( #5064 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7
2023-03-04 21:58:59 +08:00
6bc84de563
HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-03 10:40:03 +01:00
0c85952a8f
HBASE-27458 Use ReadWriteLock for region scanner readpoint map ( #4859 ) ( #5073 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-02 13:49:02 +08:00
13e06c7184
HBASE-23561 acquire lock before update regionsMap ( #1263 )
...
Addendum: tie add and delete of regionMap and encodedRegionsMap
Signed-off-by: stack <stack@apache.org>
2023-03-01 15:10:18 +01:00
5f54d9cbad
HBASE-23561 Look up of Region in Master by encoded region name is O(n) ( #1193 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-01 15:10:18 +01:00
9a23d4a3b2
HBASE-27673 Fix mTLS client hostname verification ( #5066 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-01 12:20:06 +01:00
7fef94a6cd
HBASE-27666 Addendum fix import in test
2023-02-28 14:23:24 -05:00
63e3f17c9f
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped ( #5056 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:46 -05:00
d3e02cb69a
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-28 14:36:25 +01:00
840c62e532
HBASE-24781 Clean up peer metrics when disabling peer ( #4997 )
...
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0
2023-02-28 13:35:00 +08:00
5b6d9de54c
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes ( #5059 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3
2023-02-28 10:02:46 +08:00
53d3e78432
HBASE-27650 Merging empty regions corrupts meta cache (branch-2) ( #5038 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:40:19 -05:00
3b6d8c3394
HBASE-23102: Improper Usage of Map putIfAbsent ( #828 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
2023-02-27 11:23:36 +01:00
82c4ccefd3
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file ( #5032 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f
2023-02-26 16:18:33 +08:00
Rishabh Murarka
Xiaolin Ha
Bryan Beaudreault
Kota-SH
dependabot[bot]
Duo Zhang
Andrew Purtell
Nick Dimiduk
xuzifu666
Victor
chaijunjie0101
slfan1989
Nihal Jain
alan.zhao
tianhang
Horváth Dóra
Rajeshbabu Chintaguntla
huaxiangsun
Jan Hentschel
Minwoo Kang
Balazs Meszaros
Bryan Beaudreault
okumin
Yuta Imazu