Commit Graph

19744 Commits

Author SHA1 Message Date
Andrew Purtell 3e08f9230c
HBASE-27744 Update compression dependencies (#5137)
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-23 13:05:55 -07:00
Peter Somogyi 18ba51afcb
HBASE-27745 Document protoc workarounds with Apple Silicon (#5139)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-23 17:19:35 +01:00
Xiaolin Ha 7d6a79b768
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:07:31 +08:00
Wes e6af6e0be9
HBASE-27731 Upgrade commons-validator to 1.7 (#5116)
Address CVE-2014-0114 and CVE-2019-10086 brought in by commons-beanutils
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-21 22:48:39 +08:00
xuzifu666 dd3b1630e8
HBASE-27736 HFileSystem.getLocalFs is not used (#5125)
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-21 22:46:15 +08:00
Nick Dimiduk 52e69daaea
HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64
Signed-off-by: Sean Busbey <busbey@apache.org>
2023-03-21 10:14:27 +01:00
Nick Dimiduk 814f3267d7
HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2023-03-20 14:58:15 +01:00
Duo Zhang 0110bf3a6e
HBASE-27722 Update documentation about how to enable encryption on WAL (#5120)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-20 18:49:51 +08:00
Xiaolin Ha 201846b726
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 12:44:01 +08:00
Duo Zhang 997d132601
HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl' config (#5096)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-20 10:36:14 +08:00
chaijunjie0101 e6977a9597
HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-19 20:14:52 +08:00
slfan1989 3c2c685892
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. (#5114)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-19 19:58:20 +08:00
Nihal Jain d5c86243e1
HBASE-27671 Client should not be able to restore/clone a snapshot aft… (#5109)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-18 00:06:28 -07:00
Bryan Beaudreault 1673762741
HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5104)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-17 08:05:31 -04:00
Kota-SH 58cb1f4799
HBASE-27686: Recovery of BucketCache and Prefetched data after RS Crash (#5080)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2023-03-16 14:27:55 +00:00
Nick Dimiduk 22b0c3e2bd
HBASE-27708 CPU hot-spot resolving User subject
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-16 09:15:45 +01:00
tianhang b0cfd74edd Add tianhang to the developer list 2023-03-16 10:47:32 +08:00
Duo Zhang 1f2e1f5b3a
HBASE-27715 Refactoring the long tryAdvanceEntry method in WALEntryStream (#5105)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-03-15 21:47:25 +08:00
Duo Zhang c8bee238fc
HBASE-27716 Fix TestWALOpenAfterDNRollingStart (#5102)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-15 10:40:03 +08:00
Duo Zhang ce7b1d4e4f
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-15 10:39:33 +08:00
Frens Jan Rumph c2b64e7caa
HBASE-27701 Fix a misspelling of the ZstdCodec in compression documentation (#5095)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-13 10:29:02 +01:00
Horváth Dóra 72d5a46899
HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 2023-03-10 20:14:43 +01:00
Duo Zhang e48c4485db
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication (#5055)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2023-03-10 21:54:20 +08:00
alan.zhao c013c7c72c
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5082)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-10 21:45:44 +08:00
tianhang 0491524eb1
HBASE-27615 Add group of regionServer on Master webUI (#5010)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-09 17:10:11 +08:00
Rajeshbabu Chintaguntla bc8b13e468
HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-09 10:46:25 +08:00
tianhang 8bdabed85c
HBASE-27690 Fix a misspell in TestRegionStateStore (#5090)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-08 23:23:50 +08:00
tianhang 13e11a46c6
HBASE-27681 Addendum delete old metric classes (#5092)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-08 09:30:22 -05:00
tianhang 16864c705c
HBASE-27681 Refactor Table Latency Metrics (#5072)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-07 12:03:37 -05:00
Duo Zhang 586073d0c0
HBASE-27689 Update README.md about how to request a jira account (#5088)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-07 10:13:24 +08:00
Xiaolin Ha 37858bb6b0
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 11:52:20 +08:00
Xiaolin Ha 3eedc0987a
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression (#5075)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 11:42:50 +08:00
alan.zhao 59fdaa28f7
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-04 21:46:45 +08:00
Bryan Beaudreault d2b0074f7a
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:01 -05:00
Balazs Meszaros 43aa9b33f1
HBASE-27673 Fix mTLS client hostname verification (#5065)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-28 18:39:47 +01:00
Yuta Imazu ef6a1130d0
HBASE-24781 Clean up peer metrics when disabling peer (#4997)
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
2023-02-28 13:13:49 +08:00
Duo Zhang d1fede72c3
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-28 09:47:37 +08:00
Bryan Beaudreault 8d70786a2d HBASE-27650 Addendum reduce log to debug 2023-02-27 13:23:11 -05:00
tianhang 4bee21e96b
HBASE-27660 Ignore invalid hostname when getNetworkInterfaces (#5052)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:11:42 +08:00
okumin 10037df035
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-27 11:13:54 +01:00
Bryan Beaudreault f20efafbc1
HBASE-27650 Merging empty regions corrupts meta cache (#5037)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-26 16:39:48 -05:00
Duo Zhang 4a9cf99b2f
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-26 16:14:25 +08:00
Bryan Beaudreault 4b7815d552
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5058)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 14:35:44 -05:00
Bryan Beaudreault 6b672cc071
Revert "HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5047)" (#5057)
This reverts commit 82c7dbd488.
2023-02-25 12:13:38 -05:00
Bryan Beaudreault 82c7dbd488
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5047)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 12:10:40 -05:00
tianhang bc31e68e85
HBASE-27661 Set size of systable queue in UT (#5053)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 23:15:09 +08:00
Victor 36bb0d1f6c
HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-24 16:25:01 -08:00
huaxiangsun 22dbb7afc3
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-02-21 13:47:27 +01:00
chenglei cf179d3fb9
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5039)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:42:00 +08:00
Kerasone 5f0dcdd121
HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 (#5034)
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-18 10:46:09 +08:00