Commit Graph

19749 Commits

Author SHA1 Message Date
Kota-SH a6dad700db
HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-03-27 10:49:55 +01:00
dependabot[bot] 735fb43388 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-24 21:55:02 +08:00
Duo Zhang de91a8d83a Revert "Bump jettison from 1.5.2 to 1.5.4 (#5136)"
This reverts commit 6cc6182646.
2023-03-24 21:54:53 +08:00
dependabot[bot] 6cc6182646
Bump jettison from 1.5.2 to 1.5.4 (#5136)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-24 21:54:23 +08:00
Duo Zhang 230fdc0b50
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119)
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-24 14:17:39 +08:00
Andrew Purtell 3e08f9230c
HBASE-27744 Update compression dependencies (#5137)
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-23 13:05:55 -07:00
Peter Somogyi 18ba51afcb
HBASE-27745 Document protoc workarounds with Apple Silicon (#5139)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-23 17:19:35 +01:00
Xiaolin Ha 7d6a79b768
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:07:31 +08:00
Wes e6af6e0be9
HBASE-27731 Upgrade commons-validator to 1.7 (#5116)
Address CVE-2014-0114 and CVE-2019-10086 brought in by commons-beanutils
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-21 22:48:39 +08:00
xuzifu666 dd3b1630e8
HBASE-27736 HFileSystem.getLocalFs is not used (#5125)
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-21 22:46:15 +08:00
Nick Dimiduk 52e69daaea
HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64
Signed-off-by: Sean Busbey <busbey@apache.org>
2023-03-21 10:14:27 +01:00
Nick Dimiduk 814f3267d7
HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2023-03-20 14:58:15 +01:00
Duo Zhang 0110bf3a6e
HBASE-27722 Update documentation about how to enable encryption on WAL (#5120)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-20 18:49:51 +08:00
Xiaolin Ha 201846b726
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 12:44:01 +08:00
Duo Zhang 997d132601
HBASE-27702 Remove 'hbase.regionserver.hlog.writer.impl' config (#5096)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-20 10:36:14 +08:00
chaijunjie0101 e6977a9597
HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-19 20:14:52 +08:00
slfan1989 3c2c685892
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. (#5114)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-19 19:58:20 +08:00
Nihal Jain d5c86243e1
HBASE-27671 Client should not be able to restore/clone a snapshot aft… (#5109)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-18 00:06:28 -07:00
Bryan Beaudreault 1673762741
HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5104)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-17 08:05:31 -04:00
Kota-SH 58cb1f4799
HBASE-27686: Recovery of BucketCache and Prefetched data after RS Crash (#5080)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2023-03-16 14:27:55 +00:00
Nick Dimiduk 22b0c3e2bd
HBASE-27708 CPU hot-spot resolving User subject
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-16 09:15:45 +01:00
tianhang b0cfd74edd Add tianhang to the developer list 2023-03-16 10:47:32 +08:00
Duo Zhang 1f2e1f5b3a
HBASE-27715 Refactoring the long tryAdvanceEntry method in WALEntryStream (#5105)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-03-15 21:47:25 +08:00
Duo Zhang c8bee238fc
HBASE-27716 Fix TestWALOpenAfterDNRollingStart (#5102)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-15 10:40:03 +08:00
Duo Zhang ce7b1d4e4f
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2023-03-15 10:39:33 +08:00
Frens Jan Rumph c2b64e7caa
HBASE-27701 Fix a misspelling of the ZstdCodec in compression documentation (#5095)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-13 10:29:02 +01:00
Horváth Dóra 72d5a46899
HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 2023-03-10 20:14:43 +01:00
Duo Zhang e48c4485db
HBASE-27632 Refactor WAL.Reader implementation so we can better support WAL splitting and replication (#5055)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2023-03-10 21:54:20 +08:00
alan.zhao c013c7c72c
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5082)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-10 21:45:44 +08:00
tianhang 0491524eb1
HBASE-27615 Add group of regionServer on Master webUI (#5010)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-09 17:10:11 +08:00
Rajeshbabu Chintaguntla bc8b13e468
HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-09 10:46:25 +08:00
tianhang 8bdabed85c
HBASE-27690 Fix a misspell in TestRegionStateStore (#5090)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-08 23:23:50 +08:00
tianhang 13e11a46c6
HBASE-27681 Addendum delete old metric classes (#5092)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-08 09:30:22 -05:00
tianhang 16864c705c
HBASE-27681 Refactor Table Latency Metrics (#5072)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-07 12:03:37 -05:00
Duo Zhang 586073d0c0
HBASE-27689 Update README.md about how to request a jira account (#5088)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-07 10:13:24 +08:00
Xiaolin Ha 37858bb6b0
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 11:52:20 +08:00
Xiaolin Ha 3eedc0987a
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression (#5075)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 11:42:50 +08:00
alan.zhao 59fdaa28f7
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-04 21:46:45 +08:00
Bryan Beaudreault d2b0074f7a
HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:02:01 -05:00
Balazs Meszaros 43aa9b33f1
HBASE-27673 Fix mTLS client hostname verification (#5065)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-28 18:39:47 +01:00
Yuta Imazu ef6a1130d0
HBASE-24781 Clean up peer metrics when disabling peer (#4997)
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
2023-02-28 13:13:49 +08:00
Duo Zhang d1fede72c3
HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-28 09:47:37 +08:00
Bryan Beaudreault 8d70786a2d HBASE-27650 Addendum reduce log to debug 2023-02-27 13:23:11 -05:00
tianhang 4bee21e96b
HBASE-27660 Ignore invalid hostname when getNetworkInterfaces (#5052)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:11:42 +08:00
okumin 10037df035
HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-27 11:13:54 +01:00
Bryan Beaudreault f20efafbc1
HBASE-27650 Merging empty regions corrupts meta cache (#5037)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-26 16:39:48 -05:00
Duo Zhang 4a9cf99b2f
HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-02-26 16:14:25 +08:00
Bryan Beaudreault 4b7815d552
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5058)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 14:35:44 -05:00
Bryan Beaudreault 6b672cc071
Revert "HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5047)" (#5057)
This reverts commit 82c7dbd488.
2023-02-25 12:13:38 -05:00
Bryan Beaudreault 82c7dbd488
HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5047)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 12:10:40 -05:00