ea82b9c72f
HBASE-27810. Check if the executor has already been shut down before submitting new job ( #5207 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a6e89bf624
2023-04-28 16:48:36 +02:00
4800976ae3
HBASE-27792 Guard Master/RS Dump Servlet behind admin walls ( #5176 )
2023-04-28 20:01:44 +05:30
1b603fad1a
HBASE-27808 Change flatten mode for oss in our pom file ( #5201 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2cfa6822a
2023-04-28 11:40:25 +08:00
d7c5e47767
HBASE-27818 Split TestReplicationDroppedTables ( #5206 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d
2023-04-28 10:00:13 +08:00
3267c76a74
HBASE-20804 Document and add tests for HBaseConfTool ( #5190 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f930894
2023-04-23 23:43:46 +08:00
2980ef4b4b
HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario ( #5198 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e2
2023-04-23 23:34:19 +08:00
4ee389adc4
HBASE-27791 Upgrade vega and its related js libraries ( #5173 )
...
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-18 12:16:09 +02:00
8516bb5c71
HBASE-27796 Improve MemcachedBlockCache ( #5181 )
...
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-17 14:13:19 -07:00
690ca8c562
[HBASE-27789] Backport "HBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerManager.updatePeerConfig" to branch-2 ( #5180 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-14 11:43:31 +01:00
3dda428417
HBASE-27422: Support replication for hbase:acl ( #4827 )
...
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 856fa14537
2023-04-14 10:36:40 +01:00
1e97fbfc9f
HBASE-27768 Race conditions in BlockingRpcConnection ( #5154 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-04-10 15:23:34 -04:00
65e579c060
HBASE-27713 Remove numRegions in Region Metrics ( #5107 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e498477
2023-04-08 15:09:37 +08:00
a72b516fb0
HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion ( #5110 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c648
2023-04-08 11:05:42 +08:00
045aa9f780
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up ( #5162 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-07 15:07:20 +08:00
f8f06fcd0a
Preparing development version 2.5.5-SNAPSHOT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-04-06 09:09:26 -07:00
2e426ab69d
Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-04-06 09:09:24 -07:00
7164d6c533
Revert "Preparing development version 2.5.5-SNAPSHOT"
...
This reverts commit 05830603050ab2fb24ab
2023-04-06 09:04:42 -07:00
0583060305
Preparing development version 2.5.5-SNAPSHOT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-04-05 22:07:09 -07:00
0ab2fb24ab
Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-04-05 22:07:07 -07:00
e9c14e0fbf
HBASE-27704 Quotas can drastically overflow configured limit ( #5153 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-03 17:08:50 -04:00
694752b781
HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl ( #5149 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-31 09:18:45 -04:00
9931edb851
HBASE-27726 Handling of ruby shell SyntaxError exceptions ( #5147 )
...
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
2023-03-29 14:33:04 +05:30
49baa793cb
HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 ( #5136 )
...
Bumps [jettison](https://github.com/jettison-json/jettison ) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases )
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4 )
---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb43388
2023-03-24 21:57:01 +08:00
23ce03c7c5
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory ( #5119 )
...
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.
Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50
2023-03-24 17:45:55 +08:00
32f95c4b13
HBASE-26866 Shutdown WAL may abort region server ( #4254 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a763
2023-03-24 16:08:56 +08:00
17deed9533
HBASE-26526 Introduce a timeout to shutdown of WAL ( #3297 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cb
2023-03-24 16:08:36 +08:00
e1b58290d1
HBASE-27744 Update compression dependencies ( #5137 )
...
Update compression codec dependencies:
- aircompressor 0.21 -> 0.24
- brotli4j 1.8.0 -> 1.11.0
- snappy 1.1.8.4 -> 1.1.9.1
- zstd-jni 1.5.0-4 -> 1.5.4-2
and add a new supplemental model for new brotli4j dependency.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-23 13:10:31 -07:00
6024a24957
HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon
...
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.
https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-22 15:15:29 +01:00
40d2545200
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues ( #5074 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:11:59 +08:00
8e2f6f8238
HBASE-27736 HFileSystem.getLocalFs is not used ( #5125 )
...
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e8
2023-03-21 22:56:55 +08:00
241c197315
HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2023-03-21 15:23:57 +01:00
56613517fb
HBASE-27684: add client metrics related to user region lock. ( #5081 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
2023-03-20 22:37:05 -07:00
85b599b96a
HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM
...
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.
`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2023-03-20 15:37:01 +01:00
0bc7f56a00
HBASE-27646 Should not use pread when prefetching in HFilePreadReader ( #5063 ) ( #5124 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-20 19:26:47 +08:00
c0760d39dc
HBASE-27718 The regionStateNode only need remove once in regionOffline ( #5106 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a9597
2023-03-19 20:19:48 +08:00
e68d0cf159
HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. ( #5114 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3c2c685892
2023-03-19 20:05:55 +08:00
620ab79b59
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired ( #5117 ) ( #5109 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-18 00:08:34 -07:00
29c3230da7
HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers ( #5115 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-17 15:25:06 -04:00
4156139fda
HBASE-27708 CPU hot-spot resolving User subject
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-16 13:57:13 +01:00
d151af1663
HBASE-27652 Client-side lock contention around Configuration when using read replica regions
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-15 16:08:19 +01:00
ffff78a00d
HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations ( #5101 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4f
2023-03-15 10:55:48 +08:00
becbc3f8b2
HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 ( #5097 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50
2023-03-15 08:21:39 +08:00
37a8e5b1c2
HBASE-27685 Enable code coverage reporting to SonarQube in HBase ( #5076 )
...
(cherry picked from commit 72d5a46899
2023-03-10 20:29:02 +01:00
ab8aa62030
HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner ( #5078 )
...
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468
2023-03-09 10:58:07 +08:00
6e31c18bf2
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
...
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-08 14:41:48 +01:00
2cdcab2b9c
Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 ) ( #5086 )"
...
This reverts commit 1ac7bbc8f3
2023-03-06 18:02:34 +08:00
1ac7bbc8f3
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read ( #4536 ) ( #5086 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 14:20:57 +08:00
6d463f7aab
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression ( #5075 ) ( #5084 )
...
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 12:53:47 +08:00
4effc85e44
HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream ( #5064 )
...
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7
2023-03-04 22:39:03 +08:00
555bf91f2b
HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-03 10:45:28 +01:00
Andor Molnár
Nihal Jain
Nick Dimiduk
Duo Zhang
haosen chen
Andrew Purtell
lizhexi0928
Kota-SH
Bryan Beaudreault
tianhang
chenglei
Rishabh Murarka
dependabot[bot]
Xiaolin Ha
xuzifu666
Victor
chaijunjie0101
slfan1989
alan.zhao
Horváth Dóra
Rajeshbabu Chintaguntla
huaxiangsun
Jan Hentschel