Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,641 Commits 95 Branches 866 Tags
Commit Graph

18641 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
lizhexi0928
690ca8c562
[HBASE-27789] Backport "HBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerManager.updatePeerConfig" to branch-2 (#5180) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-14 11:43:31 +01:00
Kota-SH
3dda428417 HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
 2023-04-14 10:36:40 +01:00
Bryan Beaudreault
1e97fbfc9f HBASE-27768 Race conditions in BlockingRpcConnection (#5154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-04-10 15:23:34 -04:00
tianhang
65e579c060 HBASE-27713 Remove numRegions in Region Metrics (#5107) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e4984776e2ee13ae4df1de4c000f35a58ad59)
 2023-04-08 15:09:37 +08:00
Nick Dimiduk
a72b516fb0 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c6486468f6b19f7419c9a263ed81d8bdc7)
 2023-04-08 11:05:42 +08:00
chenglei
045aa9f780
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up (#5162) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-07 15:07:20 +08:00
Andrew Purtell
f8f06fcd0a Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-06 09:09:26 -07:00
Andrew Purtell
2e426ab69d Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.5.4 2.5.4RC0 		2023-04-06 09:09:24 -07:00
Andrew Purtell
7164d6c533 Revert "Preparing development version 2.5.5-SNAPSHOT" 
This reverts commit 0583060305ddc8f0762ef4997fb46a79682e831a.

Revert "Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 0ab2fb24abe823050d253064d5052513df4c9500.

Retry tagging and preparation for 2.5.4RC0 after addressing local release build
errors.
 2023-04-06 09:04:42 -07:00
Andrew Purtell
0583060305 Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:09 -07:00
Andrew Purtell
0ab2fb24ab Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:07 -07:00
Bryan Beaudreault
e9c14e0fbf HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-03 17:08:50 -04:00
Bryan Beaudreault
694752b781 HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-31 09:18:45 -04:00
Rishabh Murarka
9931edb851 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:33:04 +05:30
dependabot[bot]
49baa793cb HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb4338876b8d7da9dcad7383bdf1fc9c90c87)
 2023-03-24 21:57:01 +08:00
Duo Zhang
23ce03c7c5 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50578144d3e0916c33d4532bb8644763)
 2023-03-24 17:45:55 +08:00
Duo Zhang
32f95c4b13 HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a7636958970d37bfcd775fd55e8de98177)
 2023-03-24 16:08:56 +08:00
Xiaolin Ha
17deed9533 HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cbc322b0824d2d755bcf4191c3a525ed)
 2023-03-24 16:08:36 +08:00
Andrew Purtell
e1b58290d1 HBASE-27744 Update compression dependencies (#5137) 
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-23 13:10:31 -07:00
Nick Dimiduk
6024a24957 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 15:15:29 +01:00
Xiaolin Ha
40d2545200 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:11:59 +08:00
xuzifu666
8e2f6f8238 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e848d34db432526dee86289439594510)
 2023-03-21 22:56:55 +08:00
Nick Dimiduk
241c197315 HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2023-03-21 15:23:57 +01:00
Victor
56613517fb
HBASE-27684: add client metrics related to user region lock. (#5081) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
 2023-03-20 22:37:05 -07:00
Nick Dimiduk
85b599b96a HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM 
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2023-03-20 15:37:01 +01:00
Xiaolin Ha
0bc7f56a00
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5124) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 19:26:47 +08:00
chaijunjie0101
c0760d39dc HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a95975580831a31d122c800d01cadac007a)
 2023-03-19 20:19:48 +08:00
slfan1989
e68d0cf159 HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. (#5114) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3c2c685892740af68428f8bb715ca4234b6ff320)
 2023-03-19 20:05:55 +08:00
Nihal Jain
620ab79b59
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired (#5117) ( #5109) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-18 00:08:34 -07:00
Bryan Beaudreault
29c3230da7 HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-17 15:25:06 -04:00
Nick Dimiduk
4156139fda HBASE-27708 CPU hot-spot resolving User subject 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-16 13:57:13 +01:00
Nick Dimiduk
d151af1663
HBASE-27652 Client-side lock contention around Configuration when using read replica regions 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-15 16:08:19 +01:00
Duo Zhang
ffff78a00d HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4ff2b5456c8655558378a127f3274107)
 2023-03-15 10:55:48 +08:00
alan.zhao
becbc3f8b2 HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5097) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50b35eea79921f20dbe6a15f5cfdf492)
 2023-03-15 08:21:39 +08:00
Horváth Dóra
37a8e5b1c2 HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 
(cherry picked from commit 72d5a46899ef0866d777f0a9508649beed6d8dd3)
 2023-03-10 20:29:02 +01:00
Rajeshbabu Chintaguntla
ab8aa62030 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078) 
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468a258b4ee47e40cf3645bf27d66471d)
 2023-03-09 10:58:07 +08:00
huaxiangsun
6e31c18bf2 HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names 
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-08 14:41:48 +01:00
haxiaolin
2cdcab2b9c Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086)" 
This reverts commit 1ac7bbc8f37492c310262548e348632ff271ec81.
 2023-03-06 18:02:34 +08:00
Xiaolin Ha
1ac7bbc8f3
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 14:20:57 +08:00
Xiaolin Ha
6d463f7aab
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression (#5075) (#5084) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 12:53:47 +08:00
alan.zhao
4effc85e44 HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f726dcd65fbfb58f9ea6aa499f2a903c)
 2023-03-04 22:39:03 +08:00
Jan Hentschel
555bf91f2b HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-03 10:45:28 +01:00
Minwoo Kang
cbfdbff841 HBASE-23561 acquire lock before update regionsMap (#1263) 
Addendum: tie add and delete of regionMap and encodedRegionsMap

Signed-off-by: stack <stack@apache.org>
 2023-03-03 10:42:39 +01:00
Minwoo Kang
26dcc133e2 HBASE-23561 Look up of Region in Master by encoded region name is O(n) (#1193) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-03 10:42:39 +01:00
Ruanhui
79a7bf770a
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#5069) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-02 11:24:20 +08:00
Nick Dimiduk
a5d0f2696a HBASE-23102: Improper Usage of Map putIfAbsent (#828) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
 2023-03-01 14:59:49 +01:00
Bryan Beaudreault
faf2ead301 HBASE-27666 Addendum fix import in test 2023-02-28 14:24:00 -05:00
Bryan Beaudreault
21e3fab299 HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-28 14:03:51 -05:00
okumin
16b9bb8557 HBASE-27655 Remove the empty path annotation from ClusterMetricsResource 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-02-28 14:39:21 +01:00
Yuta Imazu
d3264617d3 HBASE-24781 Clean up peer metrics when disabling peer (#4997) 
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0f1a186b1d31f11be26ec95e3588ae2)
 2023-02-28 13:35:14 +08:00