Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,634 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18634 Commits

Author SHA1 Message Date
Andrew Purtell 2e426ab69d Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-06 09:09:24 -07:00
Andrew Purtell 7164d6c533 Revert "Preparing development version 2.5.5-SNAPSHOT" 
This reverts commit 0583060305.

Revert "Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 0ab2fb24ab.

Retry tagging and preparation for 2.5.4RC0 after addressing local release build
errors.
 2023-04-06 09:04:42 -07:00
Andrew Purtell 0583060305 Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:09 -07:00
Andrew Purtell 0ab2fb24ab Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:07 -07:00
Bryan Beaudreault e9c14e0fbf HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-03 17:08:50 -04:00
Bryan Beaudreault 694752b781 HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-31 09:18:45 -04:00
Rishabh Murarka 9931edb851 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:33:04 +05:30
dependabot[bot] 49baa793cb HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb43388)
 2023-03-24 21:57:01 +08:00
Duo Zhang 23ce03c7c5 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50)
 2023-03-24 17:45:55 +08:00
Duo Zhang 32f95c4b13 HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a763)
 2023-03-24 16:08:56 +08:00
Xiaolin Ha 17deed9533 HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cb)
 2023-03-24 16:08:36 +08:00
Andrew Purtell e1b58290d1 HBASE-27744 Update compression dependencies (#5137) 
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-23 13:10:31 -07:00
Nick Dimiduk 6024a24957 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 15:15:29 +01:00
Xiaolin Ha 40d2545200 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:11:59 +08:00
xuzifu666 8e2f6f8238 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e8)
 2023-03-21 22:56:55 +08:00
Nick Dimiduk 241c197315 HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2023-03-21 15:23:57 +01:00
Victor 56613517fb
HBASE-27684: add client metrics related to user region lock. (#5081) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
 2023-03-20 22:37:05 -07:00
Nick Dimiduk 85b599b96a HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM 
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2023-03-20 15:37:01 +01:00
Xiaolin Ha 0bc7f56a00
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5124) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 19:26:47 +08:00
chaijunjie0101 c0760d39dc HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a9597)
 2023-03-19 20:19:48 +08:00
slfan1989 e68d0cf159 HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. (#5114) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3c2c685892)
 2023-03-19 20:05:55 +08:00
Nihal Jain 620ab79b59
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired (#5117) ( #5109) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-18 00:08:34 -07:00
Bryan Beaudreault 29c3230da7 HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-17 15:25:06 -04:00
Nick Dimiduk 4156139fda HBASE-27708 CPU hot-spot resolving User subject 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-16 13:57:13 +01:00
Nick Dimiduk d151af1663
HBASE-27652 Client-side lock contention around Configuration when using read replica regions 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-15 16:08:19 +01:00
Duo Zhang ffff78a00d HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4f)
 2023-03-15 10:55:48 +08:00
alan.zhao becbc3f8b2 HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5097) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50)
 2023-03-15 08:21:39 +08:00
Horváth Dóra 37a8e5b1c2 HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 
(cherry picked from commit 72d5a46899)
 2023-03-10 20:29:02 +01:00
Rajeshbabu Chintaguntla ab8aa62030 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078) 
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468)
 2023-03-09 10:58:07 +08:00
huaxiangsun 6e31c18bf2 HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names 
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-08 14:41:48 +01:00
haxiaolin 2cdcab2b9c Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086)" 
This reverts commit 1ac7bbc8f3.
 2023-03-06 18:02:34 +08:00
Xiaolin Ha 1ac7bbc8f3
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 14:20:57 +08:00
Xiaolin Ha 6d463f7aab
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression (#5075) (#5084) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 12:53:47 +08:00
alan.zhao 4effc85e44 HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7)
 2023-03-04 22:39:03 +08:00
Jan Hentschel 555bf91f2b HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-03 10:45:28 +01:00
Minwoo Kang cbfdbff841 HBASE-23561 acquire lock before update regionsMap (#1263) 
Addendum: tie add and delete of regionMap and encodedRegionsMap

Signed-off-by: stack <stack@apache.org>
 2023-03-03 10:42:39 +01:00
Minwoo Kang 26dcc133e2 HBASE-23561 Look up of Region in Master by encoded region name is O(n) (#1193) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-03 10:42:39 +01:00
Ruanhui 79a7bf770a
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#5069) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-02 11:24:20 +08:00
Nick Dimiduk a5d0f2696a HBASE-23102: Improper Usage of Map putIfAbsent (#828) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
 2023-03-01 14:59:49 +01:00
Bryan Beaudreault faf2ead301 HBASE-27666 Addendum fix import in test 2023-02-28 14:24:00 -05:00
Bryan Beaudreault 21e3fab299 HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-28 14:03:51 -05:00
okumin 16b9bb8557 HBASE-27655 Remove the empty path annotation from ClusterMetricsResource 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-02-28 14:39:21 +01:00
Yuta Imazu d3264617d3 HBASE-24781 Clean up peer metrics when disabling peer (#4997) 
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0)
 2023-02-28 13:35:14 +08:00
Duo Zhang c319c6f0a3 HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3)
 2023-02-28 10:08:19 +08:00
Bryan Beaudreault a3ed4a19d7 HBASE-27650 Merging empty regions corrupts meta cache (branch-2) (#5038) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-27 20:41:04 -05:00
Duo Zhang c29355ecd7 HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
 2023-02-26 16:26:45 +08:00
Bryan Beaudreault 683c37e262 HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5058) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-25 15:13:28 -05:00
tianhang 32d33735df HBASE-27661 Set size of systable queue in UT (#5053) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e85)
 2023-02-25 23:38:26 +08:00
Victor 7cb4a58bb1 HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-02-24 16:29:22 -08:00
chenglei 3dd64aa051
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5044) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-02-20 18:16:08 +08:00