18689 Commits

Author SHA1 Message Date
Wellington Ramos Chevreuil
7eae2c4707 HBASE-27871 Meta replication stuck forever if wal it's still reading gets rolled and deleted 2023-06-07 11:39:59 +01:00
Xiaolin Ha
50a6249731 HBASE-27897 ConnectionImplementation#locateRegionInMeta should pause and retry when taking user region lock failed ()
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-06-07 17:20:50 +08:00
Jack-cc
556e11d9ad HBASE-27899 Beautify the output information of the getStats method in ReplicationSource ()
Signed-off-by: 874645213@qq.com <jiancong123~>
Co-authored-by: 874645213@qq.com <jiancong123~>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3df01ea9b6de69de38bd82304c37ee274839d91f)
2023-06-06 22:21:27 +08:00
Andrew Purtell
8b28410fa9 Preparing development version 2.5.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-06-01 17:40:43 -07:00
Andrew Purtell
7ebd438126 Preparing hbase release 2.5.5RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2.5.5RC0
2023-06-01 17:40:41 -07:00
Andrew Purtell
c759f7244c Revert "Preparing development version 2.5.6-SNAPSHOT"
This reverts commit 8fcfe91a24aa86b3cd9ea9b93d11416c0f1a9afe.

Revert "Preparing hbase release 2.5.5RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 429b34a969beeaaaaf6cb97726ef8ec3cd5e746b.

Preparing to restage 2.5.5RC0.
2023-06-01 14:48:32 -07:00
Rahul Agarkar
aec67c3796 HBASE-27820: HBase is not starting due to Jersey library conflicts wi… ()
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Ankit Singhal <ankit@apache.org>

(cherry picked from commit 7cc15fc92b62877d91bbb8d653f02ead4d901900)
2023-05-31 12:46:25 +01:00
Duo Zhang
86faefab45 HBASE-27793 Addendum fix spotless issue
(cherry picked from commit abc517f75abc062581a9cf355099c1ddc487f1e7)
2023-05-27 22:02:16 +08:00
Andrew Purtell
8fcfe91a24 Preparing development version 2.5.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-05-26 17:48:02 -07:00
Andrew Purtell
429b34a969 Preparing hbase release 2.5.5RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-05-26 17:48:00 -07:00
Andrew Purtell
be0ae6282e HBASE-27872 xerial's snappy-java requires GLIBC >= 2.32 ()
We need to add a native library load check with a helpful error message
if xerial snappy fails to initialize due to a too old glibc or similar
reason, and disable the unit test if the native library fails to load.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-05-25 17:06:36 -07:00
Andrew Purtell
a4bb461e32 HBASE-27867 Close the L1 victim handler race ()
When we evict a block from L1 and move it to L2 there is a brief window of
time where we have removed the block from the L1 map and yet the victim
handler has not completed execution. Some read-your-write use cases can be
significantly impacted even though the window is small.

Victim handling can be made atomic with respect to the unmapping operation.
The upside is there will be no L1+L2 misses during the transition. The
downside is if the victim handler takes a long time to execute – currently
they are all very fast, so only a theoretical risk – then other removals or
insertions in L1 can block until it completes.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-05-25 16:47:06 -07:00
Andrew Purtell
e43fdc7501 HBASE-27843 If moveAndClose fails HFileArchiver should delete any incomplete archive side changes ()
When HFiles are placed on a filesystem other than HDFS a rename operation can be
a non-atomic file copy operation. It can take a long time to copy a large hfile
and if interrupted there may be a partially copied file present at the destination.

If we fail to “rename” the files into the archive we will continue to fail
indefinitely. Before larger changes are considered, perhaps to StoreFileTracker, we
should mitigate this problem.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-05-25 15:44:06 -07:00
Rajeshbabu Chintaguntla
be5b219595 HBASE-27793 Make HBCK be able to report unknown servers ()
Co-authored-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
2023-05-25 10:25:14 +05:30
Shuhei Yamasaki
bc64a1bc99 HBASE-27876 Only generate SBOM when releasing ()
Move CycloneDX plugin to profile section

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 256e5e9cd8d36c6cc25e3d0b100929ac974e2093)
2023-05-24 23:25:17 +08:00
dependabot[bot]
ae6cc59faa HBASE-27880 Bump requests from 2.28.1 to 2.31.0 in /dev-support/flaky-tests ()
Bumps [requests](https://github.com/psf/requests) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 22526a6339afa230679bcf08fa1c917b04cdac6d)
(cherry picked from commit 6aeaaa119869b202fdf3d5aa3bb85ef344e37eb8)
2023-05-23 22:58:34 +08:00
Duo Zhang
f5d6fa026f HBASE-27277 TestRaceBetweenSCPAndTRSP fails in pre commit ()
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dc30ca552b37c864b962fbeaaed548523f30573b)
2023-05-23 22:50:29 +08:00
Wellington Ramos Chevreuil
1285952c24 HBASE-27874 Problem in flakey generated report causes pre-commit run to fail ()
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewew-by: Kota-SH <shanmukhaharipriya@gmail.com>
(cherry picked from commit 0ba562ab4d2045e7377e8dea9dff94fb560b3ab3)
2023-05-22 14:48:57 +08:00
Shuhei Yamasaki
cbdf2f2d16 HBASE-27634 Builds emit errors related to SBOM parsing ()
Update CycloneDX version

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 49bdf6140eabcdbe2b1619bfb0f4de7f69b32c15)
2023-05-21 19:52:47 +08:00
guluo
91dd29e869 HBASE-27848:Should fast-fail if unmatched column family exists when using ImportTsv ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit ce29f97a809a849bf067fa3571fd775fb596fc10)
2023-05-21 19:48:58 +08:00
Duo Zhang
4f50c30537 HBASE-27870 Eliminate the 'WARNING: package jdk.internal.util.random not in java.base' when running UTs with jdk11 ()
Signed-off-by: Tianhang Tang <tianhang@apache.org>
(cherry picked from commit 71d7996047001d0be56915bbabed1fb0e552192b)
2023-05-18 23:19:41 +08:00
Duo Zhang
fbaddab84b HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge ()
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8b8c684bcc0060af0d9244dba86b6a46d2cdc30e)
2023-05-15 10:44:28 +08:00
Duo Zhang
b2e4d3bb8d HBASE-27865 TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule ()
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit fd4f984d87dc189f7afc6ddc50d5373e23b46ad5)
2023-05-15 10:44:21 +08:00
Duo Zhang
dcb81d0c20 HBASE-27863 Add hadoop 3.3.5 check in our personality script ()
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b28feeb989bec9709fcfbaa5066669cedea77bda)
2023-05-15 10:44:13 +08:00
Jonathan Albrecht
39ecb3d2f4 HBASE-27858 Update surefire version to 3.1.0 and use SurefireForkNodeFactory ()
Surefire version updated from 3.0.0-M6 -> 3.1.0.

SurefireForkNodeFactory is a new strategy to control how the forked
nodes communicate with the main maven process. It uses a tcp channel
instead of pipes and fixes some corrupted messages seen in the s390x
build.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 67612cc264dd44845e0797178e0b7678376b7cbe)
2023-05-13 19:01:33 +08:00
Shuhei Yamasaki
f66e141e5e HBASE-27860 Fix build error against Hadoop 3.3.5 ()
Add packages for hadoop-3.3.5

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bee09bbd61e077fd398cd534ed28e2305a66c85c)
2023-05-13 09:08:49 +08:00
Jonathan Albrecht
200e598e1b HBASE-27857 Fix timeout exception handling in HBaseClassTestRule. ()
HBaseClassTestRule applies a timeout and a system exit rule to tests.
The timeout rule throws an exception if it hits the timeout threshold.
Since the timeout rule is applied after the system exit rule, the
system exit rule does not see the exception and does not re-enable
the system exit behavior which can cause maven to hang on some
tests.

This change applies the timeout rule before the system exit rule so
that normal system exit can be restored before the surefire forked
node is shutdown.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 220eacf7c56f00a9c8746295fbc46db8a7a66da2)
2023-05-13 09:08:20 +08:00
Ruanhui
7140c29166 HBASE-27844 changed type names to avoid conflicts with built-in types ()
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d49df8b7a96cbeca60c09f837f2cd4f2067f9ddf)
2023-05-08 23:22:09 +08:00
Jonathan Albrecht
cf8e6aa172 HBASE-27838 Update zstd-jni from version 1.5.4-2 -> 1.5.5-2. ()
Note: This version includes a fix that prevented zstd-jni from
running on s390x.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5d2b6956e58f87289e48e58d4d34de7afc661406)
2023-05-05 12:03:01 +08:00
Bryan Beaudreault
064595b3c1
HBASE-26646 WALPlayer should obtain token from filesystem ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Co-authored-by: meiyi <myimeiyi@gmail.com>
2023-05-04 14:43:09 -04:00
Ray Mattingly
d5402f54d3 HBASE-27799: RpcThrottlingException wait interval message is misleading between 0-1s ()
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-05-04 14:27:43 -04:00
Duo Zhang
760b3fbc3d HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning ()
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 78610decaa5b6b5eca8c770e0eb33f73f27b83a9)
2023-05-04 23:04:06 +08:00
Duo Zhang
9a609bbc3a HBASE-27823 Addendum fix compile error 2023-05-04 23:04:06 +08:00
Duo Zhang
f24eb6dbc7 HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout ()
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 89e80da57f29b501ffe9ca852bca8dcd3462ef86)
2023-05-04 22:35:27 +08:00
Duo Zhang
13e51eaa68 HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky ()
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b59eb9640749bfb1bc22bbcb4a36921b79ad176f)
2023-05-04 22:25:08 +08:00
Duo Zhang
3088b2d86e HBASE-27821 Split TestFuzzyRowFilterEndToEnd ()
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 4e69921a001decc73a3fb0bc0d7e94789b440afb)
2023-05-04 22:06:03 +08:00
Nick Dimiduk
e973dee364 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum for branch-2.4,5) 2023-05-01 17:45:38 +02:00
Nick Dimiduk
841f2a7fa6 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum)
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
2023-05-01 17:45:38 +02:00
Nick Dimiduk
07bdc09ee5 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-05-01 17:45:38 +02:00
Duo Zhang
b50022d6cf HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests ()
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c469c31041151481d6b5c5381393599)
2023-05-01 21:47:41 +08:00
Andor Molnár
ea82b9c72f HBASE-27810. Check if the executor has already been shut down before submitting new job ()
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a6e89bf624d70a7f220f961e4f8808374400d774)
2023-04-28 16:48:36 +02:00
Nihal Jain
4800976ae3 HBASE-27792 Guard Master/RS Dump Servlet behind admin walls () 2023-04-28 20:01:44 +05:30
Nick Dimiduk
1b603fad1a HBASE-27808 Change flatten mode for oss in our pom file ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2cfa6822ae84b0a87d5e90c5e588cb900852eba)
2023-04-28 11:40:25 +08:00
Duo Zhang
d7c5e47767 HBASE-27818 Split TestReplicationDroppedTables ()
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d1208f543f936d477ff751b06e2ab73)
2023-04-28 10:00:13 +08:00
Nihal Jain
3267c76a74 HBASE-20804 Document and add tests for HBaseConfTool ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f9308944bd57f34da64746adfda75f093b825)
2023-04-23 23:43:46 +08:00
haosen chen
2980ef4b4b HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e242f5d8b9fb55b9d406c3ba54b5cb92)
2023-04-23 23:34:19 +08:00
Nihal Jain
4ee389adc4 HBASE-27791 Upgrade vega and its related js libraries ()
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-18 12:16:09 +02:00
Andrew Purtell
8516bb5c71 HBASE-27796 Improve MemcachedBlockCache ()
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-17 14:13:19 -07:00
lizhexi0928
690ca8c562
[HBASE-27789] Backport "HBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerManager.updatePeerConfig" to branch-2 ()
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-14 11:43:31 +01:00
Kota-SH
3dda428417 HBASE-27422: Support replication for hbase:acl ()
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
2023-04-14 10:36:40 +01:00