Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,669 Commits 95 Branches 866 Tags
Commit Graph

18669 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Duo Zhang
4f50c30537 HBASE-27870 Eliminate the 'WARNING: package jdk.internal.util.random not in java.base' when running UTs with jdk11 (#5242) 
Signed-off-by: Tianhang Tang <tianhang@apache.org>
(cherry picked from commit 71d7996047001d0be56915bbabed1fb0e552192b)
 2023-05-18 23:19:41 +08:00
Duo Zhang
fbaddab84b HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237) 
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8b8c684bcc0060af0d9244dba86b6a46d2cdc30e)
 2023-05-15 10:44:28 +08:00
Duo Zhang
b2e4d3bb8d HBASE-27865 TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule (#5238) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit fd4f984d87dc189f7afc6ddc50d5373e23b46ad5)
 2023-05-15 10:44:21 +08:00
Duo Zhang
dcb81d0c20 HBASE-27863 Add hadoop 3.3.5 check in our personality script (#5236) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b28feeb989bec9709fcfbaa5066669cedea77bda)
 2023-05-15 10:44:13 +08:00
Jonathan Albrecht
39ecb3d2f4 HBASE-27858 Update surefire version to 3.1.0 and use SurefireForkNodeFactory (#5234) 
Surefire version updated from 3.0.0-M6 -> 3.1.0.

SurefireForkNodeFactory is a new strategy to control how the forked
nodes communicate with the main maven process. It uses a tcp channel
instead of pipes and fixes some corrupted messages seen in the s390x
build.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 67612cc264dd44845e0797178e0b7678376b7cbe)
 2023-05-13 19:01:33 +08:00
Shuhei Yamasaki
f66e141e5e HBASE-27860 Fix build error against Hadoop 3.3.5 (#5233) 
Add packages for hadoop-3.3.5

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bee09bbd61e077fd398cd534ed28e2305a66c85c)
 2023-05-13 09:08:49 +08:00
Jonathan Albrecht
200e598e1b HBASE-27857 Fix timeout exception handling in HBaseClassTestRule. (#5231) 
HBaseClassTestRule applies a timeout and a system exit rule to tests.
The timeout rule throws an exception if it hits the timeout threshold.
Since the timeout rule is applied after the system exit rule, the
system exit rule does not see the exception and does not re-enable
the system exit behavior which can cause maven to hang on some
tests.

This change applies the timeout rule before the system exit rule so
that normal system exit can be restored before the surefire forked
node is shutdown.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 220eacf7c56f00a9c8746295fbc46db8a7a66da2)
 2023-05-13 09:08:20 +08:00
Ruanhui
7140c29166 HBASE-27844 changed type names to avoid conflicts with built-in types (#5223) 
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d49df8b7a96cbeca60c09f837f2cd4f2067f9ddf)
 2023-05-08 23:22:09 +08:00
Jonathan Albrecht
cf8e6aa172 HBASE-27838 Update zstd-jni from version 1.5.4-2 -> 1.5.5-2. (#5220) 
Note: This version includes a fix that prevented zstd-jni from
running on s390x.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5d2b6956e58f87289e48e58d4d34de7afc661406)
 2023-05-05 12:03:01 +08:00
Bryan Beaudreault
064595b3c1
HBASE-26646 WALPlayer should obtain token from filesystem (#5221) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Co-authored-by: meiyi <myimeiyi@gmail.com>
 2023-05-04 14:43:09 -04:00
Ray Mattingly
d5402f54d3 HBASE-27799: RpcThrottlingException wait interval message is misleading between 0-1s (#5192) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-05-04 14:27:43 -04:00
Duo Zhang
760b3fbc3d HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 78610decaa5b6b5eca8c770e0eb33f73f27b83a9)
 2023-05-04 23:04:06 +08:00
Duo Zhang
9a609bbc3a HBASE-27823 Addendum fix compile error 2023-05-04 23:04:06 +08:00
Duo Zhang
f24eb6dbc7 HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216) 
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 89e80da57f29b501ffe9ca852bca8dcd3462ef86)
 2023-05-04 22:35:27 +08:00
Duo Zhang
13e51eaa68 HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b59eb9640749bfb1bc22bbcb4a36921b79ad176f)
 2023-05-04 22:25:08 +08:00
Duo Zhang
3088b2d86e HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 4e69921a001decc73a3fb0bc0d7e94789b440afb)
 2023-05-04 22:06:03 +08:00
Nick Dimiduk
e973dee364 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum for branch-2.4,5) 2023-05-01 17:45:38 +02:00
Nick Dimiduk
841f2a7fa6 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum) 
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
 2023-05-01 17:45:38 +02:00
Nick Dimiduk
07bdc09ee5 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-01 17:45:38 +02:00
Duo Zhang
b50022d6cf HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c469c31041151481d6b5c5381393599)
 2023-05-01 21:47:41 +08:00
Andor Molnár
ea82b9c72f HBASE-27810. Check if the executor has already been shut down before submitting new job (#5207) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a6e89bf624d70a7f220f961e4f8808374400d774)
 2023-04-28 16:48:36 +02:00
Nihal Jain
4800976ae3 HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-28 20:01:44 +05:30
Nick Dimiduk
1b603fad1a HBASE-27808 Change flatten mode for oss in our pom file (#5201) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2cfa6822ae84b0a87d5e90c5e588cb900852eba)
 2023-04-28 11:40:25 +08:00
Duo Zhang
d7c5e47767 HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d1208f543f936d477ff751b06e2ab73)
 2023-04-28 10:00:13 +08:00
Nihal Jain
3267c76a74 HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f9308944bd57f34da64746adfda75f093b825)
 2023-04-23 23:43:46 +08:00
haosen chen
2980ef4b4b HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e242f5d8b9fb55b9d406c3ba54b5cb92)
 2023-04-23 23:34:19 +08:00
Nihal Jain
4ee389adc4 HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-18 12:16:09 +02:00
Andrew Purtell
8516bb5c71 HBASE-27796 Improve MemcachedBlockCache (#5181) 
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-17 14:13:19 -07:00
lizhexi0928
690ca8c562
[HBASE-27789] Backport "HBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerManager.updatePeerConfig" to branch-2 (#5180) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-14 11:43:31 +01:00
Kota-SH
3dda428417 HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
 2023-04-14 10:36:40 +01:00
Bryan Beaudreault
1e97fbfc9f HBASE-27768 Race conditions in BlockingRpcConnection (#5154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-04-10 15:23:34 -04:00
tianhang
65e579c060 HBASE-27713 Remove numRegions in Region Metrics (#5107) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e4984776e2ee13ae4df1de4c000f35a58ad59)
 2023-04-08 15:09:37 +08:00
Nick Dimiduk
a72b516fb0 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c6486468f6b19f7419c9a263ed81d8bdc7)
 2023-04-08 11:05:42 +08:00
chenglei
045aa9f780
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up (#5162) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-07 15:07:20 +08:00
Andrew Purtell
f8f06fcd0a Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-06 09:09:26 -07:00
Andrew Purtell
2e426ab69d Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.5.4 2.5.4RC0 		2023-04-06 09:09:24 -07:00
Andrew Purtell
7164d6c533 Revert "Preparing development version 2.5.5-SNAPSHOT" 
This reverts commit 0583060305ddc8f0762ef4997fb46a79682e831a.

Revert "Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 0ab2fb24abe823050d253064d5052513df4c9500.

Retry tagging and preparation for 2.5.4RC0 after addressing local release build
errors.
 2023-04-06 09:04:42 -07:00
Andrew Purtell
0583060305 Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:09 -07:00
Andrew Purtell
0ab2fb24ab Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:07 -07:00
Bryan Beaudreault
e9c14e0fbf HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-03 17:08:50 -04:00
Bryan Beaudreault
694752b781 HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-31 09:18:45 -04:00
Rishabh Murarka
9931edb851 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:33:04 +05:30
dependabot[bot]
49baa793cb HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb4338876b8d7da9dcad7383bdf1fc9c90c87)
 2023-03-24 21:57:01 +08:00
Duo Zhang
23ce03c7c5 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50578144d3e0916c33d4532bb8644763)
 2023-03-24 17:45:55 +08:00
Duo Zhang
32f95c4b13 HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a7636958970d37bfcd775fd55e8de98177)
 2023-03-24 16:08:56 +08:00
Xiaolin Ha
17deed9533 HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cbc322b0824d2d755bcf4191c3a525ed)
 2023-03-24 16:08:36 +08:00
Andrew Purtell
e1b58290d1 HBASE-27744 Update compression dependencies (#5137) 
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-23 13:10:31 -07:00
Nick Dimiduk
6024a24957 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 15:15:29 +01:00
Xiaolin Ha
40d2545200 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:11:59 +08:00
xuzifu666
8e2f6f8238 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e848d34db432526dee86289439594510)
 2023-03-21 22:56:55 +08:00