18212 Commits

Author SHA1 Message Date
Peter Somogyi
0a37292113 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit b68dcf46e9eacbce3325f70163756f91b0447658)
2022-11-25 15:54:52 +01:00
Ruanhui
a3ac3c581d HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee592959ee5ddd646a6769bb81a781d610)
2022-11-23 20:48:15 +08:00
mokai
1c9f6c5ccd HBASE-27504 Remove duplicated config 'hbase.normalizer.merge.min_region_age.days' in hbase-default.xml (#4894)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c691091f780150d41f6205666b6c221618567ee6)
2022-11-23 20:44:02 +08:00
chenglei
acc4d13e7f HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d6ca51c310c41a194628f90e3815c17)
2022-11-17 23:21:59 +08:00
YiweiLi4
fd92057f22 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a84676c4fac7eb697a21255abddf143a)
2022-11-17 21:39:31 +08:00
Duo Zhang
d1ac1d57c9 HBASE-27423 Upgrade hbase-thirdparty to 4.1.3 and upgrade Jackson for CVE-2022-42003/42004 (#4878)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 07a3ffdd97f22b7c1cf4dbfe23a029bec2b28336)
2022-11-17 21:36:41 +08:00
mrzhao
843cc5f952 HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2c14bec591597a74f043b36f35bd6a3)
2022-11-16 16:43:45 +08:00
Peter Somogyi
ba53872fb1
HBASE-27001 The deleted variable cannot be printed out (#4883)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0027d031ce6dec8b2ba0243c3a58554)
2022-11-15 17:22:37 +01:00
Xin Sun
f7b2efc7b7 HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 13:00:57 +08:00
Duo Zhang
0ff4402ead HBASE-27480 Skip error prone for hadoop2/3 checkes in our nightly jobs (#4877)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 085325c6961e99ebadb9da3ce014d6216e03b6ea)
2022-11-11 14:42:16 +08:00
Duo Zhang
1fb7c3b39c HBASE-27475 Use different jdks when running hadoopcheck in personality scripts (#4875)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 260cd485db36f8d04b91062012addc632ca29ec9)
2022-11-10 23:20:50 +08:00
Duo Zhang
32c8dd3c04 HBASE-27472 The personality script set wrong hadoop2 check version for branch-2 (#4866)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 6c32d1a3fb218f3639a6c2037d84624bcf74575a)
2022-11-10 12:58:58 +08:00
Duo Zhang
aa8ca7e1b9 HBASE-27473 Fix spotbugs warnings in hbase-rest Client.getResponseBody (#4867)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2d87994f685849219dfde87a111f9f79b6278c17)
2022-11-10 12:58:15 +08:00
Duo Zhang
4605c323cc HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47b5340ff02e0dec144424ab91407e07)
2022-11-08 00:20:33 +08:00
Ruanhui
5f55ff7578 HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699fd2f03e88dcd37cb9dc7d20bacfa3f2)
2022-11-05 23:03:34 +08:00
Duo Zhang
b5489fae51 HBASE-27460 Fix the hadolint errors after HBASE-27456 (#4860)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit e7d1a6a0525fcadf1cd0294d7a09af432a1af853)
2022-11-03 18:39:32 +08:00
Duo Zhang
9a110f5087 HBASE-27456 Upgrade the dockerfile used in nightly and pre commit to ubuntu 22.04 (#4857)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 3f17745f6e66c977d0dea16ac98cd4368a207944)
2022-11-01 11:36:39 +08:00
Duo Zhang
a6a5f03e5b HBASE-27437 TestHeapSize is flaky (#4841)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da9298b7f2f396826487d4133e78810895)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
2022-10-28 23:22:56 +08:00
Duo Zhang
73169be87c HBASE-27450 Update all our python scripts to use python3 (#4851)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit cdabfd3ca811d1c5ef79e9b6bd8106b2d6d12cd5)
2022-10-28 19:00:57 +08:00
Duo Zhang
4fdd2392be HBASE-27446 Spotbugs 4.7.2 report a lot of logging errors when generating report (#4848)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit d80053641d09caecf34cc878b8789bad30ad273e)
2022-10-28 18:44:15 +08:00
Duo Zhang
a8d9726091 HBASE-25983 javadoc generation fails on openjdk-11.0.11+9 (#4837)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 792f12b616ea67822064b64febaf43479a890195)
2022-10-25 22:59:57 +08:00
tianliuliu
098e59863b HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e9be5723ff5bfb0e97cadca4092455a)
2022-10-24 18:56:49 +08:00
Duo Zhang
1c2813bc0e
HBASE-27441 Use jdk 11.0.16 instead of 11.0.16.1 for branch-2.4 (#4843)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-10-24 12:30:58 +08:00
Sean Busbey
053a0da962 HBASE-27425 run flaky test job once an hour. (#4828)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c8e2d80036d932c798e5d9601d6a7fc2c5eafb6a)
2022-10-21 14:27:27 +08:00
d-c-manning
cbad5f595c HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:59 -07:00
Victor
39c596fe7a HBASE-27426 - Fix ZKWatcher shutdown seqence to avoid InterruptExcept… (#4829)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Co-authored-by: Victor Li <victor.li@salesforce.com>
2022-10-17 13:28:10 -07:00
Peter Somogyi
8d81f87cad HBASE-27431 Remove TestRemoteTable.testLimitedScan (#4832)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-17 09:40:59 +02:00
Andrew Purtell
de02ee2970 Preparing development version 2.4.16-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 11:39:40 -07:00
Andrew Purtell
35310fcd6b Preparing hbase release 2.4.15RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.4.15 2.4.15RC0
2022-10-13 11:39:36 -07:00
Duo Zhang
98ccae9494 HBASE-27421 Bump spotless plugin to 2.27.2 and reimplement the 'Remove unhelpful javadoc stubs' rule (#4824)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 0d260f5b2279422e8ed4bea127483329f7242a42)
2022-10-12 23:20:05 +08:00
sanjeet006py
00f72f346f HBASE-27420 Allow non-loopback for zk standalone server in minizkcluster (#4819)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Co-authored-by: Sanjeet Malhotra <sanjeetmalhotra@salesforce.com>
2022-10-11 12:10:59 -07:00
Andrew Purtell
4ec7ee5cb1 HBASE-27339 Improve sasl connection failure log message to include server (#4823)
Include the remote server name in the logged exception message when the
connection setup fails in BlockingRpcConnection.

Add an equivalent log line in NettyRpcConnection.

Signed-off-by: Viraj Jasani <vjasani@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/NettyRpcConnection.java
2022-10-11 10:34:37 -07:00
Andrew Purtell
5a88745994 HBASE-27424 Upgrade Jettison for CVE-2022-40149/40150 (#4822)
Jettison versions <= 1.5.0 are subject to CVE-2022-40149 and CVE-2022-40150.

Move jettison.version to 1.5.1.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-11 10:12:13 -07:00
Duo Zhang
36abd385cf HBASE-27419 Update to hbase-thirdparty 4.1.2 (#4818)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 79f853ee7c9e2e55bcc7379f72ed3b8b50ad545d)
2022-10-11 10:38:45 +08:00
Andrew Purtell
dafecec80a HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>

Conflicts:
	hbase-server/pom.xml
2022-10-10 22:58:56 +00:00
Duo Zhang
7b523af138 HBASE-27401 Addendum remove unused imports 2022-10-07 17:09:43 +08:00
Duo Zhang
8c2dd12adb HBASE-27401 Clean up current broken 'n's in our javadoc (#4812)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f08cdde6ac0fde1342ffd050e8e02441)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
2022-10-07 00:42:57 +08:00
Rajeshbabu Chintaguntla
9d7614bbdc HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:40:41 +05:30
Luca Kovács
d5af301ea1 HBASE-27407 Fixing check for "description" request param in JMXJsonServlet.java (#4816)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-10-06 12:04:15 +01:00
Rajeshbabu Chintaguntla
1c90547e8a HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:54:12 +05:30
Rajeshbabu Chintaguntla
5fa5b0364f HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time 2022-10-05 04:03:45 +05:30
Bryan Beaudreault
804844c018 HBASE-27381 Still seeing 'Stuck' in static initialization creating RegionInfo instance (#4813)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-04 08:29:57 -04:00
Duo Zhang
5750d9a6a1 HBASE-27403 Remove 'Remove unhelpful javadoc stubs' spotless rule for now (#4809)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 6abc1aefd176d4d016a32512f3d34cb1102b4ace)
2022-10-03 23:17:52 +08:00
Bryan Beaudreault
f76716b801 HBASE-27391 Downgrade ERROR log to DEBUG in ConnectionUtils.updateStats (#4804)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-28 11:34:56 -04:00
Aman Poonia
f24e7b55f9
HBASE-27384 Backport HBASE-27064 (CME in TestRegionNormalizerWorkQueue) to 2.4 (#4794) (#4468)
Co-authored-by: Andrew Purtell <apurtell@apache.org>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-09-26 22:59:58 -07:00
Andrew Purtell
e7b67a19b3
HBASE-27393 Frequent and not useful "Final timeLimitDelta" log lines (#4802)
Signed-off-by: Viraj Jasani <virajjasani@apache.org>
2022-09-26 17:54:49 -07:00
Wellington Ramos Chevreuil
e25b2a7cd0 HBASE-27370 Avoid decompressing blocks when reading from bucket cache… (#4781)
Co-authored-by: Josh Elser <elserj@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-09-20 14:37:01 +01:00
Duo Zhang
393068ccb4 HBASE-27372 Update java versions in our Dockerfiles (#4784)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit 3f5c0a505a5f5cf3fba29fd06e4139584da42956)
2022-09-19 15:47:27 +08:00
Duo Zhang
82f966474e
HBASE-27373 Fix new spotbugs warnings after upgrading spotbugs to 4.7.2 (#4787) (#4791)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-09-19 12:02:00 +08:00
Duo Zhang
c94ec54185 HBASE-27368 Do not need to throw IllegalStateException when peer is not active in ReplicationSource.initialize (#4779)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 460bb47c04cf2ffa71c23b80c5680d8cbb69234b)
2022-09-15 15:35:50 +08:00