Commit Graph

18585 Commits

Author SHA1 Message Date
mokai 838638fdab HBASE-27504 Remove duplicated config 'hbase.normalizer.merge.min_region_age.days' in hbase-default.xml (#4894)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c691091f78)
2022-11-23 20:43:42 +08:00
LiangJun He 8c2f4b2aaa
HBASE-27444 Add tool commands list_enabled_tables and list_disabled_tables (#4880)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-23 10:29:37 +08:00
Charles Connell 5976684168 HBASE-27496 Optionally limit the amount of plans executed in the Normalizer (#4888)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-22 13:08:43 -05:00
Bryan Beaudreault ad8d38b61f HBASE-27408 Improve BucketAllocatorException log to always include HFile name (#4886)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-21 08:22:42 -05:00
Tak Lon (Stephen) Wu 66aedcae02 HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-11-20 14:52:12 -08:00
chenglei daa39a46ab HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d)
2022-11-17 23:21:38 +08:00
YiweiLi4 309ed58f07 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a8)
2022-11-17 21:37:00 +08:00
Duo Zhang 8b2c7b1b49 HBASE-27423 Upgrade hbase-thirdparty to 4.1.3 and upgrade Jackson for CVE-2022-42003/42004 (#4878)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 07a3ffdd97)
2022-11-17 21:35:13 +08:00
mrzhao 43b1c9722b HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2)
2022-11-16 16:43:29 +08:00
Bri Augenreich 53e872e5f1
HBASE-26809: Report client backoff time for server overloaded (#4786)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-15 15:41:08 -05:00
Xin Sun 7bba9ae24e HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 11:59:10 +08:00
SiCheng-Zheng 71826de852
HBASE-27309 Add major compact table or region operation on master web table page (#4870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-12 21:15:20 +08:00
Duo Zhang 35817bcaf1 HBASE-27480 Skip error prone for hadoop2/3 checkes in our nightly jobs (#4877)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 085325c696)
2022-11-11 14:42:00 +08:00
Duo Zhang e007e23625 HBASE-27475 Use different jdks when running hadoopcheck in personality scripts (#4875)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 260cd485db)
2022-11-10 23:20:35 +08:00
Duo Zhang 1588fc0332 HBASE-27472 The personality script set wrong hadoop2 check version for branch-2 (#4866)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 6c32d1a3fb)
2022-11-10 12:58:34 +08:00
Duo Zhang 6446d2064a HBASE-27473 Fix spotbugs warnings in hbase-rest Client.getResponseBody (#4867)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2d87994f68)
2022-11-10 12:57:58 +08:00
Rushabh Shah ecf3debd42
HBASE-26913 Replication Observability Framework (#4862)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-11-08 13:05:42 -08:00
Duo Zhang ea4ccf0044 HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47)
2022-11-08 00:00:56 +08:00
Ruanhui b8dacbec60 HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699f)
2022-11-05 23:03:16 +08:00
Duo Zhang 1eac50af9c HBASE-27460 Fix the hadolint errors after HBASE-27456 (#4860)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit e7d1a6a052)
2022-11-03 18:38:32 +08:00
Duo Zhang bf96471ecd HBASE-27456 Upgrade the dockerfile used in nightly and pre commit to ubuntu 22.04 (#4857)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 3f17745f6e)
2022-11-01 11:35:16 +08:00
LiangJun He 1530d855ea
HBASE-27448 Add an admin method to get replication enabled state (#4858)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-01 11:22:05 +08:00
Duo Zhang 7b0d705a1a HBASE-27437 TestHeapSize is flaky (#4841)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da92)
2022-10-28 23:12:54 +08:00
Duo Zhang 2716a03230 HBASE-27450 Update all our python scripts to use python3 (#4851)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit cdabfd3ca8)
2022-10-28 18:59:18 +08:00
Duo Zhang 8db5301a42 HBASE-27446 Spotbugs 4.7.2 report a lot of logging errors when generating report (#4848)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit d80053641d)
2022-10-28 18:43:56 +08:00
Jonathan Albrecht 0f01c7e0cd HBASE-27167 s390x: Skip tests on unsupported compression libs (#4852)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d9713bf621)
2022-10-28 12:40:14 +08:00
Duo Zhang 7d1eb8d077 HBASE-25983 javadoc generation fails on openjdk-11.0.11+9 (#4837)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 792f12b616)
2022-10-25 23:05:13 +08:00
tianliuliu beabc198d0 HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e)
2022-10-24 18:56:27 +08:00
Duo Zhang 738ed028ad HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line (#4836)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863)
2022-10-24 12:05:01 +08:00
Kota-SH 25dad1fb68 HBASE-27363: Fix the config key name for PREFETCH_PERSISTENCE_PATH_KEY and spotbugs (#4774)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c881eb1ff0)
2022-10-21 15:11:42 +08:00
Sean Busbey de66e92529 HBASE-27425 run flaky test job once an hour. (#4828)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c8e2d80036)
2022-10-21 14:27:07 +08:00
chenglei edb5b60845
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed (#4839) 2022-10-21 11:12:22 +08:00
Luca Kovács a31b1486b7 HBASE-27406 Make /prometheus endpoint accessible from HBase UI (#4833)
Signed-off-by: Andor Molnar <andor@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
(cherry picked from commit dffc8e0fbe)
2022-10-20 12:51:30 +02:00
d-c-manning fc4191afa1 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:37 -07:00
Victor 2d95ce072e HBASE-27426 - Fix ZKWatcher shutdown seqence to avoid InterruptExcept… (#4829)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Co-authored-by: Victor Li <victor.li@salesforce.com>
2022-10-17 13:28:16 -07:00
Peter Somogyi bd2140fc08
HBASE-27431 Remove TestRemoteTable.testLimitedScan (#4832)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-17 09:38:45 +02:00
binlijin 861938fe26
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection (#2514) (#4825)
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-10-13 22:06:35 +08:00
Duo Zhang d6e787665c HBASE-27421 Bump spotless plugin to 2.27.2 and reimplement the 'Remove unhelpful javadoc stubs' rule (#4824)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 0d260f5b22)
2022-10-12 23:18:23 +08:00
sanjeet006py 440d168c13 HBASE-27420 Allow non-loopback for zk standalone server in minizkcluster (#4819)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Co-authored-by: Sanjeet Malhotra <sanjeetmalhotra@salesforce.com>
2022-10-11 12:10:50 -07:00
Andrew Purtell dfaa63890a HBASE-27339 Improve sasl connection failure log message to include server (#4823)
Include the remote server name in the logged exception message when the
connection setup fails in BlockingRpcConnection.

Add an equivalent log line in NettyRpcConnection.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-10-11 10:20:01 -07:00
Andrew Purtell f93bd14bd2 HBASE-27424 Upgrade Jettison for CVE-2022-40149/40150 (#4822)
Jettison versions <= 1.5.0 are subject to CVE-2022-40149 and CVE-2022-40150.

Move jettison.version to 1.5.1.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-11 10:12:04 -07:00
Duo Zhang 1ad9574a09 HBASE-27419 Update to hbase-thirdparty 4.1.2 (#4818)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 79f853ee7c)
2022-10-11 10:11:45 +08:00
Andrew Purtell 517e6172eb HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-10-10 22:57:13 +00:00
Luca Kovács f5df7693c5 HBASE-27395 Adding description to Prometheus metrics (#4807)
Signed-off-by: Tamas Payer <payert@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-10-07 11:32:26 +02:00
Duo Zhang 397ab6900d HBASE-27401 Addendum fix more javadoc issues
(cherry picked from commit 4b45256910)
2022-10-07 00:55:13 +08:00
Duo Zhang 5cab4be075 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
2022-10-06 22:13:14 +08:00
Rajeshbabu Chintaguntla d8749658db HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum added mistakenly removed in-memory flag 2022-10-06 16:40:10 +05:30
Duo Zhang 54089b4d9c HBASE-27409 Fix the javadoc for WARCRecord (#4814)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ced1d642ae)
2022-10-06 18:19:01 +08:00
Luca Kovács 94ed02d7ed HBASE-27407 Fixing check for "description" request param in JMXJsonServlet.java (#4816)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-10-06 10:51:16 +01:00
Rajeshbabu Chintaguntla 5395f92178 HBASE-27365 Minimise block addition failures due to no space in bucket cache writers queue by introducing wait time - addendum fixing the test case failure 2022-10-06 06:51:33 +05:30