Commit Graph

8924 Commits

Author SHA1 Message Date
Tak Lon (Stephen) Wu 2167e8e3ef HBASE-27547 Addendum: add missing import 2023-01-28 20:27:25 -08:00
EungsopYoo f65dfe50a3 HBASE-27547 Close store file readers after region warmup (#4942)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 45fd3f628a)
2023-01-28 23:21:42 +08:00
Andrew Purtell 48d3de8c80 HBASE-27588 "Instantiating StoreFileTracker impl" INFO level logging is too chatty (#4989)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-25 14:40:55 -08:00
Wei-Chiu Chuang 0bb224517e HBASE-25516 [JDK17] reflective access Field.class.getDeclaredField("modifiers") not supported (#3443)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 29cd782d25)
2023-01-24 22:50:57 +08:00
Tak Lon (Stephen) Wu 392bc972eb
Revert "HBASE-27539 Encapsulate and centralise access to ref count through StoreFileInfo (#4939)" (#4987)
This reverts commit 1e53e1e486.

Revert reason: the change in StoreFileReader breaks the API
backward compatibility for the next branch-2.5 patch release

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-21 21:23:51 -08:00
Bryan Beaudreault 34a891489c HBASE-27579 CatalogJanitor can cause data loss due to errors during cleanMergeRegion (#4986)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 13:01:35 -05:00
Andrew Purtell e124b31815 HBASE-27561 hbase.master.port is ignored in processing of hbase.masters (#4952)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 13:21:07 -08:00
Nick Dimiduk 9f81c78a1c HBASE-27568 ChaosMonkey add support for JournalNodes (#4963)
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 18:36:55 +01:00
Viraj Jasani 5f81798418
HBASE-27529 Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink (#4924)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-16 11:24:26 -08:00
Peter Somogyi b07b07fe41 HBASE-27565 Make the initial corePoolSize configurable for ChoreService (#4958)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 14:51:39 +01:00
Bryan Beaudreault 2752655ec7 HBASE-27531 Addendum: fix test 2023-01-11 19:39:52 -05:00
liuzhongjun bfc1338089 HBASE-27560 fix consistencyCheck did not report the hole on last region (#4950)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c1b9d8ba06)
2023-01-11 18:10:47 +08:00
Duo Zhang 49735cd717 HBASE-27485 HBaseTestingUtility minicluster requires log4j2 (#4941)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit 3f1087fe82)
2023-01-04 11:23:11 +08:00
chenglei 1e53e1e486
HBASE-27539 Encapsulate and centralise access to ref count through StoreFileInfo (#4939)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-24 20:00:34 +08:00
Bryan Beaudreault 780869bd53 HBASE-27233 Read blocks into off-heap if caching is disabled for read (#4931)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-12-21 13:26:55 -05:00
Ray Mattingly 22bd74fa05 HBASE-27253 make slowlog configurations dynamic (#4926)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 17:54:36 -05:00
Bri Augenreich 47b12d75f8 HBASE-27390 getClusterMetrics NullPointerException when ServerTask status null (#4853)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 12:03:36 -05:00
LYCJeff 2874c07ca5 HBASE-27530 Fix comment syntax errors (#4910)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9518cc1a1)
2022-12-14 23:27:02 +08:00
chenglei 01f74ac074
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction (#4922)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 11:19:08 +08:00
Bryan Beaudreault ed8549b3f6 HBASE-27490 Locating regions for all actions of batch requests can exceed operation timeout (#4908)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-12-06 08:04:07 -05:00
Victor 3e3c8fa700
HBASE-27466: Making metrics instance containing one or more connections. (#4874) (#4909)
Signed-off-by: David Manning <67607031+d-c-manning@users.noreply.github.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-12-05 12:23:26 -08:00
Bri Augenreich 1bfc58a369 HBASE-27487: Slow meta can create pathological feedback loop with multigets (#4900)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 08:15:52 -05:00
Wellington Ramos Chevreuil b01fad97fb HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-11-29 11:40:42 +00:00
Ruanhui cf5527be97 HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9)
2022-11-27 23:44:47 +08:00
Peter Somogyi b68dcf46e9 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ddb5bb43c)
2022-11-25 15:51:35 +01:00
Ruanhui c9ed26dd98 HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee59)
2022-11-23 20:48:03 +08:00
Charles Connell 2c7776e979 HBASE-27496 Optionally limit the amount of plans executed in the Normalizer (#4888)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-22 13:19:54 -05:00
Bryan Beaudreault 060ca84374 HBASE-27408 Improve BucketAllocatorException log to always include HFile name (#4886)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-21 08:23:37 -05:00
Tak Lon (Stephen) Wu 22ec7fbeba HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-11-20 15:05:36 -08:00
chenglei 4bf0523a0f HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d)
2022-11-17 23:21:50 +08:00
YiweiLi4 61b74d88a9 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a8)
2022-11-17 21:39:04 +08:00
mrzhao 71f746acce HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2)
2022-11-16 16:43:38 +08:00
Bri Augenreich 2d038edf4c HBASE-26809: Report client backoff time for server overloaded (#4786)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-15 15:41:40 -05:00
Xin Sun 3880884e8e HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 11:18:51 +08:00
Duo Zhang dfb9fdc88d HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47)
2022-11-08 00:01:30 +08:00
Ruanhui 78ddd3dae4 HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699f)
2022-11-05 23:03:27 +08:00
Duo Zhang 41c2e9950d HBASE-27437 TestHeapSize is flaky (#4841)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da92)
2022-10-28 23:13:24 +08:00
tianliuliu 784d1a96cd HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e)
2022-10-24 18:56:41 +08:00
Duo Zhang f3a64e468e HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line (#4836)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863)
2022-10-24 12:16:04 +08:00
chenglei d4145db6ab
HBASE-27433 DefaultMobStoreCompactor should delete MobStoreFile cleanly when compaction is failed (#4840) 2022-10-21 17:53:19 +08:00
Andrew Purtell 27d69ff53f Preparing development version 2.5.2-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 15:37:08 -07:00
Andrew Purtell 894ac15342 Preparing hbase release 2.5.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 15:37:04 -07:00
d-c-manning b9ec644e51 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:42 -07:00
Andrew Purtell 511e0105ae HBASE-27432 TestUsersOperationsWithSecureHadoop fails after HBASE-27411
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 13:15:20 -07:00
Andrew Purtell a8605912ec Preparing development version 2.5.2-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 09:11:37 -07:00
Andrew Purtell edf0b62273 Preparing hbase release 2.5.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 09:11:34 -07:00
binlijin 66873ca5a6
HBASE-25166 MobFileCompactionChore is closing the master's shared cluster connection (#2514) (#4826)
Co-authored-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-10-13 22:07:46 +08:00
Andrew Purtell b7fbb668d5 HBASE-27411 Update and clean up bcprov-jdk15on dependency (#4817)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-10-10 22:57:29 +00:00
Duo Zhang 050f3e1ef5 HBASE-27401 Addendum fix more javadoc issues
(cherry picked from commit 4b45256910)
2022-10-07 00:55:26 +08:00
Duo Zhang fb988373c1 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
2022-10-06 23:01:14 +08:00