Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,216 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

8723 Commits

Author SHA1 Message Date
Bri Augenreich 282c1c2737 HBASE-26581 Add metrics for failed replication edits (#4347) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-26 17:45:36 -04:00
Wellington Ramos Chevreuil 828025bb37 HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366) 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c6)
 2022-04-26 15:02:17 +01:00
Ruanhui 7715e37d37
HBASE-26942 cache region locations when getAllRegionLocations (#4357) 
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-22 07:53:01 -04:00
Duo Zhang d9f4c519ca HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted (#4352) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 35aa57e445)
 2022-04-17 23:27:19 +08:00
Pankaj eea9e78d17 HBASE-26944 Possible resource leak while creating new region scanner (#4339) 
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 62e3efccef)
 2022-04-15 11:42:34 +05:30
Duo Zhang 1fc186643f Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)" 
This reverts commit c10e4bd330.
 2022-04-13 11:48:23 +08:00
Duo Zhang c10e4bd330 HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8247b7c722)
 2022-04-13 11:10:45 +08:00
eomiks df01fd4c25 HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on (#4295) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ac9e0be27)
 2022-04-12 20:32:50 +08:00
huaxiangsun 7ac7954372
HBASE-26618 Involving primary meta region in meta scan with CatalogRe… (#4321) (#4328) 
Signed-off-by: Michael Stack <stack@apache.org>
 2022-04-11 10:26:42 -07:00
Duo Zhang 3d9892cf6a HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless (#4324) 
Signed-off-by: Yulin Niu <niuyulin@apache.org
(cherry picked from commit 3ae0d9012c)
 2022-04-09 23:54:32 +08:00
Duo Zhang 789c37e6ce HBASE-26928 Fix several indentation problems (#4323) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e68c61dd54)
 2022-04-06 15:14:46 +08:00
Tak Lon (Stephen) Wu d98483018b HBASE-26882 Backport "HBASE-26810 Add dynamic configuration support f… (#4278) 
- Include HBASE-25288 that has the configuration manager registration in HMaster

Signed-off-by: Ankit Singhal <ankit@apache.org>
 2022-04-05 11:57:07 -07:00
bsglz 46e8533fe7 HBASE-26885 Addendum throw exception instead of return in TRSP to let the procedure retry (#4299) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7f9d1f2259)
 2022-04-04 20:27:59 +08:00
Duo Zhang 18c55d20d9 HBASE-26921 Rewrite the counting cells part in TestMultiVersions (#4316) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 3e09e87fad)
 2022-04-03 23:09:40 +08:00
Duo Zhang 1b768cd48d HBASE-26920 Fix missing braces warnings in TestProcedureMember (#4315) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 78676bb85e)
 2022-04-03 23:09:39 +08:00
Duo Zhang a7f8e2a5b1 HBASE-26919 Rewrite the counting rows part in TestFromClientSide4 (#4314) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4e12eee531)
 2022-04-03 23:09:39 +08:00
chenglei d9a32f9405
HBASE-26811 Secondary replica may be disabled for read incorrectly forever (#4310) 2022-04-01 11:53:33 +08:00
chenglei d8a5bb827b
HBASE-26812 ShortCircuitingClusterConnection fails to close RegionScanners when making short-circuited calls (#4302) 2022-03-31 20:56:41 +08:00
bsglz a25e779f26 HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276) 
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM

(cherry picked from commit 1efd8fe53c)
 2022-03-29 10:13:11 +08:00
d-c-manning da2c32c36d HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-28 11:52:53 -07:00
Duo Zhang 9355506c30 HBASE-26832 Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted (#4281) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 4f491fd5e4)
 2022-03-28 08:00:16 +08:00
Xiaolin Ha 9a7ee77bd4
HBASE-26872 Load rate calculator for cost functions should be more precise (#4280) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
 2022-03-27 15:20:51 +08:00
huaxiangsun 34cb2ee967 HBASE-26864 SplitTableRegionProcedure calls openParentRegions() at a … (#4261) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-26 12:19:02 -07:00
Xiaolin Ha ce5c7a4327 HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-24 19:50:02 +08:00
chenglei 4bb1d75f67
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4265) 2022-03-23 19:13:46 +08:00
Nick Dimiduk 18d53339a8 HBASE-26834 Adapt ConnectionRule for both sync and async connections 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-21 18:27:33 +01:00
Duo Zhang 7acfbc0bea HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving (#4242) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 520ad638d9)
 2022-03-19 00:46:42 +08:00
Duo Zhang 2b2308afc7 HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop (#4238) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 31db8e3b3b)
 2022-03-19 00:46:13 +08:00
Duo Zhang c4f546041e HBASE-26833 Addendum fix NPE in TestReplicationSource.testTerminateClearsBuffer 
(cherry picked from commit bd65ad42a2)
 2022-03-17 23:23:25 +08:00
Xiaolin Ha 8cce0d3302 HBASE-26680 Close and do not write trailer for the broken WAL writer (#4174) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-16 20:15:59 +08:00
Andrew Purtell ec40003898 Preparing development version 2.4.12-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-15 10:17:31 -07:00
Andrew Purtell 7e672a0da0 Preparing hbase release 2.4.11RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-15 10:17:28 -07:00
Xiaolin Ha 89754dd314 HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS (#4218) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-15 22:17:18 +08:00
Xiaolin Ha 31cb0b809c HBASE-26840 Fix NPE in the retry of logroller (#4224) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-15 22:07:21 +08:00
Duo Zhang 920cf9d7d4 HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5ad51e8b2b)
 2022-03-15 20:19:44 +08:00
Andrew Purtell 95f4128973 Preparing development version 2.4.12-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 15:55:02 -07:00
Andrew Purtell 2743fa5b9c Preparing hbase release 2.4.11RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 15:54:59 -07:00
Bryan Beaudreault cdda96fb47 HBASE-26603 Cherry pick HBASE-26537 to branch-2.4 
HBASE-26537: Make HBASE-15676 backwards compatible, using a flag on the proto (#3931)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 14:48:37 -07:00
meiyi c3c8047977 HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 12:30:41 +08:00
Duo Zhang cffb006d8d HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit c3d0cc7040)
 2022-03-14 11:24:51 +08:00
Nick Dimiduk fd356e6682 HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:09:28 +01:00
Andrew Purtell 40f873867e HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204) 
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-11 15:13:17 +08:00
Andrew Purtell 097e19eae2 HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-11 15:07:07 +08:00
Xiaolin Ha e9711a6bb9 HBASE-26816 Fix CME in ReplicationSourceManager (#4187) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:50:44 +08:00
Andrew Purtell bfae8539bf HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184) 
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-10 15:14:17 -08:00
Bryan Beaudreault 9849d3caec HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 12:03:14 -08:00
Andrew Purtell 210517040b HBASE-26582 Prune use of Random and SecureRandom objects (#4118) 
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-08 16:12:08 -08:00
Xiaolin Ha 77dbf7a059
HBASE-26552 Introduce retry to logroller to avoid abort (#4171) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 16:41:12 +08:00
Xiaolin Ha 45801a7d74 HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 11:43:57 +08:00
Rushabh Shah 6bd2cd6d11 HBASE-26792 Implement ScanInfo#toString (#4154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-05 17:49:34 +08:00
Istvan Toth 622c436e17 HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 13:57:33 -08:00
Duo Zhang 694e9faad5 HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	pom.xml
 2022-03-04 12:10:43 -08:00
Xiaolin Ha 2af6bb75f5 HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 20:36:11 +08:00
Mike Drob c3ac78691e HBASE-26622 Update error-prone to 2.10 
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-03 11:52:16 +01:00
Nick Dimiduk 36e1a1d260 HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-03-02 15:52:05 +01:00
Andrew Purtell 819afc7a39 Preparing development version 2.4.11-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-28 09:53:11 -08:00
Andrew Purtell 3e5359c73d Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-28 09:53:07 -08:00
Andrew Purtell 9e8b5a89e5 Revert "Preparing development version 2.4.11-SNAPSHOT" 
Revert "Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 31a9beaf94.
This reverts commit 0dc107e15b.
This reverts commit a86548a257.
This reverts commit 27343174e7.
 2022-02-28 09:17:45 -08:00
Andrew Purtell 31a9beaf94 Preparing development version 2.4.11-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-28 08:48:55 -08:00
Andrew Purtell 0dc107e15b Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-28 08:48:52 -08:00
Andrew Purtell a86548a257 Preparing development version 2.4.11-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-25 18:34:32 -08:00
Andrew Purtell 27343174e7 Preparing hbase release 2.4.10RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-25 18:34:29 -08:00
Richard Marscher f358125fe5 HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor (#3944) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-18 10:26:38 -08:00
chenglei 9999f875c9
HBASE-26712 Balancer encounters NPE in rare case (#4117) 2022-02-18 10:59:29 +08:00
Xiaolin Ha 0020da472d HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate (#4105) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-16 11:24:49 +08:00
Xiaolin Ha c8ccbde51a HBASE-26434 Do compact when all L0 files are expired (#3830) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-15 22:40:22 +08:00
Yutong Xiao 3f315d7e93 HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down (#4073) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-15 20:36:23 +08:00
Tak Lon (Stephen) Wu b8db5ac24c HBASE-26729 Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2 (#4093) 
- rename from HBaseCommonTestingUtil to HBaseCommonTestingUtility

Signed-off-by: Ankit Singhal <ankit@apache.org>
 2022-02-04 06:01:37 -08:00
Bryan Beaudreault 590e38e8e4 HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-01-28 12:58:05 -08:00
Peter Somogyi a02324f202 HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#4049) 
Duo Zhang <zhangduo@apache.org>
 2022-01-20 15:11:26 +01:00
xianjingfeng 7c032c72cf HBASE-26671 Misspellings of hbck usage (#4033) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-16 16:34:41 +08:00
Nick Dimiduk 87e0554cf1 HBASE-26616 Refactor code related to ZooKeeper authentication (#3973) 
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-11 15:47:20 -08:00
Duo Zhang 3f68399fee HBASE-26643 LoadBalancer should not return empty map (#4005) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-01-08 00:40:06 +08:00
meiyi a7c4a394a9 HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 12:17:40 +08:00
meiyi 09d80d179d HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3976) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-23 18:56:41 +08:00
Duo Zhang 7ac7d014e2 HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-23 11:58:41 +08:00
Samir Khan 8e56696748 HBASE-26598 Fix excessive connections in MajorCompactor (#3961) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 11:55:36 +08:00
zhengzhuobinzzb 9c01d04354 HBASE-26580 The message of StoreTooBusy is confused (#3949) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-18 23:34:15 +08:00
zhengzhuobinzzb 101d21f25f HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-18 23:28:02 +08:00
chenglei e20b2f3df5 HBASE-26488 Memory leak when MemStore retry flushing (#3899) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:22:58 +08:00
Norbert Kalmar 8fa8344a8c HBASE-26340 TableSplit returns false size under 1MB (#3872) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:22:00 +08:00
Andrew Purtell 6449087228 Preparing development version 2.4.10-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 18:52:26 -08:00
Andrew Purtell c49f7f63fc Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 18:51:25 -08:00
Andrew Purtell 6e25a4e2f9 Revert "Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md" 
This reverts commit 53391b269c.
 2021-12-17 18:34:37 -08:00
Andrew Purtell 2059cda314 Revert "Preparing development version 2.4.10-SNAPSHOT" 
This reverts commit deb570b2e9.
 2021-12-17 18:34:37 -08:00
Andrew Purtell deb570b2e9 Preparing development version 2.4.10-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 17:04:46 -08:00
Andrew Purtell 53391b269c Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 17:04:42 -08:00
Nick Dimiduk 7957b0cc7e HBASE-26542 Apply a `package` to test protobuf files (addendum) 
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-16 16:39:56 -08:00
Xiaolin Ha 6d2faf4323 HBASE-26525 Use unique thread name for group WALs (#3903) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-07 12:23:07 +08:00
Guanghao Zhang 17750a72f5 HBASE-24870 Ignore TestAsyncTableRSCrashPublish (#2248) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
 2021-12-06 19:07:11 -08:00
LiangJun He e766dd7b29 HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921) 
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-06 23:16:28 +08:00
RamanChodzka 2382a70de5 HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-05 22:40:15 +08:00
Tomu Tsuruhara 45347bb81a HBASE-26517 Add auth method information to AccessChecker audit log (#3897) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-04 23:14:52 +08:00
Rushabh Shah 1408c044b1
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3865) (#3862) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-12-01 11:18:05 +05:30
Duo Zhang f5af7611c0 HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-01 08:34:24 +08:00
chenglei b9b075f21a HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-27 16:40:10 +08:00
Zhuoyue Huang f86bff0f53 HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' (#3843) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-11-27 16:39:22 +08:00
chenglei aa2b807026
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3886) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-27 16:30:23 +08:00
Duo Zhang e4ad6e9f64 HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-11-23 18:52:59 +08:00
zhengzhuobinzzb 9b627905c7 HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
 2021-11-21 21:02:30 +08:00
ss77892 8e5a3b415f HBASE-26463 Unreadable table names after HBASE-24605 (#3853) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-21 20:49:20 +08:00
Xiaolin Ha 24b700848f HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3854) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-18 21:59:08 +08:00
Josh Elser 7ce597d34f HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679) 
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
 2021-11-16 16:33:43 -05:00
Andrew Purtell 801f9926c5
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3839) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-11-15 16:05:53 -08:00
chenglei 5dd23e5b8c HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-12 23:03:53 +08:00
clarax 455f7bfd7b
HBASE-26337 Optimization for weighted random generators (#3829) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-11 09:57:25 +08:00
chenglei 230ce3e6b5 HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-10 11:14:52 -08:00
Yutong Xiao 563a404ac1 HBASE-26410 Fix HBase TestCanaryTool for Java17 (#3809) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-09 22:21:12 +08:00
Andrew Purtell 9ccbd8c668 Revert "HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)" 
This reverts commit 98259c679a.
 2021-11-08 21:33:35 -08:00
Andrew Purtell 6057265388 HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled (#3819) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-11-08 18:32:22 -08:00
Xiaolin Ha a2c4cb67a2 HBASE-25322 Redundant Reference file in bottom region of split (#3814) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-08 14:50:46 +08:00
haxiaolin 71bd65c1f2 Revert "HBASE-25322 Redundant Reference file in bottom region of split (#3814)" 
This reverts commit 23f9b2aeeb.
 2021-11-08 11:43:32 +08:00
Xiaolin Ha 23f9b2aeeb HBASE-25322 Redundant Reference file in bottom region of split (#3814) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-05 18:18:54 +08:00
clarax 8ea548441c
HBASE-26311 Balancer gets stuck in cohosted replica distribution (#3805) 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-11-03 12:52:51 -07:00
clarax 0b7630bc1f
HBASE-26309 Balancer tends to move regions to the server at the end o… (#3812) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-03 10:27:46 +08:00
XinSun cc701e2c28 HBASE-26406 Can not add peer replicating to non-HBase (#3806) 
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit b9b7fec57f)
 2021-11-02 15:13:45 +08:00
chenglei 98259c679a HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-01 23:11:48 +08:00
Andrew Purtell 377c0586ab Preparing development version 2.4.9-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-27 08:37:23 -07:00
Andrew Purtell f844d09157 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-27 08:37:17 -07:00
Andrew Purtell d91738b9be Revert "Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md" 
This reverts commit 281294f655.
 2021-10-27 08:25:10 -07:00
Andrew Purtell 33ba3c60b9 Revert "Preparing development version 2.4.9-SNAPSHOT" 
This reverts commit 86c97a8b1a.
 2021-10-27 08:25:08 -07:00
chenglei 1487d62d21 HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect (#3794) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-26 15:44:29 +08:00
clarax 8392dc0ad2
HBASE-26327 Replicas cohosted on a rack shouldn't keep triggering balancer (#3789) 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-10-25 15:44:42 -07:00
Anoop Sam John 35264037ef HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum (#3792) 2021-10-24 09:25:13 +05:30
clarax d23a5b5aac
HBASE-26308 Sum of multiplier of cost functions is not populated prop… (#3782) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-10-22 09:51:12 -07:00
binlijin 446630b713 HBASE-26385 Clear CellScanner when replay (#3773) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2021-10-21 21:56:54 +08:00
Andrew Purtell 86c97a8b1a Preparing development version 2.4.9-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 16:08:26 -07:00
Andrew Purtell 281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 16:08:21 -07:00
KulwantSingh011 67967f265f HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big (#3752) 
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.

Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.

Signed-off-by: Anoop <anoopsamjohn@apache.org>
 2021-10-20 15:55:10 -07:00
Andrew Purtell 4149459dde HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775) 
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-20 15:55:10 -07:00
Viraj Jasani 09ffa49df8
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3769) (#3767) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 23:07:28 +05:30
Josh Elser a372d437b3 HBASE-26350 Add a DEBUG when we fail the SASL handshake 
Closes #3743

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-10-14 15:42:53 -04:00
Peter Somogyi c42d6ccc1a
HBASE-26329 Upgrade commons-io to 2.11.0 (#3735) 
Includes HBASE-25451 changes required for commons-io 2.8.0+ upgrade.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-10-10 09:47:57 +02:00
Andrew Purtell 2ca84d531a Preparing development version 2.4.8-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-08 17:10:33 -07:00
Andrew Purtell dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-08 17:10:27 -07:00
chenglei 3cc539a561 HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-29 21:47:11 +08:00
richardantal 43455061d3 HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688) 
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-09-29 10:23:43 +02:00
bitterfox a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-28 23:16:33 +08:00
clarax dc2bb6a908 HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-26 23:45:37 +08:00
Andrew Purtell 8bd4b2c9f3 Amend HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job 
Compliation fixes for CombinedBlockCache and TestClientSideRegionScanner.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-22 12:20:00 -07:00
Tak Lon (Stephen) Wu 6ca495b273 HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-22 09:39:38 -07:00
meiyi 6f68d2765c HBASE-26261 Store configuration loss when use update_config (#3664) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-22 19:08:07 +08:00
meiyi d75d73bcc7 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 11:24:19 +08:00
chenglei 9414e3b471 HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-17 22:29:18 +08:00
Xiaolin Ha 466d2d5563 HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 18:30:24 +08:00
hapihu 9e04033ad2 [HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 12:22:19 +08:00
Andrew Purtell 24971e8073 Preparing development version 2.4.7-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-03 09:41:58 -07:00
Andrew Purtell 7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-03 09:41:52 -07:00
Rushabh Shah f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
 2021-09-02 12:08:49 -07:00
XinSun 067f609ec6 HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit 345d7256c8)
 2021-09-02 15:33:24 +08:00