Commit Graph

8669 Commits

Author SHA1 Message Date
Nick Dimiduk 36e1a1d260 HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-03-02 15:52:05 +01:00
Andrew Purtell 819afc7a39 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:11 -08:00
Andrew Purtell 3e5359c73d Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:07 -08:00
Andrew Purtell 9e8b5a89e5 Revert "Preparing development version 2.4.11-SNAPSHOT"
Revert "Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 31a9beaf94.
This reverts commit 0dc107e15b.
This reverts commit a86548a257.
This reverts commit 27343174e7.
2022-02-28 09:17:45 -08:00
Andrew Purtell 31a9beaf94 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:55 -08:00
Andrew Purtell 0dc107e15b Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:52 -08:00
Andrew Purtell a86548a257 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:32 -08:00
Andrew Purtell 27343174e7 Preparing hbase release 2.4.10RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:29 -08:00
Richard Marscher f358125fe5 HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor (#3944)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 10:26:38 -08:00
chenglei 9999f875c9
HBASE-26712 Balancer encounters NPE in rare case (#4117) 2022-02-18 10:59:29 +08:00
Xiaolin Ha 0020da472d HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate (#4105)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-16 11:24:49 +08:00
Xiaolin Ha c8ccbde51a HBASE-26434 Do compact when all L0 files are expired (#3830)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 22:40:22 +08:00
Yutong Xiao 3f315d7e93 HBASE-26688 Threads shared EMPTY_RESULT may lead to unexpected client job down (#4073)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 20:36:23 +08:00
Tak Lon (Stephen) Wu b8db5ac24c HBASE-26729 Backport "HBASE-26714 Introduce path configuration for system coprocessors" to branch-2 (#4093)
- rename from HBaseCommonTestingUtil to HBaseCommonTestingUtility

Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-02-04 06:01:37 -08:00
Bryan Beaudreault 590e38e8e4 HBASE-26713 Default to LATEST_TIMESTAMP if no timestamp sent along on Increment/Append (#4075)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-01-28 12:58:05 -08:00
Peter Somogyi a02324f202 HBASE-26689 Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#4049)
Duo Zhang <zhangduo@apache.org>
2022-01-20 15:11:26 +01:00
xianjingfeng 7c032c72cf HBASE-26671 Misspellings of hbck usage (#4033)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-16 16:34:41 +08:00
Nick Dimiduk 87e0554cf1 HBASE-26616 Refactor code related to ZooKeeper authentication (#3973)
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-11 15:47:20 -08:00
Duo Zhang 3f68399fee HBASE-26643 LoadBalancer should not return empty map (#4005)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-01-08 00:40:06 +08:00
meiyi a7c4a394a9 HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 12:17:40 +08:00
meiyi 09d80d179d HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3976)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-23 18:56:41 +08:00
Duo Zhang 7ac7d014e2 HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 11:58:41 +08:00
Samir Khan 8e56696748 HBASE-26598 Fix excessive connections in MajorCompactor (#3961)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 11:55:36 +08:00
zhengzhuobinzzb 9c01d04354 HBASE-26580 The message of StoreTooBusy is confused (#3949)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-18 23:34:15 +08:00
zhengzhuobinzzb 101d21f25f HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-18 23:28:02 +08:00
chenglei e20b2f3df5 HBASE-26488 Memory leak when MemStore retry flushing (#3899)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 12:22:58 +08:00
Norbert Kalmar 8fa8344a8c HBASE-26340 TableSplit returns false size under 1MB (#3872)
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-18 12:22:00 +08:00
Andrew Purtell 6449087228 Preparing development version 2.4.10-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:52:26 -08:00
Andrew Purtell c49f7f63fc Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:51:25 -08:00
Andrew Purtell 6e25a4e2f9 Revert "Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 53391b269c.
2021-12-17 18:34:37 -08:00
Andrew Purtell 2059cda314 Revert "Preparing development version 2.4.10-SNAPSHOT"
This reverts commit deb570b2e9.
2021-12-17 18:34:37 -08:00
Andrew Purtell deb570b2e9 Preparing development version 2.4.10-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 17:04:46 -08:00
Andrew Purtell 53391b269c Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 17:04:42 -08:00
Nick Dimiduk 7957b0cc7e HBASE-26542 Apply a `package` to test protobuf files (addendum)
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-16 16:39:56 -08:00
Xiaolin Ha 6d2faf4323 HBASE-26525 Use unique thread name for group WALs (#3903)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-07 12:23:07 +08:00
Guanghao Zhang 17750a72f5 HBASE-24870 Ignore TestAsyncTableRSCrashPublish (#2248)
Signed-off-by: meiyi <myimeiyi@gmail.com>
2021-12-06 19:07:11 -08:00
LiangJun He e766dd7b29 HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921)
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-06 23:16:28 +08:00
RamanChodzka 2382a70de5 HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-05 22:40:15 +08:00
Tomu Tsuruhara 45347bb81a HBASE-26517 Add auth method information to AccessChecker audit log (#3897)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 23:14:52 +08:00
Rushabh Shah 1408c044b1
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3865) (#3862)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-12-01 11:18:05 +05:30
Duo Zhang f5af7611c0 HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-01 08:34:24 +08:00
chenglei b9b075f21a HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 16:40:10 +08:00
Zhuoyue Huang f86bff0f53 HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' (#3843)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-27 16:39:22 +08:00
chenglei aa2b807026
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3886)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 16:30:23 +08:00
Duo Zhang e4ad6e9f64 HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-23 18:52:59 +08:00
zhengzhuobinzzb 9b627905c7 HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-11-21 21:02:30 +08:00
ss77892 8e5a3b415f HBASE-26463 Unreadable table names after HBASE-24605 (#3853)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-21 20:49:20 +08:00
Xiaolin Ha 24b700848f HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3854)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-18 21:59:08 +08:00
Josh Elser 7ce597d34f HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679)
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
2021-11-16 16:33:43 -05:00
Andrew Purtell 801f9926c5
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3839)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-15 16:05:53 -08:00
chenglei 5dd23e5b8c HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-12 23:03:53 +08:00
clarax 455f7bfd7b
HBASE-26337 Optimization for weighted random generators (#3829)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-11 09:57:25 +08:00
chenglei 230ce3e6b5 HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-10 11:14:52 -08:00
Yutong Xiao 563a404ac1 HBASE-26410 Fix HBase TestCanaryTool for Java17 (#3809)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 22:21:12 +08:00
Andrew Purtell 9ccbd8c668 Revert "HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)"
This reverts commit 98259c679a.
2021-11-08 21:33:35 -08:00
Andrew Purtell 6057265388 HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled (#3819)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:32:22 -08:00
Xiaolin Ha a2c4cb67a2 HBASE-25322 Redundant Reference file in bottom region of split (#3814)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-08 14:50:46 +08:00
haxiaolin 71bd65c1f2 Revert "HBASE-25322 Redundant Reference file in bottom region of split (#3814)"
This reverts commit 23f9b2aeeb.
2021-11-08 11:43:32 +08:00
Xiaolin Ha 23f9b2aeeb HBASE-25322 Redundant Reference file in bottom region of split (#3814)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-05 18:18:54 +08:00
clarax 8ea548441c
HBASE-26311 Balancer gets stuck in cohosted replica distribution (#3805)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-11-03 12:52:51 -07:00
clarax 0b7630bc1f
HBASE-26309 Balancer tends to move regions to the server at the end o… (#3812)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-03 10:27:46 +08:00
XinSun cc701e2c28 HBASE-26406 Can not add peer replicating to non-HBase (#3806)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit b9b7fec57f)
2021-11-02 15:13:45 +08:00
chenglei 98259c679a HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 23:11:48 +08:00
Andrew Purtell 377c0586ab Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:23 -07:00
Andrew Purtell f844d09157 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:17 -07:00
Andrew Purtell d91738b9be Revert "Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 281294f655.
2021-10-27 08:25:10 -07:00
Andrew Purtell 33ba3c60b9 Revert "Preparing development version 2.4.9-SNAPSHOT"
This reverts commit 86c97a8b1a.
2021-10-27 08:25:08 -07:00
chenglei 1487d62d21 HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect (#3794)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-26 15:44:29 +08:00
clarax 8392dc0ad2
HBASE-26327 Replicas cohosted on a rack shouldn't keep triggering balancer (#3789)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-10-25 15:44:42 -07:00
Anoop Sam John 35264037ef HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum (#3792) 2021-10-24 09:25:13 +05:30
clarax d23a5b5aac
HBASE-26308 Sum of multiplier of cost functions is not populated prop… (#3782)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-10-22 09:51:12 -07:00
binlijin 446630b713 HBASE-26385 Clear CellScanner when replay (#3773)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-10-21 21:56:54 +08:00
Andrew Purtell 86c97a8b1a Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:26 -07:00
Andrew Purtell 281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:21 -07:00
KulwantSingh011 67967f265f HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big (#3752)
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.

Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.

Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-10-20 15:55:10 -07:00
Andrew Purtell 4149459dde HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775)
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-20 15:55:10 -07:00
Viraj Jasani 09ffa49df8
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3769) (#3767)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 23:07:28 +05:30
Josh Elser a372d437b3 HBASE-26350 Add a DEBUG when we fail the SASL handshake
Closes #3743

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-10-14 15:42:53 -04:00
Peter Somogyi c42d6ccc1a
HBASE-26329 Upgrade commons-io to 2.11.0 (#3735)
Includes HBASE-25451 changes required for commons-io 2.8.0+ upgrade.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-10-10 09:47:57 +02:00
Andrew Purtell 2ca84d531a Preparing development version 2.4.8-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:33 -07:00
Andrew Purtell dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:27 -07:00
chenglei 3cc539a561 HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-29 21:47:11 +08:00
richardantal 43455061d3 HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688)
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-29 10:23:43 +02:00
bitterfox a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 23:16:33 +08:00
clarax dc2bb6a908 HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-26 23:45:37 +08:00
Andrew Purtell 8bd4b2c9f3 Amend HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job
Compliation fixes for CombinedBlockCache and TestClientSideRegionScanner.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-22 12:20:00 -07:00
Tak Lon (Stephen) Wu 6ca495b273 HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684)
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-22 09:39:38 -07:00
meiyi 6f68d2765c HBASE-26261 Store configuration loss when use update_config (#3664)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 19:08:07 +08:00
meiyi d75d73bcc7 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:24:19 +08:00
chenglei 9414e3b471 HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:29:18 +08:00
Xiaolin Ha 466d2d5563 HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:30:24 +08:00
hapihu 9e04033ad2 [HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:22:19 +08:00
Andrew Purtell 24971e8073 Preparing development version 2.4.7-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:58 -07:00
Andrew Purtell 7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:52 -07:00
Rushabh Shah f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
2021-09-02 12:08:49 -07:00
XinSun 067f609ec6 HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651)
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit 345d7256c8)
2021-09-02 15:33:24 +08:00
chenglei cf4c764d16 HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 18:17:26 +08:00
Andrew Purtell 122efbcd82 HBASE-25642 Fix or stop warning about already cached block (#3638)
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
2021-08-31 09:26:14 -07:00
keyserbrian1 133237582f HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-29 21:43:02 +08:00
Andrew Purtell 21e2c1b7c6 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-08-27 10:15:19 -07:00
Pankaj 1a5b9b7ff6 HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-27 16:47:06 +08:00
lpalasthy da74b8c8fb HBASE-26219 Negative time is logged while waiting on regionservers (#3622)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:40:16 +02:00
Xiaolin Ha d6b2257655 HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler (#3489)
Signed-off-by: stack <stack@apache.org>
2021-08-18 14:41:56 +08:00
eomiks 96015e9669 HBASE-24652 master-status UI make date type fields sortable 2021-08-16 16:02:52 -07:00
stack 2ad7905ddc HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)"
This reverts commit d07d181ea4.
2021-08-16 13:46:05 -07:00
lzx404243 627e0d61ba HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner (#2984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-14 11:11:46 +08:00
chenglei 8fced2d7f8 HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore (#3421)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 23:22:09 +08:00
Xiaolin Ha 2d89b08eb0 HBASE-26155 JVM crash when scan (#3553)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 17:20:18 +08:00
Rushabh Shah 9d34fa7d58
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-12 13:48:17 +05:30
Viraj Jasani cd007eb6b2
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573)
Signed-off-by: Michael Stack <stack@apache.org>
2021-08-10 10:59:14 +05:30
Richard Marscher 66f931c433 HBASE-6908: Add pluggable rpc queue implementation (#3522)
Can pass in a FQCN to load as the call queue implementation.

Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.

`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature

Hard fails if the class fails to load as a `BlockingQueue<CallRunner>`

Signed-off-by: stack <stack@apache.org>
2021-08-09 12:56:25 -07:00
Duo Zhang 3182507652 HBASE-26179 TestRequestTooBigException spends too much time to finish (#3571)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-07 23:08:10 +08:00
Xiaolin Ha 2ea2f800b0 HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes (#3564)
Signed-off-by: stack <stack@apache.com>
2021-08-05 08:18:09 -07:00
chenglei 9a469aeaae HBASE-26142 NullPointerException when set 'hbase.hregion.memstore.mslab.indexchunksize.percent' to zero (#3531)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-05 21:04:57 +08:00
caroliney14 428cff499d HBASE-25469 Add detailed RIT info in JSON format for consumption as metrics (#3555)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-04 18:22:49 -07:00
Andrew Purtell 91130af844 Revert "Add detailed RIT info in JSON format for consumption as metrics (#3555)"
Commit is missing JIRA identifier.

This reverts commit 9398745f44.
2021-08-04 18:22:30 -07:00
caroliney14 9398745f44 Add detailed RIT info in JSON format for consumption as metrics (#3555)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-08-04 18:07:25 -07:00
Ruanhui 348c39236c HBASE-26166 Fix a minor bug of table list on master ui (#3554)
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
2021-08-04 20:41:11 +08:00
Bryan Beaudreault 63b17d1674
HBASE-26154: Adds exception metrics for QuotaExceededException and RpcThrottlingException (#3546)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-08-02 15:19:59 +05:30
YutSean cb1174e9e1 HBASE-26105 Rectify the expired TODO comment in CombinedBC. (#3509)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-30 21:43:38 +08:00
Andrew Purtell 4ec1333df8 Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-27 09:34:19 -07:00
Andrew Purtell 03b8c0cf42 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-27 09:34:14 -07:00
Duo Zhang eb4728116d HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 (#3528)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-27 08:15:48 -07:00
Andrew Purtell 845e6f0216 Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-26 17:24:44 -07:00
Andrew Purtell 4810fd1096 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-26 17:24:37 -07:00
Andrew Purtell 67163bb1da Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-23 09:55:58 -07:00
Andrew Purtell 4a2828386f Preparing hbase release 2.4.5RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-23 09:55:52 -07:00
Rushabh Shah 9a8fff78e7 HBASE-26093 Replication is stuck due to zero length wal file in oldWALs directory (#3504)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-23 09:33:50 -07:00
meiyi a3940afd25 HBASE-24734 RegionInfo#containsRange should support check meta table (#3496) (#3517)
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-07-22 18:05:14 +08:00
gkanade a72c62b022 HBASE-24984 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operation (#3512)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-07-22 08:35:46 +05:30
Aman Poonia 02c796ca0e
HBASE-25986 set default value of normalization enabled from hbase site (#3476) (#3372)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-07-19 15:29:02 +05:30
clarax 6ab6d6f231
HBASE-25973 Balancer should explain progress in a better way in log - backport branch-2 (#3485)
Signed-off-by: stack <stack@apache.org>
2021-07-16 15:20:14 -07:00
clarax dd2ae3605d
HBASE-25739 TableSkewCostFunction need to use aggregated deviation - … (#3481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: stack <stack@duboce.net>
    Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
2021-07-16 10:53:41 -07:00
YutSean 5ee1447b55 HBASE-26083 In branch-2 & branch-1 L1 miss metric is always 0 when using CombinedBlockCache (#3473)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
2021-07-16 10:38:05 +08:00
binlijin 1d0cfa9ed4 HBASE-26086 TestHRegionReplayEvents do not pass in branch-2 and throws NullPointerException (#3480)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-15 09:53:34 +08:00
Xiaolin Ha b83fec48dc
HBASE-26036 DBB released too early in HRegion.get() and dirty data for some operations (#3436) (#3486) (#3487)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-14 16:40:25 +08:00
Duo Zhang 273c5c567d HBASE-26068 The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrong (#3461)
Signed-off-by: Yulin Niu <niuyulin@apache.org
2021-07-07 14:39:14 +08:00
Viraj Jasani 4bd7aed064
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3455)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-03 22:45:17 +05:30
Viraj Jasani c50867348b
HBASE-22923 min version of RegionServer to move system table regions (#3439) (#3438)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-01 16:24:47 +05:30
Viraj Jasani 5b5c92f427
HBASE-25902 Add missing CFs in meta during HBase 1 to 2 Upgrade (#3417)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-01 15:14:23 +05:30
bsglz 399b58e7c6 HBASE-26028 The view as json page shows exception when using TinyLfuBlockCache (#3420)
(cherry picked from commit 147b030c1f)
2021-07-01 10:36:20 +08:00
Duo Zhang c5a6e19be0 HBASE-26039 TestReplicationKillRS is useless after HBASE-23956 (#3440)
Signed-off-by: Michael Stack <stack@apache.org>
2021-06-30 08:32:36 +08:00
GeorryHuang 270b3facce HBASE-25980 Master table.jsp pointed at meta throws 500 when no all r… (#3373)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-27 22:33:48 +08:00
GeorryHuang 414deeea83 HBASE-26015 Should implement getRegionServers(boolean) method in Asyn… (#3406)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-27 22:13:36 +08:00
YutSean 3a6441c946 HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3411)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-24 15:37:46 +08:00
Duo Zhang b453cbd819 HBASE-26020 Split TestWALEntryStream.testDifferentCounts out (#3409)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-06-23 23:19:28 +08:00
litao 8d1473d321
HBASE-25934 Add username for RegionScannerHolder (#3325)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-23 12:55:21 +05:30
lujiefsi f09924b650 HBASE-25877 Add access check for compactionSwitch (#3253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 23:47:04 +08:00
belugabehr ea439c652a HBASE-25937: Clarify UnknownRegionException (#3330)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 22:44:21 +08:00
Duo Zhang ad545aa548 HBASE-25992 Addendum add missing catch WALEntryFilterRetryableException back 2021-06-21 23:59:11 +08:00