8558 Commits

Author SHA1 Message Date
XinSun
cc701e2c28 HBASE-26406 Can not add peer replicating to non-HBase (#3806)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit b9b7fec57f9de5407c63467780f454345963c2a0)
2021-11-02 15:13:45 +08:00
chenglei
98259c679a HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 23:11:48 +08:00
Andrew Purtell
377c0586ab Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:23 -07:00
Andrew Purtell
f844d09157 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:17 -07:00
Andrew Purtell
d91738b9be Revert "Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 281294f655817f086a0ffcc2d66bf5827d0521e2.
2021-10-27 08:25:10 -07:00
Andrew Purtell
33ba3c60b9 Revert "Preparing development version 2.4.9-SNAPSHOT"
This reverts commit 86c97a8b1a25c89d3812486a286259426b5eec42.
2021-10-27 08:25:08 -07:00
chenglei
1487d62d21 HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect (#3794)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-26 15:44:29 +08:00
clarax
8392dc0ad2
HBASE-26327 Replicas cohosted on a rack shouldn't keep triggering balancer (#3789)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-10-25 15:44:42 -07:00
Anoop Sam John
35264037ef HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum (#3792) 2021-10-24 09:25:13 +05:30
clarax
d23a5b5aac
HBASE-26308 Sum of multiplier of cost functions is not populated prop… (#3782)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-10-22 09:51:12 -07:00
binlijin
446630b713 HBASE-26385 Clear CellScanner when replay (#3773)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-10-21 21:56:54 +08:00
Andrew Purtell
86c97a8b1a Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:26 -07:00
Andrew Purtell
281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:21 -07:00
KulwantSingh011
67967f265f HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big (#3752)
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.

Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.

Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-10-20 15:55:10 -07:00
Andrew Purtell
4149459dde HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775)
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-20 15:55:10 -07:00
Viraj Jasani
09ffa49df8
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3769) (#3767)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 23:07:28 +05:30
Josh Elser
a372d437b3 HBASE-26350 Add a DEBUG when we fail the SASL handshake
Closes #3743

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-10-14 15:42:53 -04:00
Peter Somogyi
c42d6ccc1a
HBASE-26329 Upgrade commons-io to 2.11.0 (#3735)
Includes HBASE-25451 changes required for commons-io 2.8.0+ upgrade.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-10-10 09:47:57 +02:00
Andrew Purtell
2ca84d531a Preparing development version 2.4.8-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:33 -07:00
Andrew Purtell
dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:27 -07:00
chenglei
3cc539a561 HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-29 21:47:11 +08:00
richardantal
43455061d3 HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688)
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-29 10:23:43 +02:00
bitterfox
a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 23:16:33 +08:00
clarax
dc2bb6a908 HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-26 23:45:37 +08:00
Andrew Purtell
8bd4b2c9f3 Amend HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job
Compliation fixes for CombinedBlockCache and TestClientSideRegionScanner.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-22 12:20:00 -07:00
Tak Lon (Stephen) Wu
6ca495b273 HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684)
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-22 09:39:38 -07:00
meiyi
6f68d2765c HBASE-26261 Store configuration loss when use update_config (#3664)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 19:08:07 +08:00
meiyi
d75d73bcc7 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:24:19 +08:00
chenglei
9414e3b471 HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:29:18 +08:00
Xiaolin Ha
466d2d5563 HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:30:24 +08:00
hapihu
9e04033ad2 [HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:22:19 +08:00
Andrew Purtell
24971e8073 Preparing development version 2.4.7-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:58 -07:00
Andrew Purtell
7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:52 -07:00
Rushabh Shah
f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
2021-09-02 12:08:49 -07:00
XinSun
067f609ec6 HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651)
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit 345d7256c812dd5fbdfe9f378b2884dd945c5da2)
2021-09-02 15:33:24 +08:00
chenglei
cf4c764d16 HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 18:17:26 +08:00
Andrew Purtell
122efbcd82 HBASE-25642 Fix or stop warning about already cached block (#3638)
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
2021-08-31 09:26:14 -07:00
keyserbrian1
133237582f HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-29 21:43:02 +08:00
Andrew Purtell
21e2c1b7c6 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-08-27 10:15:19 -07:00
Pankaj
1a5b9b7ff6 HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-27 16:47:06 +08:00
lpalasthy
da74b8c8fb HBASE-26219 Negative time is logged while waiting on regionservers (#3622)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:40:16 +02:00
Xiaolin Ha
d6b2257655 HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler (#3489)
Signed-off-by: stack <stack@apache.org>
2021-08-18 14:41:56 +08:00
eomiks
96015e9669 HBASE-24652 master-status UI make date type fields sortable 2021-08-16 16:02:52 -07:00
stack
2ad7905ddc HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)"
This reverts commit d07d181ea4a9da316659bb21fd4fffc979b5f77a.
2021-08-16 13:46:05 -07:00
lzx404243
627e0d61ba HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner (#2984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-14 11:11:46 +08:00
chenglei
8fced2d7f8 HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore (#3421)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 23:22:09 +08:00
Xiaolin Ha
2d89b08eb0 HBASE-26155 JVM crash when scan (#3553)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 17:20:18 +08:00
Rushabh Shah
9d34fa7d58
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-12 13:48:17 +05:30
Viraj Jasani
cd007eb6b2
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573)
Signed-off-by: Michael Stack <stack@apache.org>
2021-08-10 10:59:14 +05:30
Richard Marscher
66f931c433 HBASE-6908: Add pluggable rpc queue implementation (#3522)
Can pass in a FQCN to load as the call queue implementation.

Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.

`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature

Hard fails if the class fails to load as a `BlockingQueue<CallRunner>`

Signed-off-by: stack <stack@apache.org>
2021-08-09 12:56:25 -07:00