Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,093 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

8653 Commits

Author SHA1 Message Date
xianjingfeng 7c032c72cf HBASE-26671 Misspellings of hbck usage (#4033) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-16 16:34:41 +08:00
Nick Dimiduk 87e0554cf1 HBASE-26616 Refactor code related to ZooKeeper authentication (#3973) 
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-11 15:47:20 -08:00
Duo Zhang 3f68399fee HBASE-26643 LoadBalancer should not return empty map (#4005) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-01-08 00:40:06 +08:00
meiyi a7c4a394a9 HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 12:17:40 +08:00
meiyi 09d80d179d HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3976) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-23 18:56:41 +08:00
Duo Zhang 7ac7d014e2 HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-23 11:58:41 +08:00
Samir Khan 8e56696748 HBASE-26598 Fix excessive connections in MajorCompactor (#3961) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 11:55:36 +08:00
zhengzhuobinzzb 9c01d04354 HBASE-26580 The message of StoreTooBusy is confused (#3949) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-18 23:34:15 +08:00
zhengzhuobinzzb 101d21f25f HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-18 23:28:02 +08:00
chenglei e20b2f3df5 HBASE-26488 Memory leak when MemStore retry flushing (#3899) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:22:58 +08:00
Norbert Kalmar 8fa8344a8c HBASE-26340 TableSplit returns false size under 1MB (#3872) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:22:00 +08:00
Andrew Purtell 6449087228 Preparing development version 2.4.10-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 18:52:26 -08:00
Andrew Purtell c49f7f63fc Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 18:51:25 -08:00
Andrew Purtell 6e25a4e2f9 Revert "Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md" 
This reverts commit 53391b269c.
 2021-12-17 18:34:37 -08:00
Andrew Purtell 2059cda314 Revert "Preparing development version 2.4.10-SNAPSHOT" 
This reverts commit deb570b2e9.
 2021-12-17 18:34:37 -08:00
Andrew Purtell deb570b2e9 Preparing development version 2.4.10-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 17:04:46 -08:00
Andrew Purtell 53391b269c Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-17 17:04:42 -08:00
Nick Dimiduk 7957b0cc7e HBASE-26542 Apply a `package` to test protobuf files (addendum) 
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-16 16:39:56 -08:00
Xiaolin Ha 6d2faf4323 HBASE-26525 Use unique thread name for group WALs (#3903) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-07 12:23:07 +08:00
Guanghao Zhang 17750a72f5 HBASE-24870 Ignore TestAsyncTableRSCrashPublish (#2248) 
Signed-off-by: meiyi <myimeiyi@gmail.com>
 2021-12-06 19:07:11 -08:00
LiangJun He e766dd7b29 HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921) 
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-06 23:16:28 +08:00
RamanChodzka 2382a70de5 HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-05 22:40:15 +08:00
Tomu Tsuruhara 45347bb81a HBASE-26517 Add auth method information to AccessChecker audit log (#3897) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-04 23:14:52 +08:00
Rushabh Shah 1408c044b1
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3865) (#3862) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-12-01 11:18:05 +05:30
Duo Zhang f5af7611c0 HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-01 08:34:24 +08:00
chenglei b9b075f21a HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-27 16:40:10 +08:00
Zhuoyue Huang f86bff0f53 HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' (#3843) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-11-27 16:39:22 +08:00
chenglei aa2b807026
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3886) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-27 16:30:23 +08:00
Duo Zhang e4ad6e9f64 HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-11-23 18:52:59 +08:00
zhengzhuobinzzb 9b627905c7 HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
 2021-11-21 21:02:30 +08:00
ss77892 8e5a3b415f HBASE-26463 Unreadable table names after HBASE-24605 (#3853) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-21 20:49:20 +08:00
Xiaolin Ha 24b700848f HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3854) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-18 21:59:08 +08:00
Josh Elser 7ce597d34f HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679) 
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
 2021-11-16 16:33:43 -05:00
Andrew Purtell 801f9926c5
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3839) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-11-15 16:05:53 -08:00
chenglei 5dd23e5b8c HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-12 23:03:53 +08:00
clarax 455f7bfd7b
HBASE-26337 Optimization for weighted random generators (#3829) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-11 09:57:25 +08:00
chenglei 230ce3e6b5 HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-10 11:14:52 -08:00
Yutong Xiao 563a404ac1 HBASE-26410 Fix HBase TestCanaryTool for Java17 (#3809) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-09 22:21:12 +08:00
Andrew Purtell 9ccbd8c668 Revert "HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)" 
This reverts commit 98259c679a.
 2021-11-08 21:33:35 -08:00
Andrew Purtell 6057265388 HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled (#3819) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-11-08 18:32:22 -08:00
Xiaolin Ha a2c4cb67a2 HBASE-25322 Redundant Reference file in bottom region of split (#3814) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-08 14:50:46 +08:00
haxiaolin 71bd65c1f2 Revert "HBASE-25322 Redundant Reference file in bottom region of split (#3814)" 
This reverts commit 23f9b2aeeb.
 2021-11-08 11:43:32 +08:00
Xiaolin Ha 23f9b2aeeb HBASE-25322 Redundant Reference file in bottom region of split (#3814) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-05 18:18:54 +08:00
clarax 8ea548441c
HBASE-26311 Balancer gets stuck in cohosted replica distribution (#3805) 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-11-03 12:52:51 -07:00
clarax 0b7630bc1f
HBASE-26309 Balancer tends to move regions to the server at the end o… (#3812) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-03 10:27:46 +08:00
XinSun cc701e2c28 HBASE-26406 Can not add peer replicating to non-HBase (#3806) 
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit b9b7fec57f)
 2021-11-02 15:13:45 +08:00
chenglei 98259c679a HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-01 23:11:48 +08:00
Andrew Purtell 377c0586ab Preparing development version 2.4.9-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-27 08:37:23 -07:00
Andrew Purtell f844d09157 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-27 08:37:17 -07:00
Andrew Purtell d91738b9be Revert "Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md" 
This reverts commit 281294f655.
 2021-10-27 08:25:10 -07:00
Andrew Purtell 33ba3c60b9 Revert "Preparing development version 2.4.9-SNAPSHOT" 
This reverts commit 86c97a8b1a.
 2021-10-27 08:25:08 -07:00
chenglei 1487d62d21 HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect (#3794) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-26 15:44:29 +08:00
clarax 8392dc0ad2
HBASE-26327 Replicas cohosted on a rack shouldn't keep triggering balancer (#3789) 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-10-25 15:44:42 -07:00
Anoop Sam John 35264037ef HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum (#3792) 2021-10-24 09:25:13 +05:30
clarax d23a5b5aac
HBASE-26308 Sum of multiplier of cost functions is not populated prop… (#3782) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-10-22 09:51:12 -07:00
binlijin 446630b713 HBASE-26385 Clear CellScanner when replay (#3773) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2021-10-21 21:56:54 +08:00
Andrew Purtell 86c97a8b1a Preparing development version 2.4.9-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 16:08:26 -07:00
Andrew Purtell 281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 16:08:21 -07:00
KulwantSingh011 67967f265f HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big (#3752) 
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.

Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.

Signed-off-by: Anoop <anoopsamjohn@apache.org>
 2021-10-20 15:55:10 -07:00
Andrew Purtell 4149459dde HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775) 
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-20 15:55:10 -07:00
Viraj Jasani 09ffa49df8
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3769) (#3767) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 23:07:28 +05:30
Josh Elser a372d437b3 HBASE-26350 Add a DEBUG when we fail the SASL handshake 
Closes #3743

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-10-14 15:42:53 -04:00
Peter Somogyi c42d6ccc1a
HBASE-26329 Upgrade commons-io to 2.11.0 (#3735) 
Includes HBASE-25451 changes required for commons-io 2.8.0+ upgrade.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-10-10 09:47:57 +02:00
Andrew Purtell 2ca84d531a Preparing development version 2.4.8-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-08 17:10:33 -07:00
Andrew Purtell dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-08 17:10:27 -07:00
chenglei 3cc539a561 HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-29 21:47:11 +08:00
richardantal 43455061d3 HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688) 
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-09-29 10:23:43 +02:00
bitterfox a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-28 23:16:33 +08:00
clarax dc2bb6a908 HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-26 23:45:37 +08:00
Andrew Purtell 8bd4b2c9f3 Amend HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job 
Compliation fixes for CombinedBlockCache and TestClientSideRegionScanner.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-22 12:20:00 -07:00
Tak Lon (Stephen) Wu 6ca495b273 HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-22 09:39:38 -07:00
meiyi 6f68d2765c HBASE-26261 Store configuration loss when use update_config (#3664) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-22 19:08:07 +08:00
meiyi d75d73bcc7 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 11:24:19 +08:00
chenglei 9414e3b471 HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-17 22:29:18 +08:00
Xiaolin Ha 466d2d5563 HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 18:30:24 +08:00
hapihu 9e04033ad2 [HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 12:22:19 +08:00
Andrew Purtell 24971e8073 Preparing development version 2.4.7-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-03 09:41:58 -07:00
Andrew Purtell 7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-03 09:41:52 -07:00
Rushabh Shah f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
 2021-09-02 12:08:49 -07:00
XinSun 067f609ec6 HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit 345d7256c8)
 2021-09-02 15:33:24 +08:00
chenglei cf4c764d16 HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-01 18:17:26 +08:00
Andrew Purtell 122efbcd82 HBASE-25642 Fix or stop warning about already cached block (#3638) 
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
 2021-08-31 09:26:14 -07:00
keyserbrian1 133237582f HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-29 21:43:02 +08:00
Andrew Purtell 21e2c1b7c6 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-08-27 10:15:19 -07:00
Pankaj 1a5b9b7ff6 HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-27 16:47:06 +08:00
lpalasthy da74b8c8fb HBASE-26219 Negative time is logged while waiting on regionservers (#3622) 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-25 16:40:16 +02:00
Xiaolin Ha d6b2257655 HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler (#3489) 
Signed-off-by: stack <stack@apache.org>
 2021-08-18 14:41:56 +08:00
eomiks 96015e9669 HBASE-24652 master-status UI make date type fields sortable 2021-08-16 16:02:52 -07:00
stack 2ad7905ddc HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)" 
This reverts commit d07d181ea4.
 2021-08-16 13:46:05 -07:00
lzx404243 627e0d61ba HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner (#2984) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-14 11:11:46 +08:00
chenglei 8fced2d7f8 HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore (#3421) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-12 23:22:09 +08:00
Xiaolin Ha 2d89b08eb0 HBASE-26155 JVM crash when scan (#3553) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-12 17:20:18 +08:00
Rushabh Shah 9d34fa7d58
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-08-12 13:48:17 +05:30
Viraj Jasani cd007eb6b2
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573) 
Signed-off-by: Michael Stack <stack@apache.org>
 2021-08-10 10:59:14 +05:30
Richard Marscher 66f931c433 HBASE-6908: Add pluggable rpc queue implementation (#3522) 
Can pass in a FQCN to load as the call queue implementation.

Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.

`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature

Hard fails if the class fails to load as a `BlockingQueue<CallRunner>`

Signed-off-by: stack <stack@apache.org>
 2021-08-09 12:56:25 -07:00
Duo Zhang 3182507652 HBASE-26179 TestRequestTooBigException spends too much time to finish (#3571) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-08-07 23:08:10 +08:00
Xiaolin Ha 2ea2f800b0 HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes (#3564) 
Signed-off-by: stack <stack@apache.com>
 2021-08-05 08:18:09 -07:00
chenglei 9a469aeaae HBASE-26142 NullPointerException when set 'hbase.hregion.memstore.mslab.indexchunksize.percent' to zero (#3531) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-05 21:04:57 +08:00
caroliney14 428cff499d HBASE-25469 Add detailed RIT info in JSON format for consumption as metrics (#3555) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-08-04 18:22:49 -07:00
Andrew Purtell 91130af844 Revert "Add detailed RIT info in JSON format for consumption as metrics (#3555)" 
Commit is missing JIRA identifier.

This reverts commit 9398745f44.
 2021-08-04 18:22:30 -07:00
caroliney14 9398745f44 Add detailed RIT info in JSON format for consumption as metrics (#3555) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-08-04 18:07:25 -07:00
Ruanhui 348c39236c HBASE-26166 Fix a minor bug of table list on master ui (#3554) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
 2021-08-04 20:41:11 +08:00
Bryan Beaudreault 63b17d1674
HBASE-26154: Adds exception metrics for QuotaExceededException and RpcThrottlingException (#3546) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-08-02 15:19:59 +05:30
YutSean cb1174e9e1 HBASE-26105 Rectify the expired TODO comment in CombinedBC. (#3509) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-07-30 21:43:38 +08:00
Andrew Purtell 4ec1333df8 Preparing development version 2.4.6-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-27 09:34:19 -07:00
Andrew Purtell 03b8c0cf42 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-27 09:34:14 -07:00
Duo Zhang eb4728116d HBASE-26120 New replication gets stuck or data loss when multiwal groups more than 10 (#3528) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2021-07-27 08:15:48 -07:00
Andrew Purtell 845e6f0216 Preparing development version 2.4.6-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-26 17:24:44 -07:00
Andrew Purtell 4810fd1096 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-26 17:24:37 -07:00
Andrew Purtell 67163bb1da Preparing development version 2.4.6-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-23 09:55:58 -07:00
Andrew Purtell 4a2828386f Preparing hbase release 2.4.5RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-07-23 09:55:52 -07:00
Rushabh Shah 9a8fff78e7 HBASE-26093 Replication is stuck due to zero length wal file in oldWALs directory (#3504) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-07-23 09:33:50 -07:00
meiyi a3940afd25 HBASE-24734 RegionInfo#containsRange should support check meta table (#3496) (#3517) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2021-07-22 18:05:14 +08:00
gkanade a72c62b022 HBASE-24984 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operation (#3512) 
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-07-22 08:35:46 +05:30
Aman Poonia 02c796ca0e
HBASE-25986 set default value of normalization enabled from hbase site (#3476) (#3372) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-07-19 15:29:02 +05:30
clarax 6ab6d6f231
HBASE-25973 Balancer should explain progress in a better way in log - backport branch-2 (#3485) 
Signed-off-by: stack <stack@apache.org>
 2021-07-16 15:20:14 -07:00
clarax dd2ae3605d
HBASE-25739 TableSkewCostFunction need to use aggregated deviation - … (#3481) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: stack <stack@duboce.net>
    Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-07-16 10:53:41 -07:00
YutSean 5ee1447b55 HBASE-26083 In branch-2 & branch-1 L1 miss metric is always 0 when using CombinedBlockCache (#3473) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
 2021-07-16 10:38:05 +08:00
binlijin 1d0cfa9ed4 HBASE-26086 TestHRegionReplayEvents do not pass in branch-2 and throws NullPointerException (#3480) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-07-15 09:53:34 +08:00
Xiaolin Ha b83fec48dc
HBASE-26036 DBB released too early in HRegion.get() and dirty data for some operations (#3436) (#3486) (#3487) 
Signed-off-by: Michael Stack <stack@apache.org>
 2021-07-14 16:40:25 +08:00
Duo Zhang 273c5c567d HBASE-26068 The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrong (#3461) 
Signed-off-by: Yulin Niu <niuyulin@apache.org
 2021-07-07 14:39:14 +08:00
Viraj Jasani 4bd7aed064
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3455) 
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-07-03 22:45:17 +05:30
Viraj Jasani c50867348b
HBASE-22923 min version of RegionServer to move system table regions (#3439) (#3438) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-07-01 16:24:47 +05:30
Viraj Jasani 5b5c92f427
HBASE-25902 Add missing CFs in meta during HBase 1 to 2 Upgrade (#3417) 
Signed-off-by: Michael Stack <stack@apache.org>
 2021-07-01 15:14:23 +05:30
bsglz 399b58e7c6 HBASE-26028 The view as json page shows exception when using TinyLfuBlockCache (#3420) 
(cherry picked from commit 147b030c1f)
 2021-07-01 10:36:20 +08:00
Duo Zhang c5a6e19be0 HBASE-26039 TestReplicationKillRS is useless after HBASE-23956 (#3440) 
Signed-off-by: Michael Stack <stack@apache.org>
 2021-06-30 08:32:36 +08:00
GeorryHuang 270b3facce HBASE-25980 Master table.jsp pointed at meta throws 500 when no all r… (#3373) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-27 22:33:48 +08:00
GeorryHuang 414deeea83 HBASE-26015 Should implement getRegionServers(boolean) method in Asyn… (#3406) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-27 22:13:36 +08:00
YutSean 3a6441c946 HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3411) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-06-24 15:37:46 +08:00
Duo Zhang b453cbd819 HBASE-26020 Split TestWALEntryStream.testDifferentCounts out (#3409) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-06-23 23:19:28 +08:00
litao 8d1473d321
HBASE-25934 Add username for RegionScannerHolder (#3325) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-06-23 12:55:21 +05:30
lujiefsi f09924b650 HBASE-25877 Add access check for compactionSwitch (#3253) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-22 23:47:04 +08:00
belugabehr ea439c652a HBASE-25937: Clarify UnknownRegionException (#3330) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-22 22:44:21 +08:00
Duo Zhang ad545aa548 HBASE-25992 Addendum add missing catch WALEntryFilterRetryableException back 2021-06-21 23:59:11 +08:00
YutSean 02714cbc18 HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid (#3403) 
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry-picked from 029dc81b39)
 2021-06-21 15:30:20 +08:00
Viraj Jasani 0c1d1d26a8
HBASE-25698 Fixing IllegalReferenceCountException when using TinyLfuBlockCache (#3215) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2021-06-21 12:57:48 +05:30
Duo Zhang beaeb0dfec HBASE-25992 Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596 (#3376) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-06-20 16:44:51 +08:00
Bharath Vissapragada 58f067dc4d
HBASE-25998: Redo synchronization in SyncFuture (#3400) 
Currently uses coarse grained synchronized approach that seems to
create a lot of contention. This patch

- Uses a reentrant lock instead of synchronized monitor
- Switches to a condition variable based waiting rather than busy wait
- Removed synchronization for unnecessary fields

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 6bafb59642)
 2021-06-18 10:37:01 -07:00
Bharath Vissapragada a4ceabdc76
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371) (#3393) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 5a19bcfa98)
 2021-06-17 12:28:18 -07:00
binlijin 814b196f03 HBASE-25997 NettyRpcFrameDecoder decode request header wrong when han… (#3380) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-15 14:42:26 +08:00
Toshihiro Suzuki b061d477a8 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (#3386) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-15 13:57:25 +09:00
Duo Zhang 5159eaec12 HBASE-25995 Change the method name for DoubleArrayCost.setCosts (#3381) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-06-15 12:06:02 +08:00
Duo Zhang 711b76c24f
HBASE-25947 Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3 (#3339) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-06-11 09:33:08 +08:00
Zheng Wang 1fd584ed2f HBASE-25967 The readRequestsCount does not calculate when the outResults is empty 2021-06-10 11:08:30 +08:00
Xiaolin Ha 7436a345be HBASE-25981 JVM crash when displaying RegionServer UI (#3364) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-09 18:18:48 +08:00
Andrew Purtell 09eebe5cd0 Preparing development version 2.4.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-06-07 15:21:44 -07:00
Andrew Purtell 20e7ba45b0 Preparing hbase release 2.4.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-06-07 15:21:39 -07:00
Duo Zhang 6d1d64caf7 HBASE-25963 HBaseCluster should be marked as IA.Public (#3348) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-06-06 21:27:18 +08:00
meiyi 2dd7ec9d9e HBASE-25929 RegionServer JVM crash when compaction (#3318) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-06-03 17:34:53 +08:00
Bharath Vissapragada 8a41cb7f1d
HBASE-25932: Ensure replication reads the trailer bytes from WAL. (#3332) (#3346) 
This bug was exposed by the test from HBASE-25924. Since this wal
implementations close the wal asynchronously, replication can potentially
miss the trailer bytes. (see jira comment for detailed analysis).

While this is not a correctness problem (since trailer does not have any entry data),
it erroneously bumps a metric that is used to track skipped bytes in WAL resulting
in false alarms which is something we should avoid.

Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
(cherry picked from commit b04c3c7786)
 2021-06-01 08:04:02 -07:00