Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,061 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

9054 Commits

Author SHA1 Message Date
Duo Zhang 443bf30a5d
HBASE-26643 LoadBalancer should not return empty map (#4005) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-01-07 23:50:37 +08:00
Duo Zhang 436fb7875c
HBASE-26586 Should not rely on the global config when setting SFT implementation for a table while upgrading (#4006) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-01-07 23:39:18 +08:00
Duo Zhang 47983cf790
HBASE-26639 The implementation of TestMergesSplitsAddToTracker is problematic (#4010) 
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-01-07 23:05:47 +08:00
Nick Dimiduk 5e263dac38
HBASE-26616 Refactor code related to ZooKeeper authentication (#3973) 
This refactor reduces the size and scope of the `ZKUtil` class. The core of this refactor is
moving the `login*` methods from `ZKUtil` into their own class, `ZKAuthentication`. The class
`JaasConfiguration` is also moved along with them.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-06 17:04:15 -08:00
Nick Dimiduk 5cb7ed8005
HBASE-26474 Implement connection-level attributes (#3952) 
Add support for `db.system`, `db.connection_string`, `db.user`.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-05 15:32:12 -08:00
Wellington Ramos Chevreuil baeb51ff8a
HBASE-26585 Add SFT configuration to META table descriptor when creating META (#3998) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-01-05 12:20:07 +00:00
Xiaolin Ha ce2bbaf30a
HBASE-26578 CompactedHFilesDischarger should be shutdown when aborting regionserver (#3946) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-05 11:10:16 +08:00
chenglei 70cb9b0ba9
HBASE-26567 Remove IndexType from ChunkCreator (#3947) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-05 00:05:54 +08:00
Duo Zhang e96df8bf40
HBASE-26641 Split TestMasterFailoverWithProcedures (#3994) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2022-01-03 00:35:14 +08:00
chenglei 1b8e577cc6
HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-01-01 20:50:52 +08:00
Duo Zhang 9e469e4a2a HBASE-26540 Implement a tool to verify the lag of region replication (#3950) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 5ac76c1c00 HBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits (#3919) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 1fdd0a4cfd HBASE-26538 Should find a way to clear the replication queue for a legacy region_replica_replication peer (#3918) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang fa37aed8f6 HBASE-26481 Consider rolling upgrading from old region replication framework (#3880) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
林尚泉 9f6dfe6d3f HBASE-26417 Remove NoopReplicationQueueStorage (#3882) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 70259a2a4c HBASE-26456 Limit the size for one replicating (#3873) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 529c36e7ad HBASE-26416 Implement a new method for region replication instead of using replay (#3864) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 67306e74b1 HBASE-26457 Should not always clear all the failed replicas when getting a flush all request (#3850) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang a8d46db416 HBASE-26448 Make sure we do not flush a region too frequently (#3847) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 1b0d9ceaba HBASE-26449 The way we add or clear failedReplicas may have race (#3846) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2021-12-31 12:29:48 +08:00
Duo Zhang 0b29a7934a HBASE-26413 Limit the total size of buffered region replication entries (#3844) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 2ee18988e6 HBASE-26412 Handle sink failure in RegionReplicationSink (#3815) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang 7286cc0035 HBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary replicas directly (#3807) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang c14a76c4fd
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3987) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:08:01 +08:00
Xiaolin Ha b948ddbf21
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 17:04:01 +08:00
meiyi 8f0c2dabbb
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 10:40:33 +08:00
Richard Marscher c8b014866a
HBASE-26623 Report CallDroppedException in exception metrics (#3980) 
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-30 00:02:50 +08:00
Yutong Xiao a599d52820
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3938) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-27 23:59:13 +08:00
Duo Zhang 3f59f21be0
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-24 14:20:32 +08:00
meiyi a67490abd3
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3971) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 16:45:36 +08:00
Duo Zhang dbdef5982a
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-23 10:37:17 +08:00
Samir Khan bf258cd68f
HBASE-26598 Fix excessive connections in MajorCompactor (#3961) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 10:29:48 +08:00
BukrosSzabolcs 771e552cf4 HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot 
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil d00b5faade HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:59 -05:00
BukrosSzabolcs a288365f92 HBASE-26271 Cleanup the broken store files under data directory (#3786) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:59 -05:00
GeorryHuang 8bec26ea91 HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil 08d117197c HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:59 -05:00
Duo Zhang e4e7cf80b7 HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil 06db852aa0 HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:59 -05:00
Duo Zhang fc4f6d10e3 HBASE-26280 Use store file tracker when snapshoting (#3685) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:59 -05:00
Duo Zhang 5ff0f98a53 HBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang 2052e80e5d HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation (#3665) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil 0ee1689332 HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang 090b2fecf4 HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil 6e053765e8 HBASE-26079 Use StoreFileTracker when splitting and merging (#3617) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang 43b40e9374 HBASE-25988 Store the store file list by a file (#3578) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang 6aaef89789 HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:57 -05:00
zhengzhuobinzzb d399799c29
HBASE-26580 The message of StoreTooBusy is confused (#3949) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-18 23:22:14 +08:00
zhengzhuobinzzb ea0fe2222d
HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-18 23:17:40 +08:00
chenglei da616c00c7
HBASE-26488 Memory leak when MemStore retry flushing (#3899) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:17:19 +08:00
Norbert Kalmar 77b6b4dee3
HBASE-26340 TableSplit returns false size under 1MB (#3872) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 11:58:16 +08:00
Duo Zhang e598f2c663 Revert "HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)" 
Need a new 4.0.1 release

This reverts commit 139f08587a.
 2021-12-17 12:25:27 +08:00
Duo Zhang 139f08587a
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-17 10:22:48 +08:00
Nick Dimiduk 006433b066 HBASE-26542 Apply a `package` to test protobuf files (addendum) 
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-16 16:23:43 -08:00
Josh Elser 13f3b17870
HBASE-26550 Make sure the master is running normally before accepting a balance command (#3928) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-14 23:17:34 +08:00
Duo Zhang 8bca21b47d
HBASE-26558 Set version as 3.0.0-alpha-2 in master in prep for first RC of 3.0.0-alpha-2 (#3935) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
 2021-12-11 20:52:35 +08:00
Xiaolin Ha ca3ba494cb
HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-07 12:26:59 +08:00
Xiaolin Ha bdbb4fa087
HBASE-26525 Use unique thread name for group WALs (#3903) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-07 12:19:33 +08:00
LiangJun He 9cf224d4fe
HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921) 
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-06 22:58:38 +08:00
RamanChodzka 554580f966
HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-05 22:34:30 +08:00
Tomu Tsuruhara cf5bc6afca
HBASE-26517 Add auth method information to AccessChecker audit log (#3897) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-04 22:59:29 +08:00
Tak Lon (Stephen) Wu 6d28bc6dd9
HBASE-26524 Addendum fix TestConstraints (#3912) 2021-12-02 12:55:41 -08:00
Nick Dimiduk ea824df571
HBASE-26471 Move tracing semantic attributes to their own class (#3896) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2021-12-01 09:21:20 -08:00
Rushabh Shah d1762f5209
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3862) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-12-01 11:04:35 +05:30
Duo Zhang 358c4dc902
HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-01 08:24:46 +08:00
chenglei e311e23ac6
HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-27 12:05:47 +08:00
Bryan Beaudreault 1b27124c61
HBASE-26304 Reflect out of band locality improvements in metrics and balancer (#3803) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-27 12:01:46 +08:00
chenglei 9fd58fecf0
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3859) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-11-25 20:32:28 +08:00
liangxs c148d5bb3f
HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-24 23:35:00 +08:00
Yutong Xiao 96d699a8f0
HBASE-26477 Fix MiniMapReduceCluster failure under Java17 (#3867) 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-23 18:39:38 +08:00
Duo Zhang 1c48248ef8
HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-11-23 18:31:18 +08:00
Xiaolin Ha b870b6d9ac HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-23 11:15:49 +08:00
haxiaolin 2aafd31ff5 Revert "HBASE-26249 Ameliorate compaction made by bul… (#3831)" 
This reverts commit 5e62e2aa8d.
 2021-11-23 11:15:14 +08:00
Xiaolin Ha 5e62e2aa8d
HBASE-26249 Ameliorate compaction made by bul… (#3831) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-23 11:14:26 +08:00
zhengzhuobinzzb 04635f405a
HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
 2021-11-21 20:59:11 +08:00
ss77892 7a80b3a4f7
HBASE-26463 Unreadable table names after HBASE-24605 (#3853) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-21 20:44:57 +08:00
Xiaolin Ha b2571df7ae
HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3842) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-18 21:36:36 +08:00
Josh Elser 1c47f80d83
HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679) 
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
 2021-11-16 16:26:55 -05:00
Andrew Purtell d92e9089de
HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace (#3840) 
Signed-off-by: Anoop <anoopsamjohn@apache.org>
 2021-11-15 16:11:53 -08:00
Andrew Purtell 69a4eda35f
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3838) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-11-15 16:05:27 -08:00
chenglei 8458e44a1a
HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-12 22:51:40 +08:00
Zhuoyue Huang 539e161e74 HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' (#3843) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
 2021-11-12 11:40:55 +08:00
Zhuoyue Huang 058d3a45b4 Revert "HBASE-26450 Server configuration will overwrite HStore configuration … (#3843)" 
This reverts commit 628b8b7f65.
 2021-11-12 11:34:38 +08:00
GeorryHuang 628b8b7f65
HBASE-26450 Server configuration will overwrite HStore configuration … (#3843) 
* HBASE-26450 Server configuration will overwrite HStore configuration After using shell command 'updateConfiguration'
 2021-11-12 11:10:38 +08:00
Yutong Xiao e1ca056676
HBASE-26410 Fix HBase TestCanaryTool for Java17 (#3809) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-09 22:11:21 +08:00
Andrew Purtell 407a5bd812
HBASE-26430 Increase log level in DefaultHeapMemoryTuner from DEBUG to INFO (#3820) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-11-08 18:34:14 -08:00
Andrew Purtell b03ed8bae0
HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled (#3819) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-11-08 18:31:21 -08:00
Xiaolin Ha a6c09a84a7 HBASE-25322 Redundant Reference file in bottom region of split (#3814) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-05 18:16:14 +08:00
clarax cd7a5099d4
HBASE-26311 Balancer gets stuck in cohosted replica distribution (#3724) 
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
 2021-11-03 11:57:37 -07:00
XinSun b9b7fec57f
HBASE-26406 Can not add peer replicating to non-HBase (#3806) 
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-02 14:26:25 +08:00
chenglei 558ab925ed
HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3777) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-01 23:05:15 +08:00
Andrew Purtell 45f76a4104
HBASE-26353 Support loadable dictionaries in hbase-compression-zstd (#3787) 
ZStandard supports initialization of compressors and decompressors with a
precomputed dictionary, which can dramatically improve and speed up compression
of tables with small values. For more details, please see

  The Case For Small Data Compression
  https://github.com/facebook/zstd#the-case-for-small-data-compression

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-27 07:39:55 -07:00
GeorryHuang 8e7f78cb44
HBASE-26396 Remove duplicate thread creation during migrating rsgroup (#3795) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-27 22:01:15 +08:00
chenglei 773ff28967
HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect (#3794) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-26 14:44:33 +08:00
Anoop Sam John 84a527bdcc
HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum (#3792) 2021-10-24 09:19:10 +05:30
Sourabh Dhanotia 0d8e5e5219
HBASE-26368 Fix checkstyle issues for HRegionServer (#3764) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-22 12:50:45 +05:30
binlijin 4838246ba3
HBASE-26385 Clear CellScanner when replay (#3773) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2021-10-21 21:30:19 +08:00
Andrew Purtell 64eb237120
HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775) 
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-20 15:48:36 -07:00
Viraj Jasani 856d08e863
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3767) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 23:05:12 +05:30
Andrew Purtell 8a6fed7b19
HBASE-26316 Per-table or per-CF compression codec setting overrides (#3730) 
We get and retain Compressor instances in HFileBlockDefaultEncodingContext,
and could in theory call Compressor#reinit when setting up the context,
to update compression parameters like level and buffer size, but we do
not plumb through the CompoundConfiguration from the Store into the
encoding context. As a consequence we can only update codec parameters
globally in system site conf files.

Fine grained configurability is important for algorithms like ZStandard
(ZSTD), which offers more than 20 compression levels, where at level 1
it is almost as fast as LZ4, and where at higher levels it utilizes
computationally expensive techniques to rival LZMA at compression ratio
but trades off significantly for reduced compresson throughput. The ZSTD
level that should be set for a given column family or table will vary by
use case.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-19 12:04:25 -07:00