Commit Graph

18952 Commits

Author SHA1 Message Date
xiaozhang0319 1043337314
HBASE-26634 Upgrade log4j to 2.17.1 (#3996)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-04 23:56:56 +08:00
Duo Zhang e96df8bf40
HBASE-26641 Split TestMasterFailoverWithProcedures (#3994)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-01-03 00:35:14 +08:00
Yutong Xiao c811acdcab
HBASE-26629 Add expiration for long time vacant scanners in Thrift2 (#3984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-02 21:19:31 +08:00
chenglei 1b8e577cc6
HBASE-26494 Using RefCnt to fix the flawed MemStoreLABImpl (#3983)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:50:52 +08:00
Yutong Xiao 96be585324
HBASE-26635 Optimize decodeNumeric in OrderedBytes (#3986)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-01 20:42:57 +08:00
Duo Zhang 9e469e4a2a HBASE-26540 Implement a tool to verify the lag of region replication (#3950)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 5ac76c1c00 HBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits (#3919)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 1fdd0a4cfd HBASE-26538 Should find a way to clear the replication queue for a legacy region_replica_replication peer (#3918)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang a62e071bf7 HBASE-26486 Attach the new region replication framework design doc to git repo (#3884)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 2a43cc63be HBASE-26478 Update ref guide about the new region replication framework (#3885)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang fa37aed8f6 HBASE-26481 Consider rolling upgrading from old region replication framework (#3880)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
林尚泉 9f6dfe6d3f HBASE-26417 Remove NoopReplicationQueueStorage (#3882)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 70259a2a4c HBASE-26456 Limit the size for one replicating (#3873)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 529c36e7ad HBASE-26416 Implement a new method for region replication instead of using replay (#3864)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 67306e74b1 HBASE-26457 Should not always clear all the failed replicas when getting a flush all request (#3850)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang a8d46db416 HBASE-26448 Make sure we do not flush a region too frequently (#3847)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 1b0d9ceaba HBASE-26449 The way we add or clear failedReplicas may have race (#3846)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-12-31 12:29:48 +08:00
Duo Zhang 0b29a7934a HBASE-26413 Limit the total size of buffered region replication entries (#3844)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 2ee18988e6 HBASE-26412 Handle sink failure in RegionReplicationSink (#3815)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang 7286cc0035 HBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary replicas directly (#3807)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-31 12:29:48 +08:00
Duo Zhang c14a76c4fd
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3987)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:08:01 +08:00
Duo Zhang fbc8046bc3
HBASE-26636 Update the ref guide upgrading section to mention that the master issue when upgrading to 2.3 (#3989)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-12-31 12:07:09 +08:00
Xiaolin Ha b948ddbf21
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 17:04:01 +08:00
meiyi 8f0c2dabbb
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 10:40:33 +08:00
Richard Marscher c8b014866a
HBASE-26623 Report CallDroppedException in exception metrics (#3980)
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-30 00:02:50 +08:00
Yutong Xiao a599d52820
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3938)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-27 23:59:13 +08:00
Yutong Xiao 543582e7eb
HBASE-26566 Optimize encodeNumeric in OrderedBytes (#3940)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-12-27 23:57:30 +08:00
Guangxu Cheng 92ff404059
HBASE-26626 Update download page for HBase Operator Tools to 1.2.0 (#3982) 2021-12-25 14:25:48 +08:00
Andrew Purtell 1f44b3d5a1 HBASE-26628 Update downloads.xml for release 2.4.9
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-24 14:58:52 -08:00
Duo Zhang 3f59f21be0
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-24 14:20:32 +08:00
Duo Zhang 70703ca81c
HBASE-26620 Add 3.0.0-alpha-2 to download page (#3977)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 22:25:16 +08:00
meiyi a67490abd3
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3971)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 16:45:36 +08:00
Duo Zhang dbdef5982a
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-23 10:37:17 +08:00
Samir Khan bf258cd68f
HBASE-26598 Fix excessive connections in MajorCompactor (#3961)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-23 10:29:48 +08:00
Wellington Ramos Chevreuil f16b7b1bfa HBASE-26265 Update ref guide to mention the new store file tracker im… (#3942) 2021-12-22 15:05:59 -05:00
BukrosSzabolcs 771e552cf4 HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil d00b5faade HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:59 -05:00
BukrosSzabolcs a288365f92 HBASE-26271 Cleanup the broken store files under data directory (#3786)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
GeorryHuang 8bec26ea91 HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil 08d117197c HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang e4e7cf80b7 HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil 06db852aa0 HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang fc4f6d10e3 HBASE-26280 Use store file tracker when snapshoting (#3685)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:59 -05:00
Duo Zhang 5ff0f98a53 HBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681)
Signed-off-by: Josh Elser <elserj@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 2052e80e5d HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation (#3665)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil 0ee1689332 HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 090b2fecf4 HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil 6e053765e8 HBASE-26079 Use StoreFileTracker when splitting and merging (#3617)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 43b40e9374 HBASE-25988 Store the store file list by a file (#3578)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:58 -05:00
Duo Zhang 6aaef89789 HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-12-22 15:05:57 -05:00