Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,947 Commits 95 Branches 866 Tags
Commit Graph

8994 Commits

Author SHA1 Message Date
Duo Zhang
9e469e4a2a HBASE-26540 Implement a tool to verify the lag of region replication (#3950) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
5ac76c1c00 HBASE-26539 The default rpc timeout 200ms is too small for replicating meta edits (#3919) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
1fdd0a4cfd HBASE-26538 Should find a way to clear the replication queue for a legacy region_replica_replication peer (#3918) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
fa37aed8f6 HBASE-26481 Consider rolling upgrading from old region replication framework (#3880) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Reviewed-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
林尚泉
9f6dfe6d3f HBASE-26417 Remove NoopReplicationQueueStorage (#3882) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
70259a2a4c HBASE-26456 Limit the size for one replicating (#3873) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
529c36e7ad HBASE-26416 Implement a new method for region replication instead of using replay (#3864) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
67306e74b1 HBASE-26457 Should not always clear all the failed replicas when getting a flush all request (#3850) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
a8d46db416 HBASE-26448 Make sure we do not flush a region too frequently (#3847) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
1b0d9ceaba HBASE-26449 The way we add or clear failedReplicas may have race (#3846) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2021-12-31 12:29:48 +08:00
Duo Zhang
0b29a7934a HBASE-26413 Limit the total size of buffered region replication entries (#3844) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
2ee18988e6 HBASE-26412 Handle sink failure in RegionReplicationSink (#3815) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
7286cc0035 HBASE-26407 Introduce a region replication sink for sinking WAL edits to secondary replicas directly (#3807) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-31 12:29:48 +08:00
Duo Zhang
c14a76c4fd
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3987) 
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
 2021-12-31 12:08:01 +08:00
Xiaolin Ha
b948ddbf21
HBASE-26347 Support detect and exclude slow DNs in fan-out of WAL (#3800) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 17:04:01 +08:00
meiyi
8f0c2dabbb
HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-30 10:40:33 +08:00
Richard Marscher
c8b014866a
HBASE-26623 Report CallDroppedException in exception metrics (#3980) 
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-30 00:02:50 +08:00
Yutong Xiao
a599d52820
HBASE-26564 Retire the method visitLogEntryBeforeWrite without RegionInfo in WALActionListner (#3938) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-27 23:59:13 +08:00
Duo Zhang
3f59f21be0
HBASE-26621 Set version as 3.0.0-alpha-3-SNAPSHOT in master (#3978) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-24 14:20:32 +08:00
meiyi
a67490abd3
HBASE-26615 Snapshot referenced data files are deleted when delete a table with merge regions (#3971) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 16:45:36 +08:00
Duo Zhang
dbdef5982a
HBASE-26609 Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoad (#3967) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-23 10:37:17 +08:00
Samir Khan
bf258cd68f
HBASE-26598 Fix excessive connections in MajorCompactor (#3961) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-23 10:29:48 +08:00
BukrosSzabolcs
771e552cf4 HBASE-26286: Add support for specifying store file tracker when restoring or cloning snapshot 
Closes #3851

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil
d00b5faade HBASE-26454 CreateTableProcedure still relies on temp dir and renames… (#3845) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:59 -05:00
BukrosSzabolcs
a288365f92 HBASE-26271 Cleanup the broken store files under data directory (#3786) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:59 -05:00
GeorryHuang
8bec26ea91 HBASE-26263 [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables (#3700) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil
08d117197c HBASE-26328 Clone snapshot doesn't load reference files into FILE SFT impl (#3749) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:59 -05:00
Duo Zhang
e4e7cf80b7 HBASE-26386 Refactor StoreFileTracker implementations to expose the set method (#3774) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:59 -05:00
Wellington Ramos Chevreuil
06db852aa0 HBASE-26326 CreateTableProcedure fails when FileBasedStoreFileTracker… (#3721) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:59 -05:00
Duo Zhang
fc4f6d10e3 HBASE-26280 Use store file tracker when snapshoting (#3685) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Reviewed-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:59 -05:00
Duo Zhang
5ff0f98a53 HBASE-26264 Add more checks to prevent misconfiguration on store file tracker (#3681) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang
2052e80e5d HBASE-26248 Should find a suitable way to let users specify the store file tracker implementation (#3665) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil
0ee1689332 HBASE-26246 Persist the StoreFileTracker configurations to TableDescriptor when creating table (#3666) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang
090b2fecf4 HBASE-26224 Introduce a MigrationStoreFileTracker to support migrating from different store file tracker implementations (#3656) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:58 -05:00
Wellington Ramos Chevreuil
6e053765e8 HBASE-26079 Use StoreFileTracker when splitting and merging (#3617) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang
43b40e9374 HBASE-25988 Store the store file list by a file (#3578) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:58 -05:00
Duo Zhang
6aaef89789 HBASE-26064 Introduce a StoreFileTracker to abstract the store file tracking logic 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-12-22 15:05:57 -05:00
zhengzhuobinzzb
d399799c29
HBASE-26580 The message of StoreTooBusy is confused (#3949) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-18 23:22:14 +08:00
zhengzhuobinzzb
ea0fe2222d
HBASE-26579 Set storage policy of recovered edits when hbase.wal.storage.type is configured (#3948) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-18 23:17:40 +08:00
chenglei
da616c00c7
HBASE-26488 Memory leak when MemStore retry flushing (#3899) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 12:17:19 +08:00
Norbert Kalmar
77b6b4dee3
HBASE-26340 TableSplit returns false size under 1MB (#3872) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-18 11:58:16 +08:00
Duo Zhang
e598f2c663 Revert "HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910)" 
Need a new 4.0.1 release

This reverts commit 139f08587a56ece62f33eaa028f6534b6129300e.
 2021-12-17 12:25:27 +08:00
Duo Zhang
139f08587a
HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.0 (#3910) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2021-12-17 10:22:48 +08:00
Nick Dimiduk
006433b066 HBASE-26542 Apply a package to test protobuf files (addendum) 
RpcServer identifies the services it hosts by unqualified service name. Thus, use `getName()`
instead of `getFullName()`. See also HBASE-26589.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-12-16 16:23:43 -08:00
Josh Elser
13f3b17870
HBASE-26550 Make sure the master is running normally before accepting a balance command (#3928) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-14 23:17:34 +08:00
Duo Zhang
8bca21b47d
HBASE-26558 Set version as 3.0.0-alpha-2 in master in prep for first RC of 3.0.0-alpha-2 (#3935) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
 2021-12-11 20:52:35 +08:00
Xiaolin Ha
ca3ba494cb
HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-12-07 12:26:59 +08:00
Xiaolin Ha
bdbb4fa087
HBASE-26525 Use unique thread name for group WALs (#3903) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-07 12:19:33 +08:00
LiangJun He
9cf224d4fe
HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921) 
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-06 22:58:38 +08:00
RamanChodzka
554580f966
HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-12-05 22:34:30 +08:00