9216 Commits

Author SHA1 Message Date
Duo Zhang
48c4a4626e
HBASE-26938 Compaction failures after StoreFileTracker integration (#4350)
Introduce a StoreFileWriterCreationTracker to track the store files being written

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-17 21:58:12 +08:00
Duo Zhang
2622fa05a6
HBASE-26946 TestRetainAssignmentOnRestartSplitWithoutZk infinite loop (#4344)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-04-16 12:24:44 +08:00
Pankaj
62e3efccef
HBASE-26944 Possible resource leak while creating new region scanner (#4339)
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-15 11:34:25 +05:30
LiangJun He
242a194b3c HBASE-26943 HMaster page style display confusion
Signed-off-by: Yu Li <liyu@apache.org>
2022-04-13 17:18:18 +08:00
LiangJun He
d0318732b7 HBASE-26943 Formatting bootstrap.min.css
Signed-off-by: Yu Li <liyu@apache.org>
2022-04-13 17:18:18 +08:00
Yu Li
58d40dbcb5 Revert "HBASE-26943 Formatting bootstrap.min.css" to correct author information
This reverts commit c5158aef937bfb6e8d8355f0dcada39c0da046fd.
2022-04-13 17:18:07 +08:00
Yu Li
463a92da65 Revert "HBASE-26943 HMaster page style display confusion" to correct author information
This reverts commit 67ac16c8da731a1bd1cc040c8898e4b66b23e983.
2022-04-13 17:17:35 +08:00
liangjunhe.hlj
67ac16c8da HBASE-26943 HMaster page style display confusion
Signed-off-by: Yu Li <liyu@apache.org>
2022-04-13 17:09:00 +08:00
liangjunhe.hlj
c5158aef93 HBASE-26943 Formatting bootstrap.min.css
Signed-off-by: Yu Li <liyu@apache.org>
2022-04-13 17:08:57 +08:00
Duo Zhang
b7ffb56927 Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)"
This reverts commit 8247b7c722f95f94afd5cb9d9b80c9ce5f61a7de.
2022-04-13 11:54:50 +08:00
Duo Zhang
8247b7c722
HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-04-13 10:49:40 +08:00
eomiks
7ac9e0be27
HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on (#4295)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-12 20:26:36 +08:00
Duo Zhang
3ae0d9012c
HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless (#4324)
Signed-off-by: Yulin Niu <niuyulin@apache.org
2022-04-09 21:38:41 +08:00
Bryan Beaudreault
eb4c2ae4b4
HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4180)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-07 08:01:44 -07:00
huaxiangsun
0b4ff98614
HBASE-26618 Involving primary meta region in meta scan with CatalogRe… (#4321)
HBASE-26618 Involving primary meta region in meta scan with CatalogReplicaLoadBalanceSimpleSelector

Signed-off-by: Michael Stack <stack@apache.org>
2022-04-06 12:11:10 -07:00
Duo Zhang
e68c61dd54
HBASE-26928 Fix several indentation problems (#4323)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-04-06 15:09:00 +08:00
Wellington Ramos Chevreuil
ae3718be0f
HBASE-26927 Add snapshot scanner UT with SFT and some cleanups to Tes… (#4322)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-04-05 16:55:34 +01:00
bsglz
7f9d1f2259
HBASE-26885 Addendum throw exception instead of return in TRSP to let the procedure retry (#4299)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-04 20:25:42 +08:00
weimingdiit
003c572246
HBASE-26924 Fix log parameter error and spelling error (#4318)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-04-04 20:20:30 +08:00
Duo Zhang
3e09e87fad
HBASE-26921 Rewrite the counting cells part in TestMultiVersions (#4316)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-04-03 22:54:00 +08:00
Duo Zhang
78676bb85e
HBASE-26920 Fix missing braces warnings in TestProcedureMember (#4315)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-04-03 22:53:50 +08:00
Duo Zhang
4e12eee531
HBASE-26919 Rewrite the counting rows part in TestFromClientSide4 (#4314)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-04-03 22:42:49 +08:00
chenglei
f51e57908f
HBASE-26811 (addendum)Secondary replica may be disabled for read incorrectly forever (#4311) 2022-04-01 14:08:19 +08:00
chenglei
805c346e54
HBASE-26811 Secondary replica may be disabled for read forever (#4182) 2022-03-31 21:46:20 +08:00
Duo Zhang
27111421d9 HBASE-26245 Addendum fix a naming issue 2022-03-31 21:40:44 +08:00
Duo Zhang
bb1bbddf74
HBASE-26245 Store region server list in master local region (#4136)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-31 21:22:01 +08:00
bsglz
1efd8fe53c
HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276)
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM
2022-03-29 10:05:24 +08:00
d-c-manning
a4db023bc5
HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-28 11:45:10 -07:00
Nick Dimiduk
620e5c6d0a HBASE-26545 Implement tracing of scan
* on `AsyncTable`, both `scan` and `scanAll` methods should result in `SCAN` table operations.
* the span of the `SCAN` table operation should have children representing all the RPC calls
  involved in servicing the scan.
* when a user provides custom implementation of `AdvancedScanResultConsumer`, any spans emitted
  from the callback methods should also be tied to the span that represents the `SCAN` table
  operation. This is easily done because these callbacks are executed on the RPC thread.
* when a user provides a custom implementation of `ScanResultConsumer`, any spans emitted from the
  callback methods should be also be tied to the span that represents the `SCAN` table
  operation. This accomplished by carefully passing the span instance around after it is created.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-28 12:46:59 +02:00
Duo Zhang
4f491fd5e4
HBASE-26832 Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted (#4281)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-28 07:53:28 +08:00
huaxiangsun
698937d32b
HBASE-26864 SplitTableRegionProcedure calls openParentRegions() at a … (#4261)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:02:16 -07:00
Tak Lon (Stephen) Wu
4ac600b04b
HBASE-26810 Add dynamic configuration support for system coprocessors (#4181)
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-03-24 17:08:50 -07:00
Xiaolin Ha
ec7141720f
HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-24 19:03:22 +08:00
chenglei
ab4351a155
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallCo… (#4249) 2022-03-23 17:14:07 +08:00
Duo Zhang
b67c16a763
HBASE-26866 Shutdown WAL may abort region server (#4254)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-23 14:53:58 +08:00
Nick Dimiduk
f78f232b28
HBASE-26834 Adapt ConnectionRule for both sync and async connections
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-21 12:41:22 +01:00
Duo Zhang
e56ed404cb
HBASE-26791 Memstore flush fencing issue for SFT (#4202)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-03-21 19:33:07 +08:00
Duo Zhang
520ad638d9
HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving (#4242)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-18 23:28:30 +08:00
Duo Zhang
31db8e3b3b
HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop (#4238)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-18 23:09:09 +08:00
huiruan
84acdf98ce HBASE-26859 Split TestSnapshotProcedure to several smaller tests (#4239)
Closes #4239

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-18 17:52:15 +08:00
Duo Zhang
bd65ad42a2 HBASE-26833 Addendum fix NPE in TestReplicationSource.testTerminateClearsBuffer 2022-03-17 23:13:41 +08:00
Xiaolin Ha
c7773adeed
HBASE-26680 Close and do not write trailer for the broken WAL writer (#4174)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-16 19:58:45 +08:00
Duo Zhang
5b28d76652
HBASE-26837 Set SFT config when creating TableDescriptor in TestCloneSnapshotProcedure (#4226)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 19:34:30 +08:00
Nick Dimiduk
c4ec5230f2
HBASE-25896 Implement a Region Visualization on Master WebUI (#4228)
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 21:01:57 +01:00
Nick Dimiduk
2507dc1b01 Revert "HBASE-25896 Implement a Region Visualization on Master WebUI"
This reverts commit d76e636da04b54781b53aea6dc9564559fae25ba.
2022-03-15 20:43:46 +01:00
Nick Dimiduk
d76e636da0 HBASE-25896 Implement a Region Visualization on Master WebUI
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 20:31:14 +01:00
Xiaolin Ha
d050217a3d
HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS (#4218)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-15 22:04:40 +08:00
Xiaolin Ha
fb09cb9e7b
HBASE-26840 Fix NPE in the retry of logroller (#4224)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-15 21:59:09 +08:00
Duo Zhang
a816204793
HBASE-26611 Changing SFT implementation on disabled table is dangerous (#4082)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-15 20:13:46 +08:00
Duo Zhang
5ad51e8b2b
HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-15 20:06:05 +08:00