Commit Graph

19168 Commits

Author SHA1 Message Date
bsglz 1efd8fe53c
HBASE-26885 The TRSP should not go on when it get a bogus server name… (#4276)
* HBASE-26885 The TRSP should not go on when it get a bogus server name from AM
2022-03-29 10:05:24 +08:00
Istvan Toth 19da537a7b
HBASE-26896 list_quota_snapshots fails with ‘ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE’ (#4284)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-28 20:46:16 +02:00
d-c-manning a4db023bc5
HBASE-26718 HFileArchiver can remove referenced StoreFiles from the archive (#4274)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-28 11:45:10 -07:00
Duo Zhang 31a49f9669 HBASE-26617 Addendum add removeUnusedImports 2022-03-28 22:56:53 +08:00
Duo Zhang a21179287b HBASE-26617 Use spotless to reduce the pain on fixing checkstyle issues (#4214)
Closes #4214

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-03-28 21:04:54 +08:00
Nick Dimiduk 620e5c6d0a HBASE-26545 Implement tracing of scan
* on `AsyncTable`, both `scan` and `scanAll` methods should result in `SCAN` table operations.
* the span of the `SCAN` table operation should have children representing all the RPC calls
  involved in servicing the scan.
* when a user provides custom implementation of `AdvancedScanResultConsumer`, any spans emitted
  from the callback methods should also be tied to the span that represents the `SCAN` table
  operation. This is easily done because these callbacks are executed on the RPC thread.
* when a user provides a custom implementation of `ScanResultConsumer`, any spans emitted from the
  callback methods should be also be tied to the span that represents the `SCAN` table
  operation. This accomplished by carefully passing the span instance around after it is created.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-28 12:46:59 +02:00
Duo Zhang 4f491fd5e4
HBASE-26832 Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompleted (#4281)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-28 07:53:28 +08:00
Xiaolin Ha ad70ac2cd1
HBASE-26872 Load rate calculator for cost functions should be more precise (#4253)
Signed-off-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2022-03-27 11:12:00 +08:00
huaxiangsun 698937d32b
HBASE-26864 SplitTableRegionProcedure calls openParentRegions() at a … (#4261)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:02:16 -07:00
Tak Lon (Stephen) Wu 4ac600b04b
HBASE-26810 Add dynamic configuration support for system coprocessors (#4181)
Signed-off-by: Ankit Singhal <ankit@apache.org>
2022-03-24 17:08:50 -07:00
Bryan Beaudreault 2a3ac5b33c
HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-24 14:54:49 -07:00
Xiaolin Ha ec7141720f
HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-24 19:03:22 +08:00
chenglei ab4351a155
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallCo… (#4249) 2022-03-23 17:14:07 +08:00
Duo Zhang b67c16a763
HBASE-26866 Shutdown WAL may abort region server (#4254)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-23 14:53:58 +08:00
Nick Dimiduk b3f00d08ce HBASE-26531 Trace coprocessor exec endpoints (addendum)
Stuck by this again. branch-2 needs this configuration instance to be initialized as an
HBaseConfiguration.
2022-03-21 19:24:54 +01:00
Nick Dimiduk f78f232b28
HBASE-26834 Adapt ConnectionRule for both sync and async connections
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-21 12:41:22 +01:00
Duo Zhang e56ed404cb
HBASE-26791 Memstore flush fencing issue for SFT (#4202)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-03-21 19:33:07 +08:00
Duo Zhang 0d7638d66d
HBASE-26870 Log4j2 integration is incorrect in nighly's client integration test (#4251)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-21 10:01:51 +08:00
Duo Zhang 53a7ca794a Revert "HBASE-26813 Remove javax.ws.rs-api dependency (#4191)"
MiniYARNCluster needs it

This reverts commit b1c161ea8e.
2022-03-19 19:45:00 +08:00
Andrew Purtell 1d38db9582 HBASE-26865 Update downloads.xml for 2.4.11
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-18 18:57:13 -07:00
Duo Zhang 520ad638d9
HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving (#4242)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-18 23:28:30 +08:00
Nick Dimiduk eaf6c1cbd6
HBASE-26855 Delete unnecessary dependency on jaxb-runtime jar (#4236)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-18 16:26:30 +01:00
Duo Zhang 31db8e3b3b
HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop (#4238)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-18 23:09:09 +08:00
huiruan 84acdf98ce HBASE-26859 Split TestSnapshotProcedure to several smaller tests (#4239)
Closes #4239

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-18 17:52:15 +08:00
tianhang eccd12a460
HBASE-26851 [Documentation] Point out compatibility issues with WAL Compression and Replication in doc (#4237)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-18 15:27:57 +08:00
Duo Zhang bd65ad42a2 HBASE-26833 Addendum fix NPE in TestReplicationSource.testTerminateClearsBuffer 2022-03-17 23:13:41 +08:00
Duo Zhang caea843e94 HBASE-26848 Addendum make tmpdir absolute 2022-03-17 13:02:14 +08:00
Nick Dimiduk b1c161ea8e
HBASE-26813 Remove javax.ws.rs-api dependency (#4191)
This is no longer needed since we've transitioned to the shaded Jersey shipped in
hbase-thirdparty. Also drop supplemental models entry.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-16 16:46:15 +01:00
Duo Zhang fec5478226 HBASE-26828 Addendum fix syntax error 2022-03-16 21:48:58 +08:00
xicm ef280d4d8d
HBASE-26720 ExportSnapshot should validate the source snapshot before copying files (#4216)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:03:28 +08:00
xicm b9c59438a4
Hbase 26275 update error message when executing deleteall with ROWPREFIXFILTER in meta table (#4205)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:02:38 +08:00
Xiaolin Ha c7773adeed
HBASE-26680 Close and do not write trailer for the broken WAL writer (#4174)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-16 19:58:45 +08:00
Duo Zhang 5b28d76652
HBASE-26837 Set SFT config when creating TableDescriptor in TestCloneSnapshotProcedure (#4226)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 19:34:30 +08:00
Duo Zhang cc13624232
HBASE-26848 Set java.io.tmpdir on mvn command when running jenkins job (#4231)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-03-16 17:52:36 +08:00
Nick Dimiduk c4ec5230f2
HBASE-25896 Implement a Region Visualization on Master WebUI (#4228)
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 21:01:57 +01:00
Nick Dimiduk 2507dc1b01 Revert "HBASE-25896 Implement a Region Visualization on Master WebUI"
This reverts commit d76e636da0.
2022-03-15 20:43:46 +01:00
Nick Dimiduk d76e636da0 HBASE-25896 Implement a Region Visualization on Master WebUI
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 20:31:14 +01:00
Xiaolin Ha d050217a3d
HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS (#4218)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-15 22:04:40 +08:00
Xiaolin Ha fb09cb9e7b
HBASE-26840 Fix NPE in the retry of logroller (#4224)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-15 21:59:09 +08:00
Duo Zhang a816204793
HBASE-26611 Changing SFT implementation on disabled table is dangerous (#4082)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-15 20:13:46 +08:00
Duo Zhang 5ad51e8b2b
HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-15 20:06:05 +08:00
Duo Zhang cc2c22072f
HBASE-26831 TestAdminShell2 is failing because of we referenced a deleted method (#4217)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-15 14:26:07 +08:00
Nick Dimiduk f640b7fd27 HBASE-25895 Implement a Cluster Metrics JSON endpoint (addendum) 2022-03-14 17:27:53 +01:00
Nick Dimiduk 36a5f86c50 HBASE-26531 Trace coprocessor exec endpoints
Trace table ExecService invocations as table operations. Ensure span relationships for both table
and master invocations.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 11:27:30 +01:00
Duo Zhang a49d147d49
HBASE-26828 Increase the concurrency when running UTs in pre commit job (#4213)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-03-14 12:01:51 +08:00
meiyi d542f471d1
HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 11:47:23 +08:00
Duo Zhang c3d0cc7040
HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-14 11:04:15 +08:00
Ruanhui fd301ad55f
HBASE-26323 Introduce a Snapshot Procedure (#4115)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-12 23:21:22 +08:00
Duo Zhang c2485215de
HBASE-25465 Use javac --release option for supporting cross version compilation (#4164)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-12 16:51:49 +08:00
Duo Zhang f4866a49dc
HBASE-26822 Revert the changes on hbase-daemon.sh after switching to log4j2 properties file (#4209)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-12 16:48:06 +08:00