Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,345 Commits 95 Branches 866 Tags
Commit Graph

8810 Commits

Author SHA1 Message Date
chenglei
d889746bc6
HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4262) 2022-03-23 17:48:20 +08:00
Duo Zhang
68f3fbe035 HBASE-26791 Memstore flush fencing issue for SFT (#4202) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit e56ed404cb574c560011535054386a0d17fe07fc)
 2022-03-22 12:35:09 +08:00
Nick Dimiduk
0d968af513 HBASE-26531 Trace coprocessor exec endpoints 
Trace table ExecService invocations as table operations. Ensure span relationships for both table
and master invocations.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-21 19:29:37 +01:00
Nick Dimiduk
321c35a6ef
HBASE-26834 Adapt ConnectionRule for both sync and async connections 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-21 12:42:18 +01:00
Duo Zhang
7af08ce614 HBASE-26861 Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchiving (#4242) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 520ad638d9dbc3cdf0d3f0706610dcf3f0a43f1e)
 2022-03-19 00:46:31 +08:00
Duo Zhang
ac5651c1b2 HBASE-26858 Refactor TestMasterRegionOnTwoFileSystems to avoid dead loop (#4238) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 31db8e3b3b8cfbc395200ae55ab7f6c52a6d4c76)
 2022-03-19 00:46:03 +08:00
huiruan
4a6ba116bf HBASE-26842 TestSnapshotProcedure fails in branch-2 (#4225) 
Closes #4225

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-18 16:21:29 +08:00
Duo Zhang
81398f9064 HBASE-26833 Addendum fix NPE in TestReplicationSource.testTerminateClearsBuffer 
(cherry picked from commit bd65ad42a297335a09ad862761e44ba101d97770)
 2022-03-17 23:23:10 +08:00
Xiaolin Ha
db5e954068 HBASE-26680 Close and do not write trailer for the broken WAL writer (#4174) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-16 20:29:27 +08:00
Duo Zhang
d3629bbf16 HBASE-26837 Set SFT config when creating TableDescriptor in TestCloneSnapshotProcedure (#4226) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5b28d7665219c24863eebeaf9aa8dcd6c26693bc)
 2022-03-16 20:16:26 +08:00
Nick Dimiduk
3c968a1bb8 HBASE-25896 Implement a Region Visualization on Master WebUI (#4228) 
This is a demonstration of visualization of regions on the cluster. The visualization is a stacked
bar chart showing total storefile size per table per region server, with the x-axis being server
names, the y-axis being storfile size, and the bars stacked per table. The visualization is
generated entirely on the fly from within the browser, implemented using Vega Lite. So far, Vega
appears to handle rendering this visualization for a cluster of over 700 region servers with
approximately 300,000 regions.

Per [0], include an update to the top-level LICENSE.txt. Also update LICENSE files in all binary
distributions (i.e., jars), by way of LICENSE.vm. Vega uses a BSD 3-clause variant without
advertising clause, and as such is a "Category A" license, per [1].

No changes are made to the NOTICE files, as per the existing example of bundling the minified
JQuery, which is also a Category A license.

[0]: https://infra.apache.org/licensing-howto.html
[1]: https://www.apache.org/legal/resolved.html#category-a

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-15 21:10:23 +01:00
Xiaolin Ha
c1bf2ffcd9 HBASE-26833 Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RS (#4218) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-15 22:12:02 +08:00
Xiaolin Ha
46af73b5c0 HBASE-26840 Fix NPE in the retry of logroller (#4224) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-15 22:08:41 +08:00
Duo Zhang
a4b192e33d HBASE-26611 Changing SFT implementation on disabled table is dangerous (#4082) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-15 20:26:24 +08:00
Duo Zhang
350db514c7 HBASE-26835 Rewrite TestLruAdaptiveBlockCache to make it more stable (#4219) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 5ad51e8b2b4b78bc7f92eea04465e24a7577d3ad)
 2022-03-15 20:19:32 +08:00
Nick Dimiduk
e6879b8fd7 HBASE-25895 Implement a Cluster Metrics JSON endpoint (addendum) 2022-03-14 17:26:20 +01:00
Nick Dimiduk
cdabd6a1ad HBASE-25895 Implement a Cluster Metrics JSON endpoint 
Publishes a set of JSON endpoints following a RESTful structure, which expose a subset of the
`o.a.h.h.ClusterMetrics` object tree. The URI structure is as follows

    /api/v1/admin/cluster_metrics
    /api/v1/admin/cluster_metrics/live_servers
    /api/v1/admin/cluster_metrics/dead_servers

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 17:26:20 +01:00
meiyi
50e12309ea HBASE-26670 HFileLinkCleaner should be added even if snapshot is disabled (#4032) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-14 12:25:03 +08:00
Duo Zhang
05627b78ec HBASE-26830 Rewrite TestLruBlockCache to make it more stable (#4212) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit c3d0cc70400645f89af78c800003e734e9e49852)
 2022-03-14 11:24:31 +08:00
Ruanhui
0f93663db5 HBASE-26323 Introduce a Snapshot Procedure (#4115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-12 23:58:56 +08:00
Duo Zhang
9e1de13d03 HBASE-25465 Use javac --release option for supporting cross version compilation (#4164) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-12 18:30:29 +08:00
Duo Zhang
340cc6c6f1
HBASE-26802 Backport the log4j2 changes to branch-2 (#4166) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-11 11:17:43 -08:00
Nick Dimiduk
a227d76009 HBASE-26819 Minor code cleanup in and around RpcScheduler 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:15:59 +01:00
Nick Dimiduk
51fd863daa HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:08:14 +01:00
Andrew Purtell
e46fbedf56 HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME (#4204) 
Change the timing of the test but not the objective by storing three large
MOB values into the row with three separate puts, each randomizing the
data. Increases running time of the testGetMassive case 2x but avoids OOME
in the test environment where the OOME was consistently reproductable.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-11 15:12:51 +08:00
Andrew Purtell
0b879f2054 HBASE-26824 TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582 (#4203) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-11 14:54:49 +08:00
Xiaolin Ha
8c42bca86e HBASE-26816 Fix CME in ReplicationSourceManager (#4187) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 11:49:29 +08:00
Andrew Purtell
49d3a00652 HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184) 
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-10 11:57:01 -08:00
Bryan Beaudreault
fac011ed87 HBASE-26814 Addendum: Fix spotbugs warning and clarify intent (#4201) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-10 10:10:12 -08:00
Bryan Beaudreault
8a4317838b HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on (#4194) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 14:44:23 -08:00
Bryan Beaudreault
91cb3028c4
HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-09 12:02:51 -08:00
Nick Dimiduk
7e267c6069 HBASE-26782 Minor code cleanup in and around RpcExecutor 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-09 12:44:54 +01:00
Andrew Purtell
300f9b9576 HBASE-26582 Prune use of Random and SecureRandom objects (#4118) 
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-08 15:22:00 -08:00
Bryan Beaudreault
5bae04e20c
HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4163) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-03-08 10:50:00 +08:00
Xiaolin Ha
f4c91ee65b
HBASE-26552 Introduce retry to logroller to avoid abort (#4170) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 16:41:49 +08:00
Xiaolin Ha
1aff89e0e4 HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-07 11:45:40 +08:00
Rushabh Shah
0a7e49ca3b
HBASE-26792 Implement ScanInfo#toString (#4154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-05 17:45:45 +08:00
Nick Dimiduk
01acd870b7 HBASE-26759 Fix trace continuity through CallRunner (#4126) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-04 15:26:48 -08:00
Andrew Purtell
961796a59e [branch-2] Amend HBASE-26731 Add metrics for active and expired scanners 
Compliation fixes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 14:14:12 -08:00
Bryan Beaudreault
fc92a00bd1 HBASE-26731 Add metrics for active and expired scanners (#4145) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionServer.java
 2022-03-04 14:06:13 -08:00
Istvan Toth
eb1c57d12e HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 13:50:03 -08:00
Duo Zhang
4644efb9f3
HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 12:06:34 -08:00
Xiaolin Ha
df90a4ba6b HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 20:47:50 +08:00
haxiaolin
b5ac6380c4 Revert "HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652)" 
This reverts commit 2fa4bb0313bf8c1f0b2c314a6541a3b89c16b581.
 2022-03-04 20:38:32 +08:00
Xiaolin Ha
2fa4bb0313 HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 20:25:23 +08:00
Nick Dimiduk
87ce5755cd
HBASE-26764 Implement generic exception support for TraceUtil methods over Callables and Runnables 
For the `TraceUtil` methods that accept `Callable` and `Runnable` types, make them generic over a
child of `Throwable`. This allows us to consolidate the two method signatures into a single more
flexible definition.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-04 09:19:03 +01:00
Mike Drob
8a9e083994 HBASE-26622 Update error-prone to 2.10 
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-03 11:51:51 +01:00
Niels Basjes
c5f63550b7 HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter (#4119) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-02 23:34:17 +08:00
Nick Dimiduk
e93abe687b HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2022-03-02 15:51:27 +01:00
BukrosSzabolcs
77bb153a2e
HBASE-26707: Reduce number of renames during bulkload (#4066) (#4122) 
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2022-02-25 20:11:41 +00:00