Commit Graph

19162 Commits

Author SHA1 Message Date
Nick Dimiduk be0afbf23a HBASE-25895 Implement a Cluster Metrics JSON endpoint
Publishes a set of JSON endpoints following a RESTful structure, which expose a subset of the
`o.a.h.h.ClusterMetrics` object tree. The URI structure is as follows

    /api/v1/admin/cluster_metrics
    /api/v1/admin/cluster_metrics/live_servers
    /api/v1/admin/cluster_metrics/dead_servers

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-10 14:58:05 +01:00
Nick Dimiduk 5851400a46 HBASE-26819 Minor code cleanup in and around RpcScheduler
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 14:45:04 +01:00
Nick Dimiduk 068031ea82 HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 14:36:39 +01:00
xicm 9293d6af2c
HBASE-26815 TestFanOutOneBlockAsyncDFSOutput is flakey (#4186)
Trigger BlockReports in MiniDFSCluster after restarting datanode

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-10 16:06:12 +08:00
chenglei 1057da8be6
HBASE-26768 Avoid unnecessary replication suspending in RegionReplica… (#4127) 2022-03-10 10:58:47 +08:00
Bryan Beaudreault 1dd29dba5c
HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on (#4194)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-09 14:43:58 -08:00
Andrew Purtell 10471944bd
HBASE-26582 Prune use of Random and SecureRandom objects (#4118)
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 13:49:02 -08:00
Bryan Beaudreault 39ecaa1975
HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4146)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-08 10:48:57 +08:00
Sean Busbey bcd9a9acef
HBASE-26760 LICENSE handling should not allow non-aggregated apache-2.0 (#4172)
- correct the license name for the Xerial Snappy wrapper.
- correct the license name for the version of GSON brought in with Hadoop 3.3.2+

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-03-07 10:31:02 -06:00
Nick Dimiduk f3f2aa9631 HBASE-26782 Minor code cleanup in and around RpcExecutor
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-07 11:55:36 +01:00
Xiaolin Ha 591f7819f3
HBASE-26552 Introduce retry to logroller to avoid abort (#4038)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 12:20:01 +08:00
Xiaolin Ha f3a48d1910
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-07 11:21:39 +08:00
Duo Zhang fee9bb0c2f
HBASE-26803 Ban reload4j and logback dependencies (#4167)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-07 09:54:20 +08:00
Duo Zhang 19ad3d6654 HBASE-26805 Addendum forward port the test improvements in HBASE-26304 for branch-2 2022-03-07 08:16:21 +08:00
Duo Zhang 480db06e46
HBASE-26805 TestRegionHDFSBlockLocationFinder is flaky (#4169)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-03-07 08:08:04 +08:00
Rushabh Shah 2b205d2230
HBASE-26792 Implement ScanInfo#toString (#4153)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-05 17:45:37 +08:00
Duo Zhang 905a6e0472
HBASE-26799 TestCanaryTool.testWriteTableTimeout is flaky (#4165)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-03-05 12:05:38 +08:00
Andrew Purtell f90816d6dc HBASE-26800 Update downloads.xml for 2.4.10
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 16:40:02 -08:00
Nick Dimiduk 2b9ab90a03
HBASE-26759 Fix trace continuity through CallRunner (#4126)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-04 15:23:25 -08:00
Bryan Beaudreault be59eb7e8d
HBASE-26731 Add metrics for active and expired scanners (#4145)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 14:03:32 -08:00
Istvan Toth 7d2457e075
HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 13:49:19 -08:00
Xiaolin Ha f4b05a8364
HBASE-26242 Allow split when store file count larger than the configed blocking file count (#3652)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 20:18:38 +08:00
Nick Dimiduk 9c037b1be7 HBASE-26764 Implement generic exception support for TraceUtil methods over Callables and Runnables
For the `TraceUtil` methods that accept `Callable` and `Runnable` types, make them generic over a
child of `Throwable`. This allows us to consolidate the two method signatures into a single more
flexible definition.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-03 12:18:33 +01:00
Nick Dimiduk dbaa68ab58 HBASE-26788 Disable Checks API callback from test results in PRs
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-03 10:58:08 +01:00
chenglei 1b994a179b
HBASE-26787 TestRegionReplicaReplicationError should inject error in replicateToReplica method (#4148) 2022-03-03 12:00:45 +08:00
Bri Augenreich b81ddd83bc
HBASE-26745: Include balancer cost metrics in jmx endpoint (#4140)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 17:38:05 -08:00
Mike Drob 06f06cbd86 HBASE-26622 Update error-prone to 2.10
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 16:07:23 +01:00
Andor Molnár 87f8d9ac4e
HBASE-23303 Add default security headers if SSL is enabled (#4128)
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-03-02 15:25:57 +01:00
Duo Zhang 4bea1e8c37
HBASE-26723 Switch to use log4j2.properties file to configure log4j2 (#4096)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-02 21:08:32 +08:00
Niels Basjes f6b74b3083
HBASE-26762 Un-Deprecate and improve documentation for Scan#setRowPrefixFilter (#4119)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-02 20:19:13 +08:00
Nick Dimiduk e85bf414ab
HBASE-26776 RpcServer failure to SASL handshake always logs user "unknown" to audit log (#4138)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-03-01 14:33:02 +01:00
Peter Somogyi 1f2ddbe7cd
HBASE-26772 Shell suspended in background (#4137)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-03-01 11:52:07 +01:00
Nick Dimiduk f8699176f7 HBASE-26663 Upgrade Maven Enforcer Plugin
The upgrade is to get the fix in MENFORCER-336, making beanshell evaluation safe for use with `mvn
-T`. Also upgrade extra-enforcer-rules to 1.5.1, as per experience with HBASE-26664.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-02-28 10:24:02 +01:00
Nick Dimiduk 5dc663ea38
HBASE-26765 Minor refactor of async scanning code (#4121)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-24 17:20:57 +01:00
Yutong Xiao 3a53c11dbf
Add xiaoyt to the developer list (#4129) 2022-02-24 12:36:28 +08:00
Duo Zhang c8662ed575
HBASE-26640 Reimplement master local region initialization to better work with SFT (#4111)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-02-24 10:10:02 +08:00
Sergey Soldatov 2d76b04197 HBASE-26767 Rest server should not use a large Header Cache.
Closes #4123

Co-authored-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-02-23 15:29:37 -05:00
Bryan Beaudreault cd45cadbc1
HBASE-26546 hbase-shaded-client missing required thirdparty classes under hadoop 3.3.1 (#3926)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-02-22 00:19:29 -06:00
LiangJun He 55ea2ef3aa
HBASE-26673 Implement a shell command for change SFT implementation (#4113)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-19 23:00:04 +08:00
Bryan Beaudreault a49c758f58
HBASE-26727 Fix CallDroppedException reporting (#4088)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 17:27:09 -08:00
Bryan Beaudreault 8fb3d4666a
HBASE-26703 Allow configuration of IPC queue balancer (#4063)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 17:21:40 -08:00
Richard Marscher b3b4405d61
HBASE-26576 Allow pluggable queue to be used with the fast path executor or normal balanced executor (#3944)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 10:00:10 -08:00
Yutong Xiao e100198ab5
HBASE-26659 The ByteBuffer of metadata in RAMQueueEntry in BucketCache could be reused. (#4026)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-18 22:24:51 +08:00
RyanT 24124f7485
HBASE-26738 Correct description of WAL directory in doc (#4097)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-18 22:20:49 +08:00
BukrosSzabolcs 4829806220
HBASE-26707: Reduce number of renames during bulkload (#4066)
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-02-17 19:34:48 +00:00
chenglei 8dec499181
add chenglei to the developer list (#4116) 2022-02-16 20:04:21 +08:00
chenglei 8ddd1d0f9e
HBASE-26712 Balancer encounters NPE in rare case (#4092)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-16 12:12:18 +05:30
Xiaolin Ha 1b47575214
HBASE-26742 Comparator of NOT_EQUAL NULL is invalid for checkAndMutate (#4105)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-16 11:08:33 +08:00
Andrew Purtell 407c6e7b22
HBASE-26730 Extend hbase shell 'status' command to support an option 'tasks' (#4095)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-02-15 18:38:18 -08:00
Xiaolin Ha 7c52895e8c
HBASE-26434 Do compact when all L0 files are expired (#3830)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-15 22:08:52 +08:00