Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,584 Commits 95 Branches 866 Tags
Commit Graph

251 Commits

Author SHA1 Message Date
tianliuliu
784d1a96cd HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e9be5723ff5bfb0e97cadca4092455a)
 2022-10-24 18:56:41 +08:00
d-c-manning
b9ec644e51 HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-10-17 14:19:42 -07:00
Duo Zhang
fb988373c1 HBASE-27401 Clean up current broken 'n's in our javadoc (#4812) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f08cdde6ac0fde1342ffd050e8e02441)

Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
 2022-10-06 23:01:14 +08:00
Bryan Beaudreault
c0717c7383 HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters (#4669) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-08-09 15:28:43 -04:00
Andrew Purtell
f7ffeac554 HBASE-27235 Clean up error-prone warnings in hbase-hadoop-compat (#4648) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-07-25 17:31:05 -07:00
Duo Zhang
9c3528d730 HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-19 10:03:26 +08:00
Bryan Beaudreault
02bc62d73f HBASE-27188 Report maxStoreFileCount in jmx (#4609) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-11 22:19:58 -04:00
Bryan Beaudreault
f5500dc495 HBASE-27186 Report block cache size metrics separately for L1 and L2 (#4608) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-07-11 22:09:30 -04:00
Duo Zhang
b5dcb7d3a1 HBASE-27023 Fix license issues after running spotless:apply (#4458) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99419401e293385e78816f4c3f87e771)
 2022-06-02 20:24:08 +08:00
litao
c4d7d55958 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a221f9f36ce7c8905d9ed063c6e9eac)
 2022-05-17 10:44:40 +05:30
Duo Zhang
1aea663c6d HBASE-26899 Run spotless:apply 2022-05-01 22:52:40 +08:00
Bri Augenreich
3439c5bd90 HBASE-26581 Add metrics for failed replication edits (#4347) 
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2022-04-26 17:46:26 -04:00
Xiaolin Ha
7906703569 HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2022-03-24 19:10:07 +08:00
Bryan Beaudreault
0f28fa8433 HBASE-26731 Add metrics for active and expired scanners (#4145) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionServer.java
 2022-03-04 14:07:16 -08:00
Bryan Beaudreault
1fb4ee37be HBASE-26727 Fix CallDroppedException reporting (#4088) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-02-18 17:27:59 -08:00
Rushabh Shah
409b175216 HBASE-26702 Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram. (#4098) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-02-09 10:24:19 +08:00
Richard Marscher
0001ad6b8b HBASE-26623 Report CallDroppedException in exception metrics (#3980) 
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
 2021-12-30 00:05:12 +08:00
Bryan Beaudreault
aa3b07f6bb
HBASE-26154: Adds exception metrics for QuotaExceededException and RpcThrottlingException (#3544) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-08-02 09:51:34 +05:30
Almog Tavor
1f1e6219a5 HBASE-26035 Redundant null check in the compareTo function (#3433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-07-01 22:57:50 +08:00
Rushabh Shah
e265eccf20
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3315) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-05-26 10:42:03 -07:00
Rushabh Shah
90dc150b1b
HBASE-25860 Add metric for successful wal roll requests. (#3238) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-05-08 13:02:52 +05:30
Baiqiang Zhao
8ff17c68e2
HBASE-25687 Backport "HBASE-25681 Add a switch for server/table query… (#3074) 
Signed-off-by: stack <stack@apache.org>
 2021-04-07 11:11:46 -07:00
Sandeep Pal
72496272aa
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized (#3018) 
Introduces a new metric that tracks number of replication sources that are stuck in initialization.

Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit ff3821814aa79248ec82f1c07f9d624e7dfb2334)
 2021-03-17 10:30:26 -07:00
meiyi
b5fc5e17e2 HBASE-25636 Expose HBCK report as metrics (#3031) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2021-03-11 15:15:23 +08:00
Rahul Kumar
e57c73a137
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-04 12:48:57 +05:30
shahrs87
6a4c9be967
HBASE-25539: Add age of oldest wal metric (#2962) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 20:59:07 -08:00
Andrew Purtell
1b6399a480
HBASE-24640 [branch-2] Purge use of VisibleForTesting (#2696) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-11-25 14:15:32 -08:00
gkanade
024349bd5d
HBASE-25026 Create a metric to track full region scans RPCs 
Add new metric rpcFullScanRequestCount to track number of requests that are full region scans. Can be used to notify user to check if this is truly intended.

Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Ramkrishna S Vasudevan <ramkrishna@apache.org>
 2020-11-19 09:55:33 +05:30
Reid Chan
70631e901f HBASE-25189 [Metrics] Add checkAndPut and checkAndDelete latency metrics at table level (#2549) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-10-25 17:47:58 +08:00
ramkrish86
11cbca1a5e
HBASE-25135 Convert the internal seperator while emitting the memstore read metrics to # (#2486) (#2489) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-10-01 18:18:31 +05:30
Bharath Vissapragada
505ceacb4b
HBASE-25082: Per table WAL metrics: appendCount and appendSize (#2440) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Ankit Jain <jain.ankit@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 56c7505f8f3c59261693bd8631cfcc4e709ead23)
 2020-09-23 21:07:44 -07:00
Viraj Jasani
4316dc738c
HBASE-24528 : BalancerDecision queue implementation in HMaster with Admin API (#2411) 
* Admin API getLogEntries() for ring buffer use-cases: so far, provides balancerDecision and slowLogResponse
* Refactor RPC call for similar use-cases
* Single RPC API getLogEntries() for both Master.proto and Admin.proto

Closes #2261

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-09-17 18:51:42 +05:30
Javier Akira Luca de Tena
cd66d8cba5
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2367) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-09-11 13:49:11 +08:00
Toshihiro Suzuki
22bf9a38c9
HBASE-24680 Refactor the checkAndMutate code on the server side (#2184) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-08-10 18:57:17 +09:00
Josh Elser
303db63b76 HBASE-24779 Report on the WAL edit buffer usage/limit for replication 
Closes #2193

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-08-07 14:33:30 -04:00
WenFeiYi
87a60c0889
HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket 
Closes #1962

Signed-off-by: David Manning
Signed-off-by: Rushabh
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-15 15:39:02 +05:30
Viraj Jasani
d3ec4886a1
Revert "HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket" 
This reverts commit 9ab5282c3ee0dc77a22ce76a5eaefc26f325de44.
 2020-07-15 00:20:13 +05:30
WenFeiYi
9ab5282c3e
HBASE-24615 MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket 
Closes #1962

Signed-off-by: David Manning
Signed-off-by: Rushabh
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-07-15 00:10:43 +05:30
ramkrish86
ef809c198b
HBASE-24205 - Create metric to know the number of reads that happens (#1920) 
* HBASE-24205 - Create metric to know the number of reads that happens
from memstore (branch-2)

* Add the optimization as in master and fix whitestyle and checkstyle

* Fix compilation error that accidently crept in

Authored-by: Ramkrishna <ramkrishna@apache.org>
Signed-off by:Anoop Sam John<anoopsamjohn@gmail.com>
Signed-off by:Viraj Jasani<virajjasani@apache.org>
 2020-06-18 18:59:46 +05:30
Wellington Ramos Chevreuil
11d093bc39 HBASE-21406 "status 'replication'" should not show SINK if the cluste… (#1761) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(Cherry picked from commit e5345b3a7c32c6a80394319c17540b84c8fe66ba)
 2020-06-03 09:33:36 +01:00
Sandeep Pal
1ff532678d
HBASE-24350: Extending and Fixing HBaseTable level replication metrics (#1704) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-05-14 13:36:11 -07:00
gkanade
1df3bee5f6 HBASE-24199 Procedure related metrics is not consumed in the JMX metric (#1616) 
Signed-off-by: stack <stack@apache.org>
 2020-05-01 11:49:32 -07:00
Peter Somogyi
b7d67dcc38 HBASE-24111 Enable CompactionTool executions on non-HDFS filesystems (#1427) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-04-06 11:55:35 +02:00
Bharath Vissapragada
9384b84552 HBASE-24075: Fix a race between master shutdown and metrics (re)init 
JMXCacheBuster resets the metrics state at various points in time. These
events can potentially race with a master shutdown. When the master is
tearing down, metrics initialization can touch a lot of unsafe state,
for example invalidated FS objects. To avoid this, this patch makes
the getMetrics() a no-op when the master is either stopped or in the
process of shutting down. Additionally, getClusterId() when the server
is shutting down is made a no-op.

Simulating a test for this is a bit tricky but with the patch I don't
locally see the long stacktraces from the jira.

Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 6f213e9d5a15afcc40b6562ab4898f913cec91eb)
 2020-04-01 10:14:34 -07:00
Wei-Chiu Chuang
8521207be4 HBASE-8868. add metric to report client shortcircuit reads. (#1334) 
Signed-off-by: stack <stack@apache.net>
 2020-03-24 15:31:34 -07:00
Viraj Jasani
17652a7b32
HBASE-23590 : Update maxStoreFileRefCount to maxCompactedStoreFileRefCount for auto region recovery based on old reader references 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-01-01 22:50:37 +05:30
Ankit Singhal
6e6c7b3c2d HBASE-23065 [hbtop] Top-N heavy hitter user and client drill downs 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-12-22 20:13:50 -08:00
Viraj Jasani
9cc144e3c7 HBASE-23245 : MutableHistogram constructor changes and provide HistogramImpl maxExpected as long (#787) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org> 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-12 01:03:32 +08:00
Josh Elser
46a18833a0 HBASE-23082 Backport of low latency space quotas for hbase snapshots 
Includes the following, incorporating HBASE-20439 and HBASE-20440, too.

1)
HBASE-18133 Decrease quota reaction latency by HBase

Certain operations in HBase are known to directly affect
the utilization of tables on HDFS. When these actions
occur, we can circumvent the normal path and notify the
Master directly. This results in a much faster response to
changes in HDFS usage.

This requires FS scanning by the RS to be decoupled from
the reporting of sizes to the Master. An API inside each
RS is made so that any operation can hook into this call
in the face of other operations (e.g. compaction, flush,
bulk load).

2)
HBASE-18135 Implement mechanism for RegionServers to report file archival for space quotas

This de-couples the snapshot size calculation from the
SpaceQuotaObserverChore into another API which both the periodically
invoked Master chore and the Master service endpoint can invoke. This
allows for multiple sources of snapshot size to reported (from the
multiple sources we have in HBase).

When a file is archived, snapshot sizes can be more quickly realized and
the Master can still perform periodical computations of the total
snapshot size to account for any delayed/missing/lost file archival RPCs.

3)
HBASE-20531 RS may throw NPE when close meta regions in shutdown procedure.
 2019-11-04 16:54:18 -05:00
Peter Somogyi
b309617b0a HBASE-15519 Add per-user metrics with lossy counting (addendum) 2019-10-28 11:47:37 +01:00