Bryan Beaudreault
694752b781
HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl ( #5149 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-31 09:18:45 -04:00
tianliuliu
784d1a96cd
HBASE-27440 fix table HistogramMetrics leak in table metrics map ( #4838 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e
)
2022-10-24 18:56:41 +08:00
Duo Zhang
f3a64e468e
HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line ( #4836 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863
)
2022-10-24 12:16:04 +08:00
Andrew Purtell
27d69ff53f
Preparing development version 2.5.2-SNAPSHOT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 15:37:08 -07:00
Andrew Purtell
894ac15342
Preparing hbase release 2.5.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 15:37:04 -07:00
d-c-manning
b9ec644e51
HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent ( #4830 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:42 -07:00
Andrew Purtell
a8605912ec
Preparing development version 2.5.2-SNAPSHOT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 09:11:37 -07:00
Andrew Purtell
edf0b62273
Preparing hbase release 2.5.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 09:11:34 -07:00
Duo Zhang
fb988373c1
HBASE-27401 Clean up current broken 'n's in our javadoc ( #4812 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0
)
Conflicts:
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
2022-10-06 23:01:14 +08:00
Michael Stack
71cf98f63f
HBASE-27340 Artifacts with resolved profiles ( #4740 )
...
Make it so our published poms carry the minimum needed to run
an hbase; the published pom has no profiles -- the profiles
specified at build time are resolved, their dependencies inlined,
and then they are stripped -- and no build-time, or plugins
dependencies or properties, etc. Resultant poms have explicit
hadoop lib versions baked in -- no more being able to choose
hbase with hadoop2 or haddop3 at downstream build time by setting
a '-Dhadoop.profile=X.0'.
Pattern is to add profiles when none in sub-modules when
the flatten plugin complains it can't resolve an hadoop
dependency's 'version' (e.g. hadoop-common, hadoop-hdfs).
Adding the hadoop-2.0 and hadoop-3.0 profiles in the sub-module
make it so the flatten plugin can figure 'hadoop.version'
definitively.
Another spin on the above happens when profiles already exist
in submodule but the flatten plugin is complaining it can't
figure figure version on an hadoop dependency NOT under
profiles. Below, we move the delinquent hadoop dependency under
existing profiles (minikdc was the usual dependency outside
profiles in sub-modules that flatten complained about).
Sometimes, moving an hadoop dependency under a profile, there
would be excludes on the local dependency. If the parent pom
excludes section was missing the local excludes, we added them
up to the parent module so all excluding is done up there in
the parent profile dependencyManagement section.
* hbase-asyncfs/pom.xml
* hbase-endpoint/pom.xml
* hbase-examples/pom.xml
* hbase-http/pom.xml
* hbase-rest/pom.xml
* hbase-server/pom.xml
Move the minikdc under profiles so it picks up appropriate hadoop version
when the flatten plugin runs.
* hbase-hadoop2-compat/pom.xml
Add hadoop2 and hadoop3 profiles and move hadoop-common, etc.
under them so we pick up appropriate hadoop version when flatten
plugin runs.
* hbase-mapreduce/pom.xml
Move hadoop dependencies under profiles so right version is
available when the flatten plugin runs.
* hbase-shaded/hbase-shaded-testing-util/pom.xml
Add profiles for hadoop-2.0 and hadoop-3.0 and move the
hadoop dependencies under them.
pom.xml
Add the flatten plugin with the flatten profiles enabled.
Add a few excludes on hadoop profiles picked up from sub-modules.
E.g. exclude bouncycastle bcprov-jdk15 when we include minikdc.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-02 16:43:29 -07:00
Nick Dimiduk
f1f79b9efe
Preparing development version 2.5.1-SNAPSHOT
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-23 15:44:51 +00:00
Nick Dimiduk
2ecd8bd6d6
Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-23 15:44:34 +00:00
Nick Dimiduk
29475d6edb
Preparing development version 2.5.1-SNAPSHOT
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-23 14:04:18 +00:00
Nick Dimiduk
6cdbc46c02
Preparing hbase release 2.5.0RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-23 14:03:59 +00:00
Bryan Beaudreault
c0717c7383
HBASE-27241 Add metrics for evaluating cost and effectiveness of bloom filters ( #4669 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-08-09 15:28:43 -04:00
Andrew Purtell
f7ffeac554
HBASE-27235 Clean up error-prone warnings in hbase-hadoop-compat ( #4648 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-25 17:31:05 -07:00
Duo Zhang
9c3528d730
HBASE-27220 Apply the spotless format change in HBASE-27208 to our code base
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-19 10:03:26 +08:00
Bryan Beaudreault
02bc62d73f
HBASE-27188 Report maxStoreFileCount in jmx ( #4609 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:19:58 -04:00
Bryan Beaudreault
f5500dc495
HBASE-27186 Report block cache size metrics separately for L1 and L2 ( #4608 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:09:30 -04:00
Duo Zhang
b5dcb7d3a1
HBASE-27023 Fix license issues after running spotless:apply ( #4458 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99
)
2022-06-02 20:24:08 +08:00
Andrew Purtell
b7158a87ea
Preparing development version 2.5.1-SNAPSHOT
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 20:06:32 -07:00
Andrew Purtell
2da2dd917f
Preparing hbase release 2.5.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 20:06:29 -07:00
litao
c4d7d55958
HBASE-27032 The draining region servers metric description is incorrect ( #4428 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a
)
2022-05-17 10:44:40 +05:30
Duo Zhang
1aea663c6d
HBASE-26899 Run spotless:apply
2022-05-01 22:52:40 +08:00
Bri Augenreich
3439c5bd90
HBASE-26581 Add metrics for failed replication edits ( #4347 )
...
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-26 17:46:26 -04:00
Xiaolin Ha
7906703569
HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions ( #4248 )
...
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-03-24 19:10:07 +08:00
Duo Zhang
5844b53dea
HBASE-26802 Backport the log4j2 changes to branch-2 ( #4166 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-hadoop-compat/pom.xml
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml
hbase-shaded/hbase-shaded-client/pom.xml
hbase-shaded/hbase-shaded-mapreduce/pom.xml
hbase-shaded/hbase-shaded-testing-util/pom.xml
hbase-shaded/pom.xml
hbase-testing-util/pom.xml
2022-03-11 11:38:37 -08:00
Bryan Beaudreault
0f28fa8433
HBASE-26731 Add metrics for active and expired scanners ( #4145 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionServer.java
2022-03-04 14:07:16 -08:00
Duo Zhang
71ddf74dda
HBASE-26691 Replacing log4j with reload4j for branch-2.x ( #4050 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 12:08:36 -08:00
Bryan Beaudreault
1fb4ee37be
HBASE-26727 Fix CallDroppedException reporting ( #4088 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-18 17:27:59 -08:00
Rushabh Shah
409b175216
HBASE-26702 Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram. ( #4098 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-02-09 10:24:19 +08:00
Richard Marscher
0001ad6b8b
HBASE-26623 Report CallDroppedException in exception metrics ( #3980 )
...
`CallDroppedException` can be thrown with `CallRunner.drop()` by queue implementations that decide to drop calls to groom the RPC call backlog. The LifoCoDel queue does this I believe and with Pluggable queue it's possible for 3rd party queue implementations to be using `drop()` for similar reasons. It would be nice for the server to be tracking these exceptions in metrics since otherwise you might have to do some extra lifting on the client side.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Bryan Beaudreault <bbeaudreault@hubspot.com>
2021-12-30 00:05:12 +08:00
Bryan Beaudreault
aa3b07f6bb
HBASE-26154: Adds exception metrics for QuotaExceededException and RpcThrottlingException ( #3544 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-08-02 09:51:34 +05:30
Almog Tavor
1f1e6219a5
HBASE-26035 Redundant null check in the compareTo function ( #3433 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-01 22:57:50 +08:00
Rushabh Shah
e265eccf20
HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream ( #3315 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-26 10:42:03 -07:00
Rushabh Shah
90dc150b1b
HBASE-25860 Add metric for successful wal roll requests. ( #3238 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-08 13:02:52 +05:30
Baiqiang Zhao
8ff17c68e2
HBASE-25687 Backport "HBASE-25681 Add a switch for server/table query… ( #3074 )
...
Signed-off-by: stack <stack@apache.org>
2021-04-07 11:11:46 -07:00
Sandeep Pal
72496272aa
HBASE-25627: HBase replication should have a metric to represent if the source is stuck getting initialized ( #3018 )
...
Introduces a new metric that tracks number of replication sources that are stuck in initialization.
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit ff3821814a
)
2021-03-17 10:30:26 -07:00
meiyi
b5fc5e17e2
HBASE-25636 Expose HBCK report as metrics ( #3031 )
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-03-11 15:15:23 +08:00
Rahul Kumar
e57c73a137
HBASE-25460 : Expose drainingServers as cluster metric ( #2994 ) ( #2995 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-03-04 12:48:57 +05:30
shahrs87
6a4c9be967
HBASE-25539: Add age of oldest wal metric ( #2962 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-02-18 20:59:07 -08:00
Viraj Jasani
0788547fea
HBASE-25474 : Bump HBase version on branch-2 ( #2871 )
...
Signed-off-by: stack <stack@apache.org>
2021-01-12 10:20:22 +05:30
Andrew Purtell
1b6399a480
HBASE-24640 [branch-2] Purge use of VisibleForTesting ( #2696 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-11-25 14:15:32 -08:00
gkanade
024349bd5d
HBASE-25026 Create a metric to track full region scans RPCs
...
Add new metric rpcFullScanRequestCount to track number of requests that are full region scans. Can be used to notify user to check if this is truly intended.
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Ramkrishna S Vasudevan <ramkrishna@apache.org>
2020-11-19 09:55:33 +05:30
Reid Chan
70631e901f
HBASE-25189 [Metrics] Add checkAndPut and checkAndDelete latency metrics at table level ( #2549 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-10-25 17:47:58 +08:00
ramkrish86
11cbca1a5e
HBASE-25135 Convert the internal seperator while emitting the memstore read metrics to # ( #2486 ) ( #2489 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-10-01 18:18:31 +05:30
Bharath Vissapragada
505ceacb4b
HBASE-25082: Per table WAL metrics: appendCount and appendSize ( #2440 )
...
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Ankit Jain <jain.ankit@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 56c7505f8f
)
2020-09-23 21:07:44 -07:00
Viraj Jasani
4316dc738c
HBASE-24528 : BalancerDecision queue implementation in HMaster with Admin API ( #2411 )
...
* Admin API getLogEntries() for ring buffer use-cases: so far, provides balancerDecision and slowLogResponse
* Refactor RPC call for similar use-cases
* Single RPC API getLogEntries() for both Master.proto and Admin.proto
Closes #2261
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-17 18:51:42 +05:30
Javier Akira Luca de Tena
cd66d8cba5
HBASE-24994 Add hedgedReadOpsInCurThread metric ( #2367 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-11 13:49:11 +08:00
Toshihiro Suzuki
22bf9a38c9
HBASE-24680 Refactor the checkAndMutate code on the server side ( #2184 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-08-10 18:57:17 +09:00