4846300c8b
HBASE-19285 Implements table-level latency histograms
...
For a egionserver's view of a table (the regions
that belong to a table hosted on a regionserver),
this change tracks the latencies of operations that
affect the regions for this table.
Tracking at the per-table level avoids the memory bloat
and performance impact that accompanied the previous
per-region latency metrics while still providing important
details for operators to consume.
Signed-Off-By: Andrew Purtell <apurtell@apache.org>
2017-11-30 17:45:23 -05:00
6961526573
HBASE-12350 Backport error-prone build support to branch-1 and branch-2
2017-11-09 15:34:09 -08:00
11a4eb9af9
HBASE-18690 Replace o.a.h.c.InterfaceAudience by o.a.h.h.c.InterfaceAudience
2017-10-23 10:38:06 +08:00
739ca50e9c
HBASE-18980 Suppress SelfComparison error in tests
2017-10-10 11:58:49 -05:00
eeaa9aee66
HBASE-18652 Expose individual cache stats in a CombinedCache through JMX (Biju Nair)
2017-09-25 20:51:11 -07:00
b6a12c843e
HBASE-18652 Expose individual cache stats in a CombinedCache through JMX - revert due to test failure
2017-09-08 14:21:30 -07:00
5bfe1da984
HBASE-18652 Expose individual cache stats in a CombinedCache through JMX
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-09-06 13:30:44 -07:00
31ba3cb6fc
HBASE-18568 Correct metric of numRegions
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-28 19:41:19 -07:00
6d378d912a
HBASE-18671 Support Append/Increment in rest api
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-26 06:44:09 -07:00
679a4eb8a6
HBASE-18644 Duplicate compactionQueueLength metric in Region Server metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-08-21 17:43:08 -07:00
a03c2036e9
HBASE-18469 Correct RegionServer metric of totalRequestCount
2017-08-11 14:53:23 +08:00
cad3d55892
HBASE-18520 Add jmx value to determine true Master Start time
...
This is to determine how long it took in total for the master to start and finish initializing.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-05 22:34:26 -07:00
abb9d88dce
HBASE-18374 RegionServer Metrics improvements
2017-07-31 12:47:11 +05:30
9278037108
HBASE-15134 Add visibility into Flush and Compaction queues
2017-07-28 13:21:04 +05:30
3dd55fa0c0
Set versions on branch-1 to 1.5.0-SNAPSHOT
2017-07-03 18:01:15 -07:00
ea3075e7fd
HBASE-15160 Put back HFile's HDFS op latency sampling code and add metrics for monitoring (Yu Li and Enis Soztutar)
2017-06-06 14:41:02 -07:00
a3c3f1012d
HBASE-18060 Backport to branch-1 HBASE-9774 HBase native metrics and metric collection for coprocessors
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-24 13:20:44 -07:00
defc25c6d1
HBASE-17448 Export metrics from RecoverableZooKeeper
...
Added metrics for RecoverableZooKeeper related to specific exceptions,
total failed ZooKeeper API calls and latency histograms for read,
write and sync operations. Also added unit tests for the same. Added
service provider for the ZooKeeper metrics implementation inside the
hadoop compatibility module.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/RecoverableZooKeeper.java
hbase-metrics-api/src/main/java/org/apache/hadoop/hbase/metrics/PackageMarker.java
2017-04-26 18:14:53 -07:00
2eb810d0f7
HBASE-17627 Active workers metric for thrift (Ashu Pachauri)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-15 15:46:29 -08:00
b123313f11
HBASE-17578 Thrift metrics should handle exceptions
2017-02-06 12:20:19 -08:00
682dd57cd6
HBASE-17205 Add a metric for the duration of region in transition
2016-12-01 10:32:24 -08:00
b8da9f83cb
HBASE-16302 age of last shipped op and age of last applied op should be histograms
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-11-29 13:54:28 +05:30
7b2673db12
HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-29 16:09:56 +08:00
be042652aa
Revert "HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count"
...
Forget to add signoff
This reverts commit 5ec218dbc2
2016-11-29 16:09:22 +08:00
5ec218dbc2
HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
2016-11-29 16:00:37 +08:00
123d26ed90
HBASE-17017 Remove the current per-region latency histogram metrics
2016-11-08 18:31:12 -08:00
59ca4dad70
HBASE-16661 Add last major compaction age to per-region metrics
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2016-10-10 15:21:53 -07:00
df25ebf84f
HBASE-15984 Handle premature EOF treatment of WALs in replication.
...
In some particular deployments, the Replication code believes it has
reached EOF for a WAL prior to succesfully parsing all bytes known to
exist in a cleanly closed file.
Consistently this failure happens due to an InvalidProtobufException
after some number of seeks during our attempts to tail the in-progress
RegionServer WAL. As a work-around, this patch treats cleanly closed
files differently than other execution paths. If an EOF is detected due
to parsing or other errors while there are still unparsed bytes before
the end-of-file trailer, we now reset the WAL to the very beginning and
attempt a clean read-through.
In current testing, a single such reset is sufficient to work around
observed dataloss. However, the above change will retry a given WAL file
indefinitely. On each such attempt, a log message like the below will
be emitted at the WARN level:
Processing end of WAL file '{}'. At position {}, which is too far away
from reported file length {}. Restarting WAL reading (see HBASE-15983
for details).
Additionally, this patch adds some additional log detail at the TRACE
level about file offsets seen while handling recoverable errors. It also
add metrics that measure the use of this recovery mechanism.
2016-09-29 10:47:57 -05:00
8a797e81b8
HBASE-16604 Scanner retries on IOException can cause the scans to miss data
2016-09-22 18:48:06 -07:00
6e9b49cac7
HBASE-16448 Custom metrics for custom replication endpoints
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-08-23 17:17:42 -07:00
16be7bba53
HBASE-16211 JMXCacheBuster restarting the metrics system might cause tests to hang
2016-07-12 13:43:58 -07:00
83c0cc109e
HBASE-15353 Add metric for number of CallQueueTooBigException's
2016-06-24 14:39:53 +08:00
198165ef5b
HBASE-16085 Add a metric for failed compactions
2016-06-23 16:04:27 -07:00
878b1ea721
HBASE-15889. String case conversions are locale-sensitive, used without locale
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
d07d316113
HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB
2016-05-09 10:25:57 -07:00
8f1deac1f8
HBASE-15742 Reduce allocation of objects in metrics (Phil Yang)
2016-05-03 09:13:38 -07:00
550d253ead
HBASE-15671 Add per-table metrics on memstore, storefile and regionsize (Alicia Ying Shu)
2016-04-21 13:33:31 -07:00
e9acc104b7
HBASE-15663 Hook up JvmPauseMonitor to ThriftServer
2016-04-20 17:36:59 -07:00
db83e631ad
HBASE-15662 Hook up JvmPauseMonitor to REST server
2016-04-20 17:36:59 -07:00
780cff5886
HBASE-15614 Report metrics from JvmPauseMonitor
2016-04-20 17:36:59 -07:00
1311e25171
HBASE-15518 Add Per-Table metrics back (Alicia Ying Shu)
2016-04-20 14:35:52 -07:00
b7502feff3
HBASE-15093 Replication can report incorrect size of log queue for the global source when multiwal is enabled (Ashu Pachauri)
2016-04-11 08:23:34 -07:00
75d46e4697
HBASE-14983 Create metrics for per block type hit/miss ratios
...
Summary: Missing a root index block is worse than missing a data block. We should know the difference
Test Plan: Tested on a local instance. All numbers looked reasonable.
Differential Revision: https://reviews.facebook.net/D55563
2016-03-30 11:53:46 -07:00
d07230a759
HBASE-15412 Add average region size metric (Alicia Ying Shu)
...
Conflicts:
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
2016-03-22 14:50:14 -07:00
249e37f83c
HBASE-15464 Flush / Compaction metrics revisited
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/test/java/org/apache/hadoop/hbase/MockRegionServerServices.java
hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2016-03-21 17:56:22 -07:00
934c0274e3
HBASE-15377 Per-RS Get metric is time based, per-region metric is size-based (Heng Chen)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2016-03-15 13:35:13 -07:00
95421d276e
HBASE-15435 Add WAL (in bytes) written metric (Alicia Ying Shu)
...
Conflicts:
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSource.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/wal/MetricsWALSourceImpl.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestMetricsWAL.java
2016-03-10 20:21:53 -08:00
bbb10c4c18
HBASE-15376 ScanNext metric is size-based while every other per-operation metric is time based
...
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
2016-03-07 17:48:37 +08:00
998e339d6e
HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT
2016-02-28 16:23:29 -08:00
7c290e922a
HBASE-15222 Addendum - Use less contended classes for metrics
2016-02-25 09:34:47 -08:00
Josh Elser
Andrew Purtell
Chia-Ping Tsai
Mike Drob
Michael Stack
tedyu
Biju Nair
张世彬10204932
Guangxu Cheng
Sukumar Maddineni
Yu Li
Zach York
Abhishek Singh Chouhan
Enis Soztutar
Vincent
ckulkarni
Ashu Pachauri
Gary Helmling
Guanghao Zhang
zhangduo
Dustin Pho
Sean Busbey
Geoffrey
Jingcheng Du
Sean Mackrory
Elliott Clark
chenheng
Mikhail Antonov