Commit Graph

77 Commits

Author SHA1 Message Date
Andrew Purtell fc79ba338a HBASE-14205 RegionCoprocessorHost System.nanoTime() performance bottleneck 2015-09-24 11:16:47 -07:00
Enis Soztutar bb4a690b79 HBASE-14082 Add replica id to JMX metrics names (Lei Chen) 2015-09-16 17:43:32 -07:00
Elliott Clark 2029e85182 HBASE-14278 Fix NPE that is showing up since HBASE-14274 went in 2015-09-16 17:25:30 -07:00
tedyu 00bdf14f96 HBASE-14314 Metrics for block cache should take region replicas into account 2015-09-09 13:32:02 -07:00
tedyu f05770b96f HBASE-14274 Addendum sets closed to true when closing 2015-08-21 15:59:15 -07:00
Elliott Clark f4ad31c8f9 HBASE-14274 Deadlock in region metrics on shutdown: MetricsRegionSourceImpl vs MetricsRegionAggregateSourceImpl
Signed-off-by: stack <stack@apache.org>
2015-08-20 20:52:10 -07:00
Elliott Clark d6c2beb4bf HBASE-14166 Per-Region metrics can be stale 2015-08-17 11:22:21 -07:00
tedyu 6a2b618d97 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-05 19:22:44 -07:00
tedyu 24dbe25e95 HBASE-13965 Revert due to test failure in TestAssignmentManager 2015-08-03 15:32:43 -07:00
tedyu c215b900f4 HBASE-13965 Stochastic Load Balancer JMX Metrics (Lei Chen) 2015-08-03 12:50:44 -07:00
Andrew Purtell 9227c2b99d HBASE-14176 Add missing headers to META-INF files 2015-07-31 11:22:50 -07:00
Enis Soztutar 77b155858f HBASE-13661 Correct binary compatibility issues discovered in 1.1.0RC0 2015-05-11 18:33:44 -07:00
Elliott Clark 91e09bc0ab HBASE-13477 Create metrics on failed requests
Summary: Add metrics on how many requests are exceptions and what type.

Test Plan: behold unit tests.

Differential Revision: https://reviews.facebook.net/D37167
2015-04-17 15:38:38 -07:00
tedyu bb65a8664d HBASE-13369 Expose scanNext stats to region server level 2015-03-31 15:27:39 -07:00
tedyu f1601c0d12 HBASE-13213 Split out locality metrics among primary and secondary region 2015-03-31 15:00:56 -07:00
nke 797eee33ab HBASE-8725 Add total time RPC call metrics
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-26 11:12:29 -07:00
Andrew Purtell d71641ab28 HBASE-12102 Duplicate keys in HBase.RegionServer metrics JSON (Ravi Kishore Valeti) 2015-02-18 08:08:48 -08:00
Ashish Singhi f5b40200db HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSmallTests.java
2015-02-12 14:16:28 -08:00
Lars Hofhansl e491f337f1 HBASE-12779 SplitTransaction: Add metrics. 2015-01-05 17:14:20 -08:00
Sean Busbey 2372739e46 HBASE-12661 add missing licenses. 2014-12-09 09:52:55 -06:00
Elliott Clark cc1a0d7c36 HBASE-12574 Update replication metrics to not do so many map look ups. 2014-12-08 10:58:21 -08:00
Elliott Clark 091142f47a HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline 2014-12-02 09:30:29 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
Andrew Purtell eb34c956a1 HBASE-12496 A blockedRequestsCount metric (Yi Deng) 2014-11-18 14:24:18 -08:00
stack 8902fb0c1b HBASE-12455 Add 'description' to bean and attribute output when you do /jmx?description=true 2014-11-11 13:14:50 -08:00
Andrew Purtell 3eed03268f HBASE-12424 Finer grained logging and metrics for split transactions
Conflicts:
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitRequest.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
2014-11-07 11:44:49 -08:00
stack bca92603e0 HBASE-12328 Need to separate JvmMetrics for Master and RegionServer (Sanghyun Yun) 2014-10-23 21:50:09 -07:00
stack 8828e0a680 HBASE-12246 Compilation with hadoop-2.3.x and 2.2.x is broken -> HBASE-12220 Add hedgedReads and hedgedReadWins metrics -- REVERT 2014-10-13 15:04:34 -07:00
stack 608bb9e308 HBASE-12189 Fix new issues found by coverity static analysis
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaState.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/UserQuotaState.java
2014-10-09 20:51:52 -07:00
stack 71ed703367 Add hedgedReads and hedgedReadWins count metrics
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2014-10-09 15:02:50 -07:00
Elliott Clark 91642eed82 HBASE-12076 Move InterfaceAudience imports to hbase-annotations 2014-09-24 04:01:58 -07:00
Elliott Clark c32af7df5f HBASE-12059 Create hbase-annotations module 2014-09-23 16:43:45 -07:00
stack 77085d0ff1 HBASE-11816 Initializing custom Metrics implementation failed in Mapper or Reducer 2014-08-25 12:27:50 -07:00
Andrew Purtell 4bd2da4783 HBASE-11702 Better introspection of long running compactions 2014-08-14 09:02:41 -07:00
Andrew Purtell a1e6fc41cf HBASE-11516 Track time spent in executing coprocessors in each region (Srikanth Srungarapu and Andrew Purtell) 2014-08-01 09:37:57 -07:00
stack 8d62d85864 HBASE-11463 (findbugs) HE: Class defines equals() and uses Object.hashCode() (Mike Drob) 2014-07-03 21:55:45 -07:00
Ted Yu afbe165676 HBASE-11267 Dynamic metrics2 metrics may consume large amount of heap memory 2014-05-30 14:00:32 +00:00
liangxie e1d16e9892 Amend HBASE-10561 Forward port: HBASE-10212 New rpc metric: number of active handler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1594126 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 05:06:14 +00:00
Jean-Daniel Cryans 205654d818 HBASE-10755 MetricsRegionSourceImpl creates metrics that start with a lower case
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1578647 13f79535-47bb-0310-9956-ffa450edef68
2014-03-17 22:37:25 +00:00
Jonathan Hsieh fb349b084e HBASE-10436 restore regionserver lists removed from hbase 0.96.0 jmx
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1571887 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 01:02:00 +00:00
mbertozzi e541b46b63 HBASE-10586 hadoop2-compat IPC metric registred twice
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1570737 13f79535-47bb-0310-9956-ffa450edef68
2014-02-21 22:47:41 +00:00
Michael Stack 013c6a6285 HBASE-10407 String Format Exception (Siwakorn Srisakaokul)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1562364 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 06:06:16 +00:00
ndimiduk a8ec7232cc HBASE-9343 Implement stateless scanner for Stargate (Vandana Ayyalasomayajula)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1558994 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 02:31:00 +00:00
eclark 1e0185468c HBASE-10124 Make Sub Classes Static When Possible
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1550294 13f79535-47bb-0310-9956-ffa450edef68
2013-12-11 22:20:00 +00:00
Michael Stack 3f58873f08 HBASE-10048 Add hlog number metric in regionserver
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548768 13f79535-47bb-0310-9956-ffa450edef68
2013-12-07 00:32:59 +00:00
Michael Stack 74f6e25c8f HBASE-5945 Reduce buffer copies in IPC server response path
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1543458 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 15:39:35 +00:00
eclark 22b77dc791 HBASE-9653 Add compaction metrics to trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1526314 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 21:44:33 +00:00
eclark e0768e0814 HBASE-9650 Per region metrics are not showing up for system tables.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1526309 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 21:41:05 +00:00
Jonathan Hsieh d2ddf0986a HBASE-9579 Sanity check visiblity and audience for server-side modules
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1525055 13f79535-47bb-0310-9956-ffa450edef68
2013-09-20 17:09:39 +00:00
eclark 01bdee029a HBASE-9194 Break HMaster metrics into multiple contexts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1514513 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 22:04:24 +00:00