Commit Graph

204 Commits

Author SHA1 Message Date
stack b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
Sean Busbey f5e05eb836 HBASE-10378 Refactor write-ahead-log implementation
Incompatible changes called out in release notes on jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu.

Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
Andrew Purtell 1ba615657b HBASE-12382 Restore incremental compilation 2014-11-11 17:45:37 -08:00
Andrew Purtell 7718390703 HBASE-12424 Finer grained logging and metrics for split transactions 2014-11-07 11:32:01 -08:00
Jonathan M Hsieh e5a1b86dba HBASE-11683 Metrics for MOB (Jingcheng Du) 2014-10-30 06:50:13 -07:00
Andrew Purtell 70a312e53f HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-27 09:29:23 -07:00
Andrew Purtell ff5bc351b2 Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
This reverts commit 7ed0260eff.
2014-10-25 08:33:43 -07:00
Andrew Purtell 7ed0260eff HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-24 18:15:12 -07:00
stack 31c185aad5 HBASE-12328 Need to separate JvmMetrics for Master and RegionServer (Sanghyun Yun) 2014-10-23 21:49:47 -07:00
stack d5be58dfd2 Add hedgedReads and hedgedReadWins count metrics 2014-10-09 15:00:25 -07:00
Andrew Purtell 6367074381 HBASE-11702 Better introspection of long running compactions 2014-08-14 09:12:52 -07:00
Andrew Purtell 19e9b8aa52 HBASE-11516 Track time spent in executing coprocessors in each region (Srikanth Srungarapu and Andrew Purtell) 2014-08-01 09:37:56 -07:00
Enis Soztutar 92c52a727a Updated version in master to 2.0.0-SNAPSHOT after 'branch-1' is created for 1.x line of releases 2014-06-30 20:26:47 -07:00
Michael Stack 46e53b089a HBASE-11229 Change block cache percentage metrics to be doubles rather than ints
In HBASE-8370 "Report data block cache hit rates apart from aggregate cache hit rates"
discussion highlights small changes in caching percentage can make for large
changes in cache contents; e.g. lots of data blocks may be getting evicited
but because meta blocks -- index and blooms -- are staying in cache with
high hit rates, a large data block eviction may show as a small change in
overall cache percentage (e.g. from 99.99 to 99.11).

Changes the getBlockCacheHitPercent from an int to a double.
Also changes name of the jmx metric blockCountHitPercent to be
blockCacheCountHitPercent instead.

May be incompatible change.
2014-05-22 11:37:50 -07:00
liangxie e1d16e9892 Amend HBASE-10561 Forward port: HBASE-10212 New rpc metric: number of active handler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1594126 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 05:06:14 +00:00
liangxie 5be2766ef4 HBASE-10561 Forward port: HBASE-10212 New rpc metric: number of active handler
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1594117 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 03:05:45 +00:00
Jonathan Hsieh fb349b084e HBASE-10436 restore regionserver lists removed from hbase 0.96.0 jmx
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1571887 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 01:02:00 +00:00
ndimiduk a8ec7232cc HBASE-9343 Implement stateless scanner for Stargate (Vandana Ayyalasomayajula)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1558994 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 02:31:00 +00:00
Michael Stack 3f58873f08 HBASE-10048 Add hlog number metric in regionserver
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1548768 13f79535-47bb-0310-9956-ffa450edef68
2013-12-07 00:32:59 +00:00
Andrew Kyle Purtell f8139d1bf5 Update version in POMs to 0.99.0-SNAPSHOT after branching for release 0.98.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1547743 13f79535-47bb-0310-9956-ffa450edef68
2013-12-04 09:31:02 +00:00
Michael Stack 74f6e25c8f HBASE-5945 Reduce buffer copies in IPC server response path
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1543458 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 15:39:35 +00:00
ndimiduk 76b5c4f3cc HBASE-9771 [WebUI] Humanize store and blockcache statistics on RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1532598 13f79535-47bb-0310-9956-ffa450edef68
2013-10-15 23:44:45 +00:00
eclark 22b77dc791 HBASE-9653 Add compaction metrics to trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1526314 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 21:44:33 +00:00
eclark e0768e0814 HBASE-9650 Per region metrics are not showing up for system tables.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1526309 13f79535-47bb-0310-9956-ffa450edef68
2013-09-25 21:41:05 +00:00
Jonathan Hsieh d2ddf0986a HBASE-9579 Sanity check visiblity and audience for server-side modules
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1525055 13f79535-47bb-0310-9956-ffa450edef68
2013-09-20 17:09:39 +00:00
Michael Stack df49eca1eb HBASE-9413 WebUI says ".META." table but table got renames to "hbase:meta". Meed to update the UI
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1520463 13f79535-47bb-0310-9956-ffa450edef68
2013-09-06 00:29:48 +00:00
eclark 01bdee029a HBASE-9194 Break HMaster metrics into multiple contexts
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1514513 13f79535-47bb-0310-9956-ffa450edef68
2013-08-15 22:04:24 +00:00
Michael Stack e11ff8a5fd HBASE-8918 Removes redundant identifiers from interfaces
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1502128 13f79535-47bb-0310-9956-ffa450edef68
2013-07-11 07:01:27 +00:00
Michael Stack e79eefe78b HBASE-8918 Removes redundant identifiers from interfaces; REVERT -- PREMATURE APPLICATION
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1501909 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 18:50:21 +00:00
Michael Stack e194ee4d98 HBASE-8918 Removes redundant identifiers from interfaces
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1501880 13f79535-47bb-0310-9956-ffa450edef68
2013-07-10 17:53:33 +00:00
Michael Stack e07dedcdec HBASE-8689 Cover all mutations rather than only Put while reporting for mutations not writing to WAL
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1493307 13f79535-47bb-0310-9956-ffa450edef68
2013-06-15 04:23:24 +00:00
Michael Stack 998296008a HBASE-8564 TestMetricsRegionServer depends on test order; ADDENDUM
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1484052 13f79535-47bb-0310-9956-ffa450edef68
2013-05-18 03:23:13 +00:00
eclark b3c97c3e3e HBASE-8564 TestMetricsRegionServer depends on test order
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1483617 13f79535-47bb-0310-9956-ffa450edef68
2013-05-17 00:28:50 +00:00
Michael Stack cb53db35f3 HBASE-7006 [MTTR] Improve Region Server Recovery Time - Distributed Log Replay
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1482675 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 04:24:02 +00:00
eclark b33878f6fc HBASE-8426 Opening a region failed on Metrics source RegionServer,sub=Regions already exists
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1477247 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 18:17:37 +00:00
eclark 47cfaa205c HBASE-8431 Fix missing license headers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1471823 13f79535-47bb-0310-9956-ffa450edef68
2013-04-25 03:20:51 +00:00
eclark 1c81734163 HBASE-7255 KV size metric went missing from StoreScanner.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1467485 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 21:47:19 +00:00
mbertozzi 8465f20316 HBASE-7615 Add metrics for snapshots
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1464441 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 11:10:56 +00:00
Michael Stack 00f7bb46c5 HBASE-8187 trunk/0.95 tarball packaging
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1462606 13f79535-47bb-0310-9956-ffa450edef68
2013-03-29 18:49:42 +00:00
nkeywal 62d1ad5fde HBASE-7968 Packaging of Trunk and 0.95 does not create the dependent jars in the lib folder
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1452261 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 11:30:49 +00:00
Michael Stack 05711f7553 HBASE-7940 Upgrade version to 0.97-SNAPSHOT in pom.xml files
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1450337 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 18:26:28 +00:00
Michael Stack 778ab055a0 HBASE-7356 Fix all javadoc warnings in all modules but hbase-server
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1422134 13f79535-47bb-0310-9956-ffa450edef68
2012-12-14 22:37:55 +00:00
eclark a23ecdae14 HBASE-7262 Move HBaseRPC metrics to metrics2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1419962 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 01:12:46 +00:00
eclark abd334265e HBASE-7265 Make Maven skip module test properties consistent
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1416723 13f79535-47bb-0310-9956-ffa450edef68
2012-12-03 23:17:29 +00:00
eclark 7fdc889169 HBASE-7062 Move HLog stats to metrics 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1411337 13f79535-47bb-0310-9956-ffa450edef68
2012-11-19 18:04:53 +00:00
eclark 3900978ffe HBASE-6410 Move RegionServer Metrics to metrics2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1406396 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 23:22:01 +00:00
Michael Stack 8c393a32a8 HBASE-6848 Make hbase-hadoop-compat findbugs clean
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1388252 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 22:51:30 +00:00
Michael Stack 1afea63673 HBASE-6501 Integrate with unit-testing tools of hadoop's metrics2 framework
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1387820 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 23:44:59 +00:00
Michael Stack 053fc8e7ba HBASE-6409 Create histogram class for metrics 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1387358 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 20:54:06 +00:00
Michael Stack 2627730b7d HBASE-6412 Move external servers to metrics2 (thrift,thrift2,rest)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1387323 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 19:10:03 +00:00
Michael Stack 773650bb0c HBASE-6706 Remove TotalOrderPartitioner
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1381881 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 05:28:31 +00:00
Michael Stack 93e03d7d09 HBASE-4050 Combine Master Metrics into a single class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1377896 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 22:39:23 +00:00
Zhihong Yu efe471f74b HBASE-6411 Move Master Metrics to metrics 2 (Alex Baranau)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1368598 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 16:58:35 +00:00
Zhihong Yu c863b51baa HBASE-6405 Create Hadoop compatibilty modules and Metrics2 implementation of replication metrics (Elliot Clark)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1362681 13f79535-47bb-0310-9956-ffa450edef68
2012-07-17 22:02:06 +00:00