Commit Graph

169 Commits

Author SHA1 Message Date
zhangduo 5ff108d0e1 HBASE-12405 WAL accounting by Store
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ResponseConverter.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-03-10 13:13:40 +08:00
Jonathan Lawlor 0c64a57e52 HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 18:04:15 -08:00
stack 6b1674b31c HBASE-13017 Backport HBASE-12035 Keep table state in Meta to 1.0 branch; REVERT 2015-03-03 13:26:15 -08:00
Enis Soztutar 9e7ad99593 HBASE-11580 Failover handling for secondary region replicas
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
2015-03-03 13:21:01 -08:00
stack f5e2a82328 HBASE-13017 Backport HBASE-12035 Keep table state in Meta to 1.0 branch (Andrey Stepachev) 2015-02-18 09:58:32 -08:00
Enis Soztutar 36e76c4be6 HBASE-11569 Flush / Compaction handling from secondary region replicas
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2015-02-13 12:49:08 -08:00
Ashish Singhi f5b40200db HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSmallTests.java
2015-02-12 14:16:28 -08:00
Jeffrey Zhong b0b0a74fef HBASE-11567 Write bulk load COMMIT events to WAL 2015-02-06 18:46:00 -08:00
Lars Hofhansl 0b3502f2b1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:57:24 -08:00
Andrew Purtell 7e1f030f2a HBASE-12731 Heap occupancy based client pushback
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2015-01-22 17:47:59 -08:00
Andrew Purtell 04a003d6a2 HBASE-12730 Backport HBASE-5162 (Basic client pushback mechanism) to branch-1 2015-01-22 14:50:40 -08:00
tedyu b79dbedad6 HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:04:49 -08:00
Nick Dimiduk 240ef12358 HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:11:32 -08:00
Enis Soztutar d66ae28c07 Update pom.xml version for 1.1.0-SNAPSHOT for branch-1 2014-12-17 23:16:41 -08:00
stack f0afcd2cc2 HBASE-12689 Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT 2014-12-14 20:37:59 -08:00
stack e3e9c96f89 HBASE-12373 Provide a command to list visibility labels (Jerry He)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDefaultVisLabelService.java
2014-12-11 15:20:40 -08:00
Matteo Bertozzi f763b5d2c4 HBASE-12663 unify getTableDescriptors() and listTableDescriptors 2014-12-10 15:30:35 +00:00
Matteo Bertozzi 09617cc2aa HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:39 +00:00
Enis Soztutar 5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
Andrew Purtell 9904252615 HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) 2014-11-22 12:13:09 -08:00
Enis Soztutar aa343ebcfe HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 14:09:28 -08:00
stack f3a38dcf16 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MasterAddressTracker.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
2014-11-12 09:09:11 -08:00
stack c99d89fd63 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT --REVERT 2014-11-05 19:15:24 -08:00
stack 625a1ea065 HBASE-8707 Add LongComparator for filter (Liu Shaohui) 2014-11-05 16:57:21 -08:00
stack c66a6b02a5 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT 2014-11-04 12:41:38 -08:00
Andrew Purtell 4649646fc8 HBASE-12361 Show data locality of region in table page (Liu Shaohui)
Conflicts:
	hbase-server/src/main/resources/hbase-webapps/master/table.jsp
2014-10-31 15:43:01 -07:00
manukranthk c9f506a297 Add admin endpoint for updating the configuration on the regionserver
Summary: This is a follow up diff for the jira to add the functionality to update configs in an online fashion.

Test Plan: Unit test. This adds an end point on the regionserver. It just tries to call the end point and make sure the call succeeds.

Differential Revision: https://reviews.facebook.net/D24861

Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerOnlineConfigChange.java
2014-10-18 16:25:03 -04:00
Enis Soztutar 10ebc49130 Update pom.xml version to 0.99.2-SNAPSHOT 2014-10-17 11:32:59 -07:00
Enis Soztutar 7d0be32b1d Update pom.xml version for 0.99.1 2014-10-11 21:56:30 -07:00
Andrew Purtell 6a37c169fc HBASE-12126 Region server coprocessor endpoint (Virag Kothari) 2014-10-10 12:07:07 -07:00
Andrew Purtell 5881eed36e HBASE-11907 Use the joni byte[] regex engine in place of j.u.regex 2014-10-02 23:06:33 -07:00
Andrew Purtell dab2af79ea HBASE-11796 Add client support for atomic checkAndMutate (Srikanth Srungarapu) 2014-09-24 15:20:53 -07:00
Elliott Clark c32af7df5f HBASE-12059 Create hbase-annotations module 2014-09-23 16:43:45 -07:00
Enis Soztutar 63c24ac73f Update pom.xml version to 0.99.1-SNAPSHOT 2014-09-22 20:14:52 -07:00
Enis Soztutar 6337705f26 Update pom.xml version for 0.99.0 2014-09-09 18:56:44 -07:00
Enis Soztutar cbc1bc7d49 HBASE-11512 Write region open/close events to WAL 2014-08-19 18:46:24 -07:00
Ted Yu 12478cded7 HBASE-11762 Record the class name of Codec in WAL header 2014-08-19 00:52:16 +00:00
Ted Yu e142961099 HBASE-11620 Record the class name of Writer in WAL header so that only proper Reader can open the WAL file (Ted Yu) 2014-08-01 17:15:32 +00:00
Nick Dimiduk 2af67c2986 HBASE-11558 Caching set on Scan object gets lost when using TableMapReduceUtil in 0.95+ (Ishan Chhabra) 2014-07-30 13:30:51 -07:00
Enis Soztutar 4fa0e3274f HBASE-11511 Write flush events to WAL 2014-07-15 14:48:30 -07:00
Enis Soztutar c76b528b6d HBASE-11367 Pluggable replication endpoint 2014-07-14 16:24:28 -07:00
Nick Dimiduk c362857901 HBASE-11118 non environment variable solution for "IllegalAccessError: class com.google.protobuf.ZeroCopyLiteralByteString cannot access its superclass com.google.protobuf.LiteralByteString" 2014-07-11 16:38:17 -07:00
Enis Soztutar ec7540229f HBASE-11475 Distributed log replay should also replay compaction events 2014-07-10 10:51:16 -07:00
Jeffrey Zhong cc4f54770b HBase-11315: Keeping MVCC for configurable longer time 2014-07-06 18:51:48 -07:00
Enis Soztutar 5a8f3f7cef HBASE-10357 Failover RPC's for scans (Devaraj Das)
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1595388 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:40 -07:00
Enis Soztutar d8ea476bf1 HBASE-10354 Add an API for defining consistency per request
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1565062 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:36 -07:00
Enis Soztutar d4b82224cc HBASE-10347 HRegionInfo changes for adding replicaId and MetaEditor/MetaReader changes for region replicas
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1565041 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:36 -07:00
Jimmy Xiang 175f133dbc HBASE-11373 hbase-protocol compile failed for name conflict of RegionTransition 2014-06-18 09:10:59 -07:00
Jimmy Xiang 58549428a6 HBASE-11059 ZK-less region assignment 2014-06-14 08:39:29 -07:00